Abstract
During percutaneous coronary intervention (PCI), severe elastic deformation of coronary arteries caused by cardiac movement is a serious disturbance to physicians. It increases the difficulty of estimating the relative position between interventional instruments and vessels, leading to inaccurate operation and higher intraoperative mortality. Providing doctors with dynamic angiographic images can be helpful. However, it often faces the challenges of indistinguishable features between consecutive frames and multiple modalities caused by individual differences. In this paper a novel deeply-supervised pseudo-siamese network (DSP-Net) is developed to solve the problem. A pseudo siamese attention dense (PSAD) block is designed to extract salient features from X-ray images with noisy background, and the deep supervision architecture is integrated to accelerate convergence. Evaluations are conducted on the CVM X-ray Database built by us, which consists of 51 sequences, showing that the proposed network can not only achieve state-of-the-art matching performance of 3.48 Hausdorff distance and 84.09% guidewire recall rate, but also demonstrate the great generality to images with different heart structures or fluoroscopic angles. Exhaustive experiment results indicate that our DSP-Net has the potential to assist doctors to overcome the visual misjudgment caused by the elastic deformation of the arteries and achieve safer procedure.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cardiovascular diseases (cvds) (2021). https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)
Briguori, C., Tavano, D., Colombo, A.: Contrast agent-associated nephrotoxicity. Prog. Cardiovasc. Dis. 45(6), 493–503 (2003)
Chang, Y., Jung, C., Sun, J., Wang, F.: Siamese dense network for reflection removal with flash and no-flash image pairs. Int. J. Comput. Vision 128(6), 1673–1698 (2020). https://doi.org/10.1007/s11263-019-01276-z
Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2017)
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., Sun, J.: REPVGG: making VGG-style convnets great again. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 13733–13742 (2021)
En, S., Lechervy, A., Jurie, F.: TS-NET: combining modality specific and common features for multimodal patch matching. In: Proceedings of the IEEE International Conference on Image Processing, pp. 3024–3028. IEEE (2018)
Grech, E.D.: Percutaneous coronary intervention. II: the procedure. BMJ 326(7399), 1137–1140 (2003)
Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1735–1742. IEEE (2006)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Howard, A., et al.: Searching for mobilenetv3. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1314–1324 (2019)
Langer, N.B., Argenziano, M.: Minimally invasive cardiovascular surgery: incisions and approaches. Methodist Debakey Cardiovasc. J. 12(1), 4 (2016)
Li, W., Liu, K., Zhang, L., Cheng, F.: Object detection based on an adaptive attention mechanism. Sci. Rep. 10(1), 1–13 (2020)
Lv, J., Yang, M., Zhang, J., Wang, X.: Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. Br. J. Radiol. 91, 20170788 (2018)
Schulz, C.J., Böckler, D., Krisam, J., Geisbüsch, P.: Two-dimensional-three-dimensional registration for fusion imaging is noninferior to three-dimensional-three-dimensional registration in infrarenal endovascular aneurysm repair. J. Vasc. Surg. 70(6), 2005–2013 (2019)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Tepel, M., Van Der Giet, M., Schwarzfeld, C., Laufer, U., Liermann, D., Zidek, W.: Prevention of radiographic-contrast-agent-induced reductions in renal function by acetylcysteine. N. Engl. J. Med. 343(3), 180–184 (2000)
Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018)
Xu, D., Dong, W., Zhou, H.: Sclera recognition based on efficient sclera segmentation and significant vessel matching. Comput. J. 65, 371–381 (2020)
Zhou, Y.J., Xie, X.L., Zhou, X.H., Liu, S.Q., Bian, G.B., Hou, Z.G.: A real-time multi-functional framework for guidewire morphological and positional analysis in interventional x-ray fluoroscopy. IEEE Trans. Cogn. Dev. Syst. 13, 657–667 (2020)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 62073325, and Grant U1913210; in part by the National Key Research and Development Program of China under Grant 2019YFB1311700; in part by the Youth Innovation Promotion Association of CAS under Grant 2020140; in part by the National Natural Science Foundation of China under Grant 62003343; in part by the Beijing Natural Science Foundation under Grant M22008.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ma, XY. et al. (2022). DSP-Net: Deeply-Supervised Pseudo-Siamese Network for Dynamic Angiographic Image Matching. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13437. Springer, Cham. https://doi.org/10.1007/978-3-031-16449-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-16449-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16448-4
Online ISBN: 978-3-031-16449-1
eBook Packages: Computer ScienceComputer Science (R0)