Skip to main content

DSP-Net: Deeply-Supervised Pseudo-Siamese Network for Dynamic Angiographic Image Matching

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2022 (MICCAI 2022)

Abstract

During percutaneous coronary intervention (PCI), severe elastic deformation of coronary arteries caused by cardiac movement is a serious disturbance to physicians. It increases the difficulty of estimating the relative position between interventional instruments and vessels, leading to inaccurate operation and higher intraoperative mortality. Providing doctors with dynamic angiographic images can be helpful. However, it often faces the challenges of indistinguishable features between consecutive frames and multiple modalities caused by individual differences. In this paper a novel deeply-supervised pseudo-siamese network (DSP-Net) is developed to solve the problem. A pseudo siamese attention dense (PSAD) block is designed to extract salient features from X-ray images with noisy background, and the deep supervision architecture is integrated to accelerate convergence. Evaluations are conducted on the CVM X-ray Database built by us, which consists of 51 sequences, showing that the proposed network can not only achieve state-of-the-art matching performance of 3.48 Hausdorff distance and 84.09% guidewire recall rate, but also demonstrate the great generality to images with different heart structures or fluoroscopic angles. Exhaustive experiment results indicate that our DSP-Net has the potential to assist doctors to overcome the visual misjudgment caused by the elastic deformation of the arteries and achieve safer procedure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cardiovascular diseases (cvds) (2021). https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)

  2. Briguori, C., Tavano, D., Colombo, A.: Contrast agent-associated nephrotoxicity. Prog. Cardiovasc. Dis. 45(6), 493–503 (2003)

    Article  Google Scholar 

  3. Chang, Y., Jung, C., Sun, J., Wang, F.: Siamese dense network for reflection removal with flash and no-flash image pairs. Int. J. Comput. Vision 128(6), 1673–1698 (2020). https://doi.org/10.1007/s11263-019-01276-z

    Article  Google Scholar 

  4. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2017)

    Article  Google Scholar 

  5. Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)

    Google Scholar 

  6. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., Sun, J.: REPVGG: making VGG-style convnets great again. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 13733–13742 (2021)

    Google Scholar 

  7. En, S., Lechervy, A., Jurie, F.: TS-NET: combining modality specific and common features for multimodal patch matching. In: Proceedings of the IEEE International Conference on Image Processing, pp. 3024–3028. IEEE (2018)

    Google Scholar 

  8. Grech, E.D.: Percutaneous coronary intervention. II: the procedure. BMJ 326(7399), 1137–1140 (2003)

    Article  Google Scholar 

  9. Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1735–1742. IEEE (2006)

    Google Scholar 

  10. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  11. Howard, A., et al.: Searching for mobilenetv3. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1314–1324 (2019)

    Google Scholar 

  12. Langer, N.B., Argenziano, M.: Minimally invasive cardiovascular surgery: incisions and approaches. Methodist Debakey Cardiovasc. J. 12(1), 4 (2016)

    Article  Google Scholar 

  13. Li, W., Liu, K., Zhang, L., Cheng, F.: Object detection based on an adaptive attention mechanism. Sci. Rep. 10(1), 1–13 (2020)

    Google Scholar 

  14. Lv, J., Yang, M., Zhang, J., Wang, X.: Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. Br. J. Radiol. 91, 20170788 (2018)

    Article  Google Scholar 

  15. Schulz, C.J., Böckler, D., Krisam, J., Geisbüsch, P.: Two-dimensional-three-dimensional registration for fusion imaging is noninferior to three-dimensional-three-dimensional registration in infrarenal endovascular aneurysm repair. J. Vasc. Surg. 70(6), 2005–2013 (2019)

    Article  Google Scholar 

  16. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  17. Tepel, M., Van Der Giet, M., Schwarzfeld, C., Laufer, U., Liermann, D., Zidek, W.: Prevention of radiographic-contrast-agent-induced reductions in renal function by acetylcysteine. N. Engl. J. Med. 343(3), 180–184 (2000)

    Article  Google Scholar 

  18. Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018)

    Google Scholar 

  19. Xu, D., Dong, W., Zhou, H.: Sclera recognition based on efficient sclera segmentation and significant vessel matching. Comput. J. 65, 371–381 (2020)

    Article  Google Scholar 

  20. Zhou, Y.J., Xie, X.L., Zhou, X.H., Liu, S.Q., Bian, G.B., Hou, Z.G.: A real-time multi-functional framework for guidewire morphological and positional analysis in interventional x-ray fluoroscopy. IEEE Trans. Cogn. Dev. Syst. 13, 657–667 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 62073325, and Grant U1913210; in part by the National Key Research and Development Program of China under Grant 2019YFB1311700; in part by the Youth Innovation Promotion Association of CAS under Grant 2020140; in part by the National Natural Science Foundation of China under Grant 62003343; in part by the Beijing Natural Science Foundation under Grant M22008.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zeng-Guang Hou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ma, XY. et al. (2022). DSP-Net: Deeply-Supervised Pseudo-Siamese Network for Dynamic Angiographic Image Matching. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13437. Springer, Cham. https://doi.org/10.1007/978-3-031-16449-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-16449-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-16448-4

  • Online ISBN: 978-3-031-16449-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics