Advertisement

Fully Automatic and Real-Time Catheter Segmentation in X-Ray Fluoroscopy

  • Pierre Ambrosini
  • Daniel Ruijters
  • Wiro J. Niessen
  • Adriaan Moelker
  • Theo van Walsum
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10434)

Abstract

Augmenting X-ray imaging with 3D roadmap to improve guidance is a common strategy. Such approaches benefit from automated analysis of the X-ray images, such as the automatic detection and tracking of instruments. In this paper, we propose a real-time method to segment the catheter and guidewire in 2D X-ray fluoroscopic sequences. The method is based on deep convolutional neural networks. The network takes as input the current image and the three previous ones, and segments the catheter and guidewire in the current image. Subsequently, a centerline model of the catheter is constructed from the segmented image. A small set of annotated data combined with data augmentation is used to train the network. We trained the method on images from 182 X-ray sequences from 23 different interventions. On a testing set with images of 55 X-ray sequences from 5 other interventions, a median centerline distance error of 0.2 mm and a median tip distance error of 0.9 mm was obtained. The segmentation of the instruments in 2D X-ray sequences is performed in a real-time fully-automatic manner.

Keywords

Catheter Guidewire Tracking X-ray Fluoroscopy Deep learning Convolutional neural network Segmentation 

Notes

Conflict of Interest

The authors declare that they have no conflict of interest.

References

  1. 1.
    Ambrosini, P., Smal, I., Ruijters, D., Niessen, W.J., Moelker, A., van Walsum, T.: A hidden Markov model for 3D catheter tip tracking with 2D X-ray catheterization sequence and 3D rotational angiography. IEEE Trans. Med. Imag. 36(3), 757–768 (2017)CrossRefGoogle Scholar
  2. 2.
    Baert, S.A., Viergever, M.A., Niessen, W.J.: Guide-wire tracking during endovascular interventions. IEEE Trans. Med. Imag. 22(8), 965–972 (2003)CrossRefMATHGoogle Scholar
  3. 3.
    Baur, C., Albarqouni, S., Demirci, S., Navab, N., Fallavollita, P.: CathNets: detection and single-view depth prediction of catheter electrodes. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, S.-L. (eds.) MIAR 2016. LNCS, vol. 9805, pp. 38–49. Springer, Cham (2016). doi: 10.1007/978-3-319-43775-0_4 CrossRefGoogle Scholar
  4. 4.
    Chang, P.L., Rolls, A., De Praetere, H., Vander Poorten, E., Riga, C.V., Bicknell, C.D., Stoyanov, D.: Robust catheter and guidewire tracking using b-spline tube model and pixel-wise posteriors. IEEE Robot. Autom. Lett. 1(1), 303–308 (2016)CrossRefGoogle Scholar
  5. 5.
    Chen, B.J., Wu, Z., Sun, S., Zhang, D., Chen, T.: Guidewire tracking using a novel sequential segment optimization method in interventional X-ray videos. In: Proceedings of IEEE International Symposium Biomedical Imaging, pp. 103–106 (2016)Google Scholar
  6. 6.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE Computer Society Conference on computer vision and pattern recognition, pp. 770–778 (2016)Google Scholar
  7. 7.
    Heibel, H., Glocker, B., Groher, M., Pfister, M., Navab, N.: Interventional tool tracking using discrete optimization. IEEE Trans. Med. Imag. 32(3), 544–555 (2013)CrossRefGoogle Scholar
  8. 8.
    Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of ICML, vol. 37, pp. 448–456 (2015)Google Scholar
  9. 9.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of IEEE Conference on CVPR, pp. 3431–3440 (2015)Google Scholar
  10. 10.
    Milletari, F., Navab, N., Ahmadi, S.A.: V-net: Fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of International Conference on 3D Vision, pp. 565–571. IEEE (2016)Google Scholar
  11. 11.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi: 10.1007/978-3-319-24574-4_28 CrossRefGoogle Scholar
  12. 12.
    Ruijters, D., Homan, R., Mielekamp, P., Van de Haar, P., Babic, D.: Validation of 3D multimodality roadmapping in interventional neuroradiology. Phys. Med. Biol. 56(16), 5335 (2011)CrossRefGoogle Scholar
  13. 13.
    Slabaugh, G., Kong, K., Unal, G., Fang, T.: Variational guidewire tracking using phase congruency. In: Ayache, N., Ourselin, S., Maeder, A. (eds.) MICCAI 2007. LNCS, vol. 4792, pp. 612–619. Springer, Heidelberg (2007). doi: 10.1007/978-3-540-75759-7_74 CrossRefGoogle Scholar
  14. 14.
    Springenberg, J.T., Dosovitskiy, A., Brox, T., Riedmiller, M.: Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806 (2014)
  15. 15.
    Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MATHMathSciNetGoogle Scholar
  16. 16.
    Wagner, M.G., Strother, C.M., Mistretta, C.A.: Guidewire path tracking and segmentation in 2D fluoroscopic time series using device paths from previous frames. In: Proceedings of SPIE, p. 97842B (2016)Google Scholar
  17. 17.
    Wang, P., Chen, T., Zhu, Y., Zhang, W., Zhou, S., Comaniciu, D.: Robust guidewire tracking in fluoroscopy. In: Proceedings of IEEE Computer Society CVPR, pp. 691–698 (2009)Google Scholar
  18. 18.
    Wu, X., Housden, J., Ma, Y., Razavi, B., Rhode, K., Rueckert, D.: Fast catheter segmentation from echocardiographic sequences based on segmentation from corresponding X-ray fluoroscopy for cardiac catheterization interventions. IEEE Trans. Med. Imag. 34(4), 861–876 (2015)CrossRefGoogle Scholar
  19. 19.
    Zhang, T., Suen, C.Y.: A fast parallel algorithm for thinning digital patterns. Commun. ACM 27(3), 236–239 (1984)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Pierre Ambrosini
    • 1
    • 3
  • Daniel Ruijters
    • 2
  • Wiro J. Niessen
    • 1
    • 3
    • 4
  • Adriaan Moelker
    • 3
  • Theo van Walsum
    • 1
    • 3
  1. 1.Biomedical Imaging Group Rotterdam, Department of Medical InformaticsErasmus MCRotterdamThe Netherlands
  2. 2.Philips HealthcareInterventional X-ray InnovationBestThe Netherlands
  3. 3.Department of Radiology and Nuclear MedicineErasmus MCRotterdamThe Netherlands
  4. 4.Imaging Physics, Faculty of Applied SciencesDelft University of TechnologyDelftThe Netherlands

Personalised recommendations