Endoscopic Navigation in the Absence of CT Imaging

  • Ayushi Sinha
  • Xingtong Liu
  • Austin Reiter
  • Masaru Ishii
  • Gregory D. Hager
  • Russell H. Taylor
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11073)


Clinical examinations that involve endoscopic exploration of the nasal cavity and sinuses often do not have a reference image to provide structural context to the clinician. In this paper, we present a system for navigation during clinical endoscopic exploration in the absence of computed tomography (CT) scans by making use of shape statistics from past CT scans. Using a deformable registration algorithm along with dense reconstructions from video, we show that we are able to achieve submillimeter registrations in in-vivo clinical data and are able to assign confidence to these registrations using confidence criteria established using simulated data.



This work was funded by NIH R01-EB015530, NSF Graduate Research Fellowship Program, an Intuitive Surgical, Inc. fellowship, and JHU internal funds.


  1. 1.
    Mirota, D.J., Ishii, M., Hager, G.D.: Vision-based navigation in image-guided interventions. Ann. Rev. Biomed. Eng. 13(1), 297–319 (2011)CrossRefGoogle Scholar
  2. 2.
    Azagury, D.E., et al.: Real-time computed tomography-based augmented reality for natural orifice transluminal endoscopic surgery navigation. Brit. J. Surg. 99(9), 1246–1253 (2012)CrossRefGoogle Scholar
  3. 3.
    Beichel, R.R., et al.: Data from QIN-HEADNECK. The Cancer Imaging Archive (2015)Google Scholar
  4. 4.
    Bosch, W.R., Straube, W.L., Matthews, J.W., Purdy, J.A.: Data from head-neck\_cetuximab. The Cancer Imaging Archive (2015)Google Scholar
  5. 5.
    Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26(6), 1045–1057 (2013)CrossRefGoogle Scholar
  6. 6.
    Fedorov, A., et al.: DICOM for quantitative imaging biomarker development: a standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 4, e2057 (2016)CrossRefGoogle Scholar
  7. 7.
    Avants, B.B., Tustison, N.J., Song, G., Cook, P.A., Klein, A., Gee, J.C.: A reproducible evaluation of ANTs similarity metric performance in brain image registration. NeuroImage 54(3), 2033–2044 (2011)CrossRefGoogle Scholar
  8. 8.
    Sinha, A., Reiter, A., Leonard, S., Ishii, M., Hager, G.D., Taylor, R.H.: Simultaneous segmentation and correspondence improvement using statistical modes. In: Proceedings of SPIE, vol. 10133, pp. 101 331B–101 331B–8 (2017)Google Scholar
  9. 9.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models their training and application. Comp. Vis. Image Underst. 61, 38–59 (1995)CrossRefGoogle Scholar
  10. 10.
    Sinha, A., et al.: The deformable most-likely-point paradigm. Med. Image Anal. (Submitted)Google Scholar
  11. 11.
    Billings, S.D., Taylor, R.H.: Generalized iterative most likely oriented-point (G-IMLOP) registration. Int. J. Comput. Assist. Radiol. Surg. 10(8), 1213–1226 (2015)CrossRefGoogle Scholar
  12. 12.
    Mardia, K.V., Jupp, P.E.: Directional statistics. Wiley Series in Probability and Statistics, pp. 1–432. Wiley, Hoboken (2008)Google Scholar
  13. 13.
    Reiter, A., Leonard, S., Sinha, A., Ishii, M., Taylor, R.H., Hager, G.D.: Endoscopic-CT: learning-based photometric reconstruction for endoscopic sinus surgery. In: Proceedings of SPIE, vol. 9784, pp. 978 418–978 418–6 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Ayushi Sinha
    • 1
  • Xingtong Liu
    • 1
  • Austin Reiter
    • 1
  • Masaru Ishii
    • 2
  • Gregory D. Hager
    • 1
  • Russell H. Taylor
    • 1
  1. 1.The Johns Hopkins UniversityBaltimoreUSA
  2. 2.Johns Hopkins Medical InstitutionsBaltimoreUSA

Personalised recommendations