Skip to main content

Towards Augmented Reality Guided Craniotomy Planning in Tumour Resections

  • Conference paper
  • First Online:
Medical Imaging and Augmented Reality (MIAR 2016)

Abstract

Augmented reality has been proposed as a solution to overcome some of the current shortcomings of image-guided neurosurgery. In particular, it has been used to merge patient images, surgical plans, and the surgical field of view into a comprehensive visualization. In this paper we explore the use of augmented reality for planning craniotomies in image-guided neurosurgery procedures for tumour resections. Our augmented reality image-guided neurosurgery system was brought into the operating room for 8 cases where the surgeon used augmented reality prior to tumour resection. We describe our initial results that suggest that augmented reality can play an important role in tailoring the size and shape of the craniotomy and for evaluating intra-operative surgical strategies. With continued development and validation, augmented reality guidance has the potential to improve the minimally invasiveness of image-guided neurosurgery through improved intraoperative surgical planning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A video of the surgeon using AR in this surgical case can be viewed at: https://www.youtube.com/watch?v=tru4uwQIvyI.

References

  1. Kersten-Oertel, M., Jannin, P., Collins, D.L.: The state of the art of visualization in mixed reality image guided surgery. Comput. Med. Imaging Graph. 37, 98–112 (2013)

    Article  Google Scholar 

  2. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D.S., Collins, D.L.: Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int. J. Comput. Assist. Radiol. Surg. 10(11), 1823–1836 (2015)

    Article  Google Scholar 

  3. Kersten-Oertel, M., Gerard, I.J., Drouin, S., Mok, K., Sirhan, D., Sinclair, D.S., Collins, D.L.: Augmented reality for specific neurovascular surgical tasks. In: Linte, C.A., Yaniv, Z., Fallavollita, P. (eds.) AE-CAI 2011. LNCS, vol. 9365, pp. 92–103. Springer, Heidelberg (2015)

    Chapter  Google Scholar 

  4. Gleason, P.L., Kikinis, R., Altobelli, D., Wells, W., Alexander III, E., Black, P.M., Jolesz, F.: Video registration virtual reality for nonlinkage stereotactic surgery. Stereotact. Funct. Neurosurg. 63, 139–143 (1994)

    Article  Google Scholar 

  5. Edwards, P., Hawkes, D., Hill, D., Jewell, D., Spink, R., Strong, A., Gleeson, M.: Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J. Image Guid. Surg. 1, 172–178 (1995)

    Article  Google Scholar 

  6. Edwards, P.J., King, A.P., Hawkes, D.J., Fleig, O., Maurer Jr., C.R., Hill, D.L., Fenlon, M.R., de Cunha, D.A., Gaston, R.P., Chandra, S., Mannss, J., Strong, A.J., Gleeson, M.J., Cox, T.C.: Stereo augmented reality in the surgical microscope. Stud. Health Technol. Inform. 62, 102–108 (1999)

    Google Scholar 

  7. Birkfellner, W., Figl, M., Matula, C., Hummel, J., Hanel, R., Imhof, H., Wanschitz, F., Wagner, A., Watzinger, F., Bergmann, H.: Computer-enhanced stereoscopic vision in a head-mounted operating binocular. Phys. Med. Biol. 48, N49–N57 (2003)

    Article  Google Scholar 

  8. Birkfellner, W., Figl, M., Huber, K., Watzinger, F., Wanschitz, F., Hummel, J., Hanel, R., Greimel, W., Homolka, P., Ewers, R., Bergmann, H.: A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation. IEEE Trans. Med. Imaging 21, 991–997 (2002)

    Article  MATH  Google Scholar 

  9. Sauer, F., Khamene, A., Bascle, B., Rubino, G.J.: A head-mounted display system for augmented reality image guidance: towards clinical evaluation for iMRI-guided neurosurgery. In: Niessen, W.J., Viergever, M.A. (eds.) MICCAI 2001. LNCS, vol. 2208, pp. 707–716. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  10. Cabrilo, I., Bijlenga, P., Schaller, K.: Augmented reality in the surgery of cerebral arteriovenous malformations: technique assessment and considerations. Acta Neurochir. (Wien) 156, 1769–1774 (2014)

    Article  Google Scholar 

  11. Cabrilo, I., Bijlenga, P., Schaller, K.: Augmented reality in the surgery of cerebral aneurysms: a technical report. Neurosurgery 10(Suppl. 2), 252–260 (2014). Discussion 260-1

    Article  Google Scholar 

  12. Mahvash, M., Besharati Tabrizi, L.: A novel augmented reality system of image projection for image-guided neurosurgery. Acta Neurochir. (Wien) 155, 943–947 (2013)

    Article  Google Scholar 

  13. Meola, A., Cutolo, F., Carbone, M., Cagnazzo, F., Ferrari, M., Ferrari, V.: Augmented reality in neurosurgery: a systematic review. Neurosurg. Rev. 1--12 (2016). [epub ahead of print]

    Google Scholar 

  14. Mercier, L., Del Maestro, R.F., Petrecca, K., Kochanowska, A., Drouin, S., Yan, C.X., Janke, A.L., Chen, S.J., Collins, D.L.: New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int. J. Comput. Assist. Radiol. Surg. 6, 507–522 (2011)

    Article  Google Scholar 

  15. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D., Collins, D.: Augmented reality in neurovascular surgery: first experiences. In: Linte, C.A., Yaniv, Z., Fallavollita, P., Abolmaesumi, P., Holmes III, D.R. (eds.) AE-CAI 2014. LNCS, vol. 8678, pp. 80–89. Springer, Heidelberg (2014)

    Google Scholar 

  16. Gerard, I.J., Kersten-Oertel, M., Drouin, S., Hall, J.A., Petrecca, K., De Nigris, D., Arbel, T., Louis Collins, D.: Improving patient specific neurosurgical models with intraoperative ultrasound and augmented reality visualizations in a neuronavigation environment. In: Oyarzun Laura, C., et al. (eds.) CLIP 2015. LNCS, vol. 9401, pp. 28–35. Springer, Heidelberg (2016). doi:10.1007/978-3-319-31808-0_4

    Chapter  Google Scholar 

  17. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330–1334 (2000)

    Article  Google Scholar 

  18. Gerard, I.J., Collins, D.L.: An analysis of tracking error in image-guided neurosurgery. Int. J. Comput. Assist. Radiol. Surg. 10, 1579–1588 (2015)

    Article  Google Scholar 

  19. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D., Collins, D.L.: Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int. J. Comput. Assist. Radiol. Surg. 10, 1–14 (2015)

    Article  Google Scholar 

  20. Mahvash, M., Boettcher, I., Petridis, A.K., Besharati Tabrizi, L.: Image guided versus conventional brain tumor and craniotomy localization. J Neurosurg Sci. (2015). http://europepmc.org/abstract/med/25600554, PMID:25600554

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marta Kersten-Oertel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kersten-Oertel, M., Gerard, I.J., Drouin, S., Petrecca, K., Hall, J.A., Louis Collins, D. (2016). Towards Augmented Reality Guided Craniotomy Planning in Tumour Resections. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, SL. (eds) Medical Imaging and Augmented Reality. MIAR 2016. Lecture Notes in Computer Science(), vol 9805. Springer, Cham. https://doi.org/10.1007/978-3-319-43775-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43775-0_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43774-3

  • Online ISBN: 978-3-319-43775-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics