Skip to main content
Book cover

International Conference on Medical Imaging and Augmented Reality

MIAR 2016: Medical Imaging and Augmented Reality pp 163–174Cite as

Towards Augmented Reality Guided Craniotomy Planning in Tumour Resections

Part of the Lecture Notes in Computer Science book series (LNIP,volume 9805)

Abstract

Augmented reality has been proposed as a solution to overcome some of the current shortcomings of image-guided neurosurgery. In particular, it has been used to merge patient images, surgical plans, and the surgical field of view into a comprehensive visualization. In this paper we explore the use of augmented reality for planning craniotomies in image-guided neurosurgery procedures for tumour resections. Our augmented reality image-guided neurosurgery system was brought into the operating room for 8 cases where the surgeon used augmented reality prior to tumour resection. We describe our initial results that suggest that augmented reality can play an important role in tailoring the size and shape of the craniotomy and for evaluating intra-operative surgical strategies. With continued development and validation, augmented reality guidance has the potential to improve the minimally invasiveness of image-guided neurosurgery through improved intraoperative surgical planning.

Keywords

  • Augmented reality
  • Tumour resection
  • Craniotomy
  • Image-guided neurosurgery

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-43775-0_15
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-43775-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.

Notes

  1. 1.

    A video of the surgeon using AR in this surgical case can be viewed at: https://www.youtube.com/watch?v=tru4uwQIvyI.

References

  1. Kersten-Oertel, M., Jannin, P., Collins, D.L.: The state of the art of visualization in mixed reality image guided surgery. Comput. Med. Imaging Graph. 37, 98–112 (2013)

    CrossRef  Google Scholar 

  2. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D.S., Collins, D.L.: Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int. J. Comput. Assist. Radiol. Surg. 10(11), 1823–1836 (2015)

    CrossRef  Google Scholar 

  3. Kersten-Oertel, M., Gerard, I.J., Drouin, S., Mok, K., Sirhan, D., Sinclair, D.S., Collins, D.L.: Augmented reality for specific neurovascular surgical tasks. In: Linte, C.A., Yaniv, Z., Fallavollita, P. (eds.) AE-CAI 2011. LNCS, vol. 9365, pp. 92–103. Springer, Heidelberg (2015)

    CrossRef  Google Scholar 

  4. Gleason, P.L., Kikinis, R., Altobelli, D., Wells, W., Alexander III, E., Black, P.M., Jolesz, F.: Video registration virtual reality for nonlinkage stereotactic surgery. Stereotact. Funct. Neurosurg. 63, 139–143 (1994)

    CrossRef  Google Scholar 

  5. Edwards, P., Hawkes, D., Hill, D., Jewell, D., Spink, R., Strong, A., Gleeson, M.: Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J. Image Guid. Surg. 1, 172–178 (1995)

    CrossRef  Google Scholar 

  6. Edwards, P.J., King, A.P., Hawkes, D.J., Fleig, O., Maurer Jr., C.R., Hill, D.L., Fenlon, M.R., de Cunha, D.A., Gaston, R.P., Chandra, S., Mannss, J., Strong, A.J., Gleeson, M.J., Cox, T.C.: Stereo augmented reality in the surgical microscope. Stud. Health Technol. Inform. 62, 102–108 (1999)

    Google Scholar 

  7. Birkfellner, W., Figl, M., Matula, C., Hummel, J., Hanel, R., Imhof, H., Wanschitz, F., Wagner, A., Watzinger, F., Bergmann, H.: Computer-enhanced stereoscopic vision in a head-mounted operating binocular. Phys. Med. Biol. 48, N49–N57 (2003)

    CrossRef  Google Scholar 

  8. Birkfellner, W., Figl, M., Huber, K., Watzinger, F., Wanschitz, F., Hummel, J., Hanel, R., Greimel, W., Homolka, P., Ewers, R., Bergmann, H.: A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation. IEEE Trans. Med. Imaging 21, 991–997 (2002)

    CrossRef  MATH  Google Scholar 

  9. Sauer, F., Khamene, A., Bascle, B., Rubino, G.J.: A head-mounted display system for augmented reality image guidance: towards clinical evaluation for iMRI-guided neurosurgery. In: Niessen, W.J., Viergever, M.A. (eds.) MICCAI 2001. LNCS, vol. 2208, pp. 707–716. Springer, Heidelberg (2001)

    CrossRef  Google Scholar 

  10. Cabrilo, I., Bijlenga, P., Schaller, K.: Augmented reality in the surgery of cerebral arteriovenous malformations: technique assessment and considerations. Acta Neurochir. (Wien) 156, 1769–1774 (2014)

    CrossRef  Google Scholar 

  11. Cabrilo, I., Bijlenga, P., Schaller, K.: Augmented reality in the surgery of cerebral aneurysms: a technical report. Neurosurgery 10(Suppl. 2), 252–260 (2014). Discussion 260-1

    CrossRef  Google Scholar 

  12. Mahvash, M., Besharati Tabrizi, L.: A novel augmented reality system of image projection for image-guided neurosurgery. Acta Neurochir. (Wien) 155, 943–947 (2013)

    CrossRef  Google Scholar 

  13. Meola, A., Cutolo, F., Carbone, M., Cagnazzo, F., Ferrari, M., Ferrari, V.: Augmented reality in neurosurgery: a systematic review. Neurosurg. Rev. 1--12 (2016). [epub ahead of print]

    Google Scholar 

  14. Mercier, L., Del Maestro, R.F., Petrecca, K., Kochanowska, A., Drouin, S., Yan, C.X., Janke, A.L., Chen, S.J., Collins, D.L.: New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int. J. Comput. Assist. Radiol. Surg. 6, 507–522 (2011)

    CrossRef  Google Scholar 

  15. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D., Collins, D.: Augmented reality in neurovascular surgery: first experiences. In: Linte, C.A., Yaniv, Z., Fallavollita, P., Abolmaesumi, P., Holmes III, D.R. (eds.) AE-CAI 2014. LNCS, vol. 8678, pp. 80–89. Springer, Heidelberg (2014)

    Google Scholar 

  16. Gerard, I.J., Kersten-Oertel, M., Drouin, S., Hall, J.A., Petrecca, K., De Nigris, D., Arbel, T., Louis Collins, D.: Improving patient specific neurosurgical models with intraoperative ultrasound and augmented reality visualizations in a neuronavigation environment. In: Oyarzun Laura, C., et al. (eds.) CLIP 2015. LNCS, vol. 9401, pp. 28–35. Springer, Heidelberg (2016). doi:10.1007/978-3-319-31808-0_4

    CrossRef  Google Scholar 

  17. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330–1334 (2000)

    CrossRef  Google Scholar 

  18. Gerard, I.J., Collins, D.L.: An analysis of tracking error in image-guided neurosurgery. Int. J. Comput. Assist. Radiol. Surg. 10, 1579–1588 (2015)

    CrossRef  Google Scholar 

  19. Kersten-Oertel, M., Gerard, I., Drouin, S., Mok, K., Sirhan, D., Sinclair, D., Collins, D.L.: Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int. J. Comput. Assist. Radiol. Surg. 10, 1–14 (2015)

    CrossRef  Google Scholar 

  20. Mahvash, M., Boettcher, I., Petridis, A.K., Besharati Tabrizi, L.: Image guided versus conventional brain tumor and craniotomy localization. J Neurosurg Sci. (2015). http://europepmc.org/abstract/med/25600554, PMID:25600554

Download references

Author information

Authors and Affiliations

  1. Biomedical Engineering, McGill University, Montréal, Canada

    Ian J. Gerard, Simon Drouin & D. Louis Collins

  2. Neurology and Neurosurgery, McGill University, Montréal, Canada

    Kevin Petrecca, Jeffery A. Hall & D. Louis Collins

  3. Montreal Neurological Institute and Hospital, Montréal, Canada

    Marta Kersten-Oertel, Ian J. Gerard, Simon Drouin, Kevin Petrecca, Jeffery A. Hall & D. Louis Collins

Authors
  1. Marta Kersten-Oertel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ian J. Gerard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Simon Drouin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kevin Petrecca
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jeffery A. Hall
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. D. Louis Collins
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marta Kersten-Oertel .

Editor information

Editors and Affiliations

  1. Institute for Surgical Technology, University of Bern, Bern, Switzerland

    Guoyan Zheng

  2. Tsinghua University, Tokyo, Japan

    Hongen Liao

  3. Faculte de Medicine, Universite de Rennes 1, Rennes Cedex, France

    Pierre Jannin

  4. University of Basel, Allschwil, Switzerland

    Philippe Cattin

  5. Hamlyn Centre, Imperial College London, London, United Kingdom

    Su-Lin Lee

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kersten-Oertel, M., Gerard, I.J., Drouin, S., Petrecca, K., Hall, J.A., Louis Collins, D. (2016). Towards Augmented Reality Guided Craniotomy Planning in Tumour Resections. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, SL. (eds) Medical Imaging and Augmented Reality. MIAR 2016. Lecture Notes in Computer Science(), vol 9805. Springer, Cham. https://doi.org/10.1007/978-3-319-43775-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43775-0_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43774-3

  • Online ISBN: 978-3-319-43775-0

  • eBook Packages: Computer ScienceComputer Science (R0)