Augmented reality in neurovascular surgery: feasibility and first uses in the operating room
- 1.1k Downloads
The aim of this report is to present a prototype augmented reality (AR) intra-operative brain imaging system. We present our experience of using this new neuronavigation system in neurovascular surgery and discuss the feasibility of this technology for aneurysms, arteriovenous malformations (AVMs), and arteriovenous fistulae (AVFs).
We developed an augmented reality system that uses an external camera to capture the live view of the patient on the operating room table and to merge this view with pre-operative volume-rendered vessels. We have extensively tested the system in the laboratory and have used the system in four surgical cases: one aneurysm, two AVMs and one AVF case.
The developed AR neuronavigation system allows for precise patient-to-image registration and calibration of the camera, resulting in a well-aligned augmented reality view. Initial results suggest that augmented reality is useful for tailoring craniotomies, localizing vessels of interest, and planning resection corridors.
Augmented reality is a promising technology for neurovascular surgery. However, for more complex anomalies such as AVMs and AVFs, better visualization techniques that allow one to distinguish between arteries and veins and determine the absolute depth of a vessel of interest are needed.
KeywordsAugmented reality Image-guided surgery Neurovascular surgery Visualization Arteriovenous malformations Arteriovenous fistulae Aneurysm
Conflict of interest
Marta Kersten-Oertel, Ian Gerard, Simon Drouin, Kelvin Mok, Denis Sirhan, David Sinclair, and D. Louis Collins declare that they have no conflict of interest.
- 2.Stieg P, Batjer H, Samson D (2007) Intracranial arteriovenous malformations. CRC Press, New YorkGoogle Scholar
- 7.Cabrilo I, Bijlenga P, Schaller K (2014) Augmented reality in the surgery of cerebral aneurysms: a technical report. Neurosurgery 10(Suppl. 2):252–260; discussion 260–261Google Scholar
- 10.Rosahl SK, Shahidi R (2008) The virtual operating field—how image guidance can become integral to microneurosurgery. In: Ramina R, de Aguiar PHP, Tatagiba M (eds) Samii’s essentials in neurosurgery. Springer, Berlin, pp 11–20Google Scholar
- 13.Gleason PL, Kikinis R, Altobelli D, Wells W, Alexander E, Black PM, Jolesz F (1994) Video registration virtual reality for nonlinkage stereotactic surgery. Stereotact Funct Neurosurg 63:139–143Google Scholar
- 14.Edwards PJ, King AP, Hawkes DJ, Fleig O, Maurer CR Jr, Hill DL, Fenlon MR, de Cunha DA, Gaston RP, Chandra S, Mannss J, Strong AJ, Gleeson MJ, Cox TC (1999) Stereo augmented reality in the surgical microscope. Stud Health Technol Inform 62:102–108Google Scholar
- 16.Birkfellner W, Figl M, Huber K, Watzinger F, Wanschitz F, Hummel J, Hanel R, Greimel W, Homolka P, Ewers R, Bergmann H (2002) A head-mounted operating binocular for augmented reality visualization in medicine—design and initial evaluation. IEEE Trans Med Imaging 21:991–997CrossRefPubMedGoogle Scholar
- 17.Mercier L, Del Maestro RF, Petrecca K, Kochanowska A, Drouin S, Yan CX, Janke AL, Chen SJ, Collins DL (2011) New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int J Comput Assist Radiol Surg 6:507–522CrossRefPubMedGoogle Scholar
- 18.Gerard I, Collins DL (2015) An analysis of tracking error in image guided neurosurgery. IJCARS 9. doi: 10.1007/s11548-014-1145-2
- 23.Kersten-Oertel M, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE Trans Vis Comput Graph 18:332–352 Google Scholar
- 24.Drouin S, Kersten-Oertel M, Chen SJS, Collins DL (2012) A realistic test and development environment for mixed reality in neurosurgery. In: Linte CA, Moore JT, Chen ECS, Holmes DR III (eds) Augmented environments for computer-assisted interventions (AE-CAI). Lecture notes in computer science, vol 7264, pp 13–23Google Scholar
- 26.Johnson L, Edwards P, Hawkes D (2002) Surface transparency makes stereo overlays unpredictable: the implications for augmented reality. Stud Health Technol Inform 94:131–136Google Scholar
- 30.Kersten-Oertel M, Gerard I, Mok K, Sirhan D, Sinclair D, Collins DL (2014) Augmented reality in neurovascular surgery: first experiences. In: Linte CA, Yaniv Z, Fallavollita P, Abolmaesumi P, Holmes DR III (eds) Augmented environments for computer-assisted interventions (AE-CAI). Lecture notes in computer science, vol 8678, pp 80–89Google Scholar
- 31.Aschke M, Wirtz CR, Raczkowsky J, Worn H, Kunze S (2003) Augmented reality in operating microscopes for neurosurgical interventions. In: Neural engineering, 2003. Conference Proceedings. First international IEEE EMBS conference on, pp 652–655Google Scholar