Abstract
In many bedside procedures, surgeons must rely on their spatiotemporal reasoning to estimate the position of an internal target by manually measuring external anatomical landmarks. One particular example that is performed frequently in neurosurgery is ventriculostomy, where the surgeon inserts a catheter into the patient’s skull to divert the cerebrospinal fluid and alleviate the intracranial pressure. However, about one-third of the insertions miss the target.
We, therefore, assembled a team of engineers and neurosurgeons to develop an interactive surgical navigation system using mixed reality on a head-mounted display that overlays the target, identified in preoperative images, directly on the patient’s anatomy and provides visual guidance for the surgeon to insert the catheter on the correct path to the target.
We conducted a user study to evaluate the improvement in the accuracy and precision of the insertions with mixed reality as well as the usability of our navigation system. The results indicate that using mixed reality improves the accuracy by over 35% and that the system ranks high based on the usability score.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Armstrong, D.G., Rankin, T.M., Giovinco, N.A., Mills, J.L., Matsuoka, Y.: A heads-up display for diabetic limb salvage surgery: a view through the google looking glass. J. Diab. Sci. Technol. 8(5), 951–956 (2014)
Aten, Q., Killeffer, J., Seaver, C., Reier, L.: Causes, complications, and costs associated with external ventricular drainage catheter obstruction. World Neurosurg. 134, 501–506 (2020)
Azimi, E., Doswell, J., Kazanzides, P.: Augmented reality goggles with an integrated tracking system for navigation in neurosurgery. In: Virtual Reality Short Papers and Posters (VRW), pp. 123–124. IEEE (2012)
Azimi, E., Molina, C., Chang, A., Huang, J., Huang, C.-M., Kazanzides, P.: Interactive training and operation ecosystem for surgical tasks in mixed reality. In: Stoyanov, D., et al. (eds.) CARE/CLIP/OR 2.0/ISIC -2018. LNCS, vol. 11041, pp. 20–29. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01201-4_3
Azimi, E., Qian, L., Kazanzides, P., Navab, N.: Robust optical see-through head-mounted display calibration: taking anisotropic nature of user interaction errors into account. In: Virtual Reality (VR). IEEE (2017)
Azimi, E., Qian, L., Navab, N., Kazanzides, P.: Alignment of the virtual scene to the tracking space of a mixed reality head-mounted display. arXiv preprint arXiv:1703.05834 (2017)
Azimi, E., et al.: Can mixed-reality improve the training of medical procedures? In: IEEE Engineering in Medicine and Biology Conference (EMBC), pp. 112–116, July 2018
Brooke, J.: SUS-a quick and dirty usability scale. Usabil. Eval. Ind. 189(194), 4–7 (1996)
Chen, L., Day, T., Tang, W., John, N.W.: Recent developments and future challenges in medical mixed reality. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 123–135 (2017)
van Doormaal, T.P., van Doormaal, J.A., Mensink, T.: Clinical accuracy of holographic navigation using point-based registration on augmented-reality glasses. Oper. Neurosurg. 17(6), 588–593 (2019)
Eck, U., Stefan, P., Laga, H., Sandor, C., Fallavollita, P., Navab, N.: Exploring visuo-haptic augmented reality user interfaces for stereo-tactic neurosurgery planning. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, S.-L. (eds.) MIAR 2016. LNCS, vol. 9805, pp. 208–220. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-43775-0_19
Frantz, T., Jansen, B., Duerinck, J., Vandemeulebroucke, J.: Augmenting Microsoft’s HoloLens with Vuforia tracking for neuronavigation. Healthc. Technol. Lett. 5(5), 221–225 (2018)
Gsaxner, C., Pepe, A., Wallner, J., Schmalstieg, D., Egger, J.: Markerless image-to-face registration for untethered augmented reality in head and neck surgery. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11768, pp. 236–244. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32254-0_27
Hart, S.G.: NASA-Task Load Index (NASA-TLX); 20 years later (2006)
Huyette, D.R., Turnbow, B.J., Kaufman, C., Vaslow, D.F., Whiting, B.B., Oh, M.Y.: Accuracy of the freehand pass technique for ventriculostomy catheter placement: retrospective assessment using computed tomography scans. J. Neurosurg. (JNS) 108(1), 88–91 (2008)
Kersten-Oertel, M., Jannin, P., Collins, D.L.: DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE Trans. Visual Comput. Graph. 18(2), 332–352 (2012)
Li, Y., et al.: A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside. J. Neurosurg. (JNS) 131, 1599–1606 (2018)
Pepe, A., et al.: A marker-less registration approach for mixed reality-aided maxillofacial surgery: a pilot evaluation. J. Digit. Imaging 32(6), 1008–1018 (2019). https://doi.org/10.1007/s10278-019-00272-6
Raabe, C., Fichtner, J., Beck, J., Gralla, J., Raabe, A.: Revisiting the rules for freehand ventriculostomy: a virtual reality analysis. J. Neurosurg. 128, 1–8 (2017)
Sadda, P., Azimi, E., Jallo, G., Doswell, J., Kazanzides, P.: Surgical navigation with a head-mounted tracking system and display. Stud. Health Technol. Inform. 184, 363–369 (2012)
Sauer, F., Khamene, A., Bascle, B., Rubino, G.J.: A head-mounted display system for augmented reality image guidance: towards clinical evaluation for iMRI-guided neurosurgery. In: Niessen, W.J., Viergever, M.A. (eds.) MICCAI 2001. LNCS, vol. 2208, pp. 707–716. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45468-3_85
Yoon, J.W., Chen, R.E., Han, P.K., Si, P., Freeman, W.D., Pirris, S.M.: Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation. Int. J. Med. Robot. Comput. Assist. Surg. 13(3), e1770 (2017)
Acknowledgments
The authors thank Sam Kamran, Adarsh Malapaka, and Nikhil Dave for their help in preparing the skull phantom and Kai Ding for the CT scan. Ehsan Azimi is supported by the Link Foundation fellowship.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Azimi, E. et al. (2020). An Interactive Mixed Reality Platform for Bedside Surgical Procedures. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12263. Springer, Cham. https://doi.org/10.1007/978-3-030-59716-0_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-59716-0_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59715-3
Online ISBN: 978-3-030-59716-0
eBook Packages: Computer ScienceComputer Science (R0)
