A Realistic Test and Development Environment for Mixed Reality in Neurosurgery

  • Simon Drouin
  • Marta Kersten-Oertel
  • Sean Jy-Shyang Chen
  • D. Louis Collins
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7264)


In a mixed reality visualization, physical and virtual environments are merged to produce new visualizations where both real and virtual objects are displayed together. In image guided surgery (IGS), surgical tools and data sets are fused into a mixed reality visualization providing the surgeon with a view beyond the visible anatomical surface of the patient, thereby reducing patient trauma, and potentially improving clinical outcomes. To date few mixed reality systems are used on a regular basis for surgery. One possible reason for this is that little research on which visualization methods and techniques are best and how they should be incorporated into the surgical workflow has been done. There is a strong need for evaluation of different visualization methods that may show the clinical usefulness of such systems. In this work we present a test and development environment for augmented reality visualization techniques and provide an example of the system use for image guided neurovascular surgery. The system was developed using open source software and off-the-shelf hardware.


Augmented Reality Virtual Object Visualization Method Selective Laser Sinter Mixed Reality 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Milgram, P., Colquhoun, H.: A Taxonomy of Real and Virtual World Display Integration. In: Mixed Reality - Merging Real and Virtual Worlds, pp. 1–16 (1999)Google Scholar
  2. 2.
    Kersten-Oertel, M., Jannin, P., Collins, D.L.: DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery. IEEE TVCG (March 2011) (preprint)Google Scholar
  3. 3.
    Birkfellner, W., Figl, M., Huber, K., Watzinger, F., Wanschitz, F., Hummel, J., Hanel, R., Greimel, W., Homolka, P., Ewers, R., Bergmann, H.: A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation. IEEE Trans. Med. Imag. 21(8), 991–997 (2002)CrossRefGoogle Scholar
  4. 4.
    Marmulla, R., Hoppe, H., Muhling, J., Eggers, G.: An augmented reality system for image-guided surgery. Int. J. Oral Maxillofac. Surg. 34, 594–596 (2005)CrossRefGoogle Scholar
  5. 5.
    Edwards, P.J., King, A.P., Maurer Jr., C.R., de Cunha, D.A., Hawkes, D.J., Hill, D.L., Gaston, R.P., Fenlon, M.R., Jusczyzck, A., Strong, A.J., Chandler, C.L., Gleeson, M.J.: Design and Evaluation of a Aystem for Microscope-assisted Guided Interventions (MAGI). IEEE Trans. Med. Imag. 19(11), 1082–1093 (2000)CrossRefGoogle Scholar
  6. 6.
    Lorensen, W., Cline, H., Nafis, C.: Enhancing Reality in the Operating Room. In: Proceedings of IEEE Vis. Conf. (VIS), pp. 410–415 (1993)Google Scholar
  7. 7.
    Pandya, A., Siadat, M.R., Auner, G.: Design, implementation and accuracy of a prototype for medical augmented reality. Comput. Aided Surg. 10(1), 23–35 (2005)Google Scholar
  8. 8.
    Paul, P., Fleig, O., Jannin, P.: Augmented Virtuality Based on Stereoscopic Reconstruction in Multimodal Image-Guided Neurosurgery: Methods and Performance Evaluation. IEEE Trans. Med. Imaging 24(11), 1500–1511 (2005)CrossRefGoogle Scholar
  9. 9.
    Low, D., Lee, C.K., Tay Dip, L.L., Ng, W.H., Ang, B.T., Ng, I.: Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Brit. J. Neurosurg. 24(1), 69–74 (2010)CrossRefGoogle Scholar
  10. 10.
    Horn, B.: Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4, 629–642 (1987)CrossRefGoogle Scholar
  11. 11.
    Eskildsen, S.F., Østergaard, L.R.: Active Surface Approach for Extraction of the Human Cerebral Cortex from MRI. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006, Part II. LNCS, vol. 4191, pp. 823–830. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Mercier, L., Del Maestro, R.F., Petrecca, K., Kochanowska, A., Drouin, S., Yan, C., Janke, A.L., Chen, S., Collins, D.L.: New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int. J. Comput. Assist. Radiol. Surg. 6(4), 507–522 (2011)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Simon Drouin
    • 1
  • Marta Kersten-Oertel
    • 1
  • Sean Jy-Shyang Chen
    • 1
  • D. Louis Collins
    • 1
  1. 1.McConnell Brain Imaging Center, MNIMcGill UniversityMontrealCanada

Personalised recommendations