A Realistic Test and Development Environment for Mixed Reality in Neurosurgery
In a mixed reality visualization, physical and virtual environments are merged to produce new visualizations where both real and virtual objects are displayed together. In image guided surgery (IGS), surgical tools and data sets are fused into a mixed reality visualization providing the surgeon with a view beyond the visible anatomical surface of the patient, thereby reducing patient trauma, and potentially improving clinical outcomes. To date few mixed reality systems are used on a regular basis for surgery. One possible reason for this is that little research on which visualization methods and techniques are best and how they should be incorporated into the surgical workflow has been done. There is a strong need for evaluation of different visualization methods that may show the clinical usefulness of such systems. In this work we present a test and development environment for augmented reality visualization techniques and provide an example of the system use for image guided neurovascular surgery. The system was developed using open source software and off-the-shelf hardware.
KeywordsAugmented Reality Virtual Object Visualization Method Selective Laser Sinter Mixed Reality
Unable to display preview. Download preview PDF.
- 1.Milgram, P., Colquhoun, H.: A Taxonomy of Real and Virtual World Display Integration. In: Mixed Reality - Merging Real and Virtual Worlds, pp. 1–16 (1999)Google Scholar
- 2.Kersten-Oertel, M., Jannin, P., Collins, D.L.: DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery. IEEE TVCG (March 2011) (preprint)Google Scholar
- 3.Birkfellner, W., Figl, M., Huber, K., Watzinger, F., Wanschitz, F., Hummel, J., Hanel, R., Greimel, W., Homolka, P., Ewers, R., Bergmann, H.: A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation. IEEE Trans. Med. Imag. 21(8), 991–997 (2002)CrossRefGoogle Scholar
- 5.Edwards, P.J., King, A.P., Maurer Jr., C.R., de Cunha, D.A., Hawkes, D.J., Hill, D.L., Gaston, R.P., Fenlon, M.R., Jusczyzck, A., Strong, A.J., Chandler, C.L., Gleeson, M.J.: Design and Evaluation of a Aystem for Microscope-assisted Guided Interventions (MAGI). IEEE Trans. Med. Imag. 19(11), 1082–1093 (2000)CrossRefGoogle Scholar
- 6.Lorensen, W., Cline, H., Nafis, C.: Enhancing Reality in the Operating Room. In: Proceedings of IEEE Vis. Conf. (VIS), pp. 410–415 (1993)Google Scholar
- 7.Pandya, A., Siadat, M.R., Auner, G.: Design, implementation and accuracy of a prototype for medical augmented reality. Comput. Aided Surg. 10(1), 23–35 (2005)Google Scholar
- 12.Mercier, L., Del Maestro, R.F., Petrecca, K., Kochanowska, A., Drouin, S., Yan, C., Janke, A.L., Chen, S., Collins, D.L.: New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int. J. Comput. Assist. Radiol. Surg. 6(4), 507–522 (2011)CrossRefGoogle Scholar