Illustrative visualization of 3D planning models for augmented reality in liver surgery
- 1.2k Downloads
Augmented reality (AR) obtains increasing acceptance in the operating room. However, a meaningful augmentation of the surgical view with a 3D visualization of planning data which allows reliable comparisons of distances and spatial relations is still an open request.
We introduce methods for intraoperative visualization of 3D planning models which extend illustrative rendering and AR techniques. We aim to reduce visual complexity of 3D planning models and accentuate spatial relations between relevant objects. The main contribution of our work is an advanced silhouette algorithm for 3D planning models (distance-encoding silhouettes) combined with procedural textures (distance-encoding surfaces). In addition, we present a method for illustrative visualization of resection surfaces.
The developed algorithms have been embedded into a clinical prototype that has been evaluated in the operating room. To verify the expressiveness of our illustration methods, we performed a user study under controlled conditions. The study revealed a clear advantage in distance assessment with the proposed illustrative approach in comparison to classical rendering techniques.
The presented illustration methods are beneficial for distance assessment in surgical AR. To increase the safety of interventions with the proposed approach, the reduction of inaccuracies in tracking and registration is a subject of our current research.
KeywordsIntraoperative visualization Augmented reality Image-guided surgery Illustrative rendering
Unable to display preview. Download preview PDF.
- 1.Schenk A, Zidowitz S, Bourquain H, Hindennach M, Hansen C, Hahn H, Peitgen HO (2008) Clinical relevance of model based computer-assisted diagnosis and therapy. Proceedings of SPIE Medical Imaging, 6915(1):691502_1-19. doi: 10.1117/12.780270
- 3.Hildebrand P, Schlichting S, Martens V, Besiveric A, Roblick U, Roblick U, Mirow L, Buerk C, Schweikard A, Bruch H (2008) Prototype of an intraoperative navigation and documentation system for laparoscopic radiofrequency ablations: first experiences. Eur J Surg Oncol 34(4): 418–421. doi: 10.1016/j.ejso.2007.04.017 PubMedGoogle Scholar
- 4.Beller S, Eulenstein S, Lange T, Hünerbein M, Schlag PM (2009) Upgrade of an optical navigation system with a permanent electromagnetic position control: a first step towards “navigated control” for liver surgery. J Hepatobiliary Pancreat Surg 16(2): 165–170. doi: 10.1007/s00534-008-0040-z CrossRefPubMedGoogle Scholar
- 14.Krempien R, Hoppe H, Kahrs L, Daeuber S, Schorr O, Eggers G, Bischof M, Munter MW, Debus J, Harms W (2008) Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. Int J Radiat Oncol Biol Phys 70(3): 944–952. doi: 10.1016/j.ijrobp.2007.10.048 PubMedGoogle Scholar
- 15.Riechmann M, Kahrs LA, Hoppe H, Ulmer C, Raczkowsky J, Lamade W, Wörn H (2006) Visualisierungskonzept für die projektorbasierte Erweiterte Realität in der Leberchirurgie. Proc BMT 209(1): 1–2Google Scholar
- 17.Navab N, Feuerstein M, Bichlmeier C (2007) Laparoscopic virtual mirror—new interaction paradigm for monitor based augmented reality. Virtual Reality Conference IEEE, pp 43–50. doi: 10.1109/VR.2007.352462
- 19.Bichlmeier C, Wimmer F, Heining SM, Navab N (2007) Contextual anatomic mimesis: hybrid in situ visualization method for improving multi-sensory depth perception in medical augmented reality. In: ISMAR ‘07: Proceedings of the 2007 6th IEEE and ACM international symposium on mixed and augmented reality, pp 1–10. doi: 10.1109/ISMAR.2007.4538837
- 20.Strothotte T, Schlechtweg S (2002) Non-photorealistic computer graphics. Morgan Kaufmann, San FranciscoGoogle Scholar
- 21.Bruckner S (2008) Interactive illustrative volume visualization. PhD thesis, University of Technology, Vienna, AustriaGoogle Scholar
- 22.Fischer J, Bartz D (2005) Stylized augmented reality for improved immersion. Proceedings of the IEEE Conference on Virtual Reality, pp 195–202. doi: 10.1109/VR.2005.1492774
- 23.Freudenberg B (2004) Real-time stroke-based halftoning. PhD thesis, Otto-von-Guericke University Magdeburg, GermanyGoogle Scholar
- 25.Ericsson K, Simon H (1993) Protocol Analysis: Verbal Reports as Data. MIT Press, BostonGoogle Scholar