Skip to main content
Log in

Intraoperative „Augmented-reality-Visualisierung“

Aktueller Stand der Entwicklung und erste Erfahrungen mit dem CamC

Intraoperative augmented reality visualization

Current state of development and initial experiences with the CamC

  • Leitthema
  • Published:
Der Unfallchirurg Aims and scope Submit manuscript

Zusammenfassung

Die intraoperative Anwendung von „augmented reality“ (AR, erweiterte Realität) fand bisher überwiegend im Bereich der Endoskopie statt. Dabei wurde das Kamerabild des Endoskops mittels aufwendig errechneter Darstellungen präoperativer Bildgebung erweitert. Aufgrund des hohen Aufwands und der Komplexität der Systeme hat sich die Technologie bisher nicht durchsetzen können. Der „Camera Augmented Mobile C-arm“ (CamC), der einen herkömmlichen C-Bogen durch eine Videokamera erweitert, zeichnet sich durch eine unkomplizierte Handhabung aus. Er bettet das Röntgenbild geometrisch exakt in das Videolivebild ein. Die klinische Anwendung in 43 Fällen zeigte die Stärken des Gerätes bei der Positionierung, der Inzisionsplanung, der Kirschner-Drahteinbringung und der Instrumentenführung anhand der neuartigen Visualisierung. Aufgrund der neuen Funktionen und der einfachen Integration in jeden Eingriff, der einen Bildwandler benötigt, hat der CamC ein großes Potential, die erste AR-Technologie in der Unfallchirurgie und Orthopädie zu werden.

Abstract

The intraoperative application of augmented reality (AR) has so far mainly taken place in the field of endoscopy. Here, the camera image of the endoscope was augmented by computer graphics derived mostly from preoperative imaging. Due to the complex setup and operation of the devices, they have not yet become part of routine clinical practice. The Camera Augmented Mobile C-arm (CamC) that extends a classic C-arm by a video camera and mirror construction is characterized by its uncomplicated handling. It combines its video live stream geometrically correct with the acquired X-ray. The clinical application of the device in 43 cases showed the strengths of the device in positioning for X-ray acquisition, incision placement, K-wire placement, and instrument guidance. With its new function and the easy integration into the OR workflow of any procedure that requires X-ray imaging, the CamC has the potential to become the first widely used AR technology for orthopedic and trauma surgery.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Abb. 1
Abb. 2
Abb. 3

Literatur

  1. Akatsuka Y, Kawamata T, Fujii M et al (2000) AR navigation system for neurosurgery. Medical Image Computing and Computer-Assisted Intervention (MICCAI), Third International Conference Pittsburgh, PA, USA

  2. Feuerstein M, Mussack T, Heining SM, Navab N (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27(3):355–369

    Article  PubMed  Google Scholar 

  3. Hirai N, Kosaka A, Kawamata T et al (2005) Image-guided neurosurgery system integrating AR-based navigation and open-MRI monitoring. Comput Aided Surg 10(2):59–72

    PubMed  Google Scholar 

  4. Konishi K, Hashizume M, Nakamoto M et al (2005) Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: application to 20 clinical cases. Int Congr Ser 1281:537–542

    Article  Google Scholar 

  5. Mischkowski RA, Zinser MJ, Kübler AC et al (2006) Application of an augmented reality tool for maxillary positioning in orthognathic surgery – a feasibility study. J Craniomaxillofac Surg 34(8):478–483

    Article  PubMed  Google Scholar 

  6. Nakamoto M, Ukimura O, Faber K, Gill IS (2012) Current progress on augmented reality visualization in endoscopic surgery. Curr Opin Urol 22(2):121–126

    Article  PubMed  Google Scholar 

  7. Navab N, Bani-Hashemi A, Mitschke M (1999) Merging visible and invisible: two camera-augmented mobile C-Arm (CAMC) applications. In: Augmented Reality, International Workshop on. IEEE Computer Society, Los Alamitos, CA, USA, p 134

  8. Navab N, Heining SM, Traub J (2009) Camera Augmented Mobile C-arm (CAMC): calibration, accuracy study and clinical applications. Medical Imaging, IEEE Transactions 99:1

  9. Okur A, Ahmadi SA, Bigdelou A, Wendler T, Navab N (2011) MR in OR: First analysis of AR/VR visualization in 100 intra-operative Freehand SPECT acquisitions. The 10th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, Oct. 26–29

  10. Shekhar R, Dandekar O, Bhat V et al (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24(8):1976–1985

    Article  PubMed  Google Scholar 

  11. Staden GV, Farrant K, Richards R, Bunker T (2000) Image intensifier position for hand and wrist fractures. Injury 31(5):351–352

    Article  PubMed  Google Scholar 

  12. Sutherland IE (1968) A head-mounted three dimensional display. Proceedings of the December 9–11, 1968, fall joint computer conference, part I, pp 757–764

  13. Teber D, Guven S, Simpfendörfer T et al (2009) Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56(2):332–338

    Article  PubMed  Google Scholar 

  14. Ukimura O, Gill IS (2008) Imaging-assisted endoscopic surgery: cleveland clinic experience. J Endourol 22(4):803–810

    Article  PubMed  Google Scholar 

  15. Ukimura O, Gill IS (2008) Imaging-assisted endoscopic surgery: cleveland clinic experience. J Endourol 22(4):803–810

    Article  PubMed  Google Scholar 

  16. Wang L, Traub J, Weidert S et al (2010) Parallax-free intra-operative X-ray image stitching. Med Image Anal 14(5):674–686

    Article  PubMed  Google Scholar 

Download references

Interessenkonflikt

Der korrespondierende Autor gibt für sich und seine Koautoren an, dass kein Interessenkonflikt besteht.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Weidert.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Weidert, S., Wang, L., von der Heide, A. et al. Intraoperative „Augmented-reality-Visualisierung“. Unfallchirurg 115, 209–213 (2012). https://doi.org/10.1007/s00113-011-2121-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00113-011-2121-8

Schlüsselwörter

Keywords

Navigation