Augmented Reality System for Oral Surgery Using 3D Auto Stereoscopic Visualization

  • Huy Hoang Tran
  • Hideyuki Suenaga
  • Kenta Kuwana
  • Ken Masamune
  • Takeyoshi Dohi
  • Susumu Nakajima
  • Hongen Liao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6891)

Abstract

We present an augmented reality system for oral and maxillofacial surgery in this paper. Instead of being displayed on a separated screen, three-dimensional (3D) virtual presentations of osseous structures and soft tissues are projected onto the patient’s body, providing surgeons with exact knowledge of depth information of high risk tissues inside the bone. We employ a 3D integral imaging technique which produce motion parallax in both horizontal and vertical direction over a wide viewing area in this study. In addition, surgeons are able to check the progress of the operation in real-time through an intuitive 3D based interface which is content-rich, hardware accelerated. These features prevent surgeons from penetrating into high risk areas and thus help improve the quality of the operation. Operational tasks such as hole drilling, screw fixation were performed using our system and showed an overall positional error of less than 1mm . Feasibility of our system was also verified with a human volunteer experiment.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Germano, I.M., Villalobos, H., Silvers, A., Post, K.D.: Clinical use of the optical digitizer for intracranial neuronavigation 45, 261–269 (1999)Google Scholar
  2. 2.
    Plaweski, S., Cazal, J., Rosell, P., Merloz, P.: Anterior cruciate ligament reconstruction using navigation: a comparative study on 60 patients. The American Journal of Sports Medicine 34, 542–552 (2006)CrossRefGoogle Scholar
  3. 3.
    Hassfeld, S., Muehling, J.: Computer assisted oral and maxillofacial surgery: A review and an assessment of technology. Int. Oral Maxillofac Surg. 30, 2–13 (2001)CrossRefGoogle Scholar
  4. 4.
    Blackwell, M., Nikou, C., M.DiGioia, A., Kanade, T.: An Image Overlay system for medical data visualization. Medical Image Analysis 4, 67–72 (2000)Google Scholar
  5. 5.
    Traub, J., Sielhorst, T., Heining, S.M., Navab, N.: Advanced Display and Visualization Concepts for Image Guided Surgery. Journal of Display Technology 4, 483–490 (2008)CrossRefGoogle Scholar
  6. 6.
    Liao, H., Nakajima, S., Iwahara, M., Kobayashi, E., Sakuma, I., Yahagi, N., Dohi, T.: Development of Real-Time 3D Navigation System for Intra-operative Information by Integral Videography. Journal of Japan Society of Computer Aided Surgery 2, 245–252 (2000)CrossRefMATHGoogle Scholar
  7. 7.
    Liao, H., Iwahara, M., Hata, N., Dohi, T.: High-quality integral videography using a multi-projector. Optics Express 12, 1067–1076 (2004)CrossRefGoogle Scholar
  8. 8.
    Liao, H., Inomata, K., Sakuma, I., Dohi, T.: 3-D Augmented Reality for MRI-guided Surgery using Integral Videography Autostereoscopic-image Overlay. IEEE Transactions on Biomedical Engineering 57, 1476–1486 (2010)CrossRefGoogle Scholar
  9. 9.
    Lippmann, M.G.: Epreuves reversibles donnant la sensation du relief. J. de Phys. 7, 821–825 (1908)Google Scholar
  10. 10.
    Liao, H., Nomura, K., Dohi, T.: Autostereoscopic Integral Photography Imaging using Pixel Distribution of Computer Graphics Generated Image. In: ACM SIGGRAPH (2005)Google Scholar
  11. 11.
    Levoy, M.: Hanrahan, p.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42 (1996)Google Scholar
  12. 12.
    Fernando, R., Kilgard, M.J.: The Cg Tutorial. Addison-Wesley Professional, Reading (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Huy Hoang Tran
    • 1
  • Hideyuki Suenaga
    • 2
  • Kenta Kuwana
    • 1
  • Ken Masamune
    • 1
  • Takeyoshi Dohi
    • 1
  • Susumu Nakajima
    • 2
  • Hongen Liao
    • 1
  1. 1.The University of TokyoJapan
  2. 2.The University of Tokyo HospitalJapan

Personalised recommendations