Abstract
We extended a system for augmented reality visualization to include the capability for instrument tracking. The original system is based on a video-see-through head-mounted display and features single-camera tracking. The tracking camera is head-mounted, rigidly fixed to a stereo pair of cameras that provide a live video view of a workspace. The tracker camera includes an infrared illuminator and works in conjunction with a set of retroreflective markers that are placed around the workspace. This marker frame configuration delivers excellent pose information for a stable overlay of graphics onto the video images. Using the single camera also for instrument tracking with relatively small marker clusters, however, encounters problems of marker identification and of noise in the pose data. We present a multilevel planar marker design, which we used to build a needle placement phantom. In this phantom, we achieved a stable augmentation; the user can see the location of the hidden target and the needle without perceptible jitter of the overlaid graphics. Piercing the needle through a foam window and hitting the target is then intuitive and comfortable. Over a hundred users have tested the system, and are consistently able to correctly place the needle on the 6mm target without prior training.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
M. Bajura, H. Fuchs, and R. Ohbuchi. “Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery within the Patient.” Proceedings of SIGGRAPH’ 92 (Chicago, IL, July 26–31, 1992). In Computer Graphics 26, #2 (July 1992): 203–210
.Andrei State, Mark A. Livingston, Gentaro Hirota, William F. Garrett, Mary C. Whitton, Henry Fuchs, and Etta D. Pisano, “Technologies for Augmented Reality Systems: realizing Ultrasound-Guided Needle Biopsies, “ Proceed. of SIGGRAPH (New Orleans, LA, August 4–9, 1996), in Computer Graphics Proceedings, Annual Conference Sereis1996, ACM SIGGRAPH, 439–446.
Michael Rosenthal, Andrei State, Joohi Lee, Gentaro Hirota, Jeremy Ackerman, Kurtis Keller, Etta D. Pisano, Michael Jiroutek, Keith Muller, and Henry Fuchs, “Augmented Reality Guidance for Needle Biopsies: A Randomized, Controlled Trial in Phantoms,” Proceedings of Medical Image Computing and Computer-Assisted Intervention-MICCAI 2001 (Utrecht, The Netherlands, October 14–17, 2001), Lecture Notes in Computer Science 2208, W. Niessen and M. Viergever (Eds.), Springer Berlin, Heidelberg, New York, pages 240–248, 2001.
Henry Fuchs, Mark A. Livingston, Ramesh Raskar, D’nardo Colucci, Kurtis Keller, Andrei State, Jessica R. Crawford, Paul Rademacher, Samual H. Drake, and Anthony A. Meyer, MD, “Augmented Reality Visualization for Laparoscopic Surgery, “ Proceedings of Medical Image Computing and Computer-Assisted Intervention-MICCAI’ 98 (Cambridge, MA, USA, October 11–13, 1998), 934–943.
W. Eric L. Grimson, Ron Kikinis, Ferenc A. Jolesz, and Peter McL. Black, “Image-Guided Surgery,” Scientific American, June, 1999, 62–69.
P.J. Edwards, D.J. Hawkes, DLG Hill, D. Jewell, R. Spink, A. Strong, and M. Gleeson, “Augmentation of Reality in the Stereo Operating Microscope for Otolaryngology and Neurosurgical Guidance,” Computer Aided Surgery 1:172–178, 1995.
King AP, Edwards PJ, Maurer CR, deCunha DA, Gaston RP, Clarkson M, Hill DLG, Hawkes DJ, Fenlon MR, Strong AJ, Cox TCS, Gleeson, MJ, “Stereo augmented reality in the surgical microscope,” Presence: Teleoperators and virtual environments 9:360–368 2000.
W. Birkfellner, K. Huber, F. Watzinger, M. Figl, F. Wanschitz, R. Hanel, D. Rafolt, R. Ewers, and H. Bergmann, “Development of the Varisocope AR, a See-through HMD for Computer-Aided Surgery,” IEEE and ACM Int. Symp. On Augmented Reality-ISAR 2000 (Munich, Germany, October 5–6, 2000), pages 54–59.
J.P. Rolland and H. Fuchs, “Optical versus Video See-Through Head-Mounted Displays in Medical Visualization,” Presence (Massachusetts Institute of Technology), Vol. 9, No. 3, June 2000, pages 287–309.
F. Sauer, F. Wenzel, S. Vogt, Y. Tao, Y. Genc, and A. Bani-Hashemi, “Augmented Workspace: Designing an AR Testbed,” IEEE and ACM Int. Symp. On Augmented Reality-ISAR 2000 (Munich, Germany, October 5–6, 2000), pages 47–53.
Calvin Maurer, Frank Sauer, Chris Brown, Bo Hu, Benedicte Bascle, Bernhard Geiger, Fabian Wenzel, Robert Maciunas, Robert Bakos, and Ali Bani-Hashemi, “Augmented Reality Visualization of Brain Structures with Stereo and Kinetic Depth Cues: System Description and Initial Evaluation with Head Phantom,” talk presented at SPIE’s Int. Symp. on Medical Imaging 2001 (San Diego, CA, February 2001).
Frank Sauer, Ali Khamene, Benedicte Bascle, and G.J. Rubino, “A Head-Mounted Display System for Augmented Reality Image Guidance: Towards Clinical Evaluation for iMRI-guided Neurosurgery,” Proceedings of Medical Image Computing and Computer-Assisted Intervention-MICCAI 2001 (Utrecht, The Netherlands, October 14–17, 2001), Lecture Notes in Computer Science 2208, W. Niessen and M. Viergever (Eds.), Springer Berlin, Heidelberg, New York, pages 707–716.
Frank Sauer, Ali Khamene, Benedicte Bascle, Sebastian Vogt, and Gregory J. Rubino, “Augmented Reality Visualization in iMRI Operating Room: System Description and Pre-Clinical Testing,” to appear in SPIE Proceed. of Medical Imaging, San Diego, February 2002.
Frank Sauer, Ali Khamene, Benedicte Bascle, Lars Schimmang, Fabian Wenzel, and Sebastian Vogt, “Augmented Reality Visualization of Ultrasound Images: System Description, Calibration, and Features,” IEEE and ACM Int. Symp. On Augmented Reality-ISAR 2001 (New York, NY, October 29–30, 2001), pages 30–39.
Frank Sauer, Ali Khamene, Benedicte Bascle, and Sebastian Vogt, “An Augmented Reality System for Ultrasound Guided Needle Biopsies,” Medicine Meets Virtual Reality MMVR 02/10 (Newport Beach, CA, January 2002), J.D. Westwood et al. (Eds.), IOS Press, 2002, pages 455–460.
Roger Y. Tsai, “A versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses”, IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, August 1987, pages 323–344.
http://www.cs.cmu.edu/~cil/v-source.html: freeware implementation of the Tsai algorithm.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sauer, F., Khamene, A., Vogt, S. (2002). An Augmented Reality Navigation System with a Single-Camera Tracker: System Design and Needle Biopsy Phantom Trial. In: Dohi, T., Kikinis, R. (eds) Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002. MICCAI 2002. Lecture Notes in Computer Science, vol 2489. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45787-9_15
Download citation
DOI: https://doi.org/10.1007/3-540-45787-9_15
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44225-7
Online ISBN: 978-3-540-45787-9
eBook Packages: Springer Book Archive