3D Ultrasound to Stereoscopic Camera Registration through an Air-Tissue Boundary
A novel registration method between 3D ultrasound and stereoscopic cameras is proposed based on tracking a registration tool featuring both ultrasound fiducials and optical markers. The registration tool is pressed against an air-tissue boundary where it can be seen both in ultrasound and in the camera view. By localizing the fiducials in the ultrasound volume, knowing the registration tool geometry, and tracking the tool with the cameras, a registration is found. This method eliminates the need for external tracking, requires minimal setup, and may be suitable for a range of minimally invasive surgeries. A study of the appearance of ultrasound fiducials on an air-tissue boundary is presented, and an initial assessment of the ability to localize the fiducials in ultrasound with sub-millimeter accuracy is provided. The overall accuracy of registration (1.69 ± 0.60 mm) is a noticeable improvement over other reported methods and warrants patient studies.
KeywordsAugmented Reality Registration Method Camera View Stereo Camera Laparoscopic Partial Nephrectomy
- 1.Grimson, E., Leventon, M.: Clinical experience with a high precision image-guided neurosurgery system. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 63–73. Springer, Heidelberg (1998)Google Scholar
- 2.Fuchs, H., Livingston, M.A., Raskar, R., et al.: Augmented Reality Visualization for Laparoscopic Surgery. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 934–943. Springer, Heidelberg (1998)Google Scholar
- 5.Cheung, C.L., et al.: Fusion of stereoscopic video and laparoscopic ultrasound for minimally invasive partial nephrectomy. In: Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling. Proc. SPIE, vol. 7261, pp. 726109–726110 (2009)Google Scholar