Abstract
This work presents a framework for mapping of free-hand endoscopic views onto 3D anatomical model constructed from ultrasound images without the use of external trackers. It is non-disruptive in terms of existing surgical workflow as surgeons do not need to accommodate operational constraints associated with the use of additionally installed motion sensors or tracking systems. A passive fiducial marker is attached to the tip of the endoscope to create a geometric eccentricity that encodes the position and orientation of the camera. The relative position between the endoscope and the anatomical model under the ultrasound image reference frame is used to establish a texture map that overlays endoscopic views onto the surface of the model. This addresses operational challenges including the limited field-of-view (FOV) and the lack of 3D perspective associated with minimally invasive procedure. Experimental results show that average tool position and orientation errors are 1.32 mm and 1.6o respectively. The R.M.S. error of the overall image mapping obtained based on comparison of dimension of landmarks is 3.30 mm with standard deviation of 2.14 mm. The feasibility of the framework is also demonstrated through implementations on a phantom model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ville, Y., Hyett, J., Hecher, K., Nicolaides, K.: Preliminary Experience with Endoscopic Laser Surgery for Severe Twin-to-Twin Transfusion Syndrome. N. Engl. J. Med. 332(4), 224–227 (1995)
Ville, Y., Hecher, K., Gagnon, A., Sebire, N., Hyett, J., Nicolaides, K.: Endoscopic laser coagulation in the management of severe twin-to-twin transfusion syndrome. BJOG: An International Journal of Obstetrics & Gynaecology 105(4), 446–453 (1998)
Bruner, J.P., Anderson, T.L., Rosemond, R.L.: Placental pathophysiology of the twin oligohydramnios-polyhydramnios sequence and the twin-twin transfusion syndrome. Placenta 19(1), 81–86 (1998)
Fowler, S.F., Sydorak, R.M., Albanese, C.T., Farmer, D.L., Harrison, M.R., Lee, H.: Fetal endoscopic surgery: Lessons learned and trends reviewed. J. Pediatr Surg. 37(12), 1700–1702 (2002)
Rauskolb, R.: Fetoscopy–a new endoscopic approach. Endoscopy 11(2), 107–113 (1979)
Reeff, M., Gerhard, F., Szekely, G.: Mosaicing of Endoscopic Placenta Images. GI Jahrestagung (2006)
Liao, H., Tsuzuki, M., Kobayashi, E., Sakuma, I.: GPU-based Fast 3D Ultrasound-Endoscope Image Fusion for Complex-Shaped Objects. In: Dossel, O., Schlegel, W. (eds.) World Congress on Medical Physics and Biomedical Engineering, pp. 206–209. Springer, Heidelberg (2009)
Liao, H., Tsuzuki, M., Mochizuki, T., Kobayashi, E., Chiba, T., Sakuma, I.: Fast image mapping of endoscopic image mosaics with 3D ultrasound image for intrauterine fetal surgery. Minimally Invasive Therapy & Allied Technologies 18(6), 332–340 (2009)
Cleary, K., Peters, T.M.: Image-Guided Interventions Technology Review and Clinical Applications. Annu. Rev. Biomed. Eng. 12, 119–142 (2010)
Stoll, J., Novotny, P., Howe, R., Dupont, P.: Real-time 3D ultrasound-based servoing of a surgical instrument. In: IEEE International Conference on Robotics and Automation, pp. 613–618 (2006)
Novotny, P.M., Stoll, J., Vasilyev, N.V., del Nido, P.J., Dupont, P.E., Zickler, T.E., Howe, R.D.: GPU based real-time instrument tracking with three-dimensional ultrasound. Med. Image Anal. 11(5), 458–464 (2007)
Stoll, J., Ren, H., Dupont, P.: Passive Markers for Tracking Surgical Instruments in Real-Time 3-D Ultrasound Imaging. IEEE T. Med. Imaging 31, 563–575 (2012)
Mung, J., Vignon, F., Jain, A.: A Non-disruptive Technology for Robust 3D Tool Tracking for Ultrasound-Guided Interventions. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part I. LNCS, vol. 6891, pp. 153–160. Springer, Heidelberg (2011)
Draper, K.J., Blake, C.C., Gowman, L., Downey, D.B., Fenster, A.: An algorithm for automatic needle localization in ultrasound-guided breast biopsies. Med. Phys. 27, 1971–1979 (2000)
Yang, L., Wang, J., Kobayashi, E., Liao, H., Yamashita, H., Sakuma, I., Chiba, T.: Ultrasound Image-based Endoscope Localization for Minimally Invasive Fetoscopic Surgery. In: IEEE International Conference on Engineering in Medicine and Biology Conference, pp. 1411–1413 (2013)
Yang, L., Wang, J., Kobayashi, E., Liao, H., Yamashita, H., Sakuma, I., Chiba, T.: An intraoperative framework for mapping of untracked endoscopic vision to 3D ultrasound placenta. Int J. Cars 8(suppl. 1), 152–153 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, L. et al. (2013). Ultrasound Image-Guided Mapping of Endoscopic Views on a 3D Placenta Model: A Tracker-Less Approach. In: Liao, H., Linte, C.A., Masamune, K., Peters, T.M., Zheng, G. (eds) Augmented Reality Environments for Medical Imaging and Computer-Assisted Interventions. MIAR AE-CAI 2013 2013. Lecture Notes in Computer Science, vol 8090. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40843-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-40843-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40842-7
Online ISBN: 978-3-642-40843-4
eBook Packages: Computer ScienceComputer Science (R0)