Abstract
Information about the 3D shape and motion of tissue surfaces at the surgical site during minimally invasive surgery is important for providing metric measurements that enable the deployment of image-guidance and enhanced robotic control. This article presents a scene flow algorithm that recovers the deformation and 3D structure of the surgical field-of-view from stereoscopic images by propagating information starting from a sparse set of candidate seed matches. By imposing spatial and temporal constraints the proposed algorithm is able to reconstruct dense 3D scene flow accurately and efficiently. Validation is performed using simulation data to evaluate the method against varying levels of image noise and results are also presented for benchmark phantom model data. The practical value of proposed method is shown by qualitative results for in vivo videos from robotic assisted procedures.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Mountney, P., Yang, G.-Z.: Motion Compensated SLAM for Image Guided Surgery. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part II. LNCS, vol. 6362, pp. 496–504. Springer, Heidelberg (2010)
Mirota, D.J., et al.: Vision-Based Navigation in Image-Guided Interventions. Ann. Rev. Biomed. Eng. 13, 297–319 (2011)
Hager, G., et al.: Surgical and interventional robotics: part III [Tutorial]. IEEE Robot. Autom. Mag. 15, 84–93 (2008)
Stoyanov, D.: Surgical Vision. Ann. Biomed. Eng. 40, 332–334 (2012)
Devernay, F., et al.: Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery. In: MIAR (2001)
Stoyanov, D., et al.: Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part II. LNCS, vol. 6362, pp. 275–282. Springer, Heidelberg (2010)
Röhl, S., et al.: Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration. Med. Phys. 39, 1632–1645 (2012)
Clancy, N.T., et al.: Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging. Biomed. Opt. Express. 11, 3119–3128 (2011)
Penne, J., Höller, K., Stürmer, M., Schrauder, T., Schneider, A., Engelbrecht, R., Feußner, H., Schmauss, B., Hornegger, J.: Time-of-Flight 3-D Endoscopy. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 467–474. Springer, Heidelberg (2009)
Stoyanov, D., et al.: Soft-tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 139–146. Springer, Heidelberg (2005)
Paul, P., et al.: A Surface Registration Method for Quantification of Intraoperative Brain Deformations in Image-Guided Neurosurgery. IEEE Trans. Inf. Tech. Biomed. 13, 976–983 (2009)
Richa, R., et al.: Towards robust 3D visual tracking for motion compensation in beating heart surgery. Med. Image Anal. 15, 302–315 (2011)
Deguchi, D., Mori, K., Suenaga, Y., Hasegawa, J.-I., Toriwaki, J.-I., Takabatake, H., Natori, H.: New Image Similarity Measure for Bronchoscope Tracking Based on Image Registration. In: Ellis, R.E., Peters, T.M. (eds.) MICCAI 2003. LNCS, vol. 2878, pp. 399–406. Springer, Heidelberg (2003)
Jianfei, L., et al.: A stable optic-flow based method for tracking colonoscopy images. In: CVPRW, pp. 1–8 (2008)
Mori, K., et al.: Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images. Med. Imag. Anal. 6, 321–336 (2002)
Cech, J., et al.: Scene flow estimation by growing correspondence seeds. In: CVPR, pp. 3129–3136 (2011)
Wedel, A., et al.: Stereoscopic Scene Flow Computation for 3D Motion Understanding. Int. J. Comp. Vis. 95, 29–51 (2011)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Press (2000)
Lhuillier, M., et al.: Robust dense matching using local and global geometric constraints. In: ICPR, pp. 1968–1972 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stoyanov, D. (2012). Stereoscopic Scene Flow for Robotic Assisted Minimally Invasive Surgery. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012. MICCAI 2012. Lecture Notes in Computer Science, vol 7510. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33415-3_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-33415-3_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33414-6
Online ISBN: 978-3-642-33415-3
eBook Packages: Computer ScienceComputer Science (R0)