Abstract
In minimally invasive surgery, dense 3D surface reconstruction is important for surgical navigation and integrating pre- and intra-operative data. Despite recent developments in 3D tissue deformation techniques, their general applicability is limited by specific constraints and underlying assumptions. The need for accurate and robust tissue deformation recovery has motivated research into fusing multiple visual cues for depth recovery. In this paper, a Markov Random Field (MRF) based Bayesian belief propagation framework has been proposed for the fusion of different depth cues. By using the underlying MRF structure to ensure spatial continuity in an image, the proposed method offers the possibility of inferring surface depth by fusing the posterior node probabilities in a node’s Markov blanket together with the monocular and stereo depth maps. Detailed phantom validation and in vivo results are provided to demonstrate the accuracy, robustness, and practical value of the technique.
Chapter PDF
Similar content being viewed by others
Keywords
References
Delingette, H., et al.: Computational Models for Image-Guided Robot-Assisted and Simulated Medical Interventions. Proceedings of the IEEE 94(9), 1678–1688 (2006)
Pankanti, S., Jain, A.K.: Integrating vision modules: stereo, shading, grouping, and line labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(9), 831–842 (1995)
Bozma, H.I., Duncan, J.S.: Integration of vision modules: a game-theoretic framework. In: Proc. CVPR (1991)
Shah, J., Pien, H.H., Gauch, J.M.: Recovery of surfaces with discontinuities by fusing shading and range data within a variational framework. IEEE Transactions on Image Processing 5(8), 1243–1251 (1996)
Deguchi, K., Okatani, T.: Shape reconstruction from an endoscope image by shape-from-shading technique for a point light source at the projection center. In: Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis (1996)
Stoyanov, D., Darzi, A., Yang, G.Z.: Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 41–48. Springer, Heidelberg (2004)
Saxena, A., Schulte, J., Ng, A.: Depth Estimation using Monocular and Stereo Cues. Proc. IJCAI (2007)
Stoyanov, D., Darzi, A., Yang, G.-Z.: Laparoscope Self-calibration for Robotic Assisted Minimally Invasive Surgery. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3750, pp. 114–121. Springer, Heidelberg (2005)
Shi, J., Tomasi, C.: Good Features to Track, Cornell University (1993)
Matas, J., et al.: Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing 22(10), 761–767 (2004)
Pilu, M.: A direct method for stereo correspondence based on singular value decomposition. In: Proc. CVPR. IEEE Computer Society, Los Alamitos (1997)
Ikeuchi, K., Horn, B.K.P.: Numerical shape from shading and occluding boundaries. In: Shape from shading, pp. 245–299. MIT Press, Cambridge (1989)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lo, B., Scarzanella, M.V., Stoyanov, D., Yang, GZ. (2008). Belief Propagation for Depth Cue Fusion in Minimally Invasive Surgery. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2008. MICCAI 2008. Lecture Notes in Computer Science, vol 5242. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85990-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-85990-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85989-5
Online ISBN: 978-3-540-85990-1
eBook Packages: Computer ScienceComputer Science (R0)