Belief Propagation for Depth Cue Fusion in Minimally Invasive Surgery
In minimally invasive surgery, dense 3D surface reconstruction is important for surgical navigation and integrating pre- and intra-operative data. Despite recent developments in 3D tissue deformation techniques, their general applicability is limited by specific constraints and underlying assumptions. The need for accurate and robust tissue deformation recovery has motivated research into fusing multiple visual cues for depth recovery. In this paper, a Markov Random Field (MRF) based Bayesian belief propagation framework has been proposed for the fusion of different depth cues. By using the underlying MRF structure to ensure spatial continuity in an image, the proposed method offers the possibility of inferring surface depth by fusing the posterior node probabilities in a node’s Markov blanket together with the monocular and stereo depth maps. Detailed phantom validation and in vivo results are provided to demonstrate the accuracy, robustness, and practical value of the technique.
KeywordsRobotic Assisted Surgery Image Guided Intervention Intra-operative Navigation Markov Random Fields Belief Networks
Unable to display preview. Download preview PDF.
- 3.Bozma, H.I., Duncan, J.S.: Integration of vision modules: a game-theoretic framework. In: Proc. CVPR (1991)Google Scholar
- 5.Deguchi, K., Okatani, T.: Shape reconstruction from an endoscope image by shape-from-shading technique for a point light source at the projection center. In: Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis (1996)Google Scholar
- 7.Saxena, A., Schulte, J., Ng, A.: Depth Estimation using Monocular and Stereo Cues. Proc. IJCAI (2007)Google Scholar
- 9.Shi, J., Tomasi, C.: Good Features to Track, Cornell University (1993)Google Scholar
- 11.Pilu, M.: A direct method for stereo correspondence based on singular value decomposition. In: Proc. CVPR. IEEE Computer Society, Los Alamitos (1997)Google Scholar
- 12.Ikeuchi, K., Horn, B.K.P.: Numerical shape from shading and occluding boundaries. In: Shape from shading, pp. 245–299. MIT Press, Cambridge (1989)Google Scholar