Tissue Deformation Recovery with Gaussian Mixture Model Based Structure from Motion
Accurate 3D reconstruction of the surgical scene is important in intra-operative guidance. Existing methods are often based on the assumption that the camera is static or the tissue is deforming with periodic motion. In minimally invasive surgery, these assumptions do not always hold due to free-form tissue deformation induced by instrument-tissue interaction and camera motion required for continuous exploration of the surgical scene, particularly for intraluminal procedures. The aim of this work is to propose a novel framework for intra-operative free-form deformation recovery. The proposed method builds on a compact scene representation scheme that is suitable for both surgical episode identification and instrument-tissue motion modeling. Unlike previous approaches, it does not impose explicit models on tissue deformation, allowing realistic free-form deformation recovery. Validation is provided on both synthetic and phantom data. The practical value of the method is further demonstrated by deformation recovery on in vivo data recorded from a robotic assisted minimally invasive surgical procedure.
KeywordsGaussian Mixture Model Minimally Invasive Surgery Camera Motion Tissue Deformation Structure From Motion
Unable to display preview. Download preview PDF.
- 2.Hager, G., Vagvolgyi, B., Yuh, D.: Stereoscopic video overlay with deformable registration. Medicine Meets Virtual Reality (2007)Google Scholar
- 3.Garcya, O., Civera, J., Gueme, A., Munoz, V., Montiel, J.: Real-time 3d modeling from endoscope image sequences. In: Workshop on Advanced Sensing and Sensor Integration in Medical Robotics, IEEE International Conference on Robotics and Automation (2009)Google Scholar
- 4.Mirota, D., Wang, H., Taylor, R.H., Ishii, M., Hager, G.D.: Toward Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 91–99. Springer, Heidelberg (2009)CrossRefGoogle Scholar
- 6.Hu, M., Penney, G.P., Rueckert, D., Edwards, P.J., Bello, F., Casula, R., Figl, M., Hawkes, D.J.: Non-rigid Reconstruction of the Beating Heart Surface for Minimally Invasive Cardiac Surgery. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 34–42. Springer, Heidelberg (2009)CrossRefGoogle Scholar
- 8.Stoyanov, D., Visentini-Scarzanella, M., Pratt, P., Yang, G.Z.: Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery. In: Jiang, T., et al. (eds.) MICCAI 2010, Part I. LNCS, vol. 6361, pp. 275–282. Springer, Heidelberg (2010)Google Scholar
- 10.Giannarou, S., Yang, G.Z.: Content-based surgical workflow representation using probabilistic motion modeling. In: International Workshop on Medical Imaging and Augmented Reality, pp. 314–323 (2010)Google Scholar
- 11.Giannarou, S., Visentini-Scarzanella, M., Yang, G.Z.: Affine-invariant anisotropic detector for soft tissue tracking in minimally invasive surgery. In: IEEE International Symposium on Biomedical Imaging, pp. 1059–1062 (2009)Google Scholar
- 13.Mosteller, E., Turkey, J.: Data and analysis and regression. Addison Wesley (1977)Google Scholar
- 14.Sanchez-Riera, J., Ostlund, J., Fua, P., Moreno-Noguer, F.: Simultaneous pose, correspondence, and non-rigid shape. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1189–1196 (2010)Google Scholar