Projective biomechanical depth matching for soft tissue registration in laparoscopic surgery
- 432 Downloads
A key component of computer- assisted surgery systems is the accurate and robust registration of preoperative planning data with intraoperative sensor data. In laparoscopic surgery, this image-based registration remains challenging due to soft tissue deformations. This paper presents a novel approach for biomechanical soft tissue registration of preoperative CT data with stereo endoscopic image data.
The proposed method consists of two registrations steps. First, we use a 3D surface mosaic from partial surfaces reconstructed from stereo endoscopic images to initially align the biomechanical model with the intraoperative position and shape of the organ. After this initialization, the biomechanical model is projected onto newly captured surfaces, resulting in displacement boundary conditions, which in turn are used to update the biomechanical model.
The method is evaluated in silico, using a human liver model, and in vivo, using porcine data. The quantitative in silico data shows a stable behaviour of the biomechanical model and root-mean-square deviation of volume vertices of under 3 mm with adjusted biomechanical parameters.
This work contributes a fully automatic featureless non-rigid registration approach. The results of the in silico and in vivo experiments suggest that our method is able to handle dynamic deformations during surgery. Additional experiments, especially regarding human tissue behaviour, are an important next step towards clinical applications.
KeywordsEndoscopic vision Biomechanical registration Minimally invasive procedures Intraoperative registration
The present research was supported by the Klaus Tschira Foundation.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
All applicable international, national and/or institutional guidelines for the care and use of animals were followed. All procedures performed in studies involving animals were in accordance with the ethical standards of the institution or practice at which the studies were conducted.
This article does not contain patient data.
- 4.Allan M, Kapoor A, Mewes P, Mountney P (2015) Non rigid registration of 3D images to laparoscopic video for image guided surgery. International workshop on computer-assisted and robotic endoscopy. Springer International Publishing, BerlinGoogle Scholar
- 5.Stefansic JD, Herline AJ, Shyr Y, Chapman WC, Fitzpatrick JM, Dawant BM, Galloway RL (2002) Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery. In: 5th IEEE EMBS international summer school on biomedical imaging. IEEE, p 12Google Scholar
- 8.Gupta T, Shin D, Sivagnanadasan N, Hoiem D (2016) 3DFS: deformable dense depth fusion and segmentation for object reconstruction from a handheld camera. arXiv:1606.05002
- 9.Newcombe RA, Fox D, Seitz SM (2015) Dynamicfusion: reconstruction and tracking of non-rigid scenes in real-time. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 343–352Google Scholar
- 10.Bregler C, Hertzmann A, Biermann H (2000) Recovering non-rigid 3D shape from image streams. In: Proceedings of IEEE conference on computer vision and pattern recognition, 2000, vol 2. IEEE, pp 690–696Google Scholar
- 14.Pratt P, Stoyanov D, Visentini-Scarzanella M, Yang G (2010) Dynamic guidance for robotic surgery using image-constrained biomechanical models. In: Medical image computing and computer-assisted intervention-MICCAI, pp 77–85Google Scholar
- 15.Oktay O, Zhang L, Mansi T, Mountney P, Mewes P, Nicolau S, Soler L, Chefd’hotel C (2013) Biomechanically driven registration of pre-to intra-operative 3D images for laparoscopic surgery. In: Medical image computing and computer-assisted intervention-MICCAI, pp 1–9Google Scholar
- 17.Collins T, Bartoli A, Bourdel N, Canis M (2016) Robust, real-time, dense and deformable 3D organ tracking in laparoscopic videos. In: International conference on medical image computing and computer-assisted intervention. Springer International Publishing (2016)Google Scholar
- 19.Rusu RB, Blodow N, Beetz M (2009) Fast point feature histograms (FPFH) for 3D registration. In: IEEE international conference on robotics and automation, 2009. ICRA’09. IEEEGoogle Scholar
- 20.Bodenstedt S, Goertler J,Wagner M, Kenngott H, Mïller-Stich B, Dillmann R, Speidel S (2016) Superpixel-based structure classification for laparoscopic surgery. In: Webster RJ, Yaniv ZR (eds) Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling, vol 9786. Bellingham. doi: 10.1117/12.2216750
- 26.Shi H (2007) Finite element modeling of soft tissue deformation. ProQuest Dissertations Publishing, University of LouisvilleGoogle Scholar