Image-based laparoscopic bowel measurement
- 367 Downloads
Minimally invasive interventions offer benefits for patients, while also entailing drawbacks for surgeons, such as the loss of depth perception. Thus estimating distances, which is of particular importance in gastric bypasses, becomes difficult. In this paper, we propose an approach based on stereo endoscopy that segments organs on-the-fly and measures along their surface during a minimally invasive interventions. Here, the application of determining the length of bowel segments during a laparoscopic bariatric gastric bypass is the main focus, but the proposed method can easily be used for other types of measurements, e.g., the size of a hernia.
As input, image pairs from a calibrated stereo endoscope are used. Our proposed method is then divided into three steps: First, we located structures of interest, such as organs and instruments, via random forest segmentation. Two modes of instrument detection are used. The first mode is based on an automatic segmentation, and the second mode uses input from the user. These regions are then reconstructed, and the distance along the surface of the reconstruction is measured. For measurement, we propose three methods. The first one is based on the direct distance of the instruments, while the second one finds the shortest path along a surface. The third method smooths the shortest path with a spline interpolation. Our measuring system is currently one shot, meaning a signal to begin a measurement is required.
To evaluate our approach, data sets from multiple users were recorded during minimally invasive bowel measurements performed on phantoms and pigs. On the phantom data sets, the overall average error was \(12.5\,\pm \,9.4\,\%\) on shorter pieces of bowel (\(\sim \)5 cm) and \(7.8\,\pm \,8.7\,\%\) on longer pieces (\(\sim \)10 cm). On the porcine data sets, the average error was \(17.7\,\pm \,13.3\,\%\).
We present and evaluate a novel approach that makes measuring on-the-fly during minimally invasive surgery possible. Furthermore, we compare different methods for determining the length of bowel segments. The only requirement for our approach is a calibrated stereo endoscope, thereby keeping the impact on the surgical workflow to a minimum.
KeywordsEndoscopy Quantitative endoscopy Segmentation Instrument and patient localization Augmented reality
The present research was conducted within the setting of Project A01 of the SFB/Transregio 125 “Cognition-Guided Surgery” funded by the German Research Foundation. It is furthermore sponsored by the European Social Fund of the State Baden-Wuerttemberg. We would also like to thank Simon Mayer of the Pforzheim School of Design for his GUI design.
Compliance with ethical standards
Conflict of interest
Sebastian Bodenstedt, Martin Wagner, Benjamin Mayer, Katherine Stemmer, Hannes Kenngott, Beat Müller-Stich, Rüdiger Dillmann and Stefanie Speidel declare that they have no conflict of interest.
All institutional and national guidelines for the care and use of laboratory animals were followed.
- 3.Field M, Clarke D, Strup S, Seales WB (2009) Stereo endoscopy as a 3-d measurement tool. In: Engineering in medicine and biology society, 2009. EMBC 2009. Annual international conference of the IEEE, pp 5748–5751Google Scholar
- 5.Bradski G (2000) The opencv library. Dr. Dobb’s J Softw Tools 25:120–126Google Scholar
- 6.Schroff F, Criminisi A, Zisserman A (2008) Object class segmentation using random forests. 54.1–54.10. doi: 10.5244/C.22.54
- 8.Maier-Hein L, Groch A, Bartoli A, Bodenstedt S, Boissonnat G, Chang PL, Clancy NT, Elson DS, Haase S, Heim E, Hornegger J, Jannin P, Kenngott H, Kilgus T, Müller-Stich B, OladokunD Röhl S, Dos Santos TR, Schlemmer HP, Seitel A, Speidel S, Wagner M, Stoyanov D (2014) Comparative validation of single-shot optical techniques for laparoscopic 3-D surface reconstruction. IEEE Trans Med Imaging 33(10):1913–1930. doi: 10.1109/TMI.2014.2325607 CrossRefPubMedGoogle Scholar
- 10.Surazhsky V, Surazhsky T, Kirsanov D, Gortler SJ, Hoppe H (2005) Fast exact and approximate geodesics on meshes. ACM TOG 24:553–560 ACMGoogle Scholar
- 11.Lipman Y, Chen X, Daubechies I, Funkhouser T (2010) Symmetry factored embedding and distance. ACM TOG 29:103 ACMGoogle Scholar