Advertisement

Image-based laparoscopic bowel measurement

  • Sebastian Bodenstedt
  • Martin Wagner
  • Benjamin Mayer
  • Katherine Stemmer
  • Hannes Kenngott
  • Beat Müller-Stich
  • Rüdiger Dillmann
  • Stefanie Speidel
Original Article

Abstract

Purpose

Minimally invasive interventions offer benefits for patients, while also entailing drawbacks for surgeons, such as the loss of depth perception. Thus estimating distances, which is of particular importance in gastric bypasses, becomes difficult. In this paper, we propose an approach based on stereo endoscopy that segments organs on-the-fly and measures along their surface during a minimally invasive interventions. Here, the application of determining the length of bowel segments during a laparoscopic bariatric gastric bypass is the main focus, but the proposed method can easily be used for other types of measurements, e.g., the size of a hernia.

Methods

As input, image pairs from a calibrated stereo endoscope are used. Our proposed method is then divided into three steps: First, we located structures of interest, such as organs and instruments, via random forest segmentation. Two modes of instrument detection are used. The first mode is based on an automatic segmentation, and the second mode uses input from the user. These regions are then reconstructed, and the distance along the surface of the reconstruction is measured. For measurement, we propose three methods. The first one is based on the direct distance of the instruments, while the second one finds the shortest path along a surface. The third method smooths the shortest path with a spline interpolation. Our measuring system is currently one shot, meaning a signal to begin a measurement is required.

Results

To evaluate our approach, data sets from multiple users were recorded during minimally invasive bowel measurements performed on phantoms and pigs. On the phantom data sets, the overall average error was \(12.5\,\pm \,9.4\,\%\) on shorter pieces of bowel (\(\sim \)5 cm) and \(7.8\,\pm \,8.7\,\%\) on longer pieces (\(\sim \)10 cm). On the porcine data sets, the average error was \(17.7\,\pm \,13.3\,\%\).

Conclusion

We present and evaluate a novel approach that makes measuring on-the-fly during minimally invasive surgery possible. Furthermore, we compare different methods for determining the length of bowel segments. The only requirement for our approach is a calibrated stereo endoscope, thereby keeping the impact on the surgical workflow to a minimum.

Keywords

Endoscopy Quantitative endoscopy Segmentation  Instrument and patient localization Augmented reality 

Notes

Acknowledgments

The present research was conducted within the setting of Project A01 of the SFB/Transregio 125 “Cognition-Guided Surgery” funded by the German Research Foundation. It is furthermore sponsored by the European Social Fund of the State Baden-Wuerttemberg. We would also like to thank Simon Mayer of the Pforzheim School of Design for his GUI design.

Compliance with ethical standards

Conflict of interest

Sebastian Bodenstedt, Martin Wagner, Benjamin Mayer, Katherine Stemmer, Hannes Kenngott, Beat Müller-Stich, Rüdiger Dillmann and Stefanie Speidel declare that they have no conflict of interest.

Ethics

All institutional and national guidelines for the care and use of laboratory animals were followed.

References

  1. 1.
    Schauer PR, Ikramuddin S, Hamad G, Eid GM, Mattar S, Cottam D, Ramanathan R, Gourash W (2003) Laparoscopic gastric bypass surgery: current technique. J Laparoendosc Adv Surg Tech 13(4):229–239CrossRefGoogle Scholar
  2. 2.
    Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3d surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996CrossRefPubMedGoogle Scholar
  3. 3.
    Field M, Clarke D, Strup S, Seales WB (2009) Stereo endoscopy as a 3-d measurement tool. In: Engineering in medicine and biology society, 2009. EMBC 2009. Annual international conference of the IEEE, pp 5748–5751Google Scholar
  4. 4.
    Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRefGoogle Scholar
  5. 5.
    Bradski G (2000) The opencv library. Dr. Dobb’s J Softw Tools 25:120–126Google Scholar
  6. 6.
    Schroff F, Criminisi A, Zisserman A (2008) Object class segmentation using random forests. 54.1–54.10. doi: 10.5244/C.22.54
  7. 7.
    Röhl S, Bodenstedt S, Suwelack S, Kenngott H, Müller-Stich BP, Dillmann R, Speidel S (2012) Dense gpu-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration. Med Phys 39:1632CrossRefPubMedGoogle Scholar
  8. 8.
    Maier-Hein L, Groch A, Bartoli A, Bodenstedt S, Boissonnat G, Chang PL, Clancy NT, Elson DS, Haase S, Heim E, Hornegger J, Jannin P, Kenngott H, Kilgus T, Müller-Stich B, OladokunD Röhl S, Dos Santos TR, Schlemmer HP, Seitel A, Speidel S, Wagner M, Stoyanov D (2014) Comparative validation of single-shot optical techniques for laparoscopic 3-D surface reconstruction. IEEE Trans Med Imaging 33(10):1913–1930. doi: 10.1109/TMI.2014.2325607 CrossRefPubMedGoogle Scholar
  9. 9.
    Lorensen WE, Cline HE (1987) Marching cubes: a high resolution 3d surface construction algorithm. ACM Siggraph Comput Graph 21:163–169 ACMCrossRefGoogle Scholar
  10. 10.
    Surazhsky V, Surazhsky T, Kirsanov D, Gortler SJ, Hoppe H (2005) Fast exact and approximate geodesics on meshes. ACM TOG 24:553–560 ACMGoogle Scholar
  11. 11.
    Lipman Y, Chen X, Daubechies I, Funkhouser T (2010) Symmetry factored embedding and distance. ACM TOG 29:103 ACMGoogle Scholar
  12. 12.
    Dijkstra EW (1959) A note on two problems in connexion with graphs. Numer Math 1(1):269–271CrossRefGoogle Scholar

Copyright information

© CARS 2015

Authors and Affiliations

  • Sebastian Bodenstedt
    • 1
  • Martin Wagner
    • 2
  • Benjamin Mayer
    • 2
  • Katherine Stemmer
    • 2
  • Hannes Kenngott
    • 2
  • Beat Müller-Stich
    • 2
  • Rüdiger Dillmann
    • 1
  • Stefanie Speidel
    • 1
  1. 1.Institute for Anthropomatics and RoboticsKarlsruhe Institute of Technology (KIT)KarlsruheGermany
  2. 2.Department of General, Visceral and Transplant SurgeryUniversity of HeidelbergHeidelbergGermany

Personalised recommendations