Skip to main content

Fast Semi-dense Surface Reconstruction from Stereoscopic Video in Laparoscopic Surgery

  • Conference paper
Information Processing in Computer-Assisted Interventions (IPCAI 2014)

Abstract

Liver resection is the main curative option for liver metastases. While this offers a 5-year survival rate of 50%, only about 20% of all patients are suitable for laparoscopic resection and thus being able to take advantage of minimally invasive surgery. One underlying difficulty is the establishment of a safe resection margin while avoiding critical structures. Intra-operative registration of patient scan data may provide a solution. However, this relies on fast and accurate reconstruction methods to obtain the current shape of the liver. Therefore, this paper presents a method for high-resolution stereoscopic surface reconstruction at interactive rates. To this end, a feature-matching propagation method is adapted to multi-resolution processing to enable parallelisation, remove global synchronisation issues and hence become amenable to a GPU-based implementation. Experiments are conducted on a planar target for reconstruction noise estimation and a visually realistic silicone liver phantom. Results highlight an average reconstruction error of 0.6 mm on the planar target, 2.4–5.7 mm on the phantom and processing times averaging around 370 milliseconds for input images of size 1920 x 540.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Peterlík, I., Duriez, C., Cotin, S.: Modeling and real-time simulation of a vascularized liver tissue. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part I. LNCS, vol. 7510, pp. 50–57. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  2. Pratt, P., Stoyanov, D., Visentini-Scarzanella, M., Yang, G.-Z.: Dynamic guidance for robotic surgery using image-constrained biomechanical models. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part I. LNCS, vol. 6361, pp. 77–85. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  3. Haouchine, N., Dequidt, J., Berger, M.O., Cotin, S.: Deformation-based augmented reality for hepatic surgery. In: Medicine Meets Virtual Reality, MMVR 20 (2013)

    Google Scholar 

  4. Kingham, T.P., Jayaraman, S., Clements, L.W., Scherer, M.A., Stefansic, J.D., Jarnagin, W.R.: Evolution of image-guided liver surgery: Transition from open to laparoscopic procedures. Journal of Gastrointestinal Surgery 17(7), 1274–1282 (2013)

    Article  Google Scholar 

  5. Clements, L.W., Chapman, W.C., Dawant, B.M., Galloway Jr., R.L., Miga, M.I.: Robust surface registration using salient anatomical features for image-guided liver surgery: Algorithm and validation. Medical Physics 35(6), 2528–2540 (2008)

    Article  Google Scholar 

  6. Meerbergen, G.V., Vergauwen, M., Pollefeys, M., Gool, L.V.: A hierarchical symmetric stereo algorithm using dynamic programming. International Journal of Computer Vision 47(1-3), 275–285 (2002)

    Article  MATH  Google Scholar 

  7. Sizintsev, M., Wildes, R.P.: Coarse-to-fine stereo vision with accurate 3D boundaries. Image and Vision Computing 28(3), 352–366 (2010)

    Article  Google Scholar 

  8. Chang, P.L., Stoyanov, D., Davison, A.J., Edwards, P.E.: Real-time dense stereo reconstruction using convex optimisation with a cost-volume for image-guided robotic surgery. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 42–49. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  9. Mei, X., Sun, X., Zhou, M., Jiao, S., Wang, H., Zhang, X.: On building an accurate stereo matching system on graphics hardware. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 467–474 (2011)

    Google Scholar 

  10. Richardt, C., Orr, D., Davies, I., Criminisi, A., Dodgson, N.A.: Real-time spatiotemporal stereo matching using the dual-cross-bilateral grid. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 510–523. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  11. Roehl, S., Bodenstedt, S., Suwelack, S., Kenngott, H., Mueller-Stich, B.P., Dillmann, R., Speidel, S.: Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration. Medical Physics 39(3), 1632–1645 (2012)

    Article  Google Scholar 

  12. Stoyanov, D., Scarzanella, M.V., Pratt, P., Yang, G.-Z.: Real-time stereo reconstruction in robotically assisted minimally invasive surgery. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part I. LNCS, vol. 6361, pp. 275–282. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  13. Hirschmueller, H., Scharstein, D.: Evaluation of stereo matching costs on images with radiometric differences. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(9), 1582–1599 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Totz, J. et al. (2014). Fast Semi-dense Surface Reconstruction from Stereoscopic Video in Laparoscopic Surgery. In: Stoyanov, D., Collins, D.L., Sakuma, I., Abolmaesumi, P., Jannin, P. (eds) Information Processing in Computer-Assisted Interventions. IPCAI 2014. Lecture Notes in Computer Science, vol 8498. Springer, Cham. https://doi.org/10.1007/978-3-319-07521-1_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-07521-1_22

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-07520-4

  • Online ISBN: 978-3-319-07521-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics