Skip to main content

Invertible Neural Networks for Uncertainty Quantification in Photoacoustic Imaging

  • Conference paper
  • First Online:
Bildverarbeitung für die Medizin 2021

Abstract

Multispectral photoacoustic imaging (PAI) is an emerging imaging modality that enables the recovery of functional tissue parameters such as blood oxygenation. However, the underlying inverse reconstruction problems are potentially ill-posed, meaning that radically different tissue properties may-in theory-yield comparable measurements. In this work, we present a new approach for handling this specific type of uncertainty using conditional invertible neural networks. We propose going beyond commonly used point estimates for tissue oxygenation and convert single-pixel initial pressure spectra to the full posterior probability density. This way, the inherent ambiguity of a problem can be encoded with multiple modes in the output. Based on the presented architecture, we demonstrate two use cases that leverage this information to not only detect and quantify but also to compensate for uncertainties: (1) photoacoustic device design and (2) optimization of photoacoustic image acquisition. Our in silico studies demonstrate the potential of the proposed methodology to become an important building block for uncertainty-aware reconstruction of physiological parameters with PAI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zackrisson S, van de Ven SMWY, Gambhir SS. Light in and sound out: emerging translational strategies for photoacoustic imaging. Cancer Res. 2014;74(4):979–1004.

    Google Scholar 

  2. Yang C, Lan H, Gao F, et al. Deep learning for photoacoustic imaging: a survey. arXiv:200804221 [cs, eess]. 2020;.

  3. Tarvainen T, Pulkkinen A, Cox BT, et al. Bayesian image reconstruction in quantitative photoacoustic tomography. IEEE Trans Med Imaging. 2013 Dec;32(12):2287–2298.

    Google Scholar 

  4. Tick J, Pulkkinen A, Tarvainen T. Image reconstruction with uncertainty quantification in photoacoustic tomography. J Acoust Soc Am. 2016;139(4):1951–1961.

    Google Scholar 

  5. Gröhl J, Kirchner T, Adler T, et al. Confidence estimation for machine learningbased quantitative photoacoustics. J Imaging. 2018;4(12):147.

    Google Scholar 

  6. Godefroy G, Arnal B, Bossy E. Solving the visibility problem in photoacoustic imaging with a deep learning approach providing prediction uncertainties. arXiv:200613096 [physics]. 2020;.

  7. Ardizzone L, Lüth C, Kruse J, et al. Guided image generation with conditional invertible neural networks. arXiv:19070233092 [cs]. 2019;.

  8. Fang Q, Boas DA. Monte Carlo simulation of photon migration in 3D turbid media accelerated by graphics processing units. Opt Express. 2009;17(22):20178–20190.

    Google Scholar 

  9. Kingma DP, Dhariwal P. Glow: generative ow with invertible 1x1 convolutions. arXiv:180703039 [cs, stat]. 2018;.

  10. Ardizzone L, Kruse J, Wirkert S, et al. Analyzing inverse problems with invertible neural networks. arXiv:180804730 [cs, stat]. 2019;.

  11. Adler TJ, Ardizzone L, Vemuri A, et al. Uncertainty-aware performance assessment of optical imaging modalities with invertible neural networks. Int J Comput Assist Radiol Surg. 2019;14(6):997–1007.

    Google Scholar 

  12. Shao P, Cox B, Zemp R. Estimating optical absorption, scattering, and Grueneisen distributions with multiple-illumination photoacoustic tomography. Appl Opt. 2011;50:3145–54.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan-Hinrich Nölke .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Der/die Autor(en), exklusiv lizenziert durch Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nölke, JH. et al. (2021). Invertible Neural Networks for Uncertainty Quantification in Photoacoustic Imaging. In: Palm, C., Deserno, T.M., Handels, H., Maier, A., Maier-Hein, K., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2021. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-33198-6_80

Download citation

Publish with us

Policies and ethics