Skip to main content

Studying Robustness of Semantic Segmentation Under Domain Shift in Cardiac MRI

  • Conference paper
  • First Online:
Statistical Atlases and Computational Models of the Heart. M&Ms and EMIDEC Challenges (STACOM 2020)

Abstract

Cardiac magnetic resonance imaging (cMRI) is an integral part of diagnosis in many heart related diseases. Recently, deep neural networks have demonstrated successful automatic segmentation, thus alleviating the burden of time-consuming manual contouring of cardiac structures. Moreover, frameworks such as nnU-Net provide entirely auto- matic model configuration to unseen datasets enabling out-of-the-box application even by non-experts. However, current studies commonly neglect the clinically realistic scenario, in which a trained network is applied to data from a different domain such as deviating scanners or imaging protocols. This potentially leads to unexpected performance drops of deep learning models in real life applications. In this work, we systematically study challenges and opportunities of domain transfer across images from multiple clinical centres and scanner vendors. In order to maintain out-of-the-box usability, we build upon a fixed U-Net architecture configured by the nnU-net framework to investigate various data augmentation techniques and batch normalization layers as an easy-to-customize pipeline component and provide general guidelines on how to improve domain generalizability abilities in existing deep learning methods. Our proposed method ranked first at the Multi-Centre, Multi-Vendor & Multi-Disease Cardiac Image Segmentation Challenge (M&Ms).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://doi.org/10.5281/zenodo.4134721.

  2. 2.

    https://doi.org/10.5281/zenodo.4134879.

  3. 3.

    Code available at: https://github.com/MIC-DKFZ/nnUNet

References

  1. Suinesiaputra, A., et al.: A collaborative resource to build consensus for automated left ventricular segmentation of cardiac MR images. Med. Image Anal. 18, 50–62 (2014). https://doi.org/10.1016/j.media.2013.09.001

    Article  Google Scholar 

  2. Bernard, O., et al.: Deep learning techniques for automatic MRI Cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans. Med. Imaging 37, 2514–2525 (2018). https://doi.org/10.1109/TMI.2018.2837502

    Article  Google Scholar 

  3. Isensee, F., Jäger, P.F., Kohl, S.A.A., Petersen, J., Maier-Hein, K.H.: Automated design of deep learning methods for biomedical image segmentation. arXiv preprint arXiv:1904.08128 [cs]. (2020)

  4. Campello, Víctor M. et al.: Multi-Centre, Multi-Vendor & Multi-Disease Cardiac Image Segmentation. (in preparation)

    Google Scholar 

  5. Bjorck, N., Gomes, C.P., Selman, B., Weinberger, K.Q.: Understanding batch normalization. In: Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems 31, pp. 7694–7705. Curran Associates, Inc. (2018)

    Google Scholar 

  6. Volpi, R., Namkoong, H., Sener, O., Duchi, J.C., Murino, V., Savarese, S.: Generalizing to unseen domains via adversarial data augmentation. In: Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems 31, pp. 5334–5344. Curran Associates, Inc. (2018)

    Google Scholar 

  7. Karani, N., Chaitanya, K., Baumgartner, C., Konukoglu, E.: A lifelong learning approach to brain MR segmentation across scanners and protocols. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 476–484. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_54

    Chapter  Google Scholar 

  8. Chen, C., et al.: Improving the Generalizability of Convolutional Neural Network-Based Segmentation on CMR Images. (2020). https://doi.org/10.3389/fcvm.2020.00105

    Article  Google Scholar 

  9. Zech, J.R., Badgeley, M.A., Liu, M., Costa, A.B., Titano, J.J., Oermann, E.K.: Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLOS Med. 15, e1002683 (2018). https://doi.org/10.1371/journal.pmed.1002683

    Article  Google Scholar 

  10. Zhang, L., et al.: Generalizing deep learning for medical image segmentation to unseen domains via deep stacked transformation. IEEE Trans. Med. Imaging 39, 2531–2540 (2020). https://doi.org/10.1109/TMI.2020.2973595

    Article  Google Scholar 

  11. Sandfort, V., Yan, K., Pickhardt, P.J., Summers, R.M.: Data augmentation using generative adversarial networks (CycleGAN) to improve generalizability in CT segmentation tasks. Sci. Rep. 9, 16884 (2019). https://doi.org/10.1038/s41598-019-52737-x

    Article  Google Scholar 

  12. Isensee, F., et al.: batchgenerators - a python framework for data augmentation (2020). https://github.com/MIC-DKFZ/batchgenerators, https://doi.org/10.5281/zenodo.3632567 (2020)

Download references

Acknowledgement

The authors of this paper declare that the segmentation method they implem- ented for participation in the \( M \& Ms\) challenge has not used any pre-trained models nor additional MRI datasets other than those provided by the organizers. Peter M. Full holds a Kaltenbach scholarship from the German Heart Foundation (Deutsche Herzstiftung). Fabian Isensee is funded by the Helmholtz Imaging Platform (HIP).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter M. Full .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Full, P.M., Isensee, F., Jäger, P.F., Maier-Hein, K. (2021). Studying Robustness of Semantic Segmentation Under Domain Shift in Cardiac MRI. In: Puyol Anton, E., et al. Statistical Atlases and Computational Models of the Heart. M&Ms and EMIDEC Challenges. STACOM 2020. Lecture Notes in Computer Science(), vol 12592. Springer, Cham. https://doi.org/10.1007/978-3-030-68107-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-68107-4_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-68106-7

  • Online ISBN: 978-3-030-68107-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics