Skip to main content
Book cover

Annual Conference on Medical Image Understanding and Analysis

MIUA 2019: Medical Image Understanding and Analysis pp 164–173Cite as

Multi-task CNN for Structural Semantic Segmentation in 3D Fetal Brain Ultrasound

Part of the Communications in Computer and Information Science book series (CCIS,volume 1065)

Abstract

The fetal brain undergoes extensive morphological changes throughout pregnancy, which can be visually seen in ultrasound acquisitions. We explore the use of convolutional neural networks (CNNs) for the segmentation of multiple fetal brain structures in 3D ultrasound images. Accurate automatic segmentation of brain structures in fetal ultrasound images can track brain development through gestation, and can provide useful information that can help predict fetal health outcomes. We propose a multi-task CNN to produce automatic segmentations from atlas-generated labels of the white matter, thalamus, brainstem, and cerebellum. The network as trained on 480 volumes produced accurate 3D segmentations on 48 test volumes, with Dice coefficient of 0.93 on the white matter and over 0.77 on segmentations of thalamus, brainstem and cerebellum.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-39343-4_14
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   79.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-39343-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.

Notes

  1. 1.

    Due to the size of this network, we used a batch size of 1 volume for training.

References

  1. Pistorius, L.R., et al.: Grade and symmetry of normal fetal cortical development: a longitudinal two-and three-dimensional ultrasound study. Ultrasound Obstet. Gynecol. 36(6), 700–708 (2010)

    CrossRef  Google Scholar 

  2. Studholme, C.: Mapping fetal brain development in utero using magnetic resonance imaging: the Big Bang of brain mapping. Annu. Rev. Biomed. Eng. 13(1), 345–368 (2011)

    CrossRef  Google Scholar 

  3. Namburete, A.I.L., Stebbing, R.V., Kemp, B., Yaqub, M., Papageorghiou, A.T., Noble, J.A.: Learning-based prediction of gestational age from ultrasound images of the fetal brain. Med. Image Anal. 21(1), 72–86 (2015)

    CrossRef  Google Scholar 

  4. Kuklisova-Murgasova, M., et al.: Others: a dynamic 4D probabilistic atlas of the developing brain. NeuroImage 54(4), 2750–2763 (2011)

    CrossRef  Google Scholar 

  5. Gholipour, A., et al.: A normative spatiotemporal MRI atlas of the fetal brain for automatic segmentation and analysis of early brain growth. Sci. Rep. 7, 476 (2017)

    CrossRef  Google Scholar 

  6. Yaqub, M., et al.: Volumetric segmentation of key fetal brain structures in 3D ultrasound. In: Wu, G., Zhang, D., Shen, D., Yan, P., Suzuki, K., Wang, F. (eds.) MLMI 2013. LNCS, vol. 8184, pp. 25–32. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-02267-3_4

    CrossRef  Google Scholar 

  7. Habas, P.A., et al.: A spatiotemporal atlas of MR intensity, tissue probability and shape of the fetal brain with application to segmentation. Neuroimage 53(2), 460–470 (2010)

    CrossRef  Google Scholar 

  8. Schmidt-Richberg, A., et al.: Abdomen segmentation in 3D fetal ultrasound using CNN-powered deformable models. In: Cardoso, M.J., et al. (eds.) FIFI/OMIA -2017. LNCS, vol. 10554, pp. 52–61. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67561-9_6

    CrossRef  Google Scholar 

  9. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    CrossRef  Google Scholar 

  10. Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: Fully convolutional neural networks for volumetric medical image segmentation, June 2016

    Google Scholar 

  11. Roy, A.G., Conjeti, S., Navab, N., Wachinger, C.: QuickNAT: a fully convolutional network for quick and accurate segmentation of neuroanatomy. NeuroImage 186, 713–727 (2019)

    CrossRef  Google Scholar 

  12. Papageorghiou, A.T., et al.: International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project. Lancet 384(9946), 869–879 (2014)

    CrossRef  Google Scholar 

  13. Namburete, A.I., Xie, W., Yaqub, M., Zisserman, A., Noble, J.A.: Fully-automated alignment of 3D fetal brain ultrasound to a canonical reference space using multi-task learning. Med. Image Anal. 46, 1–14 (2018)

    CrossRef  Google Scholar 

  14. Vinkesteijn, A., Mulder, P., Wladimiroff, J.: Fetal transverse cerebellar diameter measurements in normal and reduced fetal growth. Ultrasound Obstet. Gynecol. 15(1), 47–51 (2000)

    CrossRef  Google Scholar 

  15. Moeskops, P., et al.: Deep learning for multi-task medical image segmentation in multiple modalities. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 478–486. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_55

    CrossRef  Google Scholar 

Download references

Acknowledgment

This work is supported by funding from the Engineering and Physical Sciences Research Council (EPSRC) and Medical Research Council (MRC) [grant number EP/L016052/1]. A. T. Papageorghiou is supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). A. Namburete is grateful for support from the UK Royal Academy of Engineering under the Engineering for Development Research Fellowships scheme. We thank the INTERGROWTH-21st Consortium for permission to use 3D ultrasound volumes of the fetal brain.

Author information

Authors and Affiliations

  1. Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK

    Lorenzo Venturini, J. Alison Noble & Ana I. L. Namburete

  2. Nuffield Department of Obstetrics and Gynaecology, University of Oxford, Oxford, UK

    Aris T. Papageorghiou

Authors
  1. Lorenzo Venturini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aris T. Papageorghiou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Alison Noble
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ana I. L. Namburete
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lorenzo Venturini .

Editor information

Editors and Affiliations

  1. University of Liverpool, Liverpool, UK

    Yalin Zheng

  2. University of Liverpool, Liverpool, UK

    Bryan M. Williams

  3. University of Liverpool, Liverpool, UK

    Prof. Dr. Ke Chen

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Venturini, L., Papageorghiou, A.T., Noble, J.A., Namburete, A.I.L. (2020). Multi-task CNN for Structural Semantic Segmentation in 3D Fetal Brain Ultrasound. In: Zheng, Y., Williams, B., Chen, K. (eds) Medical Image Understanding and Analysis. MIUA 2019. Communications in Computer and Information Science, vol 1065. Springer, Cham. https://doi.org/10.1007/978-3-030-39343-4_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-39343-4_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-39342-7

  • Online ISBN: 978-3-030-39343-4

  • eBook Packages: Computer ScienceComputer Science (R0)