Advertisement

Semi-supervised Learning for Network-Based Cardiac MR Image Segmentation

  • Wenjia Bai
  • Ozan Oktay
  • Matthew Sinclair
  • Hideaki Suzuki
  • Martin Rajchl
  • Giacomo Tarroni
  • Ben Glocker
  • Andrew King
  • Paul M. Matthews
  • Daniel Rueckert
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10434)

Abstract

Training a fully convolutional network for pixel-wise (or voxel-wise) image segmentation normally requires a large number of training images with corresponding ground truth label maps. However, it is a challenge to obtain such a large training set in the medical imaging domain, where expert annotations are time-consuming and difficult to obtain. In this paper, we propose a semi-supervised learning approach, in which a segmentation network is trained from both labelled and unlabelled data. The network parameters and the segmentations for the unlabelled data are alternately updated. We evaluate the method for short-axis cardiac MR image segmentation and it has demonstrated a high performance, outperforming a baseline supervised method. The mean Dice overlap metric is 0.92 for the left ventricular cavity, 0.85 for the myocardium and 0.89 for the right ventricular cavity. It also outperforms a state-of-the-art multi-atlas segmentation method by a large margin and the speed is substantially faster.

Notes

Acknowledgements

This research has been conducted using the UK Biobank Resource under Application Number 18545. This work is supported by EPSRC programme Grant (EP/P001009/1). H.S. is supported by a Research Fellowship from the Uehara Memorial Foundation. P.M.M. gratefully acknowledges support from the Imperial College Healthcare Trust Biomedical Research Centre, the EPSRC Centre for Mathematics in Precision Healthcare and the MRC.

References

  1. 1.
    Avendi, M., et al.: A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI. Med. Image Anal. 30, 108–119 (2016)CrossRefGoogle Scholar
  2. 2.
    Bai, W., et al.: A probabilistic patch-based label fusion model for multi-atlas segmentation with registration refinement: application to cardiac MR images. IEEE Trans. Med. Imaging 32(7), 1302–1315 (2013)CrossRefGoogle Scholar
  3. 3.
    Brosch, T., et al.: Deep 3D convolutional encoder networks with shortcuts for multiscale feature integration applied to multiple sclerosis lesion segmentation. IEEE Trans. Med. Imaging 35(5), 1229–1239 (2016)CrossRefGoogle Scholar
  4. 4.
    Chen, H., et al.: DCAN: deep contour-aware networks for accurate gland segmentation. In: CVPR, pp. 2487–2496 (2016)Google Scholar
  5. 5.
    Chen, L., et al.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. arXiv:1606.00915 (2016)
  6. 6.
    Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFs with Gaussian edge potentials. In: NIPS, pp. 1–9 (2011)Google Scholar
  7. 7.
    Lin, D., et al.: ScribbleSup: scribble-supervised convolutional networks for semantic segmentation. In: CVPR, pp. 3159–3167 (2016)Google Scholar
  8. 8.
    Long, J., et al.: Fully convolutional networks for semantic segmentation. In: CVPR, pp. 3431–3440 (2015)Google Scholar
  9. 9.
    Ngo, T., et al.: Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med. Image Anal. 35, 159–171 (2017)CrossRefGoogle Scholar
  10. 10.
    Papandreou, G., et al.: Weakly- and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: ICCV, pp. 1742–1750 (2015)Google Scholar
  11. 11.
    Poudel, R., et al.: Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. arXiv:1608.03974 (2016)
  12. 12.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi: 10.1007/978-3-319-24574-4_28 CrossRefGoogle Scholar
  13. 13.
    Rueckert, D., et al.: Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans. Med. Imaging 18(8), 712–721 (1999)CrossRefGoogle Scholar
  14. 14.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: ICLR, pp. 1–14 (2015)Google Scholar
  15. 15.
    Theano Development Team: Theano: a python framework for fast computation of mathematical expressions. arXiv:1605.02688 (2016)
  16. 16.
    Tran, P.: A fully convolutional neural network for cardiac segmentation in short-axis MRI. arXiv:1604.00494 (2016)
  17. 17.
    Yang, H., Sun, J., Li, H., Wang, L., Xu, Z.: Deep fusion net for multi-atlas segmentation: application to cardiac MR images. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 521–528. Springer, Cham (2016). doi: 10.1007/978-3-319-46723-8_60 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Wenjia Bai
    • 1
  • Ozan Oktay
    • 1
  • Matthew Sinclair
    • 2
  • Hideaki Suzuki
    • 3
  • Martin Rajchl
    • 1
  • Giacomo Tarroni
    • 1
  • Ben Glocker
    • 1
  • Andrew King
    • 2
  • Paul M. Matthews
    • 3
  • Daniel Rueckert
    • 1
  1. 1.Biomedical Image Analysis Group, Department of ComputingImperial College LondonLondonUK
  2. 2.Division of Imaging Sciences and Biomedical EngineeringKing’s College LondonLondonUK
  3. 3.Division of Brain Sciences, Department of MedicineImperial College LondonLondonUK

Personalised recommendations