Advertisement

More Unlabelled Data or Label More Data? A Study on Semi-supervised Laparoscopic Image Segmentation

  • Yunguan FuEmail author
  • Maria R. Robu
  • Bongjin Koo
  • Crispin Schneider
  • Stijn van Laarhoven
  • Danail Stoyanov
  • Brian Davidson
  • Matthew J. Clarkson
  • Yipeng Hu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11795)

Abstract

Improving a semi-supervised image segmentation task has the option of adding more unlabelled images, labelling the unlabelled images or combining both, as neither image acquisition nor expert labelling can be considered trivial in most clinical applications. With a laparoscopic liver image segmentation application, we investigate the performance impact by altering the quantities of labelled and unlabelled training data, using a semi-supervised segmentation algorithm based on the mean teacher learning paradigm. We first report a significantly higher segmentation accuracy, compared with supervised learning. Interestingly, this comparison reveals that the training strategy adopted in the semi-supervised algorithm is also responsible for this observed improvement, in addition to the added unlabelled data. We then compare different combinations of labelled and unlabelled data set sizes for training semi-supervised segmentation networks, to provide a quantitative example of the practically useful trade-off between the two data planning strategies in this surgical guidance application.

Keywords

Semi-supervised Laparoscopic video Image segmentation 

Notes

Acknowledgement

This work is supported by the Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) (203145Z/16/Z). DS receives funding from EPSRC [EP/P012841/1]. MC receives funding from EPSRC [EP/P034454/1]. BD was supported by the NIHR Biomedical Research Centre at University College London Hospitals NHS Foundations Trust and University College London. The imaging data used for this work were obtained with funding from the Health Innovation Challenge Fund [HICF-T4-317], a parallel funding partnership between the Wellcome Trust and the Department of Health.

References

  1. 1.
    Abraham, N., Khan, N.M.: A novel focal tversky loss function with improved attention u-net for lesion segmentation. arXiv preprint arXiv:1810.07842 (2018)
  2. 2.
    Bai, W., et al.: Semi-supervised learning for network-based cardiac MR image segmentation. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 253–260. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-66185-8_29CrossRefGoogle Scholar
  3. 3.
    Cheplygina, V., de Bruijne, M., Pluim, J.P.: Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis. Med. Image Anal. 54, 280–296 (2019)CrossRefGoogle Scholar
  4. 4.
    Clarkson, M.J., et al.: The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging. Int. J. Comput. Assist. Radiol. Surg. 10(3), 301–316 (2015)CrossRefGoogle Scholar
  5. 5.
    Cui, W., et al.: Semi-supervised brain lesion segmentation with an adapted mean teacher model. arXiv preprint arXiv:1903.01248 (2019)
  6. 6.
    Gibson, E., et al.: Deep residual networks for automatic segmentation of laparoscopic videos of the liver. In: Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, vol. 10135, p. 101351M. International Society for Optics and Photonics (2017)Google Scholar
  7. 7.
    Lee, D.H.: Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on Challenges in Representation Learning, ICML, vol. 3, p. 2 (2013)Google Scholar
  8. 8.
    Perone, C.S., Cohen-Adad, J.: Deep semi-supervised segmentation with weight-averaged consistency targets. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS-2018. LNCS, vol. 11045, pp. 12–19. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-00889-5_2CrossRefGoogle Scholar
  9. 9.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-24574-4_28CrossRefGoogle Scholar
  10. 10.
    Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., Jorge Cardoso, M.: Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In: Cardoso, M.J., et al. (eds.) DLMIA/ML-CDS -2017. LNCS, vol. 10553, pp. 240–248. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-67558-9_28CrossRefGoogle Scholar
  11. 11.
    Tarvainen, A., Valpola, H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Advances in Neural Information Processing Systems, pp. 1195–1204 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Yunguan Fu
    • 1
    • 2
    Email author
  • Maria R. Robu
    • 1
  • Bongjin Koo
    • 1
  • Crispin Schneider
    • 3
  • Stijn van Laarhoven
    • 3
  • Danail Stoyanov
    • 1
  • Brian Davidson
    • 3
  • Matthew J. Clarkson
    • 1
  • Yipeng Hu
    • 1
  1. 1.Wellcome/EPSRC Centre for Interventional and Surgical Sciences, Centre for Medical Image ComputingUniversity College LondonLondonUK
  2. 2.InstaDeepLondonUK
  3. 3.Division of Surgery and Interventional ScienceUniversity College LondonLondonUK

Personalised recommendations