Abstract
The novel coronavirus disease 2019 (COVID-19) characterized by atypical pneumonia has caused millions of deaths worldwide. Automatically segmenting lesions from chest Computed Tomography (CT) is a promising way to assist doctors in COVID-19 screening, treatment planning, and follow-up monitoring. However, voxel-wise annotations are extremely expert-demanding and scarce, especially when it comes to novel diseases, while an abundance of unlabeled data could be available. To tackle the challenge of limited annotations, in this paper, we propose an uncertainty-guided dual-consistency learning network (UDC-Net) for semi-supervised COVID-19 lesion segmentation from CT images. Specifically, we present a dual-consistency learning scheme that simultaneously imposes image transformation equivalence and feature perturbation invariance to effectively harness the knowledge from unlabeled data. We then quantify the segmentation uncertainty in two forms and employ them together to guide the consistency regularization for more reliable unsupervised learning. Extensive experiments showed that our proposed UDC-Net improves the fully supervised method by 6.3% in Dice and outperforms other competitive semi-supervised approaches by significant margins, demonstrating high potential in real-world clinical practice. (Code is available at https://github.com/poiuohke/UDC-Net).
Y. Li and L. Luo—The first two authors contributed equally.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Ai, T., et al.: Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology, 200642 (2020)
Berthelot, D., Carlini, N., Goodfellow, I., Papernot, N., Oliver, A., Raffel, C.A.: MixMatch: a holistic approach to semi-supervised learning. In: NeurIPS, pp. 5049–5059 (2019)
Chapelle, O., Scholkopf, B., Zien, A.: Semi-supervised learning. IEEE TNNLS 20(3), 542–542 (2009)
Di, D., Shi, F., Yan, F., Xia, L., Mo, Z., Ding, Z., et al.: Hypergraph learning for identification of COVID-19 with CT imaging. MedIA, 101910 (2020)
Fan, D.P., Zhou, T., Ji, G.P., Zhou, Y., Chen, G., Fu, H., et al.: Inf-Net: automatic COVID-19 lung infection segmentation from CT images. IEEE TMI 39, 2626–2637 (2020)
Fang, Y., Zhang, H., Xie, J., Lin, M., Ying, L., Pang, P., et al.: Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology, 200432 (2020)
Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y., et al.: Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 395(10223), 497–506 (2020)
Jin, C., Chen, W., Cao, Y., Xu, Z., Tan, Z., Zhang, X., et al.: Development and evaluation of an artificial intelligence system for COVID-19 diagnosis. Nat. Commun. 11(1), 1–14 (2020)
Ke, Z., Wang, D., Yan, Q., Ren, J., Lau, R.W.: Dual student: breaking the limits of the teacher in semi-supervised learning. In: ICCV, pp. 6728–6736 (2019)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)
Lee, J., Chung, S.Y.: Robust training with ensemble consensus. In: ICLR (2020). https://openreview.net/forum?id=ryxOUTVYDH
Li, X., Yu, L., Chen, H., Fu, C.W., Xing, L., Heng, P.A.: Transformation-consistent self-ensembling model for semisupervised medical image segmentation. IEEE TNNLS 32, 523–534 (2020)
Liang, W., et al.: Early triage of critically ill COVID-19 patients using deep learning. Nat. Commun. 11(1), 1–7 (2020)
Liu, Q., Yu, L., Luo, L., Dou, Q., Heng, P.A.: Semi-supervised medical image classification with relation-driven self-ensembling model. IEEE TMI 39, 3429–3440 (2020)
Luo, L., Yu, L., Chen, H., Liu, Q., Wang, X., Xu, J., et al.: Deep mining external imperfect data for chest X-ray disease screening. IEEE TMI 39(11), 3583–3594 (2020)
Ma, J., et al.: Active contour regularized semi-supervised learning for COVID-19 CT infection segmentation with limited annotations. Phys. Med. Biol. 65, 225034 (2020)
Mei, X., Lee, H.C., Diao, K.y., Huang, M., Lin, B., Liu, C., et al.: Artificial intelligence-enabled rapid diagnosis of patients with COVID-19. Nat. Med., 1–5 (2020)
Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 3DV, pp. 565–571. IEEE (2016)
Miyato, T., Maeda, S.i., Koyama, M., Ishii, S.: Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE TPAMI 41(8), 1979–1993 (2018)
Oh, Y., Park, S., Ye, J.C.: Deep learning COVID-19 features on CXR using limited training data sets. IEEE TMI 39, 2688–2700 (2020)
Ouali, Y., Hudelot, C., Tami, M.: Semi-supervised semantic segmentation with cross-consistency training. In: CVPR, pp. 12674–12684 (2020)
Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. In: NeurIPS, pp. 8026–8037 (2019)
Qiao, S., Shen, W., Zhang, Z., Wang, B., Yuille, A.: Deep co-training for semi-supervised image recognition. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11219, pp. 142–159. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01267-0_9
Tarvainen, A., Valpola, H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. NeurIPS 30, 1195–1204 (2017)
van Engelen, J.E., Hoos, H.H.: A survey on semi-supervised learning. Mach. Learn. 109(2), 373–440 (2019). https://doi.org/10.1007/s10994-019-05855-6
Wang, G., Liu, X., Li, C., Xu, Z., Ruan, J., Zhu, H., et al.: A noise-robust framework for automatic segmentation of COVID-19 pneumonia lesions from CT images. IEEE TMI 39(8), 2653–2663 (2020)
Wang, L., Lin, Z.Q., Wong, A.: COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020)
Wang, X., Chen, H., Ran, A.R., Luo, L., Chan, P.P., Tham, C.C., et al.: Towards multi-center glaucoma OCT image screening with semi-supervised joint structure and function multi-task learning. MedIA 63, 101695 (2020)
Wang, X., Chen, H., Xiang, H., Lin, H., Lin, X., Heng, P.A.: Deep virtual adversarial self-training with consistency regularization for semi-supervised medical image classification. Med. Image Anal. 70, 102010 (2021)
Wang, X., Tang, F., Chen, H., Luo, L., Tang, Z., Ran, A.R., et al.: UD-MIL: uncertainty-driven deep multiple instance learning for oct image classification. IEEE JBHI 24, 3431–3442 (2020)
Wang, X., Deng, X., Fu, Q., Zhou, Q., Feng, J., Ma, H., et al.: A weakly-supervised framework for COVID-19 classification and lesion localization from chest CT. IEEE TMI 39, 2615–2625(2020)
Worrall, D.E., Garbin, S.J., Turmukhambetov, D., Brostow, G.J.: Harmonic networks: deep translation and rotation equivariance. In: CVPR, pp. 5028–5037 (2017)
Xia, Y., Yang, D., Yu, Z., Liu, F., Cai, J., Yu, L., et al.: Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation. MedIA 65, 101766 (2020)
Yu, L., Wang, S., Li, X., Fu, C.-W., Heng, P.-A.: Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 605–613. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_67
Zhang, C., Bengio, S., Hardt, M., Recht, B., Vinyals, O.: Understanding deep learning requires rethinking generalization. In: ICLR (2017)
Zhu, N., Zhang, D., Wang, W., Li, X., Yang, B., Song, J., et al.: A novel coronavirus from patients with pneumonia in China, 2019. N. Engl. J. Med. 382, 727–733 (2020)
Acknowledgement
This work was supported by Key-Area Research and Development Program of Guangdong Province, China (2020B010165004 and 2018B010109006), Hong Kong Innovation and Technology Fund (Project No. ITS/311/18FP and Project No. ITS/426/17FP.), and National Natural Science Foundation of China with Project No. U1813204.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Y., Luo, L., Lin, H., Chen, H., Heng, PA. (2021). Dual-Consistency Semi-supervised Learning with Uncertainty Quantification for COVID-19 Lesion Segmentation from CT Images. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12902. Springer, Cham. https://doi.org/10.1007/978-3-030-87196-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-87196-3_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87195-6
Online ISBN: 978-3-030-87196-3
eBook Packages: Computer ScienceComputer Science (R0)
