Abstract
nnU-Net serves as a good baseline for many medical image segmentation challenges in recent years. It works pretty well for fully-supervised segmentation tasks. However, it is less efficient for inference and cannot effectively make full use of unlabeled data, both of which are vital in real clinical scenarios. To this end, we revisit nnU-Net and find the trade-off between efficiency and accuracy in this framework. Based on the default nnU-Net settings, we design a co-training framework consisting of two strategies to generate high-quality pseudo labels and make efficient inference respectively. Specifically, we first design a resource-intensive nnU-Net to iteratively generate high-quality pseudo labels for unlabeled data. Then we train another light-weight 3D nnU-Net using labeled data and selected unlabeled data, with high-quality pseudo labels used for the latter to achieve efficient segmentation. We conduct experiments on the FLARE22 challenge. Our resource-intensive nnU-Net achieves the mean DSC of 0.9064 on 13 abdominal organ segmentation tasks and ranks first on the validation leaderboard. Our light-weight nnU-Net shows the mean DSC of 0.8773 on the validation leaderboard but it makes a better trade-off between accuracy and efficiency. On the test set, it shows the mean DSC of 0.8864, the mean NSD of 0.9465, and the average inference time of 14.59s and wins the championship of the FLARE22 challenge. Our code is publicly available at https://github.com/Ziyan-Huang/FLARE22.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digital Imaging 26(6), 1045–1057 (2013)
Heller, N., et al.: The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the kits19 challenge. Med. Image Anal. 67, 101821 (2021)
Heller, N., et al.: An international challenge to use artificial intelligence to define the state-of-the-art in kidney and kidney tumor segmentation in CT imaging. Am. Soc. Clin. Oncol. 38(6), 626 (2020)
Huang, Z., Wang, Z., Yang, Z., Gu, L.: AdwU-Net: adaptive depth and width u-net for medical image segmentation by differentiable neural architecture search. In: Medical Imaging with Deep Learning (2022). https://openreview.net/forum?id=kF-d1SKWJpS
Isensee, F., Jaeger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18(2), 203–211 (2021)
Ma, J., et al.: Loss odyssey in medical image segmentation. Med. Image Anal. 71, 102035 (2021)
Ma, J., et al.: Fast and low-GPU-memory abdomen CT organ segmentation: the flare challenge. Med. Image Anal. 82, 102616 (2022). https://doi.org/10.1016/j.media.2022.102616
Ma, J., et al.: Abdomenct-1k: Is abdominal organ segmentation a solved problem? In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2021). https://doi.org/10.1109/TPAMI.2021.3100536
Simpson, A.L., et al.: A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv preprint arXiv:1902.09063 (2019)
Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning, pp. 6105–6114. PMLR (2019)
Acknowledgements
The authors of this paper declare that the segmentation method they implemented for participation in the FLARE 2022 challenge has not used any pre-trained models nor additional datasets other than those provided by the organizers. The proposed solution is fully automatic without any manual intervention.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, Z. et al. (2022). Revisiting nnU-Net for Iterative Pseudo Labeling and Efficient Sliding Window Inference. In: Ma, J., Wang, B. (eds) Fast and Low-Resource Semi-supervised Abdominal Organ Segmentation. FLARE 2022. Lecture Notes in Computer Science, vol 13816. Springer, Cham. https://doi.org/10.1007/978-3-031-23911-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-23911-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23910-6
Online ISBN: 978-3-031-23911-3
eBook Packages: Computer ScienceComputer Science (R0)