Abstract
The effects of label noise and ambiguity are widespread, especially for subjective tasks such as bone age assessment (BAA). However, most existing BAA algorithms ignore these issues. We propose a robust framework for BAA supporting Tanner & Whitehouse 3 (TW3) method, which is clinically more objective and reproducible than Greulich & Pyle (GP) method, but has received less attention from the research community. Since the publicly available RSNA BAA dataset was annotated using GP method, we contribute additional TW3 annotations. We formulate TW3 BAA as an ordinal regression problem, and address both label noise and ambiguity with a two stage deep learning framework. The first stage focuses on correcting erroneous labels with ambiguity tolerated, while the latter stage introduces a module called Residual Context Graph (RCG) to conquer label ambiguity. Inspired by the way human experts handle ambiguity, we combine fine-grained local features with a graph based context. Experiments show the proposed framework outperforms previously reported TW3-based BAA systems by large margins. TW3 annotations of bone maturity levels for a portion of the RSNA BAA dataset will be made publicly available.
Keywords
- Bone age assessment
- Noisy label
- Graph convolutional network
P. Gong and Z. Yin—Contributed equally.
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Arpit, D., et al.: A closer look at memorization in deep networks. In: Proceedings of the 34th International Conference on Machine Learning, vol. 70, pp. 233–242. JMLR.org (2017)
Chen, K., et al.: MMDetection: Open MMLab detection toolbox and benchmark. arXiv preprint arXiv:1906.07155 (2019)
Cicero, M., Bilbily, A.: Machine learning and the future of radiology: how we won the 2017 RSNA ML challenge (2017). https://www.16bit.ai/blog/ml-and-future-of-radiology
Escobar, M., González, C., Torres, F., Daza, L., Triana, G., Arbeláez, P.: Hand pose estimation for pediatric bone age assessment. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11769, pp. 531–539. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32226-7_59
Gao, B.B., Xing, C., Xie, C.W., Wu, J., Geng, X.: Deep label distribution learning with label ambiguity. IEEE Trans. Image Process. 26(6), 2825–2838 (2017)
Greulich, W.W., Pyle, S.I.: Radiographic Atlas of Skeletal Development of the Hand and Wrist, 2nd edn. Stanford University Press, Standord (1959)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Ji, Y., Chen, H., Lin, D., Wu, X., Lin, D.: PRSNet: part relation and selection network for bone age assessment. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11769, pp. 413–421. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32226-7_46
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Pan, H., Han, H., Shan, S., Chen, X.: Mean-variance loss for deep age estimation from a face. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5285–5294 (2018)
Son, S., et al.: TW3-based fully automated bone age assessment system using deep neural networks. IEEE Access 7, 33346–33358 (2019)
Sun, K., Xiao, B., Liu, D., Wang, J.: Deep high-resolution representation learning for human pose estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5693–5703 (2019)
Tanaka, D., Ikami, D., Yamasaki, T., Aizawa, K.: Joint optimization framework for learning with noisy labels. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5552–5560 (2018)
Tanner, J.M., Healy, M.J.R., Goldstein, H., Cameron, N.: Assessment of Skeletal Maturity and Prediction of Adult Height (TW3 Method). Saunders, London (2001)
Tanner, J.M., Whitehouse, R., Cameron, N., Marshall, W., Healy, M.J.R., Goldstein, H.: Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method). Academic press, London (1976)
Thodberg, H.H., Kreiborg, S., Juul, A., Pedersen, K.D.: The BoneXpert method for automated determination of skeletal maturity. IEEE Trans. Med. Imaging 28(1), 52–66 (2009)
Acknowledgments
We thank the anonymous reviewers for their constructive comments. This work was supported by Capital’s Funds for Health Improvement and Research (2020-2-2104), MOST-2018AAA0102004 and NSFC-61625201.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Gong, P., Yin, Z., Wang, Y., Yu, Y. (2020). Towards Robust Bone Age Assessment: Rethinking Label Noise and Ambiguity. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12266. Springer, Cham. https://doi.org/10.1007/978-3-030-59725-2_60
Download citation
DOI: https://doi.org/10.1007/978-3-030-59725-2_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59724-5
Online ISBN: 978-3-030-59725-2
eBook Packages: Computer ScienceComputer Science (R0)
-
Published in cooperation with
http://miccai.org/
