Abstract
Purpose
We aimed to use deep learning with convolutional neural network (CNN) to discriminate between benign and malignant breast mass images from ultrasound.
Materials and Methods
We retrospectively gathered 480 images of 96 benign masses and 467 images of 144 malignant masses for training data. Deep learning model was constructed using CNN architecture GoogLeNet and analyzed test data: 48 benign masses, 72 malignant masses. Three radiologists interpreted these test data. Sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUC) were calculated.
Results
The CNN model and radiologists had a sensitivity of 0.958 and 0.583–0.917, specificity of 0.925 and 0.604–0.771, and accuracy of 0.925 and 0.658–0.792, respectively. The CNN model had equal or better diagnostic performance compared to radiologists (AUC = 0.913 and 0.728–0.845, p = 0.01–0.14).
Conclusion
Deep learning with CNN shows high diagnostic performance to discriminate between benign and malignant breast masses on ultrasound.
This is a preview of subscription content, access via your institution.
Similar content being viewed by others
References
Siegel RL, Miller KD, Jemal A. Cancer statistics, 2018. CA Cancer J Clin. 2018;68:7–30.
Kornecki A. Current status of breast ultrasound. Can Assoc Radiol J. 2011;62:31–40.
Newell MS, Mahoney MC. Ultrasound-guided percutaneous breast biopsy. Tech Vasc Interv Radiol. 2014;17:23–31.
D’Orsi C, Sickles E, Mendelson E, Morris E. Breast imaging reporting and data system. 5th ed. Reston: American College of Radiology; 2013.
Rao AA, Feneis J, Lalonde C, Ojeda-Fournier H. A pictorial review of changes in the BI-RADS fifth edition. Radiographics. 2016;36:623–39.
Youk JH, Son EJ, Gweon HM, Kim H, Park YJ, Kim JA. Comparison of strain and shear wave elastography for the differentiation of benign from malignant breast lesions, combined with B-mode ultrasonography: qualitative and quantitative assessments. Ultrasound Med Biol. 2014;40:2336–44.
Yasaka K, Akai H, Kunimatsu A, Kiryu S, Abe O. Deep learning with convolutional neural network in radiology. Jpn J Radiol. 2018;36:257–72.
Chartrand G, Cheng PM, Vorontsov E, Drozdzal M, Turcotte S, Pal CJ, et al. Deep learning: a primer for radiologists. Radiographics. 2017;37:2113–31.
Lakhani P, Sundaram B. Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology. 2017;284:574–82.
Hamidinekoo A, Denton E, Rampun A, Honnor K, Zwiggelaar R. Deep learning in mammography and breast histology, an overview and future trends. Med Image Anal. 2018;47:45–67.
Yasaka K, Akai H, Kunimatsu A, Kiryu S, Abe O. Deep learning with convolutional neural network in radiology. Jpn J Radiol. 2018;36:257–72.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: Proceeding of IEEE international conference on computer vision pattern recognition; 2015. p. 1–9.
Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167 (2015).
Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’ for medical statistics. Bone Marrow Transplant. 2013;48:452–8.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Demircioğlu Ö, Uluer M, Arıbal E. How many of the biopsy decisions taken at inexperienced breast radiology units were correct? J Breast Health. 2017;13:23–6.
Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, et al. A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol. 2017;62:7714–28.
Huang Q, Zhang F, Li X. Machine learning in ultrasound computer-aided diagnostic systems: a survey. Biomed Res Int. 2018;4(2018):5137904.
Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35:1285–98.
Shi J, Zhou S, Liu X, Zhang Q, Lu M, Wang T. Stacked deep polynomial network based representation learning for tumor classification with small ultrasound image dataset. Neurocomputing. 2016;194:87–94.
Stoffel E, Becker AS, Wurnig MC, Marcon M, Ghafoor S, Berger N, et al. Distinction between phyllodes tumor and fibroadenoma in breast ultrasound using deep learning image analysis. Eur J Radiol Open. 2018;24:165–70.
Kumar V, Webb JM, Gregory A, Denis M, Meixner DD, Bayat M, et al. Automated and real-time segmentation of suspicious breast masses using convolutional neural network. PLoS ONE. 2018;16(13):e0195816.
M Claesen, B De Moor. Hyperparameter search in machine learning. arXiv:1502.02127 (2015).
Acknowledgements
For this study, Kazunori Kubota and Tomoyuki Fujioka received grant (KAKENHI-PROJECT-16K10270; https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-16K10270/).
Funding
Kazunori Kubota and Tomoyuki Fujioka received grant (KAKENHI-PROJECT-16K10270; https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-16K10270/).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All the authors and their institution have no conflicts of interest.
Ethical approval
All procedures used in this research were approved by the Ethical Committee of Tokyo Medical and Dental University, Medical Hospital.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Fujioka, T., Kubota, K., Mori, M. et al. Distinction between benign and malignant breast masses at breast ultrasound using deep learning method with convolutional neural network. Jpn J Radiol 37, 466–472 (2019). https://doi.org/10.1007/s11604-019-00831-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11604-019-00831-5