Abstract
Breast tumor is one of the major cause of death among women all over the world. Ultrasound imaging-based breast abnormality detection and classification play a vital role to develop an automatic computer-aided diagnostic system. In this paper, deep learning technology is integrated with ultrasound images for pre-screening of breast cancer. Two breast ultrasound image datasets are trained on different deep-learning architectures with image augmentation. Convolutional neural network extracts the features from training ultrasound images which are fine-tuned for multiple iterations. The experimental outcomes indicate accurate and rapid prediction performance on the test dataset of 2D B-mode ultrasound images, signifying a promising approach for assistance to radiologists in clinical applications with the use of deep learning. Results demonstrate the proposed method attains an accuracy, sensitivity, and specificity of 96.31%, 92.63%, and 96.71% respectively. About 12 B-mode 2D ultrasound image frames can be processed per second which marks it as a highly efficient system. The proposed method gives better performance compared to other methods which shows its effectiveness in real-time computer-aided diagnosis of breast tumor and benign-malignant classification.
Similar content being viewed by others
References
Al-Dhabyani W, Gomaa M, Khaled H, Fahmy A (2020) Dataset of breast ultrasound images. Data Br 28:104863. https://doi.org/10.1016/j.dib.2019.104863
American Cancer Society (2019) “Breast cancer facts & figure,” Am Cancer Soc 70(8): 515–517. [Online] Accessed on 15 June, 2020
Atrey K, Singh BK, Roy A, Bodhey NK (2020) “Breast cancer detection and validation using dual modality imaging,” 454–458, https://doi.org/10.1109/icpc2t48082.2020.9071501
Cai L, Wang X, Wang Y, Guo Y, Yu J, Wang Y (2015) Robust phase-based texture descriptor for classification of breast ultrasound images. Biomed Eng Online 14(1):1. https://doi.org/10.1186/s12938-015-0022-8
Chen Z, Strange H, Oliver A, Denton ERE, Boggis C, Zwiggelaar R (2015) Topological Modeling and Classification of Mammographic Microcalcification Clusters. IEEE Trans Biomed Eng 62(4):1203–1214. https://doi.org/10.1109/TBME.2014.2385102
Corsetti V et al (2011) Evidence of the effect of adjunct ultrasound screening in women with mammography-negative dense breasts: Interval breast cancers at 1 year follow-up. Eur J Cancer 47(7):1021–1026. https://doi.org/10.1016/j.ejca.2010.12.002
Costantini M, Belli P, Lombardi R, Franceschini G, Mulè A, Bonomo L (2006) Characterization of solid breast masses: Use of the sonographic breast imaging reporting and data system lexicon. J Ultrasound Med 25(5):649–659. https://doi.org/10.7863/jum.2006.25.5.649
Da Silva Neto PR, De Carvalho Filho OA (2019) “Automatic classification of breast lesions using Transfer Learning,” IEEE Lat. Am. Trans 17(12):1964–1969. https://doi.org/10.1109/TLA.2019.9011540
Eltrass AS, Salama MS (2020) Fully automated scheme for computer-aided detection and breast cancer diagnosis using digitised mammograms. IET Image Process 14(3):495–505. https://doi.org/10.1049/iet-ipr.2018.5953
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, in: Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. https://doi.org/10.1109/CVPR.2016.90
Huang YL, Lin SH, Chen DR (2005) “Computer-aided diagnosis applied to 3-D US of solid breast nodules by using principal component analysis and image retrieval,” in Annual International Conference of the IEEE Engineering in Medicine and Biology – Proceedings 7: 1802–1805. https://doi.org/10.1109/iembs.2005.1616798
Huang YL, Wang KL, Chen DR (2006) Diagnosis of breast tumors with ultrasonic texture analysis using support vector machines. Neural Comput Appl 15(2):164–169. https://doi.org/10.1007/s00521-005-0019-5
Huang Q, Luo Y, Zhang Q (2017) Breast ultrasound image segmentation: a survey. Int J Comput Assist Radiol Surg 12(3):493–507. https://doi.org/10.1007/s11548-016-1513-1
Huang Q, Chen Y, Liu L, Tao D, Li X (2020) On Combining Biclustering Mining and AdaBoost for Breast Tumor Classification. IEEE Trans Knowl Data Eng 32(4):728–738. https://doi.org/10.1109/TKDE.2019.2891622
Krizhevsky A, Sutskever I, Hinton GE (2020) AlexNet, ACM Int. Conf. Proceeding Ser
Kuo WJ, Chang RF, Chen DR, Lee CC (2001) Data mining with decision trees for diagnosis of breast tumor in medical ultrasonic images. Breast Cancer Res Treat 66(1):51–57. https://doi.org/10.1023/A:1010676701382
Lecun Y, Bottou L, Bengio Y, Ha P (1998) LeNet, Proc. IEEE
Liao WX et al (2020) Automatic Identification of Breast Ultrasound Image Based on Supervised Block-Based Region Segmentation Algorithm and Features Combination Migration Deep Learning Model. IEEE J Biomed Heal Informatics 24(4):984–993. https://doi.org/10.1109/JBHI.2019.2960821
Mendelson EB, Böhm-Vélez M, Berg WA et al (2013) “ACR BI-RADS® Ultrasound.,” ACR BI-RADS® Atlas, Breast Imaging Report. Data Syst
Moon WK, Lee Y-W, Ke H-H, Lee SH, Huang CS, Chang RF (2020) Computer-aided diagnosis of breast ultrasound images using ensemble learning from convolutional neural networks. Comput Methods Programs Biomed 190:105361. https://doi.org/10.1016/j.cmpb.2020.105361
Moon WK, Lee YW, Ke HH, Lee SH, Huang CS, Chang RF (2020) Computer-aided diagnosis of breast ultrasound images using ensemble learning from convolutional neural networks. Comput Methods Programs Biomed. https://doi.org/10.1016/j.cmpb.2020.105361
Paulinelli RR et al (2005) Risk of malignancy in solid breast nodules according to their sonographic features. J Ultrasound Med 24(5):635–641. https://doi.org/10.7863/jum.2005.24.5.635
Redmon J, Farhadi A (2018) ‘‘YOLOv3: An incremental improvement,’’ 2018, https://arxiv.org/abs/1804.02767. [Online]. Available: https://arxiv.org/abs/1804.02767
Sahiner B et al (2007) Malignant and benign breast masses on 3D US volumetric images: Effect of computer-aided diagnosis on radiologist accuracy. Radiology 242(3):716–724. https://doi.org/10.1148/radiol.2423051464
Siegel RL, Miller KD, Jemal A (2020) Cancer statistics, 2020. CA Cancer J Clin 70(1):7–30. https://doi.org/10.3322/caac.21590
Simonyan K, Zisserman A (2015) “Very deep convolutional networks for large-scale image recognition,” in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2014) GoogLeNet, Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit
Tang X, Xiao Q, Yu K (2020) “Breast cancer candidate gene detection through integration of subcellular localization data with protein-protein interaction networks,” IEEE Trans. Nanobioscience 1–1, 2020. https://doi.org/10.1109/tnb.2020.2990178
Thitaikumar A, Mobbs LM, Kraemer-Chant CM, Garra BS, Ophir J (2008) Breast tumor classification using axial shear strain elastography: A feasibility study. Phys Med Biol 53(17):4809–4823. https://doi.org/10.1088/0031-9155/53/17/022
Wang Y et al (2020) Deeply-Supervised Networks with Threshold Loss for Cancer Detection in Automated Breast Ultrasound. IEEE Trans Med Imaging 39(4):866–876. https://doi.org/10.1109/TMI.2019.2936500
Whitney HM, Li H, Ji Y, Liu P, Giger ML (2020) Comparison of Breast MRI Tumor Classification Using Human-Engineered Radiomics, Transfer Learning from Deep Convolutional Neural Networks, and Fusion Method. Proc IEEE 108(1):163–177. https://doi.org/10.1109/JPROC.2019.2950187
Wu JX, Chen PY, Lin CH, Chen S, Shung KK (2020) Breast Benign and Malignant Tumors Rapidly Screening by ARFI-VTI Elastography and Random Decision Forests Based Classifier. IEEE Access 8:54019–54034. https://doi.org/10.1109/ACCESS.2020.2980292
Yap MH et al (2018) Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks. IEEE J Biomed Heal Informatics. https://doi.org/10.1109/JBHI.2017.2731873
Zhao F, Li X, Biswas S, Mullick R, Mendonça PRS, Vaidya V (2014) “Topological texture-based method for mass detection in breast ultrasound image,” in 2014 IEEE 11th International Symposium on Biomedical Imaging, ISBI 2014, Apr. 685–689. https://doi.org/10.1109/isbi.2014.6867963
Zhang E, Seiler S, Chen M, Lu W, Gu X (2020) BIRADS features-oriented semi-supervised deep learning for breast ultrasound computer-aided diagnosis. Phys Med Biol 65:125005. https://doi.org/10.1088/1361-6560/ab7e7d
Zhou L et al (2020) Transfer learning-based DCE-MRI method for identifying differentiation between benign and malignant breast tumors. IEEE Access. https://doi.org/10.1109/ACCESS.2020.2967820
Zou Y, Guo Z (2003) A review of electrical impedance techniques for breast cancer detection. Med Eng Phys 25(2):79–90. https://doi.org/10.1016/S1350-4533(02)00194-7
Yu X, Kang C, Guttery DS, Kadry S, Chen Y, Zhang ZD (2020) “ResNet-SCDA-50 for breast abnormality classification,” IEEE/ACM Trans. Comput. Biol. Bioinforma 1–1. https://doi.org/10.1109/tcbb.2020.2986544
Acknowledgements
This research was supported in parts by the Grants from Department of Science and Technology, Government of India, grant number SEED/TIDE/2018/6/G.
Author information
Authors and Affiliations
Contributions
RCJ, DS and MKD designed the study. RCJ, DS and VT performed data analysis under supervision of MKD. RCJ, DS, VT and MKD drafted the paper. All authors approved the final version of the draft.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Joshi, R.C., Singh, D., Tiwari, V. et al. An efficient deep neural network based abnormality detection and multi-class breast tumor classification. Multimed Tools Appl 81, 13691–13711 (2022). https://doi.org/10.1007/s11042-021-11240-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11240-0