Skip to main content

Advertisement

Log in

An efficient deep neural network based abnormality detection and multi-class breast tumor classification

  • 1176: Artificial Intelligence and Deep Learning for Biomedical Applications
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Breast tumor is one of the major cause of death among women all over the world. Ultrasound imaging-based breast abnormality detection and classification play a vital role to develop an automatic computer-aided diagnostic system. In this paper, deep learning technology is integrated with ultrasound images for pre-screening of breast cancer. Two breast ultrasound image datasets are trained on different deep-learning architectures with image augmentation. Convolutional neural network extracts the features from training ultrasound images which are fine-tuned for multiple iterations. The experimental outcomes indicate accurate and rapid prediction performance on the test dataset of 2D B-mode ultrasound images, signifying a promising approach for assistance to radiologists in clinical applications with the use of deep learning. Results demonstrate the proposed method attains an accuracy, sensitivity, and specificity of 96.31%, 92.63%, and 96.71% respectively. About 12 B-mode 2D ultrasound image frames can be processed per second which marks it as a highly efficient system. The proposed method gives better performance compared to other methods which shows its effectiveness in real-time computer-aided diagnosis of breast tumor and benign-malignant classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Al-Dhabyani W, Gomaa M, Khaled H, Fahmy A (2020) Dataset of breast ultrasound images. Data Br 28:104863. https://doi.org/10.1016/j.dib.2019.104863

    Article  Google Scholar 

  2. American Cancer Society (2019) “Breast cancer facts & figure,” Am Cancer Soc 70(8): 515–517. [Online] Accessed on 15 June, 2020

  3. Atrey K, Singh BK, Roy A, Bodhey NK (2020) “Breast cancer detection and validation using dual modality imaging,” 454–458, https://doi.org/10.1109/icpc2t48082.2020.9071501

  4. Cai L, Wang X, Wang Y, Guo Y, Yu J, Wang Y (2015) Robust phase-based texture descriptor for classification of breast ultrasound images. Biomed Eng Online 14(1):1. https://doi.org/10.1186/s12938-015-0022-8

    Article  Google Scholar 

  5. Chen Z, Strange H, Oliver A, Denton ERE, Boggis C, Zwiggelaar R (2015) Topological Modeling and Classification of Mammographic Microcalcification Clusters. IEEE Trans Biomed Eng 62(4):1203–1214. https://doi.org/10.1109/TBME.2014.2385102

    Article  Google Scholar 

  6. Corsetti V et al (2011) Evidence of the effect of adjunct ultrasound screening in women with mammography-negative dense breasts: Interval breast cancers at 1 year follow-up. Eur J Cancer 47(7):1021–1026. https://doi.org/10.1016/j.ejca.2010.12.002

    Article  Google Scholar 

  7. Costantini M, Belli P, Lombardi R, Franceschini G, Mulè A, Bonomo L (2006) Characterization of solid breast masses: Use of the sonographic breast imaging reporting and data system lexicon. J Ultrasound Med 25(5):649–659. https://doi.org/10.7863/jum.2006.25.5.649

    Article  Google Scholar 

  8. Da Silva Neto PR, De Carvalho Filho OA (2019) “Automatic classification of breast lesions using Transfer Learning,” IEEE Lat. Am. Trans 17(12):1964–1969. https://doi.org/10.1109/TLA.2019.9011540

  9. Eltrass AS, Salama MS (2020) Fully automated scheme for computer-aided detection and breast cancer diagnosis using digitised mammograms. IET Image Process 14(3):495–505. https://doi.org/10.1049/iet-ipr.2018.5953

    Article  Google Scholar 

  10. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, in: Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. https://doi.org/10.1109/CVPR.2016.90

  11. Huang YL, Lin SH, Chen DR (2005) “Computer-aided diagnosis applied to 3-D US of solid breast nodules by using principal component analysis and image retrieval,” in Annual International Conference of the IEEE Engineering in Medicine and Biology – Proceedings 7: 1802–1805. https://doi.org/10.1109/iembs.2005.1616798

  12. Huang YL, Wang KL, Chen DR (2006) Diagnosis of breast tumors with ultrasonic texture analysis using support vector machines. Neural Comput Appl 15(2):164–169. https://doi.org/10.1007/s00521-005-0019-5

    Article  Google Scholar 

  13. Huang Q, Luo Y, Zhang Q (2017) Breast ultrasound image segmentation: a survey. Int J Comput Assist Radiol Surg 12(3):493–507. https://doi.org/10.1007/s11548-016-1513-1

    Article  Google Scholar 

  14. Huang Q, Chen Y, Liu L, Tao D, Li X (2020) On Combining Biclustering Mining and AdaBoost for Breast Tumor Classification. IEEE Trans Knowl Data Eng 32(4):728–738. https://doi.org/10.1109/TKDE.2019.2891622

    Article  Google Scholar 

  15. Krizhevsky A, Sutskever I, Hinton GE (2020) AlexNet, ACM Int. Conf. Proceeding Ser

  16. Kuo WJ, Chang RF, Chen DR, Lee CC (2001) Data mining with decision trees for diagnosis of breast tumor in medical ultrasonic images. Breast Cancer Res Treat 66(1):51–57. https://doi.org/10.1023/A:1010676701382

    Article  Google Scholar 

  17. Lecun Y, Bottou L, Bengio Y, Ha P (1998) LeNet, Proc. IEEE

  18. Liao WX et al (2020) Automatic Identification of Breast Ultrasound Image Based on Supervised Block-Based Region Segmentation Algorithm and Features Combination Migration Deep Learning Model. IEEE J Biomed Heal Informatics 24(4):984–993. https://doi.org/10.1109/JBHI.2019.2960821

    Article  Google Scholar 

  19. Mendelson EB, Böhm-Vélez M, Berg WA et al (2013) “ACR BI-RADS® Ultrasound.,” ACR BI-RADS® Atlas, Breast Imaging Report. Data Syst

  20. Moon WK, Lee Y-W, Ke H-H, Lee SH, Huang CS, Chang RF (2020) Computer-aided diagnosis of breast ultrasound images using ensemble learning from convolutional neural networks. Comput Methods Programs Biomed 190:105361. https://doi.org/10.1016/j.cmpb.2020.105361

    Article  Google Scholar 

  21. Moon WK, Lee YW, Ke HH, Lee SH, Huang CS, Chang RF (2020) Computer-aided diagnosis of breast ultrasound images using ensemble learning from convolutional neural networks. Comput Methods Programs Biomed. https://doi.org/10.1016/j.cmpb.2020.105361

    Article  Google Scholar 

  22. Paulinelli RR et al (2005) Risk of malignancy in solid breast nodules according to their sonographic features. J Ultrasound Med 24(5):635–641. https://doi.org/10.7863/jum.2005.24.5.635

    Article  Google Scholar 

  23. Redmon J, Farhadi A (2018) ‘‘YOLOv3: An incremental improvement,’’ 2018, https://arxiv.org/abs/1804.02767. [Online]. Available: https://arxiv.org/abs/1804.02767

  24. Sahiner B et al (2007) Malignant and benign breast masses on 3D US volumetric images: Effect of computer-aided diagnosis on radiologist accuracy. Radiology 242(3):716–724. https://doi.org/10.1148/radiol.2423051464

    Article  Google Scholar 

  25. Siegel RL, Miller KD, Jemal A (2020) Cancer statistics, 2020. CA Cancer J Clin 70(1):7–30. https://doi.org/10.3322/caac.21590

    Article  Google Scholar 

  26. Simonyan K, Zisserman A (2015) “Very deep convolutional networks for large-scale image recognition,” in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings

  27. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2014) GoogLeNet, Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit

  28. Tang X, Xiao Q, Yu K (2020) “Breast cancer candidate gene detection through integration of subcellular localization data with protein-protein interaction networks,” IEEE Trans. Nanobioscience 1–1, 2020. https://doi.org/10.1109/tnb.2020.2990178

  29. Thitaikumar A, Mobbs LM, Kraemer-Chant CM, Garra BS, Ophir J (2008) Breast tumor classification using axial shear strain elastography: A feasibility study. Phys Med Biol 53(17):4809–4823. https://doi.org/10.1088/0031-9155/53/17/022

    Article  Google Scholar 

  30. Wang Y et al (2020) Deeply-Supervised Networks with Threshold Loss for Cancer Detection in Automated Breast Ultrasound. IEEE Trans Med Imaging 39(4):866–876. https://doi.org/10.1109/TMI.2019.2936500

    Article  Google Scholar 

  31. Whitney HM, Li H, Ji Y, Liu P, Giger ML (2020) Comparison of Breast MRI Tumor Classification Using Human-Engineered Radiomics, Transfer Learning from Deep Convolutional Neural Networks, and Fusion Method. Proc IEEE 108(1):163–177. https://doi.org/10.1109/JPROC.2019.2950187

    Article  Google Scholar 

  32. Wu JX, Chen PY, Lin CH, Chen S, Shung KK (2020) Breast Benign and Malignant Tumors Rapidly Screening by ARFI-VTI Elastography and Random Decision Forests Based Classifier. IEEE Access 8:54019–54034. https://doi.org/10.1109/ACCESS.2020.2980292

    Article  Google Scholar 

  33. Yap MH et al (2018) Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks. IEEE J Biomed Heal Informatics. https://doi.org/10.1109/JBHI.2017.2731873

    Article  Google Scholar 

  34. Zhao F, Li X, Biswas S, Mullick R, Mendonça PRS, Vaidya V (2014) “Topological texture-based method for mass detection in breast ultrasound image,” in 2014 IEEE 11th International Symposium on Biomedical Imaging, ISBI 2014, Apr. 685–689. https://doi.org/10.1109/isbi.2014.6867963

  35. Zhang E, Seiler S, Chen M, Lu W, Gu X (2020) BIRADS features-oriented semi-supervised deep learning for breast ultrasound computer-aided diagnosis. Phys Med Biol 65:125005. https://doi.org/10.1088/1361-6560/ab7e7d

    Article  Google Scholar 

  36. Zhou L et al (2020) Transfer learning-based DCE-MRI method for identifying differentiation between benign and malignant breast tumors. IEEE Access. https://doi.org/10.1109/ACCESS.2020.2967820

    Article  Google Scholar 

  37. Zou Y, Guo Z (2003) A review of electrical impedance techniques for breast cancer detection. Med Eng Phys 25(2):79–90. https://doi.org/10.1016/S1350-4533(02)00194-7

    Article  Google Scholar 

  38. Yu X, Kang C, Guttery DS, Kadry S, Chen Y, Zhang ZD (2020) “ResNet-SCDA-50 for breast abnormality classification,” IEEE/ACM Trans. Comput. Biol. Bioinforma 1–1. https://doi.org/10.1109/tcbb.2020.2986544

Download references

Acknowledgements

This research was supported in parts by the Grants from Department of Science and Technology, Government of India, grant number SEED/TIDE/2018/6/G.

Author information

Authors and Affiliations

Authors

Contributions

RCJ, DS and MKD designed the study. RCJ, DS and VT performed data analysis under supervision of MKD. RCJ, DS, VT and MKD drafted the paper. All authors approved the final version of the draft.

Corresponding author

Correspondence to Malay Kishore Dutta.

Ethics declarations

Conflict of interest

The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Joshi, R.C., Singh, D., Tiwari, V. et al. An efficient deep neural network based abnormality detection and multi-class breast tumor classification. Multimed Tools Appl 81, 13691–13711 (2022). https://doi.org/10.1007/s11042-021-11240-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11240-0

Keywords

Navigation