Skip to main content

Advertisement

SpringerLink
Log in

Recognizing breast tumors based on mammograms combined with pre-trained neural networks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Breast cancer is one of the most common cancers in women worldwide, and it seriously threatens people’s lives and health. Breast Imaging Reporting and Data System is developed as a standardized system or tool for reporting breast mammograms, where different grades of diagnosis and treatment are critical to the survival rate and survival time of patients. Efficient computer-aided diagnosis of breast tumors based on computer vision models can better assist physicians in selecting effective treatment options, thereby reducing patient mortality. Therefore, early detection and early treatment are of great significance to patients with breast disease. In this study, a new image enhancement framework, called Image Negatives and Contrast Limited Adaptive Histogram Equalization Image Enhancement, was created for the first time based on the comparison of a set of multiple data preprocessing methods for detecting normal, benign, and probably benign breasts. The ResNet-50 pre-trained neural network was used for feature extraction and the classification results were compared on K-nearest neighbor, Random Forest, and Support Vector Machine classifiers. The evaluation indexes adopted in this paper include confusion matrix, precision, sensitivity, F1 Score, etc. These evaluation indexes can be used to evaluate the model in a very comprehensive and accurate way. The experiments show that the KNN classifier has the best classification result, the classification accuracy is 85%, and the AUC is 0.89. It is proved that mammography, as a non-invasive screening tool, has certain practical significance in effectively evaluating tumor grade and its clinical application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Abdel-Nasser M, Moreno A, Puig D (2016) Temporal mammogram image registration using optimized curvilinear coordinates. Comput Methods Programs Biomed 127:1–14

    Google Scholar 

  2. Abdelhafiz D et al (2019) Deep convolutional neural networks for mammography: advances, challenges and applications. BMC Bioinform 20(Suppl 11):281

    Google Scholar 

  3. Al-Najdawi N, Biltawi M, Tedmori S (2015) Mammogram image visual enhancement, mass segmentation and classification. Appl Soft Comput 35:175–185

    Google Scholar 

  4. Alshayeji MH et al (2022) Computer-aided detection of breast cancer on the Wisconsin dataset: an artificial neural networks approach. Biomed Signal Process Control 71:103141

    Google Scholar 

  5. Arputham C et al (2021) Mammographic image classification using deep neural network for computer-aided diagnosis. Intell Autom Soft Comput 27(3):747–759

    Google Scholar 

  6. Bakkouri I, Afdel K (2018) Multi-scale CNN based on region proposals for efficient breast abnormality recognition. Multimed Tools Appl 78(10):12939–12960

    Google Scholar 

  7. Beeravolu AR et al (2021) Preprocessing of breast cancer images to create datasets for Deep-CNN. IEEE Access 9:33438–33463

    Google Scholar 

  8. Benhassine NE, Boukaache A, Boudjehem D (2019) Classification of mammogram images using the energy probability in frequency domain and most discriminative power coefficients. Int J Imaging Syst Technol 30(1):45–56

    Google Scholar 

  9. Boumaraf S et al (2020) A new computer-aided diagnosis system with modified genetic feature selection for BI-RADS classification of breast masses in mammograms. Biomed Res Int 2020:7695207

    Google Scholar 

  10. Bozkurt S et al (2016) Using automatically extracted information from mammography reports for decision-support. J Biomed Inform 62:224–231

    Google Scholar 

  11. Chokri F, Hayet M, Farida (2016) Mammographic mass classification according to Bi-RADS lexicon. IET Comput Vision 11(3):189–198

    Google Scholar 

  12. Corcoran J et al (2015) The effects of point or polygon based training data on randomforest classification accuracy of wetlands. Remote Sens 7(4):4002–4025

    Google Scholar 

  13. Fanizzi A et al (2016) Automatised detection of microcalcification in mammography. Phys Med 32:217

    Google Scholar 

  14. Ferlay J et al (2010) Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. Int J Cancer 127(12):2893–2917

    Google Scholar 

  15. Ghaemian N, Haji Ghazi N, Tehrani, Nabahati M (2021) Accuracy of mammography and ultrasonography and their BI-RADS in detection of breast malignancy. Casp J Intern Med 12(4):573–579

    Google Scholar 

  16. Goel N et al (2022) Dilated CNN for abnormality detection in wireless capsule endoscopy images. Soft Comput 26(3):1231–1247

    Google Scholar 

  17. Goel N et al (2022) Investigating the significance of color space for abnormality detection in wireless capsule endoscopy images. Biomed Signal Process Control 75:103624

    Google Scholar 

  18. Greenspan H, van Ginneken B, Summers RM (2016) Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans Med Imaging 35(5):1153–1159

    Google Scholar 

  19. Kumar A, Sushil R, Tiwari AK (2019) Comparative study of classification techniques for breast cancer diagnosis. Int J Comput Sci Eng 7(1):234–240

    Google Scholar 

  20. Lbachir IA et al (2017) A New mammogram preprocessing method for computer-aided diagnosis systems. In: 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA), pp 166–171

  21. Lecun Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Google Scholar 

  22. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Google Scholar 

  23. Lee S et al (2019) Noise removal in medical mammography images using fast non-local means denoising algorithm for early breast cancer detection: a phantom study. Optik 180:569–575

    Google Scholar 

  24. Li H et al (2019) Benign and malignant classification of mammogram images based on deep learning. Biomed Signal Process Control 51:347–354

    Google Scholar 

  25. Li M et al (2020) Computer-aided diagnosis and staging of pancreatic cancer based on CT images. IEEE Access 8:141705–141718

    Google Scholar 

  26. Loizidou K et al (2021) Digital subtraction of temporally sequential mammograms for improved detection and classification of microcalcifications. Eur Radiol Exp 5(1):40

    Google Scholar 

  27. Lu L, Daigle BJ Jr (2020) Prognostic analysis of histopathological images using pre-trained convolutional neural networks: application to hepatocellular carcinoma. PeerJ 8:e8668

    Google Scholar 

  28. Luque-Baena RM et al (2014) Application of genetic algorithms and constructive neural networks for the analysis of microarray cancer data. Theor Biol Med Model 11:S7

    Google Scholar 

  29. Maroof N et al (2020) Mitosis detection in breast cancer histopathology images using hybrid feature space. Photodiagnosis Photodyn Ther 31:101885

    Google Scholar 

  30. Mathur M et al (2020) Crosspooled FishNet: transfer learning based fish species classification model. Multimed Tools Appl 79(41–42):31625–31643

    Google Scholar 

  31. Mehmood M et al (2021) Machine learning enabled early detection of breast cancer by structural analysis of mammograms. Comput Mater Contin 67(1):641–657

    Google Scholar 

  32. Miranda GH, Felipe JC (2015) Computer-aided diagnosis system based on fuzzy logic for breast cancer categorization. Comput Biol Med 64:334–346

    Google Scholar 

  33. Nwadike UI et al (2017) Mammographic classification of breast lesions amongst women in Enugu, South East Nigeria. Afr Health Sci 17(4):1044–1050

    Google Scholar 

  34. Pavey TG et al (2017) Field evaluation of a random forest activity classifier for wrist-worn accelerometer data. J Sci Med Sport 20(1):75–80

    Google Scholar 

  35. Rajaraman S et al (2018) Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images. PeerJ 6:e4568

    Google Scholar 

  36. Rajathi GM (2020) Optimized radial basis neural network for classification of breast cancer images. J Ambient Intell Humaniz Comput

  37. Rehman KU et al (2021) Computer vision-based microcalcification detection in Digital Mammograms using fully connected depthwise separable convolutional neural network. Sensors (Basel) 21(14):4854

    Google Scholar 

  38. Rigatti SJ (2017) Random forest. J Insurance Med (New York, NY) 47(1):31–39

    Google Scholar 

  39. Saffari N et al (2020) Fully automated breast density segmentation and classification using deep learning. Diagnostics (Basel) 10(11):988

    Google Scholar 

  40. Sampath D, Murthy A, Karthikeyan T, Vinoth R, Kanna (2021) Gait-based person fall prediction using deep learning approach. Soft Comput

  41. Shen L et al (2019) Deep learning to improve breast cancer detection on screening mammography. Sci Rep 9(1):12495

    MathSciNet  Google Scholar 

  42. Sung H et al (2021) Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and Mortality Worldwide for 36 cancers in 185 countries. CA Cancer J Clin 71(3):209–249

    Google Scholar 

  43. Tajbakhsh N et al (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299–1312

    Google Scholar 

  44. Vapnik VN (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988–999

    Google Scholar 

  45. Verma B (2008) Novel network architecture and learning algorithm for the classification of mass abnormalities in digitized mammograms. Artif Intell Med 42(1):67–79

    MathSciNet  Google Scholar 

  46. Williamson S, Vijayakumar K, Kadam VJ (2021) Predicting breast cancer biopsy outcomes from BI-RADS findings using random forests with chi-square and MI features. Multimed Tools Appl

  47. Xue J, Zhao YX (2008) Random forests of phonetic decision trees for acoustic modeling in conversational speech recognition. IEEE Trans Audio Speech Lang Process 16(3):519–528

    Google Scholar 

  48. Yan Z et al (2020) Rapid identification of benign and malignant pancreatic tumors using serum Raman spectroscopy combined with classification algorithms. Optik 208:164473

    Google Scholar 

  49. Yang B et al (2021) Detection of breast cancer of various clinical stages based on serum FT-IR spectroscopy combined with multiple algorithms. Photodiagnosis Photodyn Ther 33:102199

    Google Scholar 

  50. Zeng J et al (2019) A probabilistic model to support radiologists’ classification decisions in mammography practice. Med Decis Making 39(3):208–216

    Google Scholar 

  51. Zhang X et al (2015) Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans Med Imaging 34(2):496–506

    Google Scholar 

  52. Zhang X et al (2017) Whole mammogram image classification with convolutional neural networks. In: Hu XH et al (Eds) 2017 IEEE International Conference on Bioinformatics and Biomedicine, pp 700–704

  53. Zhang Q, Wang H, Yoon SW (2020) A 1-norm regularized linear programming nonparallel hyperplane support vector machine for binary classification problems. Neurocomputing 376:141–152

    Google Scholar 

  54. Zhang N et al (2021) Application of deep learning to establish a diagnostic model of breast lesions using two-dimensional grayscale ultrasound imaging. Clin Imaging 79:56–63

    Google Scholar 

  55. Zhang S et al (2021) Research on application of classification model based on Stack generalization in staging of cervical tissue pathological images. IEEE Access 9:48980–48991

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the Xinjiang Uygur Autonomous Region Science Foundation for Distinguished Young Scholars under Grant 2019Q003, in part by the Tianshan Innovation Team Planning Project under Grant 2020D14031, and in part by the Tianshan Youth Planning Project under Grant 2019Q043.

Author information

Author notes

  1. Yujie Bai and Min Li contributed equally to this work and should be considered co-first authors.

Authors and Affiliations

  1. College of Software, Xinjiang University, Urumqi, 830046, China

    Yujie Bai, Cheng Chen & Xiaoyi Lv

  2. College of Information Science and Engineering, Xinjiang University, Urumqi, 830046, China

    Min Li & Chen Chen

  3. The Affiliated Cancer Hospital of Xinjiang Medical University, Urumqi, 830011, China

    Xiaojian Ma, Xiaojing Gan & Hongtao Li

  4. Key Laboratory of Software Engineering Technology, Xinjiang University, Urumqi, 830046, China

    Xiaoyi Lv

  5. Department of Pathology, Xinjiang Key Laboratory of Clinical Genetic Testing and Biomedical Information, Karamay Central Hospital, Karamay, China

    Chen Chen & Xiaoyi Lv

  6. Key Laboratory of Signal Detection and Processing, Xinjiang University, Urumqi, 830046, China

    Xiaoyi Lv

Authors
  1. Yujie Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaojian Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaojing Gan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Cheng Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chen Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xiaoyi Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hongtao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Xiaoyi Lv or Hongtao Li.

Ethics declarations

Conflict of interest

The authors have no relevant financial interests in this article and no potential conflicts of interest to disclose.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

Table 9 List of abbreviations
Full size table

Appendix 2

Table 10 List of symbols
Full size table

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bai, Y., Li, M., Ma, X. et al. Recognizing breast tumors based on mammograms combined with pre-trained neural networks. Multimed Tools Appl 82, 27989–28008 (2023). https://doi.org/10.1007/s11042-023-14708-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14708-3

Keywords

Search

Navigation