Skip to main content
SpringerLink
Log in

Breast Mammograms Diagnosis Using Deep Learning: State of Art Tutorial Review

  • Review Article
  • Published:
Archives of Computational Methods in Engineering Aims and scope Submit manuscript

Abstract

Usually, screening (mostly mammography) is used by radiologists to manually detect breast cancer. The likelihood of identifying suspected cases as false positives or false negatives is significant, contingent on the experience of the radiologist and the kind of imaging screening device/method utilized. The confirmation of the type of tumour seen by the radiologist is sent for histological investigation (microscopic analysis) through a biopsy, where the tumor's grade and stage, which are used in the latter stages of treatment, are ascertained through biopsy. However, a secondary issue with the cancer detection process is that only 15 to 30% of instances that are referred for biopsy result in malignant findings. Since deep learning demonstrated remarkable performance in visual recognition challenges, it has been widely applied to a variety of tasks. Similar examples include deep learning applications in healthcare, which are gaining a lot of interest from the research community. Deep learning is used to identify, categories tumours, and breast cancer is a significant global health concern. The medical sciences could now make more accurate diagnoses and detections due to recent advancements in machine learning techniques. Hence due to systems potential accuracy, it could offer optimistic outcomes when used to read malignant images. In imaging domains, deep learning-based methods have achieved remarkable success in constituent segmentation (UNet), localization (DenseNet), and classification (VGG-19). This study examines, how deep learning methods are assisting in the highly accurate diagnosis of benign or malignant tumours based on screened images. In contrast to a mammogram, which is covered in detail, this paper briefly discusses imaging methods for cancer detection. Early detection and cost effectiveness are two main benefits of applying machine learning and deep learning techniques to mammograms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Rahim MSM, Norouzi A, Rehman A, Saba T (2017) 3D bones segmentation based on CT images visualization. Biomed Res 28(8):3641–3644

    Google Scholar 

  2. What cells in the human body live the longest? (2020) https://www.sciencefocus.com/. https://www.sciencefocus.com/the-human-body/what-cells-in-the-human-body-live-the-longest/

  3. C. T. C. O. America (2019) What is cancer? https://www.cancercenter.com/what-is-cancer

  4. Larabi-Marie-Sainte S, Aburahmah L, Almohaini R et al (2019) Current techniques for diabetes prediction: review and case study. Appl Sci 9(21):4604

    Article  Google Scholar 

  5. S. H. Care (2020) Cancer types. https://stanfordhealthcare.org/medical-conditions/cancer/cancer/cancer-types.html

  6. Nazir M, Khan MA, Saba T, Rehman A (2019) Brain tumor detection from MRI images using multi-level wavelets. In: 2019 International conference on computer and information sciences (ICCIS), April 2019. IEEE, pp 1–5

  7. M. Clinic (2019) Leukemia. https://www.mayoclinic.org/diseases-conditions/leukemia/symptoms-causes/syc-20374373

  8. Webmd (2019) What is lymphoma? https://www.webmd.com/cancer/lymphoma/lymphoma-cancer

  9. A. S. o. C. O. (ASCO) (2019) Breast cancer: introduction. https://www.cancer.net/cancer-types/breast-cancer/introduction

  10. A. C. Society (2020) What is breast cancer? https://www.cancer.org/cancer/breast-cancer/about/what-is-breast-cancer.html

  11. S. H. Care (2020). About this condition: breast cancer. https://stanfordhealthcare.org/medical-conditions/cancer/breast-cancer/about-this-condition/types.html

  12. Sadad T, Rehman A, Munir A et al (2021) Brain tumor detection and multi-classification using advanced deep learning techniques. Microsc Res Tech 84(6):1296–1308

    Article  Google Scholar 

  13. W. C. R. F. W. International (2018) Global Cancer Observatory (GCO). https://gco.iarc.fr/today/online-analysis-pie?v=2018&mode=cancer&mode_population=continents&population=900&populations=900&key=total&sex=0&cancer=39&type=0&statistic=5&prevalence=0&population_group=0&ages_group%5B%5D=0&ages_group%5B%5D=17&nb_items=7&group_cancer=1&include_nmsc=1&include_nmsc_other=1&half_pie=0&donut=0&population_group_globocan_id=

  14. Ferlay EMJ, Lam F, Colombet M, Mery L, Piñeros M, Znaor A, Soerjomataram I, Bray F (2020) Global Cancer Observatory: cancer today. https://gco.iarc.fr/today/online-analysis-pie?v=2020&mode=cancer&mode_population=continents&population=900&populations=900&key=total&sex=2&cancer=39&type=1&statistic=5&prevalence=0&population_group=0&ages_group%5B%5D=0&ages_group%5B%5D=17&nb_items=5&group_cancer=1&include_nmsc=1&include_nmsc_other=1&half_pie=0&donut=0#collapse-others

  15. Ghaderi K, Phillips J, Perry H, Lotfi P, Mehta T (2019) Contrast-enhanced mammography: current applications and future directions. Radiographics 39:1907–1920

    Article  Google Scholar 

  16. Phillips J (2015) Introduction to mammography. https://www.youtube.com/watch?v=dEdR4iOdLh0

  17. Singh OV, Choudhary P (2019) A study on convolution neural network for breast cancer detection. In: 2019 Second international conference on advanced computational and communication paradigms (ICACCP), 2019, pp 1–7

  18. Hussain N, Khan MA, Sharif M, Khan SA, Albesher AA et al (2020) A deep neural network and classical features based scheme for objects recognition: an application for machine inspection. Multimed Tools Appl. https://doi.org/10.1007/s11042-020-08852-3

    Article  Google Scholar 

  19. Javed R, Rahim MSM, Saba T, Rehman A (2020) A comparative study of features selection for skin lesion detection from dermoscopic images. Netw Model Anal Health Inform Bioinform 9:1–13

    Article  Google Scholar 

  20. Wojciechowski (2020) Breast cancer stages. https://www.breastcancer.org/symptoms/diagnosis/staging

  21. N. C. Institute (2020) Cancer staging. https://www.cancer.gov/about-cancer/diagnosis-staging/staging#:~:text=In%20situ%E2%80%94Abnormal%20cells%20are,distant%20parts%20of%20the%20body.

  22. A. C. Society (2020) Breast cancer early detection and diagnosis. https://www.cancer.org/cancer/breast-cancer/screening-tests-and-early-detection.html

  23. Kolb TM, Lichy J, Newhouse JH (2002) Comparison of the performance of screening mammography, physical examination, and breast US and evaluation of factors that influence them: an analysis of 27,825 patient evaluations. Radiology 225:165–175

    Article  Google Scholar 

  24. Brem RF, Lenihan MJ, Lieberman J, Torrente J (2015) Screening breast ultrasound: past, present, and future. Am J Roentgenol 204:234–240

    Article  Google Scholar 

  25. Eberl MM, Fox CH, Edge SB, Carter CA, Mahoney MC (2006) BI-RADS classification for management of abnormal mammograms. J Am Board Fam Med 19:161

    Article  Google Scholar 

  26. Niell BL, Freer PE, Weinfurtner RJ, Arleo EK, Drukteinis JS (2017) Screening for breast cancer. Radiol Clin N Am 55:1145–1162

    Article  Google Scholar 

  27. Lebron-Zapata L, Jochelson MS (2018) Overview of breast cancer screening and diagnosis. PET Clin 13:301–323

    Article  Google Scholar 

  28. O’Connor M, Rhodes D, Hruska C (2009) Molecular breast imaging. Expert Rev Anticancer Ther 9:1073–1080

    Article  Google Scholar 

  29. Tabár L, Fagerberg CJ, Gad A, Baldetorp L, Holmberg LH, Gröntoft O et al (1985) Reduction in mortality from breast cancer after mass screening with mammography. Randomised trial from the Breast Cancer Screening Working Group of the Swedish National Board of Health and Welfare. Lancet 1:829–832

    Article  Google Scholar 

  30. Shapiro S, Venet W, Strax P, Venet L, Roeser R (1982) Ten- to fourteen-year effect of screening on breast cancer mortality. J Natl Cancer Inst 69:349–355

    Google Scholar 

  31. Breastcancer.org (2020, 16 August) CT (CAT) scans (computerized tomography). https://www.breastcancer.org/symptoms/testing/types/cat_scans#:~:text=This%20helps%20determine%20whether%20or,an%20early%2Dstage%20breast%20cancer

  32. Moy L, Newell MS, Mahoney MC, Bailey L, Barke LD, Carkaci S et al (2016) ACR appropriateness criteria Stage I breast cancer: initial workup and surveillance for local recurrence and distant metastases in asymptomatic women. J Am Coll Radiol 13:e43–e52

    Article  Google Scholar 

  33. A. C. Society (2020) Breast biopsy. https://www.cancer.org/cancer/breast-cancer/screening-tests-and-early-detection/breast-biopsy.html

  34. Wallace A, Comstock C, Hoh C, Vera D (2005) Breast imaging: a surgeon’s prospective. Nucl Med Biol 32:781–792

    Article  Google Scholar 

  35. Saba T, Bokhari STF, Sharif M, Yasmin M, Raza M (2018) Fundus image classification methods for the detection of glaucoma: a review. Microsc Res Tech 81(10):1105–1121

    Article  Google Scholar 

  36. Khan MA, Sharif MI, Raza M, Anjum A et al (2022) Skin lesion segmentation and classification: a unified framework of deep neural network features fusion and selection. Expert Syst 39(7):e12497

    Article  Google Scholar 

  37. S. K. M. C. H. a. R. C. S. RC (November 27). https://shaukatkhanum.org.pk/sacp/

  38. Sechopoulos I, Teuwen J, Mann R (2021) Artificial intelligence for breast cancer detection in mammography and digital breast tomosynthesis: state of the art. Semin Cancer Biol 72:214–225

    Article  Google Scholar 

  39. Posso M, Puig T, Carles M, Rué M, Canelo-Aybar C, Bonfill X (2017) Effectiveness and cost-effectiveness of double reading in digital mammography screening: a systematic review and meta-analysis. Eur J Radiol 96:40–49

    Article  Google Scholar 

  40. Mughal B, Muhammad N, Sharif M et al (2018) Removal of pectoral muscle based on topographic map and shape-shifting silhouette. BMC Cancer 18(1):1–14

    Article  Google Scholar 

  41. Muhsin ZF, Rehman A, Altameem A et al (2014) Improved quadtree image segmentation approach to region information. Imaging Sci J 62(1):56–62

    Article  Google Scholar 

  42. Mughal B, Sharif M, Muhammad N et al (2018) A novel classification scheme to decline the mortality rate among women due to breast tumor. Microsc Res Tech 81(2):171–180

    Article  Google Scholar 

  43. Saba T, Rehman A, Mehmood Z, Kolivand H, Sharif M (2018) Image enhancement and segmentation techniques for detection of knee joint diseases: a survey. Curr Med Imaging 14(5):704–715

    Article  Google Scholar 

  44. Yousaf K, Mehmood Z, Saba T et al (2019) Mobile-health applications for the efficient delivery of health care facility to people with dementia (PwD) and support to their carers: a survey. BioMed Res Int 2019:7151475

    Article  Google Scholar 

  45. Sharif U, Mehmood Z, Mahmood T, Javid MA et al (2019) Scene analysis and search using local features and support vector machine for effective content-based image retrieval. Artif Intell Rev 52:901–925

    Article  Google Scholar 

  46. Sadad NT, Munir A, Saba T, Hussain A (2018) Fuzzy C-means and region growing based classification of tumor from mammograms using hybrid texture feature. J Comput Sci 29:34–45

    Article  MathSciNet  Google Scholar 

  47. NN-SVG (n.d.). http://alexlenail.me, http://alexlenail.me/NN-SVG/LeNet.html

  48. Saba T, Al-Zahrani S, Rehman A (2012) Expert system for offline clinical guidelines and treatment. Life Sci J 9(4):2639–2658

    Google Scholar 

  49. Lotter W, Sorensen G, Cox D (2017) A multi-scale CNN and curriculum learning strategy for mammogram classification. In: Deep learning in medical image analysis and multimodal learning for clinical decision support: third international workshop, DLMIA 2017, and 7th international workshop, ML-CDS 2017, held in conjunction with MICCAI 2017, Québec City, QC, Canada, 14 September 2017 Proceedings 3, pp 169–177.

  50. Geras KJ, Mann RM (2019) Artificial intelligence for mammography and digital breast tomosynthesis: current concepts and future perspectives. Radiology 293:246–259

    Article  Google Scholar 

  51. Yaroslav Nikulin YN, Clatz O, Iannessi A (2017) 5.1 - Yaroslav Nikulin (Therapixel). https://www.synapse.org/#!Synapse:syn4224222/wiki/439232

  52. Krizhevsky A, Sutskever I, Hinton GE, ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, 2012, pp 1097–1105.

  53. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  54. Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision, 2014, pp 818–833

  55. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp 770–778

  56. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp 1–9

  57. Abdelhafiz D, Yang C, Ammar R, Nabavi S (2019) Deep convolutional neural networks for mammography: advances, challenges and applications. BMC Bioinform 20:281

    Article  Google Scholar 

  58. Suckling J et al (1994) The Mammographic Image Analysis Society digital mammogram database Exerpta Medica. In: International congress series 1069, pp 375–378

  59. Debelee TG, Schwenker F, Ibenthal A, Yohannes D (2019) Survey of deep learning in breast cancer image analysis. Evol Syst 11:1–21

    Google Scholar 

  60. Tsochatzidis L, Costaridou L, Pratikakis I (2019) Deep learning for breast cancer diagnosis from mammograms—a comparative study. J Imaging 5:37

    Article  Google Scholar 

  61. Hubbard RA, Kerlikowske K, Flowers CI, Yankaskas BC, Zhu W, Miglioretti DL (2011) Cumulative probability of false-positive recall or biopsy recommendation after 10 years of screening mammography: a cohort study. Ann Intern Med 155:481–492

    Article  Google Scholar 

  62. Cheng HD, Cai X, Chen X, Hu L, Lou X (2003) Computer-aided detection and classification of microcalcifications in mammograms: a survey. Pattern Recognit 36:2967–2991

    Article  Google Scholar 

  63. Boulehmi H, Mahersia H, Hamrouni K, Sana B, Najla M (2013) Breast cancer detection: a review on mammograms analysis techniques. In: 10th International multi-conferences on systems, signals and devices, 2013

  64. McSweeney MB, Sprawls P, Egan RL (1983) Enhanced image mammography. Am J Roentgenol 140:9–14

    Article  Google Scholar 

  65. Morrow WM, Paranjape RB, Rangayyan RM, Desautels JL (1992) Region-based contrast enhancement of mammograms. IEEE Trans Med Imaging 11:392–406

    Article  Google Scholar 

  66. Bouyahia S, Jérôme M, Ellouze N (2009) Wavelet based microcalcifications detection in digitized mammograms. ICGST-GVIP J 8

  67. Yan Y, Conze PH, Decencière E, Lamard M, Quellec G, Cochener B et al (2019) Cascaded multi-scale convolutional encoder–decoders for breast mass segmentation in high-resolution mammograms. In: 2019 41st Annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019, pp 6738–6741

  68. Rampun A, López-Linares K, Morrow PJ, Scotney BW, Wang H, Ocaña IG et al (2019) Breast pectoral muscle segmentation in mammograms using a modified holistically-nested edge detection network. Med Image Anal 57:1–17

    Article  Google Scholar 

  69. Rashed E, El Seoud M (2019) Deep learning approach for breast cancer diagnosis. In: Proceedings of the 2019 8th international conference on software and information engineering, 2019, pp 243–247

  70. Montelius L, Rezkalla G (2019) Providing mass context to a pretrained deep convolutional neural network for breast mass classification. Thesis

  71. Xi P, Shu C, Goubran R (2019) A unified deep learning framework for multi-modal multi-dimensional data. In: 2019 IEEE international symposium on medical measurements and applications (MeMeA), 2019, pp 1–6

  72. Wu N, Phang J, Park J, Shen Y, Huang Z, Zorin M et al (2019) Deep neural networks improve radiologists’ performance in breast cancer screening. IEEE Trans Med Imaging 39(4):1184–1194

    Article  Google Scholar 

  73. Ting FF, Tan YJ, Sim KS (2019) Convolutional neural network improvement for breast cancer classification. Expert Syst Appl 120:103–115

    Article  Google Scholar 

  74. Rampun A, Scotney BW, Morrow PJ, Wang H (2018) Breast mass classification in mammograms using ensemble convolutional neural networks. In: 2018 IEEE 20th international conference on e-health networking, applications and services (Healthcom), 2018, pp 1–6

  75. Naz A, Javed MU, Javaid N et al (2019) Short-term electric load and price forecasting using enhanced extreme learning machine optimization in smart grids. Energies 12(5):866

    Article  Google Scholar 

  76. Walton WC, Kim S-J, Harvey SC, Mullen LA, Porter DW (2019) Towards CNN-based registration of craniocaudal and mediolateral oblique 2-D X-ray mammographic images. In: 2019 41st Annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019, pp 2758–2764

  77. Sharif U, Mehmood Z, Mahmood T et al (2019) Scene analysis and search using local features and support vector machine for effective content-based image retrieval. Artif Intell Rev 52:901–925

    Article  Google Scholar 

  78. Ragab DA, Sharkas M, Marshall S, Ren J (2019) Breast cancer detection using deep convolutional neural networks and support vector machines. PeerJ 7:e6201

    Article  Google Scholar 

  79. Li C, Wang X, Liu W, Latecki LJ, Wang B, Huang J (2019) Weakly supervised mitosis detection in breast histopathology images using concentric loss. Med Image Anal 53:165–178

    Article  Google Scholar 

  80. Le E, Wang Y, Huang Y, Hickman S, Gilbert F (2019) Artificial intelligence in breast imaging. Clin Radiol 74(5):357–366

    Article  Google Scholar 

  81. Kumar A, Mukherjee S, Luhach AK (2019) Deep learning with perspective modeling for early detection of malignancy in mammograms. J Discrete Math Sci Cryptogr 22:627–643

    Article  Google Scholar 

  82. Tahir B, Iqbal S, Khan UG, M., et al (2019) Feature enhancement framework for brain tumor segmentation and classification. Microsc Res Tech 82(6):803–811

    Article  Google Scholar 

  83. Falconí LG, Pérez M, Aguilar WG (2019) Transfer learning in breast mammogram abnormalities classification with MobileNet and NasNet. In: 2019 International conference on systems, signals and image processing (IWSSIP), 2019, pp 109–114

  84. Bakalo R, Goldberger J, Ben-Ari R (2019) A dual branch deep neural network for classification and detection in mammograms

  85. Chougrad H, Zouaki H, Alheyane O (2019) Multi-label transfer learning for the early diagnosis of breast cancer. Neurocomputing 392:168–180

    Article  Google Scholar 

  86. Castro E, Pereira JC, Cardoso JS (2019) Weight rotation as a regularization strategy in convolutional neural networks. In: 2019 41st Annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019, pp 2106–2110

  87. Bakalo R, Goldberger J, Ben-Ari R (2021) Weakly and semi supervised detection in medical imaging via deep dual branch net. Neurocomputing 421:15–25

    Article  Google Scholar 

  88. Rampun A, Wang H, Scotney B, Morrow P, Zwiggelaar R (2018) Classification of mammographic microcalcification clusters with machine learning confidence levels. In: 14th International workshop on breast imaging (IWBI 2018), 2018, p 107181B

  89. Seely JM, Alhassan T (2018) Screening for breast cancer in 2018—what should we be doing today? Curr Oncol 25:115–124

    Article  Google Scholar 

  90. Fahad HM, Ghani Khan MU, Saba T, Rehman A, Iqbal S (2018) Microscopic abnormality classification of cardiac murmurs using ANFIS and HMM. Microsc Res Tech 81(5):449–457

    Article  Google Scholar 

  91. Fotouhi S, Asadi S, Kattan MW (2019) A comprehensive data level analysis for cancer diagnosis on imbalanced data. J Biomed Inform 90:103089

    Article  Google Scholar 

  92. Meethongjan K, Dzulkifli M, Rehman A, Altameem A et al (2013) An intelligent fused approach for face recognition. J Intell Syst 22(2):197–212

    Google Scholar 

Download references

Acknowledgements

This work was supported by Artificial Intelligence and Data Analytics (AIDA) Lab CCIS Prince Sultan University Riyadh Saudi Arabia. Authors are thankful for the support.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University of Engineering and Technology, Narowal Campus, Narowal, Pakistan

    Osama Bin Naeem

  2. Department of Computer Engineering, University of Engineering and Technology, Lahore, Pakistan

    Yasir Saleem

  3. Department of Computer Science, University of Engineering and Technology, Lahore, Pakistan

    M. Usman Ghani Khan

  4. Artificial Intelligence & Data Analytics Lab, CCIS Prince Sultan University, Riyadh, 11586, Saudi Arabia

    M. Usman Ghani Khan, Amjad Rehman Khan & Tanzila Saba

  5. MIS Department, College of Business Administration, Prince Sattam bin Abdulaziz University, 11942, Alkharj, Saudi Arabia

    Saeed Ali Bahaj

  6. School of Clinical Medicine, Zhengzhou University, Zhengzhou, 450001, Henan, People’s Republic of China

    Noor Ayesha

Authors
  1. Osama Bin Naeem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yasir Saleem
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Usman Ghani Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amjad Rehman Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tanzila Saba
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Saeed Ali Bahaj
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Noor Ayesha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amjad Rehman Khan.

Ethics declarations

Conflict of interest

Authors declare no conflict for this research.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naeem, O.B., Saleem, Y., Khan, M.U.G. et al. Breast Mammograms Diagnosis Using Deep Learning: State of Art Tutorial Review. Arch Computat Methods Eng 31, 2431–2449 (2024). https://doi.org/10.1007/s11831-023-10052-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11831-023-10052-9

Search

Navigation