Abstract
Breast cancer (BrC) is a lethal form of cancer which causes numerous deaths in women across the world. Generally, mammograms and histopathology biopsy images are recommended for early detection of BrC as they enable a more reliable prediction than just using mammograms. However, research indicates that even the most experienced dermatologists can detect BrC in early stage with an average accuracy of less than 80%. Over the years, researchers have made significant progress in the development of automated tools and techniques to assist radiologists or medical practitioners in BrC detection. Various machine learning and deep learning based architectures are extensively experimented on different publicly available datasets to improve the performance measures. There is further scope of improvements by extracting better representative features with deep architectural variants or ensembles techniques to minimize the misclassifications. Learnt parameters of any pretrained deep models may provide a better starting point for any other architectures using transfer learning technique. In this work, we propose computer-aided transfer learning based deep model as a binary classifier for breast cancer detection. Generally, deep learning architectures are sequential, following only a single channel for features’ extraction and further classification. However, fused features extracted from multiple channels may better represent features qualitatively. The novelty of our approach is the use of multi-channel merging techniques for devising a dual-architecture ensemble. The models are trained and tested on the BreakHis dataset and an improvement in comparison with the state-of-the-arts is observed in various performance metrics. Among several combinations for ensemble architectures by utilizing various pretrained models, the Xception + InceptionV3 combination achieved an average accuracy of 97.5% for multi-channelled architecture, setting benchmarking results for further research in this direction.
Similar content being viewed by others
References
Aghdam MH, Heidari S (2015) Feature selection using particle swarm optimization in text categorization. J Artificial Intell Soft Comput Res 5(4):231–238
Allison KH, Reisch LM, Carney PA, Weaver DL, Schnitt SJ, O ' Malley FP, Elmore JG (2014) Understanding diagnostic variability in breast pathology: lessons learned from an expert consensus review panel. Histopathology 65(2):240–251. https://doi.org/10.1111/his.12387
Alom MZ, Yakopcic C, Taha TM, Asari VK (2019) Breast cancer classification from histopathological images with inception recurrent residual convolutional neural network. J Digit Imaging 32(4):605–617
Alzubaidi L, Al-Shamma O, Fadhel MA, Farhan L, Zhang J, Dyan Y (2020) Optimizing the performance of breast Cancer classification by employing the same domain transfer learning from hybrid deep convolutional neural network model. Electronics 9(3):445. https://doi.org/10.3390/electronics9030445
American Cancer Society (2020) Breast Cancer Facts and Figures 2019–2020. https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/breast-cancer-facts-and-figures/breastcancer-facts-and-figures-2019-2020.pdf.
Awan R, Koohbanani N, Shaban M, Lisowska A, Rajpoot N (2018) Context-aware learning using transferable features for classification of breast cancer histology images. In: International conference image analysis and recognition. Springer, Cham, pp 788–795
Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global Cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer J Clin 68(6):394–424. https://doi.org/10.3322/caac.21492
Chollet F (2015) Keras. https://github.com/fchollet/keras.
Cytecare Cancer Hopitals (2020) Statistics of breast cancer in India. https://cytecare.com/blog/statistics-ofbreast-cancer/. Accessed 10 June, 2020.
Ferreira C, Melo T, Sousa P, Meyer M, Shakibapour E, Costa P, Campilho A (2018) Classification of breast cancer histology images through transfer learning using a pre-trained inception ResNet v2. In: International conference image analysis and recognition. Springer, Cham, pp 763–770. https://doi.org/10.1007/978-3-319-93000-8-86
George YM, Zayed HH, Roushdy MI, Elbagoury BM (2014) Remote computer-aided breast Cancer detection and diagnosis system based on cytological images. IEEE Syst J 8(3):949–964. https://doi.org/10.1109/JSYST.2013.2279415
Guo Y, Dng H, Song F, Zhu C, Liu J (2018) Breast Cancer histology image classification based on deep neural networks. In: International conference image analysis and recognition. Springer, Cham, pp 827–836
Gupta V, Bhavsar A (2017) Breast cancer histopathological image classification: is magnification important?. In: proceedings of the IEEE conference on computer vision and pattern recognition workshops - CVPRW’17, pp 17-24. doi: https://doi.org/10.1109/CVPRW.2017.107.
Kassani SH, Kassani PH, Wesolowski MJ, Schneider KA, Deters R (2019) Breast cancer diagnosis with transfer learning and global pooling. In: Proceedings of the international conference on information and communication technology convergence –ICTC’19, pp 519–524. https://doi.org/10.1109/ICTC46691.2019.8939878
Malon CD, Cosatto E (2013) Classification of mitotic figures with convolutional neural networks and seeded blob features Journal of Pathology Informatics 4.
Mayo Clinic (2019) Breast Cancer. https://www.mayoclinic.org/diseases-conditions/breastcancer/diagnosis-treatment/drc-20352475. Accessed 19 July 2020.
Migowski A (2015) Early detection of breast cancer and the interpretation of results of survival studies. Ciencia & saude coletiva 20(4):1309–1310. https://doi.org/10.1590/1413-81232015204.17772014. (Portugese)
Milosevic M, Jankovic D, Milenkovic A, Stojanov D (2018) Early diagnosis and detection of breast cancer. Technol Health Care 26(4):729–759. https://doi.org/10.3233/THC-181277
Murtaza G, Shuib L, Wahab AWA, Mujtaba G, Raza G (2020) Ensembled deep convolution neural network-based breast cancer classification with misclassification reduction algorithms. Multimed Tools Appl 79:18447–18479. https://doi.org/10.1007/s11042-020-08692-1
Nahid AA, Mehrabi MA, Kong Y (2018) Histopathological breast cancer image classification by deep neural network techniques guided by local clustering, BioMed Research International
Nawaz W, Ahmed S, Tahir A, Khan HA (2018) Classification of breast cancer histology images using AlexNet. In: International conference image analysis and recognition. In: international conference image analysis and recognition. Springer, Cham, pp 869–876
Rouhi R, Jafari M, Kasaei M, Keshavarzian P (2015) Benign and malignant breast tumors classification based on region growing and CNN segmentation. Expert Syst Appl 42(3):990–1002
Samala RK, Chan HP, Hadjiiski LM, Helvie MA, Richter C, Cha K (2018) Evolutionary pruning of transfer learned deep convolutional neural network for breast cancer diagnosis in digital breast tomosynthesis. Phys Med Biol 63(9):095005. https://doi.org/10.1088/1361-6560/aabb5b
Sarker MI, Kim H, Tarasov D, Akhmetzanov D (2019) Inception architecture and residual connections in classification of breast Cancer histology images. arXiv 2019 arXiv preprint arXiv:1912.04619
Sommer C, Fiaschi L, Hamprecht FA, Gerlich DW (2012) Learning-based mitotic cell detection in histopathological images. In: Proceedings of the 21st international conference on pattern recognition – ICPR’12, pp 2306–2309
Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2016) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63(7):1455–1462
US Cancer Statistics Working Group (2017) United States cancer statistics: 1999–2014 incidence and mortality web-based report. US Department of Health and Human Services, Centers for Disease Control and Prevention and National Cancer Institute, Atlanta
Vang YS, Chen Z, Xie X (2018) Deep learning framework for multi-class breast Cancer histology image classification. In: International conference image analysis and recognition. Springer, Cham, pp 914–922
Wang Z, Dong N, Dai W, Rosario SD, Xing EP (2018) Classification of breast cancer histopathological images using convolutional neural networks with hierarchical loss and global pooling. In: International conference image analysis and recognition. Springer, Cham, pp 745–753
WHO. Breast cancer. https://www.who.int/cancer/prevention/diagnosis-screening/breast-cancer/en/. Accessed 18 July 2020.
Zhang L, Zhang B, Coenen F, Lu W (2013) Breast cancer diagnosis from biopsy images with highly reliable random subspace classifier ensembles. Mach Vis Appl 24(7):1405–1420. https://doi.org/10.1007/s00138-012-0459-8
Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition – CVPR’17, pp 1800–1807. https://doi.org/10.1109/CVPR.2017.195
Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition – CVPR’17, pp 1492–1500. https://doi.org/10.1109/CVPR.2017.634
Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI conference on artificial intelligence – AAAI’17, pp 4278–4284. https://dl.acm.org/doi/10.5555/3298023.329818838
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition – CVPR’17, pp 4700–4708. https://doi.org/10.1109/CVPR.2017.243
Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition – CVPR’16, pp 2818–2826. https://doi.org/10.1109/CVPR.2016.308
Ragab DA, Sharkas M, Marshall S, Ren J (2019) Breast cancer detection using deep convolutional neural networks and support vector machines. PeerJ 7:e6201
Hadush S, Girmay Y, Sinamo A, Hagos G (2020) Breast Cancer detection using convolutional neural networks. arXiv preprint arXiv:2003.07911
Keleş MK (2019) Breast cancer prediction and detection using data mining classification algorithms: a comparative study. Tehnički vjesnik 26(1):149–155
Zheng J, Lin D, Gao Z, Wang S, He M, Fan J (2020) Deep learning assisted efficient AdaBoost algorithm for breast cancer detection and early diagnosis. IEEE Access 8:96946–96954. https://doi.org/10.1109/ACCESS.2020.2993536
Wang Y, Lei B, Elazab A, Tan EL, Wang W, Huang F, Wang T (2020) Breast cancer image classification via multi-network features and dual-network orthogonal low-rank learning. IEEE Access 8:27779–27792
Hamed G, Marey MAER, Amin SES, Tolba MF (2020) Deep learning in breast Cancer detection and classification. In: Joint European-US workshop on applications of invariance in computer vision. Springer, Cham, pp 322–333
Ak MF (2020) A comparative analysis of breast Cancer detection and diagnosis using data visualization and machine learning applications. Healthcare 8(2):111 Multidisciplinary digital publishing institute
Vrigazova BP (2020) Detection of malignant and benign breast Cancer using the ANOVA-BOOTSTRAP-SVM. J Data Inform Sci 5(2):62–75
Chan A, Tuszynski JA (2016) Automatic prediction of tumour malignancy in breast cancer with fractal dimension. R Soc Open Sci 3(12):160558
Bardou D, Zhang K, Ahmad SM (2018) Classification of breast Cancer based on histology images using convolutional neural networks. IEEE Access 6:24680–24693
Kahya MA, Al-Hayani W, Algamal ZY (2017) Classification of breast cancer histopathology images based on adaptive sparse support vector machine. J Appl Mathematics Bioinform 7(1):49
Alom MZ, Yakopcic C, Nasrin MS, Taha TM, Asari VK (2019) Breast cancer classification from histopathological images with inception recurrent residual convolutional neural network. J Digit Imaging 32(4):605–617
Arslan AK, Yaşar Ş, Çolak C (2019) Breast cancer classification using a constructed convolutional neural network on the basis of the histopathological images by an interactive web-based interface. In: Proceedings of the 3rd international symposium on multidisciplinary studies and innovative technologies – ISMSIT’19, pp 1–5. https://doi.org/10.1109/ISMSIT.2019.8932942
BBayramoglu N, Kannala J, Heikkilä J (2016) Deep learning for magnification independent breast cancer histopathology image classification. In: Proceedings of the 23rd international conference on pattern recognition –ICPR’16, pp 2440–2445. https://doi.org/10.1109/ICPR.2016.7900002
Spanhol FA, Oliveira LS, Cavalin PR, Petitjean C, Heutte L (2017) Deep features for breast cancer histopathological image classification. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics –SMC’17, pp 1868–1873. https://doi.org/10.1109/SMC.2017.8122889
Araújo T, Aresta G, Castro E, Rouco J, Aguiar P, Eloy C, Campilho A (2017) Classification of breast cancer histology images using convolutional neural networks. PLoS One 12(6):e0177544
Jiang Y, Chen L, Zhang H, Xiao X (2019) Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module. PLoS One 14(3):e0214587. https://doi.org/10.1371/journal.pone.0214587
Rajarapollu PR, Mankar VR (2017) Bicubic interpolation algorithm implementation for image appearance enhancement. Int J Comput Sci Inf Technol 8(2):23–26 http://www.ijcst.com/vol8/8.2/4-prachi-r-rajarapollu.pdf
López-García G, Jerez JM, Franco L, Veredas FJ (2019) A transfer-learning approach to feature extraction from Cancer transcriptomes with deep autoencoders. In: Advances in computational intelligence, IWANN’19. Lecture notes in computer science, vol 11506. Springer, Cham. https://doi.org/10.1007/978-3-030-20521-8_74
Tkachenko R, Izonin I (2019) model and principles for the implementation of neural-like structures based on geometric data transformations. In: advances in computer science for engineering and education, ICCSEEA’18. Advances in intelligent systems and computing, vol 754. Springer, Cham. https://doi.org/10.1007/978-3-319-91008-6_58
Wenzhong L, Huanlan L, Caijian H, Liangjun Z (2020) Classifications of breast cancer images by deep learning. medRxiv. https://doi.org/10.1101/2020.06.13.20130633
Gupta K, Chawla N (2020) Analysis of histopathological images for prediction of breast Cancer using traditional classifiers with pre-trained CNN. Procedia Comput Sci 167:878–889
Nawaz M, Sewissy AA, Soliman THA (2018) Multi-class breast Cancer classification using deep learning convolutional neural network. Int J Advanced Comput Sci Appl (IJACSA) 9:6. https://doi.org/10.14569/IJACSA.2018.090645
Patil A, Tamboli D, Meena S, Anand D, Sethi A (2019) Breast Cancer histopathology image classification and localization using multiple instance learning. In: Proceedings of the IEEE international WIE conference on electrical and computer engineering -WIECON-ECE’19, pp 1–4. https://doi.org/10.1109/WIECON-ECE48653.2019.9019916
Hameed Z, Zahia S, Garcia-Zapirain B, Javier Aguirre J, María Vanegas A (2020) Breast cancer histopathology image classification using an ensemble of deep learning models. Sensors 20(16):4373
Ali A, Zhu Y, Zakarya M (2021) A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing. Multimed Tools Appl:1–33. https://doi.org/10.1007/s11042-020-10486-4
Ali A, Zhu Y, Chen Q, Yu J, Cai H (2019) Leveraging spatio-temporal patterns for predicting citywide traffic crowd flows using deep hybrid neural networks. In: Proceedings of the IEEE 25th international conference on parallel and distributed systems – ICPADS’19, pp 125–132. https://doi.org/10.1109/ICPADS47876.2019.00025
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tembhurne, J.V., Hazarika, A. & Diwan, T. BrC-MCDLM: breast Cancer detection using Multi-Channel deep learning model. Multimed Tools Appl 80, 31647–31670 (2021). https://doi.org/10.1007/s11042-021-11199-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11199-y