Skip to main content
SpringerLink
Log in

A weighted ensemble transfer learning approach for melanoma classification from skin lesion images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Cancer is the foremost cause of mortality among humans, as per statistics and accurate classification of the lesion is critical for treating skin cancer at an early stage. Identification of the disease via computer-aided tools can help in accurate diagnosis. This study’s primary goal is to suggest an effective strategy for more accurately classifying skin lesions. The binary classification of skin lesions has been proposed using the weighted average ensemble approach. The predictions from various models are combined via the weighted sum ensemble, where the weights of each model are determined by how well it performs. Weights for each learner in the weighted ensemble are scientifically determined based on their average accuracy on the testing dataset. The proposed weighted ensemble classifier uses an ensemble of seven deep-learning neural networks to perform binary classification, including InceptionV3, VGG16, Xception, ResNet50, and others. The International Skin Imaging Collaboration (ISIC) dataset has been used for experimentation, which is binary classified into Melanoma and Nevus. The proposed ensemble method provides the highest level of accuracy, precision, recall, f1-score, sensitivity, and specificity of 93.36%, 93%, 93%, 93%, 97%, and 97% respectively on the first ISIC dataset. The proposed methodology’s efficiency has also been compared and evaluated with another ISIC dataset. On the other ISIC dataset, the proposed weighted ensemble classifier had an accuracy of 85.54%. Additionally, the proposed methodology has been compared with state-of-art techniques. a weighted ensemble method where the final result decision is made based on the weighted total of the anticipated outputs from the classifiers. Each model is given a specific weight, which is then multiplied by the value it predicted and used to get the sum or average forecast. The suggested classification model concluded about the expected probabilities for each class and selected the class with the highest probability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

The data used in this study are given in this link: https://www.kaggle.com/datasets/qikangdeng/isic-2019-and-2020-melanoma-dataset

References

  1. Togaçar M, Cömert Z, Ergen B (2021) Intelligent skin cancer detection applying autoencoder, MobileNetV2 and spiking neural networks. Chaos, Solitons & Fractals, Elsevier, vol 144(C). https://doi.org/10.1016/j.chaos.2021.110714

  2. Kassem M, Hosny K, Fouad M (2020) Skin lesions classification into eight classes for ISIC 2019 using deep convolutional neural network and transfer learning. IEEE Access 8:114822–114832. https://doi.org/10.1109/ACCESS.2020.3003890

  3. Ashraf R, Afzal S, Rehman A, Gul S, Baber J, Bakhtyar M, Mehmood I, Song O, Maqsood M (2020) Region-of-interest based transfer learning assisted framework for skin cancer detection. IEEE Access 8:147858–147871. https://doi.org/10.1109/ACCESS.2020.3014701

  4. Milton MAA (2019) Automated skin lesion classification using ensemble of deep neural networks in ISIC 2018: skin lesion analysis towards melanoma detection challenge, arXiv:1901.10802

  5. Banasode P, Patil M, Ammanagi N (2021) A melanoma skin cancer detection using machine learning technique: support vector machine. In: IOP Conference Series: Materials Science and Engineering. IOP Publishing, vol 1065, no. 1, p 012039

  6. Jana E, Subban R, Saraswathi S (2017) Research on skin cancer cell detection using image processing. In 2017 IEEE International conference on Computational Intelligence and Computing Research (ICCIC). IEEE, pp 1–8. https://doi.org/10.1109/ICCIC.2017.8524554

  7. Singh V, Nwogu I (2018) Analyzing skin lesions in dermoscopy images using convolutional neural networks. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, pp 4035–4040. https://doi.org/10.1109/SMC.2018.00684

  8. DeViries T, Ramachandram D (2017) Skin lesion classification using deep multi-scale convolutional neural networks. arXiv preprint arXiv:1703.01402

  9. Jain S, Singhania U, Tripathy B, Nasr E, Aboudaif M, Kamrani A (2021) Deep learning-based transfer learning for classification of skin cancer. Sensors 21:8142. https://doi.org/10.3390/s21238142

    Article  ADS  CAS  PubMed  PubMed Central  Google Scholar 

  10. Yu L, Chen H, Dou Q, Qin J, Heng P (2016) Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE 36(4):994–1004. https://doi.org/10.1109/TMI.2016.2642839

    Article  Google Scholar 

  11. Mahecha M, Parra O, Velandia J (2019) Design of a system for melanoma detection through the processing of clinical images using artificial neural networks. 17th Conferenceone-Business, e-Services ande-Society(I3E), pp 605–616, https://doi.org/10.1007/978-3-030-02131-3_53ff.ffhal-02274187f

  12. Liao H, Li Y, Luo J (2016) Skin disease classification versus skin lesion characterization: achieving robust diagnosis using multi-label deep neural networks. In: 23rd International Conference on Pattern Recognition (ICPR). IEEE, pp 355–360

  13. Rezvantalab A, Safigholi H, Karimijeshni S (2018) Dermatologist-level dermoscopy skin cancer classification using different deep learning convolutional neural networks algorithms. arXiv preprint arXiv:1810.10348

  14. Bisla D, Choromanska A, Berman RS, Stein JA, Polsky D (2019) Towards automated melanoma detection with deep learning: data purification and augmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 0–0

  15. Abdelhalim ISA, Mohamed MF, Mahdy YB (2021) Data augmentation for skin lesion using self-attention based progressive generative adversarial network. Expert Syst Appl 165:113922

  16. Rashid H, Tanveer MA, Khan HA (2019) Skin lesion classification using GAN based data augmentation. In: 2019 41St annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 916–919

  17. Codella NC, Nguyen QB, Pankanti S, Gutman DA, Helba B, Halpern AC, Smith JR (2017) Deep learning ensembles for melanoma recognition in dermoscopy images. IBM J Res Dev 61(4/5):5–1. https://doi.org/10.1147/JRD.2017.2708299

  18. Xie F, Fan H, Li Y, Jiang Z, Meng R, Bovik A (2016) Melanoma classification on dermoscopy images using a neural network ensemble model. IEEE Trans Med Imaging 36(3):849–858. https://doi.org/10.1109/TMI.2016.2633551

  19. Suganya R (2016) An automated computer aided diagnosis of skin lesions detection and classification for dermoscopy images. 2016 fifth international conference on recent trends in information technology, pp 1-5

  20. Farooq M, Azhar M, Raza R (2016) Automatic Lesion Detection System (ALDS) for skin cancer classification using SVM and neural classifiers. 2016 IEEE 16th international conference on bioinformatics and bioengineering, pp 301–308. https://doi.org/10.1109/BIBE.2016.53

  21. Srivastava V, Kumar D, Roy S (2022) A median based quadrilateral local quantized ternary pattern technique for the classification of dermatoscopic images of skin cancer. Comput Electr Eng 102:108259

    Article  Google Scholar 

  22. Jaleel JA, Salim S, Aswin RB (2013). Computer aided detection of skin cancer. In: 2013 International Conference on Circuits, Power and Computing Technologies (ICCPCT). IEEE, pp 1137–1142

  23. Nugroho A, Slamet I, Sugiyanto (2019) Skins cancer identification system of HAMl0000 skin cancer dataset using convolutional neural network. In: AIP conference proceedings. AIP Publishing, vol 2202, no. 1. https://doi.org/10.1063/1.5141652

  24. Li Y, Shen L (2018) Skin lesion analysis towards melanoma detection using deep learning network. Sensors 18(2):556. https://doi.org/10.3390/s18020556

  25. Roy S, Shoghi KI (2019) Computer-aided tumor segmentation from T2-weighted MR images of patient-derived tumor xenografts. In: Image analysis and recognition: 16th international conference, ICIAR 2019, Waterloo, ON, Canada, August 27–29, 2019, Proceedings, Part II 16 (pp. 159–171). Springer International Publishing

  26. Nijhawan R, Bhatnagar D, Roy S (2022) Diagnosing skin lesion using multi-modal analysis. In: 2022 5th international conference on computational intelligence and networks (CINE), IEEE, pp 1–5

  27. Brinker T, Hekler A, Enk A, Kalle C (2019) Enhanced classifier training to improve precision of a convolutional neural network to identify images of skin lesions. PLoS ONE 14(6):e0218713. https://doi.org/10.1371/journal.pone.0218713

  28. Dang T, Nguyen TT, Moreno-Garcia C, Elyan E, McCall J (2021) Weighted ensemble of deep learning models based on comprehensive learning particle swarm optimization for medical image segmentation. 021 IEEE Congress on Evolutionary Computation (CEC), pp 744–751

  29. Roy S, Meena T, Lim SJ (2022) Demystifying supervised learning in healthcare 4.0: a new reality of transforming diagnostic medicine. Diagnostics 12(10):2549

  30. Meena T, Kabiraj A, Reddy PB, Roy S (2023) Weakly supervised confidence aware probabilistic CAM multi-thorax anomaly localization network. In: 2023 IEEE 24th International Conference on Information Reuse and Integration for Data Science (IRI), Bellevue, pp 309–314. https://doi.org/10.1109/IRI58017.2023.00061

  31. Roy S, Bhattacharyya D, Bandyopadhyay SK, Kim TH (2017) An effective method for computerized prediction and segmentation of multiple sclerosis lesions in brain MRI. Comput Methods Programs Biomed 140:307–320

    Article  PubMed  Google Scholar 

  32. Alfi IA, Rahman MM, Shorfuzzaman M, Nazir A (2022) A non-invasive interpretable diagnosis of melanoma skin cancer using deep Learning and ensemble stacking of machine learning models. Diagnostics 12(3):726

    Article  PubMed  PubMed Central  Google Scholar 

  33. Shahsavari A, Khatibi T, Ranjbari S (2023) Skin lesion detection using an ensemble of deep models: SLDED. Multimed Tools Appl 82(7):10575–10594

    Article  Google Scholar 

  34. Jin Q, Cui H, Sun C, Meng Z, Su R (2021) Cascade knowledge diffusion network for skin lesion diagnosis and segmentation. Appl Soft Comput 99:106881

    Article  Google Scholar 

  35. Imran A, Nasir A, Bilal M, Sun G, Alzahrani A, Almuhaimeed A (2022) Skin cancer detection using combined decision of deep learners. IEEE Access 10:118198–118212

    Article  Google Scholar 

  36. Tembhurne JV, Hebbar N, Patil HY, Diwan T (2023) Skin cancer detection using ensemble of machine learning and deep learning techniques. Multimed Tools Appl 82(18):27501–27524

    Article  Google Scholar 

  37. Basak H, Kundu R, Sarkar R (2022) MFSNet: A multi focus segmentation network for skin lesion segmentation. Pattern Recogn 128:108673

    Article  Google Scholar 

  38. Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, Kang JJ (2021) Classification of skin disease using deep learning neural networks with MobileNet V2 and LSTM. Sensors 21:2852. https://doi.org/10.3390/s21082852

    Article  ADS  PubMed  PubMed Central  Google Scholar 

  39. Srinivasu PN, Shafi J, Krishna TB, Sujatha CN, Praveen SP, Ijaz MF (2022) Using recurrent neural networks for predicting type-2 diabetes from genomic and tabular data. Diagnostics 12:3067. https://doi.org/10.3390/diagnostics12123067

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Pal D, Meena T, Roy S (2023) A fully connected reproducible SE-UResNet for multiorgan chest radiographs segmentation. In: 2023 IEEE 24th International Conference on Information Reuse and Integration for Data Science (IRI), Bellevue, pp 261–266. https://doi.org/10.1109/IRI58017.2023.00052

  41. Fekri-Ershad S, Alsaffar MF (2023) Developing a tuned three-layer perceptron fed with trained deep convolutional neural networks for cervical cancer diagnosis. Diagnostics 13(4):686. https://doi.org/10.3390/diagnostics13040686

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. AIAS, Amity University, Uttar Pradesh, Noida, 201303, India

    Himanshi Meswal

  2. Department of Computer Science and Engineering, Bharati Vidyapeeth’s College of Engineering, New Delhi, 110063, India

    Deepika Kumar & Aryan Gupta

  3. Artificial Intelligence & Data Science, Jio Institute, Navi Mumbai, 410206, India

    Sudipta Roy

Authors
  1. Himanshi Meswal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Deepika Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aryan Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sudipta Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sudipta Roy.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meswal, H., Kumar, D., Gupta, A. et al. A weighted ensemble transfer learning approach for melanoma classification from skin lesion images. Multimed Tools Appl 83, 33615–33637 (2024). https://doi.org/10.1007/s11042-023-16783-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16783-y

Keywords

Search

Navigation