Skip to main content

Advertisement

SpringerLink
Log in

Efficient fusion of handcrafted and pre-trained CNNs features to classify melanoma skin cancer

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Skin cancer is one of the most aggressive cancers in the world. Computer-Aided Diagnosis (CAD) system for cancer detection and classification is a top-rated solution that decreases human effort and time with very high classification accuracy. Machine learning (ML) and deep learning (DL) based approaches have been widely used to develop robust skin-lesion classification systems. Each of the techniques excels when the other fails. Their performances are closely related to the size of the learning dataset. Thus, approaches that are based on the ML are less potent than those found on the DL when working with large datasets and vice versa. In this article, we propose a powerful skin-lesion classification approach based on a fusion of handcrafted features (shape, skeleton, color, and texture) and features extracted from most powerful DL architectures. This combination will make it possible to remedy the limitations of both the ML and DL approaches for the case of large and small datasets. Features engineering is then applied to remove redundant features and to select only relevant features. The proposed approach is validated and tested on both small and large datasets. A comparative study is also conducted to compare the proposed approach with different and recent approaches applied to each dataset. The results obtained show that this features-fusion based approach is very promising and can effectively combine the power of ML and DL based approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Akram T, Khan MA, Sharif M, Yasmin M (2018) Skin lesion segmentation and recognition using multichannel saliency estimation and M-SVM on selected serially fused features. J Ambient Intell Humaniz Comput 1–20

  2. Almansour E, Jaffar MA (2016 Apr 30) Classification of Dermoscopic skin cancer images using color and hybrid texture features. IJCSNS Int J Comput Sci Netw Secur 16(4):135–139

    Google Scholar 

  3. Anirudha RC, Kannan R, Patil N (2014) Genetic algorithm based wrapper feature selection on hybrid prediction model for analysis of high dimensional data. In2014 9th international conference on industrial and information systems (ICIIS) (pp. 1-6). IEEE

  4. Arifin MS, Kibria MG, Firoze A, Amini MA, Yan H (2012) Dermatological disease diagnosis using color-skin images. In 2012 international conference on machine learning and cybernetics (Vol. 5, pp. 1675-1680). IEEE

  5. Barata C, Celebi ME, Marques JS (2018 Jun 11) A survey of feature extraction in dermoscopy image analysis of skin cancer. IEEE Journal of biomedical and health informatics 23(3):1096–1109

    Google Scholar 

  6. Berseth M, Logix NLP (2017) ISIC 2017 – Skin Lesion Analysis Towards Melanoma Detection, pp. 1–4

  7. Bhati P, Singhal M (2015) Early stage detection and classification of melanoma. In: Communication, control and intelligent systems (CCIS), 2015, pp 181–185. IEEE

  8. Bi L, Kim J, Ahn E, Feng D (2017) Automatic skin lesion analysis using large-scale dermoscopy images and deep residual networks. arXiv preprint arXiv: 1703.04197

  9. Celebi ME, Kingravi HA, Uddin B, Iyatomi H, Aslandogan YA, Stoecker WV, Moss RH (2007 Sep 1) A methodological approach to the classification of dermoscopy images. Comput Med Imaging Graph 31(6):362–373

    Google Scholar 

  10. Chang WY, Huang A, Yang CY, Lee CH, Chen YC, Wu TY, Chen GS (2013) Computer-aided diagnosis of skin lesions using conventional digital photography: a reliability and feasibility study. PLoS One 8(11):e76 212

    Google Scholar 

  11. Codella N, Cai J, Abedini M, Garnavi R, Halpern A, Smith JR (2015) Deep learning, sparse coding, and SVM for melanoma recognition in dermoscopy images. In international workshop on machine learning in medical imaging (pp. 118-126). Springer, Cham

  12. Codella N, Cai J, Abedini M, Garnavi R, Halpern A, Smith JR (2015) Deep learning, sparse coding, and svm for melanoma recognition in dermoscopy images. In: International workshop on machine learning in medical imaging, pp. 118–126. Springer, Berlin.

  13. Codella NC, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittler H, Halpern A (2018) Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic). In2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018) (pp. 168-172). IEEE

  14. Correa DN, Paniagua LR, Noguera JL, Pinto-Roa DP, Toledo LA (2015) Computerized diagnosis of melanocytic lesions based on the ABCD method. In2015 Latin American computing conference (CLEI) (pp. 1-12). IEEE.

  15. Dalila F, Zohra A, Reda K, Hocine C (2017 Jul 1) Segmentation and classification of melanoma and benign skin lesions. Optik. 140:749–761

    Google Scholar 

  16. Dara S, Tumma P (2018) Feature extraction by using deep learning: a survey. In2018 second international conference on electronics, communication and aerospace technology (ICECA) (pp. 1795-1801). IEEE

  17. Deepa SN, Devi BA (2011 Nov 1) A survey on artificial intelligence approaches for medical image classification. Indian J Sci Technol 4(11):1583–1595

    Google Scholar 

  18. Díaz IG (2017) Incorporating the knowledge of dermatologists to convolutional neural networks for the diagnosis of skin lesions. arXiv preprint arXiv:1703.01976

  19. Dreiseitl S, Ohno-Machado L, Kittler H, Vinterbo S, Billhardt H, Binder M (2001 Feb 1) A comparison of machine learning methods for the diagnosis of pigmented skin lesions. J Biomed Inform 34(1):28–36

    Google Scholar 

  20. Fan H, Xie F, Li Y, Jiang Z, Liu J (2017 Jun 1) Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold. Comput Biol Med 85:75–85

    Google Scholar 

  21. Filali Y, Sabri MA, Aarab A (2017) An improved approach for skin lesion analysis based on multiscale decomposition. In2017 international conference on electrical and information technologies (ICEIT) (pp. 1-6). IEEE

  22. Filali Y, Ennouni A, Sabri MA, Aarab A (2017) Multiscale approach for skin lesion analysis and classification. In2017 international conference on advanced Technologies for Signal and Image Processing (ATSIP) (pp. 1-6). IEEE

  23. Filali Y, Ennouni A, Sabri MA, Aarab A (2018) A study of lesion skin segmentation, features selection and classification approaches. In2018 international conference on intelligent systems and computer vision (ISCV) (pp. 1-7). IEEE

  24. Filali Y, El Khoukhi H, Sabri MA, Yahyaouy A, Aarab A (2019) New and Efficient Features for Skin Lesion Classification based on Skeletonization". In2019 Journal of Computer Science. Volume 15, Issue 9. pp 1225.1236

  25. Filali Y, Abdelouahed S, Aarab A (2019 May 19) An improved segmentation approach for skin lesion classification. Statistics, Optimization & Information Computing 7(2):456–467

    Google Scholar 

  26. Filali Y, El Khoukhi H, Sabri MA, Yahyaouy A, Aarab A (2019) Texture classification of skin lesion using convolutional neural network. In2019 international conference on wireless technologies, embedded and intelligent systems (WITS) (pp. 1-5). IEEE

  27. Filali Y, Sabri MA, Aarab A (2020) Improving skin Cancer classification based on features fusion and selection. In embedded systems and artificial intelligence (pp. 379–387). Springer, Singapore.

  28. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. InProceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778)

  29. Immagulate I, Vijaya MS (2015) Categorization of non-melanoma skin lesion diseases using support vector machine and its variants. International Journal of Medical Imaging 3(2):34–40

    Google Scholar 

  30. Jain S, Pise N (2015 Jan 1) Computer-aided melanoma skin cancer detection using image processing. Procedia Computer Science 48:735–740

    Google Scholar 

  31. Kannan V (2018) Feature selection using genetic algorithms

  32. Kasmi R, Mokrani K (2016) Classification of malignant melanoma and benign skin lesions: implementation of automatic abcd rule. IET Image Process 10(6):448–455

    Google Scholar 

  33. Kassani SH, Kassani PH (2019 Jun 1) A comparative study of deep learning architectures on melanoma detection. Tissue Cell 58:76–83

    Google Scholar 

  34. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097–1105)

  35. Li Y, Shen L (2018) Skin lesion analysis towards melanoma detection using deep learning network. Sensors. 18(2):556

    Google Scholar 

  36. Litjens G, Kooi T, Bejnordi BE, Setio AA, Ciompi F, Ghafoorian M, Van Der Laak JA, Van Ginneken B, Sánchez CI (2017 Dec 1) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88

    Google Scholar 

  37. Mahbod A, Schaefer G, Wang C, Ecker R, Ellinge I (2019) Skin lesion classification using hybrid deep neural networks. In ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 1229-1233). IEEE

  38. Marques JS, Barata C, Mendonça T (2012) On the role of texture and color in the classification of dermoscopy images. In2012 annual international conference of the IEEE engineering in medicine and biology society (pp. 4402-4405). IEEE

  39. Matsunaga K, Hamada A, Minagawa A, Koga H (2017) Image classification of melanoma, nevus and seborrheic keratosis by deep neural network ensemble. arXiv preprint arXiv:1703.03108

  40. Mendonc T, Ferreira PM, Marques JS (2013) PH 2 - A dermoscopic image database for research and benchmarking *, no. July, pp. 1–5

  41. Mohanaiah P, Sathyanarayana P, GuruKumar L (2013 May) Image texture feature extraction using GLCM approach. Int J Sci Res Publ 3(5):1

    Google Scholar 

  42. Moura N, Veras R, Aires K, Machado V, Silva R, Araújo F, Claro M (2018) Combining ABCD Rule, texture features and transfer learning in automatic diagnosis of melanoma. In2018 IEEE symposium on computers and communications (ISCC) (pp. 00508-00513). IEEE

  43. Nasir M, Attique Khan M, Sharif M, Lali IU, Saba T, Iqbal T (2018 Jun) An improved strategy for skin lesion detection and classification using uniform segmentation and feature selection based approach. Microsc Res Tech 81(6):528–543

    Google Scholar 

  44. Nauman A, Qadri YA, Amjad M, Zikria YB, Afzal MK, Kim SW (2020) Multimedia internet of things: a comprehensive survey. IEEE Access 8:8202–8250

    Google Scholar 

  45. Oliveira RB, Mercedes Filho E, Ma Z, Papa JP, Pereira AS, Tavares JM (2016 Jul 1) Computational methods for the image segmentation of pigmented skin lesions: a review. Comput Methods Prog Biomed 131:127–141

    Google Scholar 

  46. Oliveira RB, Pereira AS, Tavares JM (2018) Computational diagnosis of skin lesions from dermoscopic images using combined features. Neural Comput & Applic 1–21

  47. OZKAN IA, KOKLU M (2017 Dec 28) Skin lesion classification using machine learning algorithms. International Journal of Intelligent Systems and Applications in Engineering 5(4):285–289

    Google Scholar 

  48. Pathan S, Prabhu KG, Siddalingaswamy PC (2018 Nov 1) Hair detection and lesion segmentation in dermoscopic images using domain knowledge. Medical & biological engineering & computing 56(11):2051–2065

    Google Scholar 

  49. Pathan S, Prabhu KG, Siddalingaswamy PC (2019 May 1) Automated detection of melanocytes related pigmented skin lesions: a clinical framework. Biomedical Signal Processing and Control 51:59–72

    Google Scholar 

  50. Patro S, Sahu KK (2015) Normalization: A preprocessing stage. arXiv preprint arXiv:1503.06462

  51. Qadri YA, Nauman A, Zikria YB, Vasilakos AV, Kim SW (2020) The future of healthcare internet of things: a survey of emerging technologies. IEEE Communications Surveys & Tutorials 22(2):1121–1167

    Google Scholar 

  52. Rubegni P, Cevenini G, Burroni M, Perotti R, Dell'Eva G, Sbano P, Miracco C, Luzi P, Tosi P, Barbini P, Andreassi L (2002 Oct 20) Automated diagnosis of pigmented skin lesions. Int J Cancer 101(6):576–580

    Google Scholar 

  53. Sabri, M., Filali, Y., Ennouni, A., Yahyaouy, A., & Aarab, A. (2019). "2. An overview of skin lesion segmentation, features engineering, and classification". In Intelligent decision support systems. Berlin, Boston: De Gruyter, pp. 31–52 doi:https://doi.org/10.1515/9783110621105-002

  54. Salido JANN and C. R. Jr (2018) Hair artifact removal and skin lesion segmentation of dermoscopy images, vol. 11, no. 3, pp. 2–5

  55. Salido JA, Ruiz C (2018) Using deep learning for melanoma detection in dermoscopy images. International Journal of Machine Learning and Computing 8(1):61–68

    Google Scholar 

  56. Sanchez-Monedero J, Saez A, Perez-Ortiz M, Gutierrez PA, Hervás-martínez C (2016) Classification of melanoma presence and thickness based on computational image analysis. In: International conference on hybrid artificial intelligence systems. Springer, Berlin, pp 427–438

    Google Scholar 

  57. Schaefer G, Krawczyk B, Celebi ME, Iyatomi H (2014 Dec 1) An ensemble classification approach for melanoma diagnosis. Memetic Computing 6(4):233–240

    Google Scholar 

  58. Shoieb DA, Youssef SM, Aly WM (2016 Dec) Computer-aided model for skin diagnosis using deep learning. Journal of Image and Graphics 4(2):122–129

    Google Scholar 

  59. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  60. Singhal A, Ramesht Shukla PK, Dubey S, Singh S, Pachori RB Comparing the capabilities of transfer learning models to detect skin lesion in humans

  61. Srividya TD, Arulmozhi V (2018) Detection of skin cancer - A genetic algorithm approach, vol. 7, pp. 131–135

  62. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. InProceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9)

  63. Vasconcelos MJ, Rosado L, Ferreira M (2015) A new risk assessment methodology for dermoscopic skin lesion images. In2015 IEEE international symposium on medical measurements and applications (MeMeA) proceedings (pp. 570-575). IEEE.

  64. Victor A, Ghalib M (2017) Automatic detection and classification of skin cancer. International Journal of Intelligent Engineering and Systems 10(3):444–451

    Google Scholar 

  65. Xu L, Jackowski M, Goshtasby A, Roseman D, Bines S, Yu C, Dhawan A, Huntley A (1999 Jan 1) Segmentation of skin cancer images. Image Vis Comput 17(1):65–74

    Google Scholar 

  66. Zhang X (2017) Melanoma segmentation based on deep learning. Computer assisted surgery 22(sup1):267–277

    Google Scholar 

  67. Zhou H, Schaefer G, Celebi ME, Iyatomi H, Norton KA, Liu T, Lin F (2010) Skin lesion segmentation using an improved snake model. In2010 annual international conference of the IEEE engineering in medicine and biology (pp. 1974-1977). IEEE.

Download references

Acknowledgments

This research work has been funded by the laboratories: LIIAN and LESSI and the Faculty of Sciences, University Sidi Mohamed Ben abdellah, Fez, Morocco.

Author information

Authors and Affiliations

  1. Department of Computer science, Faculty of Sciences Dhar-Mahraz, USMBA, Fez, Morocco

    Youssef Filali, Hasnae EL Khoukhi & My Abdelouahed Sabri

  2. Department of Physics, Faculty of Sciences Dhar-Mahraz, USMBA, Fez, Morocco

    Abdellah Aarab

Authors
  1. Youssef Filali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hasnae EL Khoukhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. My Abdelouahed Sabri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Abdellah Aarab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Youssef Filali.

Ethics declarations

• All authors have participated in the conception and design, or the analysis and interpretation of the data, drafting and revising it critically for improving the important intellectual content.

• The manuscript which have been submitted to the journal for reviewer is original, has been written by the started authors and has not been published elsewhere.

• This manuscript does not contain any studies with human participants performed by any of the authors.

• The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Filali, Y., EL Khoukhi, H., Sabri, M.A. et al. Efficient fusion of handcrafted and pre-trained CNNs features to classify melanoma skin cancer. Multimed Tools Appl 79, 31219–31238 (2020). https://doi.org/10.1007/s11042-020-09637-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09637-4

Keywords

Search

Navigation