Deep learning based an automated skin lesion segmentation and intelligent classification model

Abstract

Internet of Medical Things (IoMT) includes interconnected sensors, wearable devices, medical devices, and clinical systems. At the same time, skin cancer is a commonly available type of cancer that exists all over the globe. This study projects a new segmentation based classification model for skin lesion diagnosis by combining a GrabCut algorithm and Adaptive Neuro-Fuzzy classifier (ANFC) model. The proposed method involves four main steps: preprocessing, segmentation, feature extraction, and classification. Initially, the preprocessing step is carried out using a Top hat filter and inpainting technique. Then, the Grabcut algorithm is used to segment the preprocessed images. Next, the feature extraction process takes place by the use of a deep learning based Inception model. Finally, an adaptive neuro-fuzzy classifier (ANFC) system gets executed to classify the dermoscopic images into different classes. The proposed model is simulated using a benchmark International Skin Imaging Collaboration (ISIC) dataset and the results are examined interms of accuracy, sensitivity and specificity. The proposed model exhibits better identification and classification of skin cancer. For examining the effective outcome of the projected technique, an extensive comparison of the presented method with earlier models takes place. The experimental values indicated that the proposed method has offered a maximum sensitivity of 93.40%, specificity of 98.70% and accuracy of 97.91%.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. Ali ARA, Deserno TM (2012) A systematic review of automated melanoma detection in dermatoscopic images and its ground truth data. In Medical Imaging, Image Perception, Observer Performance, and Technology Assessment. International Society for Optics and Photonics, Bellingham, WA, USA, p 8318

    Google Scholar 

  2. Al-Masni MA, Al-Antari MA, Choi MT, Han SM, Kim TS (2018) Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks. Comput Methods Programs Biomed 162:221–231. https://doi.org/10.1016/j.cmpb.2018.05.027

    Article  Google Scholar 

  3. Bi L, Kim J, Ahn E, Kumar A, Fulham M, Feng D (2017) Dermoscopic image segmentation via multi-stage fully convolutional networks. IEEE Trans Biomed Eng 64:2065–2074

    Article  Google Scholar 

  4. Codella NC, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittler Hl (2018). Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI). In: Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA, pp.4–7.

  5. Elhoseny M, Shankar K, Uthayakumar J (2019) Intelligent diagnostic prediction and classification system for chronic kidney disease. Sci Rep 9(1):1–14

    Article  Google Scholar 

  6. Feng J, Isern NG, Burton SD, Hu JZ (2013) Studies of secondary melanoma on C57BL/6J mouse liver using 1H NMR metabolomics. Metabolites 3:1011–1035

    Article  Google Scholar 

  7. Gandhi SA, Kampp J (2015) Skin cancer epidemiology, detection, and management. Med Clin N Am 99:1323–1335

    Article  Google Scholar 

  8. Jaworek KJ (2016) Computer-aided diagnosis of micro-malignant melanoma lesions applying support vector machines. Biomed Res Int 2016:1–8

    Google Scholar 

  9. Jemal A, Siege R, Ward E, Hao Y, Xu J (2019) Thun, M.J. Cancer statistics, 2019. CA Cancer J Clin 69:7–34

    Article  Google Scholar 

  10. Karimkhani C, Green A, Nijsten T, Weinstock M, Dellavalle R, Naghavi M, Fitzmaurice C (2017) The global burden of melanoma: results from the Global Burden of Disease Study. Br J Dermatol 177:134–140

    Article  Google Scholar 

  11. Kathiresan S, Sait ARW, Gupta D, Lakshmanaprabu SK, Khanna A, Pandey HM (2020) Automated detection and classification of fundus diabetic retinopathy images using synergic deep learning model. Pattern Recogn Lett 133:210–216

    Article  Google Scholar 

  12. Li H, He X, Zhou F, Yu Z, Ni D, Wand T, Lei B (2019) Dense deconvolutional network for skin lesion segmentation. IEEE J Biomed Health Inf 23(2):527–537. https://doi.org/10.1109/JBHI.2018.2859898

    Article  Google Scholar 

  13. Mandal D (2018) Adaptive neuro-fuzzy inference system based grading of basmati rice grains using image processing technique. Appl Syst Innovat 1(2):19–33

    Article  Google Scholar 

  14. Parvathy P, Subramaniam K, Prasanna Venkatesan GKD, Karthikaikumar V, Justin V, Jayasankar T (2020). Development of hand gesture recognition system using machine learning. J Ambient Intell Human Comput (2020). https://doi.org/10.1007/s12652-020-02314-2.

  15. Pellacani G, Seidenari S (2002) Comparison between morphological parameters in pigmented skin lesion images acquired by means of epiluminescence surface microscopy and polarized-light videomicroscopy. Clin Dermatol 20:222–227

    Article  Google Scholar 

  16. Pustokhina IV, Pustokhin DA, Gupta D, Khanna A, Shankar K, Nguyen GN (2020) An effective training scheme for deep neural network in edge computing enabled internet of medical things (IoMT) systems. IEEE Access 8:107112–107123

    Article  Google Scholar 

  17. Raj RJS, Shobana SJ, Pustokhina IV, Pustokhin DA, Gupta D, Shankar K (2020) Optimal feature selection-based medical image classification using deep learning model in internet of medical things. IEEE Access 8:58006–58017

    Article  Google Scholar 

  18. Shankar K, Lakshmanaprabu SK, Khanna A, Tanwar S, Rodrigues JJ, Roy NR (2019) Alzheimer detection using Group Grey Wolf Optimization based features with convolutional classifier. Comput Electr Eng 77:230–243

    Article  Google Scholar 

  19. Shankar K, Zhang Y, Liu Y, Wu L, Chen CH (2020) Hyperparameter tuning deep learning for diabetic retinopathy fundus image classification. IEEE Access 8:118164–118173

    Article  Google Scholar 

  20. Siegel R, Miller K, Jemal A (2018) Cancer statistics. CA. Cancer J Clin 68:7–30

    Article  Google Scholar 

  21. Sikkandar YM, Jayasankar T, Kavitha KR, Prakash NB, Sudharsan NM ,Hemalakshmi GR (2020). Three factor nonnegative matrix factorization based HE stain unmixing in histopathological images. J Ambient Intell Human Comput (2020). https://doi.org/10.1007/s12652-020-02265-8.

  22. Sinz C, Tschandl P, Rosendahl C, Akay BN, Argenziano G, Blum A, Braun RP, Cabo H, Gourhant JY, Kreusch J (2017) Accuracy of dermatoscopy for the diagnosis of nonpigmented cancers of the skin. J Am Acad Dermatol 77:1100–1109

    Article  Google Scholar 

  23. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-First AAAI Conference on Artificial Intelligence, Association for the Advancement of Artificial Intelligence,USA pp:1–3.

  24. Tarver T (2012) American Cancer Society. Cancer facts and figures 2014. J Consum Health Internet 16:366–367

    Article  Google Scholar 

  25. Unver HM, Ayan E (2019) Skin lesion segmentation in dermoscopic images with combination of YOLO and grabcut algorithm. Diagnostics 9(3):72–94

    Article  Google Scholar 

  26. Yu Z, Jiang X, Zhou F, Qin J, Ni D, Chen S, Lei B, Wang T (2018) Melanoma recognition in dermoscopy images via aggregated deep convolutional features. IEEE Trans Biomed Eng 66:1006–1016

    Article  Google Scholar 

  27. Yuan Y, Chao M, Lo YC (2017) Automatic skin lesion segmentation using deep fully convolutional networks with Jaccard distance. IEEE Trans Med Imaging 36:1876–1886

    Article  Google Scholar 

Download references

Acknowledgments

The authors extend their appreciation to the Deanship of Scientific Research at Majmaah University for funding this work under Project Number. R-1441-165.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mohamed Yacin Sikkandar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yacin Sikkandar, M., Alrasheadi, B.A., Prakash, N.B. et al. Deep learning based an automated skin lesion segmentation and intelligent classification model. J Ambient Intell Human Comput 12, 3245–3255 (2021). https://doi.org/10.1007/s12652-020-02537-3

Download citation

Keywords

  • IoMT
  • Skin lesion
  • Deep learning
  • Artifact removal
  • Feature extraction