Automated Detection of Melanoma in Dermoscopic Images

  • Jose Luis García Arroyo
  • Begoña García Zapirain
Part of the Series in BioEngineering book series (SERBIOENG)


In this chapter a software system for the automated detection of melanoma over dermoscopic images is presented. The analysis is carried out by supporting in the “ABCD Rule” medical algorithm, undertaking the automated detection and characterization of the corresponding indicators. For this purpose the system uses different image processing techniques and three supervised machine learning tasks. To test the robustness of the system the different indicators of the algorithm are tested, obtaining good results of accuracy in all of them, and there also was determined in a direct way the diagnostic capacity of the system, obtaining results of 81.25 % of sensitivity and 77.14 % of specificity. Moreover, the system is also capable of analyzing macroscopic images, having been designd with multiplatform architecture and being firmly oriented to teledermatology, which is increasingly used.


Melanoma Segmentation Biosignal processing techniques Pattern recognition Machine learning 



The authors wish to acknowledge the help of the companies GAIA, IMQ and Maser, as well as the support provided by the Basque Country Government Departments of Education and Industry, Commerce and Tourism.


  1. 1.
    Skin Cancer Foundation, “Skin Cancer Foundation–Skin cancer facts”. (2013)
  2. 2.
    Asociación Española Contra el Cáncer, “Melanoma”. (2013)
  3. 3.
    International Dermoscopy Society, “Consensus Net Meeting on Dermoscopy”. (2013).Google Scholar
  4. 4.
    Zaballos, P., Carrera, C., Puig, S., Malvehy, J.: Educación Médica Continuada Criterios dermatoscópicos para el diagnóstico del melanoma, Medicina Cutánea Ibero-Latino-Americana, vol. 32 (2004).Google Scholar
  5. 5.
    Psaty, E.L., Halpern, A.C.: Current and emerging technologies in melanoma diagnosis: the state of the art. Clin. dermatol. 27(1), 35–45 (2009)CrossRefGoogle Scholar
  6. 6.
    Smith, L., Macneil, S.: State of the art in non-invasive imaging of cutaneous melanoma. Skin res. technol. 17(3), 257–269 (2011)CrossRefGoogle Scholar
  7. 7.
    Goodson, A.G., Grossman, D.: Strategies for early melanoma detection: approaches to the patient with nevi. J. Am. Acad. Dermatol. 60(5), 719–738 (2009)CrossRefGoogle Scholar
  8. 8.
    Guitera, P., Menzies, S.W.: State of the art of diagnostic technology for early-stage melanoma. Expert Rev. Anticancer Ther. 11(5), 715–723 (2011)CrossRefGoogle Scholar
  9. 9.
    Pehamberger, H., Steiner, A., Wolff, K.: In vivo epiluminescence microscopy of pigmented skin lesions. I: Pattern analysis of pigmented skin lesions. J. Am. Acad. Dermatol. 17(4), 571–583 (1987)CrossRefGoogle Scholar
  10. 10.
    Stolz, W., Riemann, A., Cognetta, A.B.: ABCD rule of dermatoscopy: a new practical method for early recognition of malignant melanoma. Eur. J. Dermatol. 4, 521–527 (1994)Google Scholar
  11. 11.
    Menzies, S.W., Ingvar, C., Crotty, K.A., McCarthy, W.H.: Frequency and morphologic characteristics of invasive melanomas lacking specific surface microscopic features. Arch. dermatol. 132(10), 1178–1182 (1996)CrossRefGoogle Scholar
  12. 12.
    Argenziano, G., Fabbrocini, G., Carli, P., De Giorgi, V., Sammarco, E., Delfino, M.: Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. Arch. dermatol. 134(12), 1563–1570 (1998)CrossRefGoogle Scholar
  13. 13.
    FotoFinder Systems, “Fotofinder”. (2013)
  14. 14.
    Isasi, Gola: A., García Zapirain, B., Méndez Zorrilla, A.: Melanomas non-invasive diagnosis application based on the ABCD rule and pattern recognition image processing algorithms. Comput. Biol. Med. 41(9), 742–755 (2011)CrossRefGoogle Scholar
  15. 15.
    Lee, T., Ng, V., Gallagher, R., Coldman, A., McLean, D.: Dullrazor\(\textregistered \): a software approach to hair removal from images. Comput. Biol. Med. 27(6), 533–543 (1997)CrossRefGoogle Scholar
  16. 16.
    Zhou, H., Chen, M., Gass, R., Rehg, J.M., Ferris, L., Ho, J., Drogowski, L.: Feature-preserving artifact removal from dermoscopy images. In: Proceedings of the SPIE Medical Imaging Conference, vol. 6914, pp. 69141B–69141B-9 (2008).Google Scholar
  17. 17.
    Wighton, P., Lee, T.K., Atkins, M.S.: Dermascopic hair disocclusion using inpainting. In: Proceedings of the SPIE Medical Imaging Conference, vol. 6914, pp. 691427–691427-8 (2008).Google Scholar
  18. 18.
    Kiani, K., Sharafat, A.R.: E-shaver: an improved DullRazor(\({\textregistered }\)) for digitally removing dark and light-colored hairs in dermoscopic images. Comput. biol. med. 41(3), 139–145 (2011)CrossRefGoogle Scholar
  19. 19.
    Abbas, Q., Garcia, I.F.: Emre Celebi, M., Ahmad, W.: A feature-preserving hair removal algorithm for dermoscopy images. Skin Res. technol. 19(1), e27–e36 (2013)CrossRefGoogle Scholar
  20. 20.
    Abbas, Q., Celebi, M.E., García, I.F.: Hair removal methods: a comparative study for dermoscopy images. Biomed. Signal Process. Control 6(4), 395–404 (2011)CrossRefGoogle Scholar
  21. 21.
    Celebi, M.E., Iyatomi, H., Schaefer, G., Stoecker, W.V.: Lesion border detection in dermoscopy images. Comput. Med. Imaging Graph. 33(2), 148–153 (2009)CrossRefGoogle Scholar
  22. 22.
    Gómez, Delgado: D., Butakoff, C., Ersbøll, B.K., Stoecker, W.: Independent histogram pursuit for segmentation of skin lesions. IEEE Trans. Biomed. Eng. 55(1), 157–161 (2008)CrossRefGoogle Scholar
  23. 23.
    Garnavi, R., Aldeen, M., Celebi, M.E., Varigos, G., Finch, S.: Border detection in dermoscopy images using hybrid thresholding on optimized color channels. Comput. Med. Imaging Graph. 35(2), 105–115 (2011)CrossRefGoogle Scholar
  24. 24.
    Celebi, Emre: M., Wen, Q., Hwang, S., Iyatomi, H., Schaefer, G.: Lesion border detection in dermoscopy images using ensembles of thresholding methods. Skin Res. Technol. 19(1), e252–e258 (2013)CrossRefGoogle Scholar
  25. 25.
    Schmid, P.: Segmentation of digitized dermatoscopic images by two-dimensional color clustering. IEEE Trans. Med. Imaging 18(2), 164–171 (1999)CrossRefGoogle Scholar
  26. 26.
    Cucchiara, R., Grana, C., Seidenari, S., Pellacani, G.: Exploiting color and topological features for region segmentation with recursive fuzzy C-means. Mach. Graph. Vis. Int. J. 11(2/3), 169–182 (2002).Google Scholar
  27. 27.
    Zhou, H., Schaefer, G., Sadka, A.H., Celebi, M.E.: Anisotropic mean shift based fuzzy C-means segmentation of dermoscopy images. IEEE J. Sel. Top. Signal Process. 3(1), 26–34 (2009)CrossRefGoogle Scholar
  28. 28.
    Melli, R., Grana, C., Cucchiara, R.: Comparison of color clustering algorithms for segmentation of dermatological images. In: Proceedings of the SPIE Medical Imaging Conference, vol. 6144, pp. 61443S–61443S-9 (2006).Google Scholar
  29. 29.
    Celebi, Emre: M., Alp Aslandogan, Y., Stoecker, W.V., Iyatomi, H., Oka, H., Chen, X.: Unsupervised border detection in dermoscopy images. Skin Res. Technol. 13(4), 454–462 (2007)CrossRefGoogle Scholar
  30. 30.
    Celebi, M.E., Kingravi, H.A., Iyatomi, H., Aslandogan, Y.A., Stoecker, W.V., Moss, R.H., Malters, J.M., Grichnik, J.M., Marghoob, A.A., Rabinovitz, H.S., Menzies, S.W.: Border detection in dermoscopy images using statistical region merging. Skin Res. Technol. 14(3), 347–353 (2008)CrossRefGoogle Scholar
  31. 31.
    Wang, H., Chen, X., Moss, R.H., Stanley, R.J., Stoecker, W.V., Celebi, M.E., Szalapski, T.M., Malters, J.M., Grichnik, J.M., Marghoob, A.A., Rabinovitz, H.S., Menzies, S.W.: Watershed segmentation of dermoscopy images using a watershed technique. Skin Res. Technol. 16(3), 378–384 (2010)Google Scholar
  32. 32.
    Erkol, B.H.E., Moss, R., Stanley, R., Stoecker, W.: Automatic lesion boundary detection in dermoscopy images using gradient vector flow snakes. Skin Res. Technol. 11, 17–26 (2005)CrossRefGoogle Scholar
  33. 33.
    Zhou, H., Schaefer, G., Celebi, M.E., Lin, F., Liu, T.: Gradient vector flow with mean shift for skin lesion segmentation. Comput. Med. Imaging Graph. 35(2), 121–127 (2011)CrossRefGoogle Scholar
  34. 34.
    Abbas, Q., Celebi, M.E.: Fondón García, I.: A novel perceptually-oriented approach for skin tumor segmentation. Int. J. Innovative Comput. Inf. Control 8(3), 1837–1848 (2012)Google Scholar
  35. 35.
    Iyatomi, H., Oka, H., Celebi, M.E., Hashimoto, M., Hagiwara, M., Tanaka, M., Ogawa, K.: An improved internet-based melanoma screening system with dermatologist-like tumor area extraction algorithm. Comput. Med. Imaging Graph. 32(7), 566–579 (2008)CrossRefGoogle Scholar
  36. 36.
    Alcon, Fernandez: J., Ciuhu, C., Ten Kate, W., Heinrich, A., Uzunbajakava, N., Krekels, G., Siem, D., De Haan, G.: Automatic imaging system with decision support for inspection of pigmented skin lesions and melanoma diagnosis. IEEE J. Sel. Top. Signal Process. 3(1), 14–25 (2009)Google Scholar
  37. 37.
    Di Leo, G., Paolillo, A., Sommella, P., Fabbrocini, G., Rescigno, O.: A software tool for the diagnosis of melanomas. In: IEEE Instrumentation & Measurement Technology Conference Proceedings, vol. 2010, pp. 886–891 (2010).Google Scholar
  38. 38.
    Ganster, H., Pinz, A., Röhrer, R., Wildling, E., Binder, M., Kittler, H.: Automated melanoma recognition. IEEE Trans. Med. Imaging 20(3), 233–239 (2001)CrossRefGoogle Scholar
  39. 39.
    Tommasi, T., La Torre, E., Caputo, B., Beichel, R., Sonka, M.: Melanoma Recognition Using Representative and Discriminative Kernel Classifiers. Computer Vision Approaches to Medical Image Analysis Lecture Notes in Computer Science 4241, 1–12 (2006)CrossRefGoogle Scholar
  40. 40.
    Celebi, M.E., Kingravi, H.A., Uddin, B., Iyatomi, H., Aslandogan, Y.A., Stoecker, W.V., Moss, R.H.: A methodological approach to the classification of dermoscopy images. Comput. Med. Imaging Graph. 31(6), 362–373 (2007)CrossRefGoogle Scholar
  41. 41.
    Rahman, M.M., Bhattacharya, P., Desai, B.C.: A multiple expert-based melanoma recognition system for dermoscopic images of pigmented skin lesions. In: 8th IEEE International Conference on BioInformatics and. BioEngineering 2008, 1–6 (2008)Google Scholar
  42. 42.
    Surowka, G.: Supervised learning of melanocytic skin lesion images. In: Conference on Human System. Interactions 2008, 121–125 (2008)Google Scholar
  43. 43.
    Situ, N., Yuan, X., Chen, J., Zouridakis, G.: Malignant melanoma detection by Bag-of-Features classification. In: 30th Annual International Conference of the IEEE, Engineering in Medicine and Biology Society, EMBS 2008, pp. 3110–3113 (2008).Google Scholar
  44. 44.
    Zhou, H., Rehg, J.M.: Dermoscopic interest point detector and descriptor. In: IEEE International Symposium on Biomedical Imaging: From Nano to Macro, vol. 2009, pp. 1318–1321 (2009).Google Scholar
  45. 45.
    Situ, N., Wadhawan, T., Hu, R., Lancaster, K., Yuan, X., Zouridakis, G.: Evaluating sampling strategies of dermoscopic interest points. In: IEEE International Symposium on Biomedical Imaging: From Nano to Macro, vol. 2011, pp. 109–112 (2011).Google Scholar
  46. 46.
    Anantha, M., Moss, R.H., Stoecker, W.V.: Detection of pigment network in dermatoscopy images using texture analysis. Comput. Med. Imaging Graph. 28(5), 225–234 (2004)CrossRefGoogle Scholar
  47. 47.
    Betta, G., Di Leo, G., Fabbrocini, G., Paolillo, A., Sommella, P.: Dermoscopic image-analysis system: estimation of atypical pigment network and atypical vascular pattern. In: IEEE International Workshop on Medical Measurement and Applications, MeMea 2006, vol. 2006, pp. 63–67 (2006).Google Scholar
  48. 48.
    Di Leo, G., Liguori, C., Paolillo, A., Sommella, P.: An improved procedure for the automatic detection of dermoscopic structures in digital ELM images of skin lesions. In: IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, vol. 2008, pp. 190–194 (2008).Google Scholar
  49. 49.
    Barata, C., Marques, J.S., Rozeira, J.: A system for the detection of pigment network in dermoscopy images using directional filters. IEEE Trans. Biomed. Eng. 59(10), 2744–2754 (2012)CrossRefGoogle Scholar
  50. 50.
    Shrestha, B., Bishop, J., Kam, K., Chen, X., Moss, R.H., Stoecker, W.V., Umbaugh, S., Stanley, R.J., Celebi, M.E., Marghoob, A.A., Argenziano, G., Soyer, H.P.: Detection of atypical texture features in early malignant melanoma. Skin Res. Technol. 16(1), 60–65 (2010)CrossRefGoogle Scholar
  51. 51.
    Sadeghi, M., Razmara, M., Lee, T.K., Atkins, M.S.: A novel method for detection of pigment network in dermoscopic images using graphs. Comput. Med. Imaging Graph. 35(2), 137–143 (2011)CrossRefGoogle Scholar
  52. 52.
    Sadeghi, M., Razmara, M., Wighton, P., Lee, T.K., Atkins, M.S.: Modeling the dermoscopic structure pigment network using a clinically inspired feature set. Lect. Notes Comput. Sci. 6326, 467–474 (2010)CrossRefGoogle Scholar
  53. 53.
    Skrovseth, S.O., Schopf, T.R., Thon, K., Zortea, M., Geilhufe, M., Mollersen, K., Kirchesch, H.M., Godtliebsen, F.: A computer aided diagnostic system for malignant melanomas. In: 2010 3rd International Symposium on Applied Sciences in Biomedical and Communication Technologies (ISABEL 2010), pp. 1–5 (2010).Google Scholar
  54. 54.
    Yoshino, S., Tanaka, T., Tanaka, M., Oka, H.: Application of morphology for detection of dots in tumor. In: SICE 2004 Annual Conference, vol. 1, pp. 591–594 (2004).Google Scholar
  55. 55.
    Celebi, M.E., Iyatomi, H., Stoecker, W.V., Moss, R.H., Rabinovitz, H.S., Argenziano, G., Soyer, H.P.: Automatic detection of blue-white veil and related structures in dermoscopy images. Comput. Med. Imaging Graph. 32(8), 670–677 (2008)CrossRefGoogle Scholar
  56. 56.
    Di Leo, G., Fabbrocini, G., Paolillo, A., Rescigno, O., Sommella, P.: Towards an automatic diagnosis system for skin lesions: Estimation of blue-whitish veil and regression structures. In: 6th International Multi-Conference on Systems. Signals and Devices, vol. 2009, pp. 1–6 (2009).Google Scholar
  57. 57.
    Arroyo, J.L.G., Zapirain, B.G., Zorrilla, A.M.: Blue-white veil and dark-red patch of pigment pattern recognition in dermoscopic images using machine-learning techniques. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), vol. 2011, pp. 196–201 (2011).Google Scholar
  58. 58.
    Mirzaalian, H., Lee, T.K., Hamarneh, G.: Learning features for streak detection in dermoscopic color images using localized radial flux of principal intensity curvature. In: IEEE Workshop on Mathematical Methods in Biomedical Image. Analysis 2012, 97–101 (2012)Google Scholar
  59. 59.
    Sadeghi, M., Lee, T.K., Mclean, D., Lui, H., Atkins, M.S.: Oriented pattern analysis for streak detection in dermoscopy images. In: Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012, pp. 298–306 (2012).Google Scholar
  60. 60.
    Sadeghi, M., Lee, T., Lui, H., McLean, D., Atkins, S.: Detection and analysis of irregular streaks in dermoscopic images of skin lesions. IEEE Trans. Med, Imaging (2013)Google Scholar
  61. 61.
    Dalal, A., Moss, R.H., Stanley, R.J., Stoecker, W.V., Gupta, K., Calcara, D.A.: Xu, J., Shrestha, B., Drugge, R., Malters, J.M., Perry, L.A.: Concentric decile segmentation of white and hypopigmented areas in dermoscopy images of skin lesions allows discrimination of malignant melanoma. Comput. Med. Imaging Graph. 35(2), 148–154 (2011)CrossRefGoogle Scholar
  62. 62.
    Madasu, V.K., Lovell, B.C.: Blotch detection in pigmented skin lesions using fuzzy co-clustering and texture segmentation. In: Digital Image Computing: Techniques and Applications, vol. 2009, pp. 25–31 (2009).Google Scholar
  63. 63.
    Stoecker, W.V., Gupta, K., Stanley, R.J., Moss, R.H., Shrestha, B.: Detection of asymmetric blotches (asymmetric structureless areas) in dermoscopy images of malignant melanoma using relative color. Skin Res. Technol. 11(3), 179–184 (2005)CrossRefGoogle Scholar
  64. 64.
    Pellacani, G., Grana, C., Cucchiara, R., Seidenari, S.: Automated extraction and description of dark areas in surface microscopy melanocytic lesion images. Dermatology (Basel, Switzerland) 208(1), 21–26 (2004).Google Scholar
  65. 65.
    Khan, A., Gupta, K., Stanley, R.J., Stoecker, W.V., Moss, R.H., Argenziano, G., Soyer, H.P., Rabinovitz, H.S., Cognetta, A.B.: Fuzzy logic techniques for blotch feature evaluation in dermoscopy images. Comput. Med. Imaging Graph. 33(1), 50–57 (2009)CrossRefGoogle Scholar
  66. 66.
    Iyatomi, H., Oka, H., Celebi, M.E., Ogawa, K., Argenziano, G., Soyer, H.P., Koga, H., Saida, T., Ohara, K., Tanaka, M.: Computer-based classification of dermoscopy images of melanocytic lesions on acral volar skin. J. Invest. Dermatol. 128(8), 2049–2054 (2008)CrossRefGoogle Scholar
  67. 67.
    Korotkov, K., Garcia, R.: Computerized analysis of pigmented skin lesions: a review. Artif. Intell. Med. 56(2), 69–90 (2012)CrossRefGoogle Scholar
  68. 68.
    Celebi, M.E., Stoecker, W.V., Moss, R.H.: Advances in skin cancer image analysis. Comput. Med. Imaging Graph. 35(2), 83–84 (2011)CrossRefGoogle Scholar
  69. 69.
    Derma Medical Systems, “MoleMax”. (2013)
  70. 70.
    Biomips, “DBDermo-Mips/DDAX Software”. (2013)
  71. 71.
    Canfield Imaging Systems, “Canfield”. (2013)
  72. 72.
    MedX Health Corporation, “SIAscopy\({^{\rm{TM}}}\)-Molemate”. (2013)
  73. 73.
    Walter, F.M., Morris, H.C., Humphrys, E., Hall, P.N., Prevost, A.T., Burrows, N., Bradshaw, L., Wilson, E.C.F., Norris, P., Walls, J., Johnson, M., Kinmonth, A.L., Emery, J.D.: Effect of adding a diagnostic aid to best practice to manage suspicious pigmented lesions in primary care: randomised controlled trial. Br. Med. J. 345, e4110:1–14 (2012).Google Scholar
  74. 74.
    MELA Sciences Inc., “MelaFind”. (2013)
  75. 75.
    Monheit, G., Cognetta, A.B., Ferris, L., Rabinovitz, H., Gross, K.: Martini, M., Grichnik, J.M., Mihm, M., Prieto, V.G., Googe, P., King, R., Toledano, A., Kabelev, N., Wojton, M., Gutkowicz-Krusin, D.: The performance of MelaFind: a prospective multicenter study. Arch. Dermatol. 147(2), 188–194 (2011)CrossRefGoogle Scholar
  76. 76.
    Dermoscopix, “Dermoscopix”. (2013)
  77. 77.
    Visiomed AG, “MicroDerm”. (2013)
  78. 78.
    DatInf GmbH, “MoleExpert”. (2013)
  79. 79.
    Western Research Inc., “DermAlert”. (2013)
  80. 80.
    Health Discovery Corporation, “MelApp”. (2013)
  81. 81.
    University of Michigan, “UMSkinCheck”. (2013)
  82. 82.
    Molemap Inc., “Molemap”. (2013)
  83. 83.
    Molesafe Inc., “Molesafe”. (2013)
  84. 84.
    Melanoscan Inc., “Melanoscan”. (2013)
  85. 85.
    Elizabeth, D.D.P., Rhett, J., Drugge, M.D., Nguyen, C., Luciana, G.: Clinical pathway for melanoma detection using comprehensive cutaneous analysis with Melanoscan\({\textregistered }\), Dermatol. Online J. (2010). Accessed 08 Oct 2012
  86. 86.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993).Google Scholar
  87. 87.
    Otsu, N.: A threshold selection method from gray level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)MathSciNetCrossRefGoogle Scholar
  88. 88.
    Breiman, L.: Random forests. Mach. Learn. 45, 5–32 (2001)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Jose Luis García Arroyo
    • 1
  • Begoña García Zapirain
    • 1
  1. 1.DeustoTech-LIFE Laboratory, Faculty of EngineeringUniversity of DeustoBilbaoSpain

Personalised recommendations