Skip to main content
SpringerLink
Log in

A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: coherent taxonomy, open issues and recommendation pathway solution

  • Review Paper
  • Published:
Health and Technology Aims and scope Submit manuscript

Abstract

This research aims to review the attempts of researchers in response to the new and disruptive technology of skin cancer applications in terms of evaluation and benchmarking, in order to identify the research landscape from the literature into a cohesive taxonomy. An extensive search was conducted for articles dealing with ‘skin cancer’, ‘apps’ and ‘smartphone’ or ‘mHealth’ in different variations to find all the relevant articles in three main databases, namely, “Web of Science”, “Science Direct”, and “IEEE explore”. These databases are considered wide enough to cover medical and technical literature. The final classification scheme outcome of the dataset contained 110 articles that were classified into four classes: development and design; analytical; evaluative and comparative; and review and survey studies. Afterwards, another filtering process was achieved based on the evaluation criteria error rate within the dataset, time complicity and reliability, which are used in skin cancer applications. The final classification scheme outcome of the dataset contained 89 articles distributed in mapping and crossover with four sections concluded from 110 articles. Development and design studies, analytical studies, evaluative and comparative studies and articles of reviews and surveys comprised of 48.3146%, 22.4719%, 16.8539% (15), and 12.3595% (11) of the reviewed articles, respectively. The basic features of this evolving approach were identified in these aspects. We also determined open issues in terms of evaluation and benchmarking that hamper the utility of this technology. Furthermore, with the exception of the 89 papers reviewed, the new recommendation pathway solution was described in order to improve the measurement process for smartphone-based skin cancer diagnosis applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Barata C, et al. Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst J. 2014;8(3):965–79.

    Article  Google Scholar 

  2. Malyuskin O, and Fusco V. Resonance microwave reflectometry for early stage skin cancer identification. In 2015 9th European Conference on Antennas and Propagation (EuCAP). 2015.

  3. Mendi E, et al. Automatic mobile segmentation of dermoscopy images using density based and fuzzy c-means clustering. in 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA) 2014.

  4. Alsalem MA, et al. A review of the automated detection and classification of acute leukaemia: coherent taxonomy, datasets, validation and performance measurements, motivation, open challenges and recommendations. Comput Methods Prog Biomed. 2018;158:93–112.

    Article  Google Scholar 

  5. Rosado L and Ferreira M. A prototype for a mobile-based system of skin lesion analysis using supervised classification. 2013. IEEE.

  6. Do TT, et al. Early melanoma diagnosis with mobile imaging. 2014. IEEE.

  7. Mahmoud MKA, Al-Jumaily A, and Takruri M. The automatic identification of melanoma by wavelet and curvelet analysis: study based on neural network classification. IEEE.

  8. Abuzaghleh O, Barkana BD, and Faezipour M. Automated skin lesion analysis based on color and shape geometry feature set for melanoma early detection and prevention. IEEE.

  9. Abuzaghleh O, Faezipour M, and Barkana BD. A comparison of feature sets for an automated skin lesion analysis system for melanoma early detection and prevention. in 2015 Long Island systems, Applications and Technology 2015.

  10. Wadhawan T, et al. SkinScan©: a portable library for melanoma detection on handheld devices. IEEE.

  11. Mhaske HR and Phalke DA. Melanoma skin cancer detection and classification based on supervised and unsupervised learning. 2013. IEEE.

  12. Yas QM, et al. A systematic review on smartphone skin Cancer apps: coherent taxonomy, motivations, open challenges and recommendations, and new research direction. Journal of Circuits, Systems and Computers. 2018;27(05):1830003.

    Article  Google Scholar 

  13. Masood A, Al-Jumaily A, and Anam K. Self-supervised learning model for skin cancer diagnosis. 2015. IEEE.

  14. Dumitrache I, Sultana AE, and Dogaru R. Automatic detection of skin melanoma from images using natural computing approaches. IEEE.

  15. Abuzaghleh O., Barkana BD, and Faezipour M. SKINcure: a real time image analysis system to aid in the malignant melanoma prevention and early detection. IEEE.

  16. Sabouri P, et al. A cascade classifier for diagnosis of melanoma in clinical images. IEEE.

  17. Hu R, Queen CM, and Zouridakis G. Detection of Buruli ulcer disease: Preliminary results with dermoscopic images on smart handheld devices. 2013. IEEE.

  18. Fosu KPO and Jouny I. Mobile melanoma detection application for Android smart phones. 2015. IEEE.

  19. Ballerini L, et al. Non-melanoma skin lesion classification using colour image data in a hierarchical K-NN classifier. IEEE.

  20. Duarte MF, et al. Melanoma classification from Hidden Markov tree features. 2012. IEEE.

  21. Ruela M, et al. On the role of shape in the detection of melanomas. 2015. IEEE.

  22. Haider S, et al. Enhanced classification of malignant melanoma lesions via the integration of physiological features from dermatological photographs. IEEE.

  23. Taeb A, Gigoyan S, Safavi-Naeini S. Millimetre-wave waveguide reflectometers for early detection of skin cancer. IET Microwaves, Antennas & Propagation. 2013;7(14):1182–6.

    Article  Google Scholar 

  24. Töpfer F, Dudorov S, Oberhammer J. Millimeter-wave near-field probe designed for high-resolution skin cancer diagnosis. IEEE Transactions on Microwave Theory and Techniques. 2015;63(6):2050–9.

    Article  Google Scholar 

  25. Varshney U. Mobile health: four emerging themes of research. Decis Support Syst. 2014;66:20–35.

    Article  Google Scholar 

  26. Wang Y, et al. Toward in vivo biopsy of melanoma based on photoacoustic and ultrasound dual imaging with an integrated detector. Biomedical optics express. 2016;7(2):279–86.

    Article  MathSciNet  Google Scholar 

  27. Hartinger AE, Guardo R and Gagnon H. EIT system and reconstruction algorithm adapted for skin cancer imaging. In 2012 11th International Conference on Information Science, Signal processing and their applications (ISSPA). 2012.

  28. Littman-Quinn R, et al. mHealth applications for telemedicine and public health intervention in Botswana. 2011. IEEE.

  29. Tittmann BR, et al. Fine mapping of tissue properties on excised samples of melanoma and skin without the need for histological staining. IEEE Trans Ultrason Ferroelectr Freq Control. 2013;60(2):320–31.

    Article  Google Scholar 

  30. Caratelli D, et al. Accurate time-domain modeling of reconfigurable antenna sensors for non-invasive melanoma skin Cancer detection. IEEE Sensors J. 2012;12(3):635–43.

    Article  Google Scholar 

  31. Töpfer F, Emtestam L, and Oberhammer J. Dermatological verification of micromachined millimeter-wave skin-cancer probe. In 2014 IEEE MTT-S International Microwave Symposium (IMS2014). 2014.

  32. Körner A, et al. Supportive care needs and distress in patients with non-melanoma skin cancer: nothing to worry about? Eur J Oncol Nurs. 2016;20:150–5.

    Article  Google Scholar 

  33. Heckman C, et al. Development of an internet intervention to address behaviors associated with skin cancer risk among young adults. Internet Interventions. 2015;2(3):340–50.

    Article  Google Scholar 

  34. Glodde N, et al. Differential role of cannabinoids in the pathogenesis of skin cancer. Life Sci. 2015;138:35–40.

    Article  Google Scholar 

  35. Paradisi A, et al. Markedly reduced incidence of melanoma and nonmelanoma skin cancer in a nonconcurrent cohort of 10,040 patients with vitiligo. J Am Acad Dermatol. 2014;71(6):1110–6.

    Article  Google Scholar 

  36. Liu J, et al. Both HDAC5 and HDAC6 are required for the proliferation and metastasis of melanoma cells. J Transl Med. 2016;14(1):7–7.

    Article  Google Scholar 

  37. Rashtak S, et al. Incidence and risk factors for skin cancer following lung transplantation. J Am Acad Dermatol. 2015;72(1):92–8.

    Article  Google Scholar 

  38. Abuzaghleh O, Faezipour M and Barkana BD. Skinaid: a virtual reality system to aid in the skin cancer prevention and pain treatment. in 2013 IEEE Long Island Systems, Applications and Technology Conference (LISAT) 2013.

  39. Blumrosen G, et al. C-SMART: efficient seamless cellular phone based patient monitoring system. in 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks. 2011.

  40. Nezerwa M, et al. Universal design with mobile app development: Bridging the Gap for the forgotten populations. In 2015 Long Island Systems, Applications and Technology 2015.

  41. Chen X, et al. A study on the model of mobile medical application in 3G network. in 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet). 2011.

  42. Godoy SE, et al. Dynamic infrared imaging for skin cancer screening. Infrared Phys Technol. 2015;70:147–52.

    Article  Google Scholar 

  43. Bourouis A, et al. M-health: skin disease analysis system using Smartphone's camera. Procedia Computer Science. 2013;19:1116–20.

    Article  Google Scholar 

  44. Ali AR, Couceiro MS, and Hassenian AE. Melanoma detection using fuzzy C-means clustering coupled with mathematical morphology. In 2014 14th International Conference on Hybrid Intelligent Systems. 2014.

  45. Raikar A, Sangani SP, and Hanabaratti KD. Diagnosis of melanomas by check-list method. in 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT) 2013.

  46. Caratelli D, et al. Locally conformal FDTD modeling of MEMS-based antenna sensors for melanoma detection. In 2011 IEEE International Symposium on Medical Measurements and Applications. 2011.

  47. Youl PH, et al. Can skin cancer prevention and early detection be improved via mobile phone text messaging? A randomised, attention control trial. Prev Med. 2015;71:50–6.

    Article  Google Scholar 

  48. Jain S, jagtap V, Pise N. Computer aided melanoma skin Cancer detection using image processing. Procedia Computer Science. 2015;48:735–40.

    Article  Google Scholar 

  49. J Chaube, U., V. Kumar Vyas, and H. Girishkumar Bhatt, Design and synthesis of potent N-Phenylpyrimidine derivatives for the treatment of skin Cancer Vol. 6. 2016.

  50. Truong BCQ, et al. High correlation of double Debye model parameters in skin cancer detection. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2014.

  51. Liu Z, et al. Cancer-promoting effect of capsaicin on DMBA/TPA-induced skin tumorigenesis by modulating inflammation, Erk and p38 in mice. Food Chem Toxicol. 2015;81:1–8.

    Article  Google Scholar 

  52. Doran CM, et al. Benefit cost analysis of three skin cancer public education mass-media campaigns implemented in new South Wales, Australia. PLoS One. 2016;11(1):e0147665-e0147665.

    Article  MathSciNet  Google Scholar 

  53. Moon Y, et al. Differentiation of cutaneous melanoma from surrounding skin using laser-induced breakdown spectroscopy. In 2016 Conference on Lasers and Electro-Optics (CLEO). 2016.

  54. Møllersen K, Hardeberg JY, and Godtliebsen F. Divergence-based colour features for melanoma detection. in 2015 Colour and Visual Computing Symposium (CVCS) 2015.

  55. Mete M and Sirakov NM. Optimal set of features for accurate skin cancer diagnosis. In 2014 IEEE International Conference on Image Processing (ICIP). 2014.

  56. Sankaran S and Sethumadhavan G. Quantifications of asymmetries on the spectral bands of MALIGNANT melanoma using six sigma threshold as preprocessor. in Third international conference on computational intelligence and information technology (CIIT 2013). 2013.

  57. Paja W and Wrzesień M. Melanoma important features selection using random forest approach. In 2013 6th International Conference on Human System Interactions (HSI). 2013.

  58. Tran B, et al. Association between ultraviolet radiation, skin sun sensitivity and risk of pancreatic cancer. Cancer Epidemiol. 2013;37(6):886–92.

    Article  Google Scholar 

  59. Wang F, et al. The distribution of biologically effective UV spectral irradiances received on a manikin face that cause erythema and skin cancer. J Photochem Photobiol B Biol. 2014;140:205–14.

    Article  Google Scholar 

  60. Karimkhani C, et al. The surgeon general should say that indoor ultraviolet radiation tanning causes skin Cancer. Am J Prev Med. 2015;49(3):437–40.

    Article  Google Scholar 

  61. Töpfer F, Dudorov S, and Oberhammer J. 2-Dimensional near-field millimeter-wave scanning with micromachined probe for skin cancer diagnosis. In 2013 IEEE 26th International Conference on Micro Electro Mechanical Systems (MEMS). 2013.

  62. Hillert R, et al. Large molecular systems landscape uncovers T cell trapping in human skin cancer. Sci Rep. 2016;6:19012–2.

  63. Khunsap S, et al. Anticancer properties of phospholipase A2 from Daboia siamensis venom on human skin melanoma cells. Journal of Venomous Animals and Toxins including Tropical Diseases. 2016;22(1):7.

    Article  Google Scholar 

  64. Sokołowski A and Pardela T. Fourier transforms in melanoma image classification. In 2013 6th International Conference on Human System Interactions (HSI). 2013.

  65. Khosravi H, Schmidt B, Huang JT. Characteristics and outcomes of nonmelanoma skin cancer (NMSC) in children and young adults. J Am Acad Dermatol. 2015;73(5):785–90.

    Article  Google Scholar 

  66. Helgadottir H, et al. CDKN2a mutation-negative melanoma families have increased risk exclusively for skin cancers but not for other malignancies. Int J Cancer. 2015;137(9):2220–6.

    Article  Google Scholar 

  67. Zhao J, et al., Wavenumber selection based analysis in Raman spectroscopy improves skin cancer diagnostic specificity. Vol 141. 2016.

  68. Ferrucci L, et al., Indoor tanning in businesses and homes and risk of melanoma and nonmelanoma skin cancer in 2 US case-control studies. Vol. 71. 2014.

  69. Dawei N. Classification of melanoma and Clark nevus skin lesions based on medical image processing techniques. In 2011 3rd International Conference on Computer Research and Development 2011.

  70. Lamel SA, et al. Application of mobile teledermatology for skin cancer screening. J Am Acad Dermatol. 2012;67(4):576–81.

    Article  Google Scholar 

  71. Töpfer F, Dudorov S, and Oberhammer J. Micromachined 100GHz near-field measurement probe for high-resolution microwave skin-cancer diagnosis. In 2012 IEEE/MTT-S International Microwave Symposium Digest. 2012.

  72. Singh D, Gautam D, and Ahmed M Detection techniques for melanoma diagnosis: A performance evaluation in 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014). 2014.

  73. Valavanis I, et al. Inference of a robust diagnostic signature in the case of Melanoma: Gene selection by information gain and Gene Ontology tree exploration. In 13th IEEE International Conference on BioInformatics and Bioengineering 2013.

  74. Alfed N, et al. Pigment network-based skin cancer detection. in 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). 2015.

  75. Bhowmik A, et al. Suitability of frequency modulated thermal wave imaging for skin cancer detection—a theoretical prediction. J Therm Biol. 2015;51:65–82.

    Article  Google Scholar 

  76. Wysong A, et al. Non-melanoma skin cancer and NSAID use in women with a history of skin cancer in the Women's Health Initiative. Prev Med. 2014;69:8–12.

    Article  Google Scholar 

  77. Del Boz J, et al. Skin Cancer prevention and detection campaign at golf courses on Spain's Costa del sol. Actas Dermo-Sifiliográficas (English Edition). 2015;106(1):51–60.

    Google Scholar 

  78. Barrett PD, Barrett HE. An audit into use of minimum dataset reporting of skin cancers in the north of England Cancer network. Pathogenesis. 2015;2(1):5–8.

    Article  Google Scholar 

  79. Yang A, et al. Increased skin tumor incidence and keratinocyte hyper-proliferation in a mouse model of down syndrome. PLoS One. 2016;11(1):e0146570.

    Article  Google Scholar 

  80. Sáez A, Serrano C, Acha B. Model-based classification methods of global patterns in Dermoscopic images. IEEE Trans Med Imaging. 2014;33(5):1137–47.

    Article  Google Scholar 

  81. Masood A and Al-Jumaily A, Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms. Vol. 2013. 2013. 323268.

  82. Azadeh Noori H, Al-Jumaily A, and Sulaiman R. Review on automatic early skin cancer detection. In 2011 International Conference on Computer Science and Service System (CSSS). 2011.

  83. Borisova EG, Angelova LP, Pavlova EP. Endogenous and exogenous fluorescence skin Cancer diagnostics for clinical applications. IEEE Journal of Selected Topics in Quantum Electronics. 2014;20(2):211–22.

    Article  Google Scholar 

  84. Haque T, et al. Topical therapies for skin cancer and actinic keratosis. Eur J Pharm Sci. 2015;77:279–89.

    Article  Google Scholar 

  85. Chummun S, McLean NR. The management of malignant skin cancers. Surgery (Oxford). 2017;35(9):519–24.

    Article  Google Scholar 

  86. Friedman B, English JC, Ferris LK. Indoor tanning, skin Cancer and the young female patient: a review of the literature. J Pediatr Adolesc Gynecol. 2015;28(4):275–83.

    Article  Google Scholar 

  87. Colantonio S, Bracken MB, Beecker J. The association of indoor tanning and melanoma in adults: systematic review and meta-analysis. J Am Acad Dermatol. 2014;70(5):847–857.e18.

    Article  Google Scholar 

  88. Kassianos AP, et al. Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review. Br J Dermatol. 2015;172(6):1507–18.

    Article  Google Scholar 

  89. Korotkov K, Garcia R. Computerized analysis of pigmented skin lesions: a review. Artif Intell Med. 2012;56(2):69–90.

    Article  Google Scholar 

  90. Silva BMC, et al. Mobile-health: a review of current state in 2015. J Biomed Inform. 2015;56:265–72.

    Article  Google Scholar 

  91. Liu J, et al. Higher caffeinated coffee intake is associated with reduced malignant melanoma risk: a meta-analysis study. PLoS One. 2016;11(1):e0147056-e0147056.

    Google Scholar 

  92. Jadhav A and Sonar R, “Analytic hierarchy process (AHP), weighted scoring method (WSM), and hybrid knowledge based system (HKBS) for software selection: a comparative study,” in Emerging trends in engineering and technology (ICETET), 2009 2nd international conference on, 2009, pp. 991–997.

  93. Belton V and Stewart T, Multiple criteria decision analysis: an integrated approach. Springer Science & Business Media, 2002.

  94. Malczewski J, GIS and multicriteria decision analysis. John Wiley & Sons, 1999.

  95. Petrovic-Lazarevic S and Abraham A, “Hybrid fuzzy-linear programming approach for multi criteria decision making problems,” arXivPrepr.Cs/0405019, 2004.

  96. Zionts S. MCDM—if not a roman numeral, then what? Interfaces (Providence). 1979;9(4):94–101.

    Article  Google Scholar 

  97. Zaidan AA, Karim HA, Ahmad NN, Zaidan BB, Kiah MLM. Robust pornography classification solving the image size variation problem based on multi-agent learning. J. Circuits, Syst. Comput. 2015;24(2):1550023.

    Article  Google Scholar 

  98. Zaidan AA, Zaidan BB, Hussain M, Haiqi A, Kiah MLM, Abdulnabi M. Multi-criteria analysis for OS-EMR software selection problem: a comparative study. Decis Support Syst. 2015;78:15–27.

    Article  Google Scholar 

  99. Whaiduzzaman M, Gani A, Anuar NB, Shiraz M, Haque MN, Haque IT. Cloud service selection using multicriteria decision analysis. Sci World J. 2014;2014

  100. Huang JJ, Multiple attribute decision making: methods and applications. Chapman and Hall/CRC, 2011.

  101. Wang J-J, Jing Y-Y, Zhang C-F, Zhao J-H. Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew Sust Energ Rev. 2009;13(9):2263–78.

    Article  Google Scholar 

  102. Haralambopoulos DA, Polatidis H. Renewable energy projects: structuring a multi-criteria group decision-making framework. Renew Energy. 2003;28(6):961–73.

    Article  Google Scholar 

  103. Qu L, Chen Y. A hybrid MCDM method for route selection of multimodal transportation network. Adv Neural Networks-ISNN. 2008:374–383, 2008.

  104. Gbanie SP, Tengbe PB, Momoh JS, Medo J, Kabba VTS. Modelling landfill location using geographic information systems (GIS) and multi-criteria decision analysis (MCDA): case study Bo, southern Sierra Leone. Appl Geogr. 2013;36:3–12.

    Article  Google Scholar 

  105. Ligmann-Zielinska A, Jankowski P. Impact of proximity-adjusted preferences on rank-order stability in geographical multicriteria decision analysis. J GeogrSyst. 2012;14(2):167–87.

    Google Scholar 

  106. Phillips LD, e Costa CAB. Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing. Ann Oper Res. 2007;154(1):51–68.

    Article  MathSciNet  MATH  Google Scholar 

  107. Diaby V, Campbell K, Goeree R. Multi-criteria decision analysis (MCDA) in health care: a bibliometric analysis. Oper Res Heal Care. 2013;2(1):20–4.

    Article  Google Scholar 

  108. Thokala P, et al. Multiple criteria decision analysis for health care decision making—an introduction: report 1 of the ISPOR MCDA emerging good practices task force. Value Heal. 2016;19(1):1–13.

    Article  Google Scholar 

  109. Adunlin G, Diaby V, Xiao H. Application of multicriteria decision analysis in health care: a systematic review and bibliometric analysis. Health Expect. 2015;18(6):1894–905.

    Article  Google Scholar 

  110. Marsh K, Dolan P, Kempster J, Lugon M. Prioritizing investments in public health: a multi-criteria decision analysis. J Public Health (Bangkok). 2012;35(3):460–6.

    Article  Google Scholar 

  111. Ho W. Integrated analytic hierarchy process and its applications–a literature review. Eur J Oper Res. 2008;186(1):211–28.

    Article  MathSciNet  MATH  Google Scholar 

  112. Liberatore MJ, Nydick RL. The analytic hierarchy process in medical and health care decision making: a literature review. Eur J Oper Res. Aug. 2008;189(1):194–207.

    Article  MATH  Google Scholar 

  113. Guindo LA, et al. From efficacy to equity: literature review of decision criteria for resource allocation and healthcare decisionmaking. Cost Eff Resour Alloc. 2012;10(1):9.

    Article  Google Scholar 

  114. Marsh K, Lanitis T, Neasham D, Orfanos P, Caro J. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. PharmacoEconomics. 2014;32(4):345–65.

    Article  Google Scholar 

  115. Kalid N, et al. Based on real time remote health monitoring systems: a new approach for prioritization ‘large scales data’ patients with chronic heart diseases using body sensors and communication technology. J Med Syst. Apr. 2018;42(4):69.

    Article  Google Scholar 

  116. Mühlbacher AC, Kaczynski A. Making good decisions in healthcare with multi-criteria decision analysis: the use, current research and future development of MCDA. Appl Health Econ Health Policy. 2016;14(1):29–40.

    Article  Google Scholar 

  117. Zaidan AA, Zaidan BB, Al-Haiqi A, Kiah MLM, Hussain M, Abdulnabi M. Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS. J Biomed Inform. 2015;53:390–404.

    Article  Google Scholar 

  118. Oliveira M, Fontes DBMM, and Pereira T, “Multicriteria decision making: a case study in the automobile industry,” in International symposium on operational research and applications (ISORAP2013), 2013.

  119. M. Aruldoss, “A Survey On multi criteria decision making methods and its applications,” Am. J Inf Syst, vol. 1, no. 1, pp. 31–43, 2013.

    Google Scholar 

  120. Mansooreh M and Pet-Edwards J, “Technical briefing: making multiple-objective decisions,” Inst. Electr. Ve electron. Eng. Inc., IEEE Comput. Soc. press. USA, 1997.

  121. Triantaphyllou E, “Multi-criteria decision making methods,” in Multi-criteria decision making methods: A comparative study, Springer, 2000, pp. 5–21.

  122. Triantaphyllou E, Shu B, Sanchez SN, Ray T. Multi-criteria decision making: an operations research approach. Encycl. Electr. Electron.Eng. 1998;15(1998):175–86.

    Google Scholar 

  123. Yoon KP and Hwang CL, Multiple attribute decision making: an introduction, vol. 104. Sage publications, 1995.

  124. Abdullateef BN, Elias NF, Mohamed H, Zaidan AA, Zaidan BB. An evaluation and selection problems of OSS-LMS packages. Spring. 2016;5(1):248.

    Article  Google Scholar 

  125. Jumaah FM, Zaidan AA, Zaidan BB, Bahbibi R, Qahtan MY, Sali A. Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers. Telecommun Syst. 2017:1–19.

  126. Kiah MLM, Haiqi A, Zaidan BB, Zaidan AA. Open source EMR software: profiling, insights and hands-on analysis. Comput Methods Prog Biomed. 2014;117(2):360–82.

    Article  Google Scholar 

  127. Qader MA, Zaidan BB, Zaidan AA, Ali SK, Kamaluddin MA, Radzi WB. A methodology for football players selection problem based on multi-measurements criteria analysis. Meas J Int Meas Confed. 2017;111:38–50.

    Article  Google Scholar 

  128. Yas QM, Zadain AA, Zaidan BB, Lakulu MB, Rahmatullah B. Towards on develop a framework for the evaluation and benchmarking of skin detectors based on artificial intelligent models using multi-criteria decision-making techniques. Int. J. Pattern Recognit. Artif.Intell. 2017;31(3):1759002.

    Article  Google Scholar 

  129. Salman OH, Zaidan AA, Zaidan BB. Naserkalid, and M. Hashim, “novel methodology for triage and prioritizing using ‘big data’ patients with chronic heart diseases through telemedicine environmental,”. Int J Inf Technol DecisMak. 2017;16(5):1211–45.

    Article  Google Scholar 

  130. Yas QM, Zaidan AA, Zaidan BB, Rahmatullah B, and Karim HA, “Comprehensive insights into evaluation and benchmarking of real-time skin detectors: review, open issues & challenges, and recommended solutions,” Measurement, 2017.

  131. Zaidan BB, Zaidan AA, Abdul Karim H, Ahmad NN. A new approach based on multi-dimensional evaluation and benchmarking for data hiding techniques. Int J Inf Technol Decis Mak. 2017:1–42.

  132. Zaidan BB, Zaidan AA, Karim HA, Ahmad NN. A new digital watermarking evaluation and benchmarking methodology using an external group of evaluators and multi-criteria analysis based on ‘large-scale data. Softw PractExp. 2017;47(10):1365–92.

    Article  Google Scholar 

  133. Zaidan BB, Zaidan AA. Software and hardware FPGA-based digital watermarking and steganography approaches: toward new methodology for evaluation and benchmarking using multi-criteria decision-making techniques. J. Circuits, Syst. Comput. 2017;26(7):1750116.

    Article  Google Scholar 

  134. Zaidan BB, Zaidan AA. Comparative study on the evaluation and benchmarking information hiding approaches based multi-measurement analysis using TOPSIS method with different normalisation, separation and context techniques. Measurement. 2018;117:277–94.

    Article  Google Scholar 

  135. Kalid N, Zaidan AA, Zaidan BB, Salman OH, Hashim M, Muzammil H. Based real time remote health monitoring systems: a review on patients prioritization and related‘ big data’ using body sensors information and communication technology. J Med Syst. 2018;42(2):30.

    Article  Google Scholar 

  136. Jumaah FM, Zadain AA, Zaidan BB, Hamzah AK, and Bahbibi R, “Decision-making solution based multi-measurement design parameter for optimization of GPS receiver tracking channels in static and dynamic real-time positioning multipath environment,” Measurement, 2018.

  137. Shih HS, Shyur HJ, Lee ES. An extension of TOPSIS for group decision making. Math.Comput.Model. 2007;45(7–8):801–13.

    Article  MATH  Google Scholar 

  138. Saaty TL, Ozdemir MS. Why the magic number seven plus or minus two. Math. Comput.Model. 2003;38(3–4):233–44.

    Article  MathSciNet  MATH  Google Scholar 

  139. Lesmes D, Castillo M, and Zarama R, “Application of the Analytic Network Process (ANP) to establish weights in order to re-accredit a program of a university,” in Proc. of The 10th International Symposium on The Analytic Hierarchy Process, 2009, vol. 29.

  140. Saaty TL, “The analytic hierarchy process, New York: McGrew Hill,” Int. Transl. To Russ. Port. Chinese, Revis. Ed. Paperb. (1996, 2000), Pittsburgh RWS Publ., 1980.

  141. Nilsson H. E.-M.Nordström, and K. Öhman, “decision support for participatory forest planning using AHP and TOPSIS,”. Forests. 2016;7(5):100.

    Article  Google Scholar 

  142. Kandakoglu A, Celik M, Akgun I. A multi-methodological approach for shipping registry selection in maritime transportation industry. MathComputModel. 2009;49(3):586–97.

    MATH  Google Scholar 

  143. Barrios MAO, De Felice F, Negrete KP, Romero BA, Arenas AY, Petrillo A. An AHP-Topsis integrated model for selecting the most appropriate tomography equipment. Int J Inf Technol Decis Mak. 2016;15(4):861–85.

    Article  Google Scholar 

  144. Çalışkan H. Selection of boron based tribological hard coatings using multi-criteria decision making methods. Mater Des. 2013;50:742–9.

    Article  Google Scholar 

  145. Ortíz MA, Cómbita JP, la Hoz Á l AD, De Felice F, Petrillo A. An integrated approach of AHP-DEMATEL methods applied for the selection of allied hospitals in outpatient service. Int J Med Eng Inform. 2016;8(2):87–107.

    Article  Google Scholar 

  146. Beikkhakhian Y, Javanmardi M, Karbasian M, Khayambashi B. The application of ISM model in evaluating agile suppliers selection criteria and ranking suppliers using fuzzy TOPSIS-AHP methods. Expert Syst Appl. 2015;42(15):6224–36.

    Article  Google Scholar 

  147. Taylan O, Kaya D, Demirbas A. An integrated multi attribute decision model for energy efficiency processes in petrochemical industry applying fuzzy set theory. Energy Convers Manag. 2016;117:501–12.

    Article  Google Scholar 

  148. Keeney RL and Raiffa H, Decisions with multiple objectives: preferences and value trade-offs. Cambridge university press, 1993.

Download references

Author information

Authors and Affiliations

  1. Department of Computing, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia

    A. A. Zaidan, B. B. Zaidan, O. S. Albahri, M. A. Alsalem, A. S. Albahri, Qahtan M. Yas & M. Hashim

Authors
  1. A. A. Zaidan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. B. B. Zaidan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. O. S. Albahri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. A. Alsalem
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A. S. Albahri
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qahtan M. Yas
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. M. Hashim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. A. Zaidan.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Highlights

• Mapping the research landscape of skin cancer diagnosis apps based evaluation and benchmarking into a coherent taxonomy.

• Highlight the open challenges that hinder the utility of skin cancer diagnosis apps based evaluation and benchmarking.

• Recommendations pathway solution to improve the acceptance of skin cancer diagnosis apps based evaluation and benchmarking

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zaidan, A.A., Zaidan, B.B., Albahri, O.S. et al. A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: coherent taxonomy, open issues and recommendation pathway solution. Health Technol. 8, 223–238 (2018). https://doi.org/10.1007/s12553-018-0223-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12553-018-0223-9

Keywords

Search

Navigation