A Systematic Comparison and Evaluation of Supervised Machine Learning Classifiers Using Headache Dataset

  • Ahmed J. AljaafEmail author
  • Dhiya Al-Jumeily
  • Abir J. Hussain
  • Paul Fergus
  • Mohammed Al-Jumaily
  • Naeem Radi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9227)


The massive growth of data volume within the healthcare sector pushes the current classical systems that were adapted to the limit. Recent studies have focused on the use of machine learning methods to develop healthcare systems to extract knowledge from data by means of analysing, mining, pattern recognition, classification and prediction. Our research study reviews and examines different supervised machine learning classifiers using headache dataset. Different statistical measures have been used to evaluate the performance of seven well-known classifiers. The experimental study indicated that Decision Tree classifier achieved a better overall performance, followed by Artificial Neural Network, Support Vector Machine and k-Nearest Neighbor. This would determine the most suitable classifier for developing a particular classification system that is capable of identifying primary headache disorders.


Machine learning Performance analysis Primary headache 


  1. 1.
    Jeon, H.S., Lee, W.D.: Performance measurement of decision tree excluding insignificant leaf nodes. In: International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC). IEEE (2014)Google Scholar
  2. 2.
    El-Sappagh, S.H., El-Masri, S., Riad, A.M., Elmogy, M.: Data mining and knowledge discovery: applications, techniques, challenges and process models in healthcare. Int. J. Eng. Res. Appl. 3(3), 900–906 (2013)Google Scholar
  3. 3.
    Aljaaf, A.J., Al-Jumeily, D., Hussain, A.J., Fergus, P., Al-Jumaily, M., Abdel-Aziz, K.: Toward an optimal use of artificial intelligence techniques within a clinical decision support system. In: The Science and Information (SAI), London (2015) Google Scholar
  4. 4.
    Foster, K.R., Koprowski, R., Skufca, J.D.: Machine learning, medical diagnosis, and biomedical engineering research commentary. Biomed. Eng. 13, 94 (2014)Google Scholar
  5. 5.
    Sewak, M., Singh, S.: In pursuit of the best artificial neural network for predicting the most complex data. In: International Conference on Communication, Information and Computing Technology (ICCICT). IEEE, Mumbai (2015)Google Scholar
  6. 6.
    Dastanpour, A., Ibrahim, S., Mashinchi, R., Selamat, A.: Comparison of genetic algorithm optimization on artificial neural network and support vector machine in intrusion detection system. In: IEEE Conference on Open Systems (ICOS). IEEE, Malaysia (2014)Google Scholar
  7. 7.
    Al-Rahayfeh, A., Faezipour, M.: Classifiers comparison for a new eye gaze direction classification system. In: LISAT Conference. IEEE, Long Island (2014)Google Scholar
  8. 8.
    Thepade, S.D., Kalbhor, M.M.: Novel data mining based image classification with Bayes, tree, rule, lazy and function classifiers using fractional row mean of cosine, sine and walsh column transformed images. In: International Conference on Communication, Information and Computing Technology (ICCICT). IEEE, Mumbai (2015)Google Scholar
  9. 9.
    Siji, K.K., Mathew, B.S., Chandran, R., Shajeemohan, B.S., Shanthini, K.S.: Feature selection, optimization and performance analysis of classifiers for biological images. In: National Conference on Communication, Signal Processing and Networking. IEEE (2014)Google Scholar
  10. 10.
    Milovic, B., Milovic, M.: Prediction and decision making in health care using data mining. Int. J. Public Health Sci. (IJPHS) 1(2), 67–78 (2012)CrossRefGoogle Scholar
  11. 11.
    Sweety, M.E., Jiji, G.W.: Detection of alzheimer disease in brain images using PSO and decision tree approach. In: International Conference on Advanced Communication Control and Computing Technologies (ICACCCT). IEEE, Ramanathapuram (2014)Google Scholar
  12. 12.
    Sundararaj, G.K., Balamurugan, V.: An expert system based on texture features and decision tree classifier for diagnosis of tumor in brain MR images. In: International Conference on Contemporary Computing and Informatics (IC3I). IEEE, Mysore (2014)Google Scholar
  13. 13.
    Kaya, M., Bilge, H.S.: Classification of pancreas tumor dataset using adaptive weighted k-nearest neighbor algorithm. In: International Symposium on Innovations in Intelligent Systems and Applications (INISTA). IEEE, Alberobello (2014) Google Scholar
  14. 14.
    Headache Classification Subcommittee of the International Headache Society: The international classification of headache disorder: 2nd edition. Cephalalgia: Int. J. Headache 24(Suppl. 1), 9–160 (2004)Google Scholar
  15. 15.
    O’Flynn, N., Ridsdale, L.: Headache in primary care: how important is diagnosis to management. Br. J. Gen. Pract. 52(480), 569–573 (2002)Google Scholar
  16. 16.
    National Institute for Health and Care Excellence (NICE): Diagnosis and management of headaches in young people and adults: clinical guideline. Br. J. Gen. Pract. 63(613), 443–445 (2013)CrossRefGoogle Scholar
  17. 17.
    Silva, F.R., Vidotti, V.G., Cremasco, F., Dias, M., Gomi, E.S., Costa, V.P.: Sensitivity and specificity of machine learning classifiers for glaucoma diagnosis using spectral domain OCT and standard automated perimetry. Arq. Bras. Oftalmol. 76(3), 170–174 (2013)zbMATHCrossRefGoogle Scholar
  18. 18.
    Gupta, N., Rawal, A., Narasimhan, V.L., Shiwani, S.: Accuracy, sensitivity and specificity measurement of various classification techniques on healthcare data. IOSR J. Comput. Eng. (IOSR-JCE) 11(5), 70–73 (2013)CrossRefGoogle Scholar
  19. 19.
    Fergus, P., Cheung, P., Hussain, A., Al-Jumeily, D., Dobbins, C., Iram, S.: Prediction of preterm deliveries from EHG signals using machine learning. PLoS ONE 8(10), e77154 (2013). doi: 10.1371/journal.pone.0077154 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Ahmed J. Aljaaf
    • 1
    Email author
  • Dhiya Al-Jumeily
    • 1
  • Abir J. Hussain
    • 1
  • Paul Fergus
    • 1
  • Mohammed Al-Jumaily
    • 2
  • Naeem Radi
    • 3
  1. 1.Applied Computing Research GroupLiverpool John Moores UniversityLiverpoolUK
  2. 2.Department of NeurosurgeryDr. Sulaiman Al Habib HospitalDubai Healthcare CityUAE
  3. 3.Al Khawarizmi International CollegeAbu DhabiUAE

Personalised recommendations