Comparison of Machine Learning Techniques for Prediction Problems

  • Yoney Kirsal EverEmail author
  • Kamil Dimililer
  • Boran Sekeroglu
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 927)


Last three decades, artificial intelligence have become mandatory for human lives since the revolution of computers. As a part of it, Machine Learning and the proposed techniques are used to solve the real life problems instead of humans by using their extended capabilities for classification, optimization, and as well as prediction. However, there is a big mystery for the optimum technique for any kind of data and problem domain. In this paper, preliminary experiments are performed using recent and challenging nine datasets and four popular machine learning techniques in order to determine optimum technique for prediction domain. Obtained results are analyzed using three evaluation methods; MSE value, EV and R2 scores. Obtained results showed that, increment or degradation of instances in datasets do not affect the performance of the techniques directly and neural network algorithms produce higher and more steady prediction rates.


  1. 1.
    Utomo, D., Pujiono, Soeleman, M.A.: Stock price prediction using back propagation neural network based on gradient descent with momentum and adaptive learning rate. J. Internet Bank. Commer. 22, 1–16 (2017)Google Scholar
  2. 2.
    Nawi, N.M., Ghazali, R., Salleh, M.N.M.: The development of improved back-propagation neural networks algorithm for predicting patients with heart disease. In: Proceedings of Information Computing and Applications - First International Conference, ICICA 2010, pp. 317–324 (2010)Google Scholar
  3. 3.
    Gu, J., Yin, G., Huang, P., Guo, J., Chen, L.: An improved back propagation neural network prediction model for subsurface drip irrigation system. Comput. Electr. Eng. 60, 58–65 (2017)CrossRefGoogle Scholar
  4. 4.
    Lee, T.-L.: Back-propagation neural network for the prediction of the short-term storm surge in Taichung harbor, Taiwan. Eng. Appl. Artif. Intell. 21(1), 63–72 (2008)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Ogunde, A.O., Ogunleye, G.O., Oreoluwa, O.: A decision tree algorithm based system for predicting crime in the university. Mach. Learn. Res. 2(1), 26–34 (2017)Google Scholar
  6. 6.
    Mesaric, J., Šebalj, D.: Decision trees for predicting the academic success of students. Croat. Oper. Res. Rev. 7, 367–388 (2016)CrossRefGoogle Scholar
  7. 7.
    Lee, J.S., Lee, E.S.: Exploring the usefulness of a decision tree in predicting people’s locations. Procedia - Soc. Behav. Sci. 140, 447–451 (2014)CrossRefGoogle Scholar
  8. 8.
    Gupta, B., Arora, A., Rawat, A., Jain, A., Dhami, N.: Analysis of various decision tree algorithms for classification in data mining. Int. J. Comput. Appl. 163(8), 15–19 (2017)Google Scholar
  9. 9.
    Tuncal, K., Sekeroglu, B., Ozkan, C.: Lung cancer incidence prediction using machine learning algorithms. Accepted to be published in International Journal of Machine Learning and Computing (2019). Student Performance Prediction and Classification Using Machine Learning AlgorithmsGoogle Scholar
  10. 10.
    Sekeroglu, B., Dimililer, K., Tuncal, K.: Student performance prediction and classification using machine learning algorithms. In: Accepted to be published in Proceedings of 8th International Conference on Educational and Information Technology, ICEIT 2019 (2019)Google Scholar
  11. 11.
    Broomhead, D.S., Lowe, D.: Radial basis functions, mutli-variable functional interpolation and adaptive networks. Complex Syst. 2, 321–355 (1988)zbMATHGoogle Scholar
  12. 12.
    Rout M., Majhi, B., Mohapatra, U.M., Mahapatra, R.: Stock indices prediction using radial basis function neural network. In: Proceedings of International Conference on Swarm, Evolutionary, and Memetic Computing, pp. 285–293 (2012)Google Scholar
  13. 13.
    Smola, A.J., Scholkopf, B.: A tutorial on support vector regression. Stat. Comput. 14(3), 199–222 (2004)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Henrique, B.M., Sobreiro, V.A., Kimura, H.: Stock price prediction using support vector regression on daily and up to the minute prices. J. Financ. Data Sci. 4(3), 183–201 (2018)CrossRefGoogle Scholar
  15. 15.
    Azeez, O.S., Pradhan, B., Shafri, H.Z.M.: Vehicular CO emission prediction using support vector regression model and GIS. Sustainability 10(10), 3434 (2018)CrossRefGoogle Scholar
  16. 16.
    Dougherty, G.: Pattern Recognition and Classification, 1st edn. Springer, New York (2013)CrossRefGoogle Scholar
  17. 17.
    De Vito, S., Massera, E., Piga, M., Martinotto, L., Di Francia, G.: On field calibration of an electronic nose for benzene estimation in an urban pollution monitoring scenario. Sens. Actuators B: Chem. 129(2), 750–757 (2008)CrossRefGoogle Scholar
  18. 18.
    Zhong, P., Fukushima, M.: Regularized nonsmooth Newton method for multi-class support vector machines. Optim. Methods Softw. 22(1), 225–236 (2007)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Tüfekci, P.: Prediction of full load electrical power output of a base load operated combined cycle power plant using machine learning methods. Int. J. Electr. Power Energy Syst. 60, 126–140 (2014)CrossRefGoogle Scholar
  20. 20.
    Yeh, I.C., Hsu, T.K.: Building real estate valuation models with comparative approach through case-based reasoning. Appl. Soft Comput. 65, 260–271 (2018)CrossRefGoogle Scholar
  21. 21.
    Ogidan E.T., Dimililer K., Ever Y.K.: Machine learning for expert systems in data analysis. In: 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies, ISMSIT 2018 (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Yoney Kirsal Ever
    • 1
    Email author
  • Kamil Dimililer
    • 2
  • Boran Sekeroglu
    • 3
  1. 1.Software Engineering DepartmentNear East UniversityNicosiaTurkey
  2. 2.Electrical and Electronic EngineeringNear East UniversityNicosiaTurkey
  3. 3.Information Systems EngineeringNear East UniversityNicosiaTurkey

Personalised recommendations