Advertisement

Support Vector Machine Optimized by Fireworks Algorithm for Handwritten Digit Recognition

  • Eva Tuba
  • Romana Capor Hrosik
  • Adis Alihodzic
  • Raka Jovanovic
  • Milan TubaEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1126)

Abstract

Handwritten digit recognition is an important subarea in the object recognition research area. Support vector machines represent a very successful recent binary classifier. Basic support vector machines have to be improved in order to deal with real-world problems. The introduction of soft margin for outliers and misclassified samples as well as kernel function for non linearly separably data leads to the hard optimization problem of selecting parameters for these two modifications. Grid search which is often used is rather inefficient. In this paper we propose the use of one of the latest swarm intelligence algorithms, the fireworks algorithm, for the support vector machine parameters tuning. We tested our approach on standard MNIST base of handwritten images and with selected set of simple features we obtained better results compared to other approaches from literature.

Keywords

Handwritten digit recognition Machine learning Support vector machine Optimization Swarm intelligence Fireworks algorithm 

Notes

Acknowledgment

This research was supported by the Ministry of Education, Science and Technological Development of the Republic of Serbia, Grant No. III-44006.

References

  1. 1.
    Singh, P.K., Sarkar, R., Nasipuri, M.: A study of moment based features on handwritten digit recognition. Appl. Comput. Intell. Soft Comput. 2016, 1–17 (2016)CrossRefGoogle Scholar
  2. 2.
    Jagannathan, J., Sherajdheen, A., Deepak, R., Krishnan, N.: License plate character segmentation using horizontal and vertical projection with dynamic thresholding. In: International Conference on Emerging Trends in Computing, Communication and Nanotechnology (ICE-CCN), pp. 700–705, March 2013Google Scholar
  3. 3.
    Babu, U.R., Venkateswarlu, Y., Chintha, A.K.: Handwritten digit recognition using k-nearest neighbour classifier. In: World Congress on Computing and Communication Technologies (WCCCT), pp. 60–65. IEEE (2014)Google Scholar
  4. 4.
    Desai, A.A.: Gujarati handwritten numeral optical character reorganization through neural network. Pattern Recogn. 43(7), 2582–2589 (2010)zbMATHCrossRefGoogle Scholar
  5. 5.
    Neves, R.F.P., Zanchettin, C., Filho, A.N.G.L.: An efficient way of combining SVMs for handwritten digit recognition. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds.) ICANN 2012. LNCS, vol. 7553, pp. 229–237. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-33266-1_29CrossRefGoogle Scholar
  6. 6.
    Ashiquzzaman, A., Tushar, A.K.: Handwritten Arabic numeral recognition using deep learning neural networks. In: IEEE International Conference on Imaging, Vision & Pattern Recognition, pp. 1–4. IEEE (2017)Google Scholar
  7. 7.
    Stromatias, E., Neil, D., Galluppi, F., Pfeiffer, M., Liu, S.C., Furber, S.: Live demonstration: handwritten digit recognition using spiking deep belief networks on SpiNNaker. In: IEEE International Symposium on Circuits and Systems (ISCAS), p. 1901. IEEE (2015)Google Scholar
  8. 8.
    Pang, S., Yang, X.: Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput. Intell. Neurosci. 2016, 1–10 (2016). Article ID 3049632CrossRefGoogle Scholar
  9. 9.
    Tuba, E., Tuba, M., Simian, D.: Handwritten digit recognition by support vector machine optimized by bat algorithm. In: Computer Science Research Notes CSRN: Papers from the 24th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2602, pp. 369–376 (2016)Google Scholar
  10. 10.
    Tuba, E., Bacanin, N.: An algorithm for handwritten digit recognition using projection histograms and SVM classifier. In: 23rd IEEE Telecommunications Forum TELFOR, pp. 464–467 (2015)Google Scholar
  11. 11.
    Kessab, B.E., Daoui, C., Bouikhalene, B., Fakir, M., Moro, K.: Extraction method of handwritten digit recognition tested on the MNIST database. Int. J. Adv. Sci. Technol. 50(6), 99–110 (2013)Google Scholar
  12. 12.
    Vamvakas, G., Gatos, B., Perantonis, S.J.: Handwritten character recognition through two-stage foreground sub-sampling. Pattern Recogn. 43(8), 2807–2816 (2010)zbMATHCrossRefGoogle Scholar
  13. 13.
    Ebrahimzadeh, R., Jampour, M.: Efficient handwritten digit recognition based on histogram of oriented gradients and SVM. Int. J. Comput. Appl. 104(9), 10–13 (2014)Google Scholar
  14. 14.
    Impedovo, S., Mangini, F.M., Barbuzzi, D.: A novel prototype generation technique for handwriting digit recognition. Pattern Recogn. 47(3), 1002–1010 (2014)CrossRefGoogle Scholar
  15. 15.
    Cardoso, A., Wichert, A.: Handwritten digit recognition using biologically inspired features. Neurocomputing 99(1), 575–580 (2013)CrossRefGoogle Scholar
  16. 16.
    Li, J., Zheng, S., Tan, Y.: The effect of information utilization: introducing a novel guiding spark in the fireworks algorithm. IEEE Trans. Evol. Comput. 21(1), 153–166 (2017)CrossRefGoogle Scholar
  17. 17.
    Tan, Y., Zhu, Y.: Fireworks algorithm for optimization. In: Tan, Y., Shi, Y., Tan, K.C. (eds.) ICSI 2010. LNCS, vol. 6145, pp. 355–364. Springer, Heidelberg (2010).  https://doi.org/10.1007/978-3-642-13495-1_44CrossRefGoogle Scholar
  18. 18.
    Tuba, E., Tuba, M., Beko, M.: Support vector machine parameters optimization by enhanced fireworks algorithm. In: Tan, Y., Shi, Y., Niu, B. (eds.) ICSI 2016. LNCS, vol. 9712, pp. 526–534. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-41000-5_52CrossRefGoogle Scholar
  19. 19.
    Tuba, E., Tuba, M., Dolicanin, E.: Adjusted fireworks algorithm applied to retinal image registration. Stud. Inform. Control 26(1), 33–42 (2017)CrossRefGoogle Scholar
  20. 20.
    Tuba, E., Jovanovic, R., Beko, M., Tallón-Ballesteros, A.J., Tuba, M.: Bare bones fireworks algorithm for medical image compression. In: Yin, H., Camacho, D., Novais, P., Tallón-Ballesteros, A.J. (eds.) IDEAL 2018. LNCS, vol. 11315, pp. 262–270. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-03496-2_29CrossRefGoogle Scholar
  21. 21.
    Tuba, M., Bacanin, N., Beko, M.: Fireworks algorithm for RFID network planning problem. In: Proceedings of the 25th International Conference Radioelektronika, pp. 440–444, April 2015Google Scholar
  22. 22.
    Zheng, S., Janecek, A., Tan, Y.: Enhanced fireworks algorithm. In: 2013 IEEE Congress on Evolutionary Computation, pp. 2069–2077, June 2013Google Scholar
  23. 23.
    Zheng, S., Li, J., Janecek, A., Tan, Y.: A cooperative framework for fireworks algorithm. IEEE/ACM Trans. Comput. Biol. Bioinf. 14(1), 27–41 (2017)CrossRefGoogle Scholar
  24. 24.
    Li, J., Tan, Y.: Enhancing interaction in the fireworks algorithm by dynamic resource allocation and fitness-based crowdedness-avoiding strategy. In: IEEE Congress on Evolutionary Computation (CEC), pp. 4015–4021, July 2016Google Scholar
  25. 25.
    Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)CrossRefGoogle Scholar
  26. 26.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Eva Tuba
    • 1
  • Romana Capor Hrosik
    • 2
  • Adis Alihodzic
    • 3
  • Raka Jovanovic
    • 4
  • Milan Tuba
    • 1
    Email author
  1. 1.Singidunum UniversityBelgradeSerbia
  2. 2.Maritime DepartmentUniversity of DubrovnikDubrovnikCroatia
  3. 3.Faculty of ScienceUniversity of SarajevoSarajevoBosnia and Herzegovina
  4. 4.Qatar Environment and Energy Research Institute (QEERI), Hamad bin Khalifa UniversityDohaQatar

Personalised recommendations