Convolutional Neural Network Architecture for Offline Handwritten Characters Recognition

  • Soufiane HamidaEmail author
  • Bouchaib Cherradi
  • Hassan Ouajji
  • Abdelhadi Raihani
Conference paper
Part of the Learning and Analytics in Intelligent Systems book series (LAIS, volume 7)


Automatic handwriting recognition systems are a very wide-ranging research topic for many years. This type of intelligent systems is applied in various fields: Checks processing, forms processing, automatic processing of handwritten answers in an examination, etc. The purpose of this work is to propose a new Convolutional Neural Network (CNN) model and compare its performance with those of K-Nearest Neighbors (KNN) technique. Both used for the classification of complex multiclass problems. In this paper, we implement and evaluate the performance of this two-machine learning algorithms used to predict handwritten characters. The training and testing data have been extracted from the MNIST digits and letters database, which contains pre-processed images. The results obtained using different similarity measures such as accuracy, sensitivity and specificity confirm that the classification obtained by our proposed CNN architecture is the most accurate compared to the KNN studied in this work.


Machine learning Convolutional neural network K-Nearest Neighbors Prediction Classification 


  1. 1.
    Plamondon, R., Srihari, S.N.: Online and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell., 22 (2000)CrossRefGoogle Scholar
  2. 2.
    Jayadevan, R., Kolh, E.S.R., Patil, P.M., Pal, U.: Automatic processing of handwritten bank cheque images: a survey. Int. J. Doc. Anal. Recogn. (IJDAR) 15(4), 267–296 (2011)CrossRefGoogle Scholar
  3. 3.
    Karsenti, T.: Intelligence artificielle en éducation: L’urgence de préparer les futurs enseignants aujourd’hui pour l’école de demain ? Formation et profession, 112–119 (2018)Google Scholar
  4. 4.
    Mioulet, L.: Reconnaissance de l’écriture manuscrite avec des réseaux récurrents. HAL Id: tel-01301728 (2016)Google Scholar
  5. 5.
    Govindarajan, M.: Evaluation of ensemble classifiers for handwriting recognition. Mod. Educ. Comput. Sci. (2013)Google Scholar
  6. 6.
    Zhao H., Liu H.: Multiple classifiers fusion and CNN feature extraction for handwritten digits recognition. Granular Comput. (2019)Google Scholar
  7. 7.
    Shamsuddin, M.R., Abdul-Rahman, S., Mohamed, A.: Exploratory analysis of MNIST handwritten digit for machine learning modelling. Soft Comput. Data Sci., 134–145 (2018)Google Scholar
  8. 8.
    Moazam, S., Muhammad, A., Rana, H.: Performance evaluation of advanced deep learning architectures for offline handwritten character recognition. In: The International IEEE Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan (2017)Google Scholar
  9. 9.
    Kaensar, C.: A comparative study on handwriting digit recognition classifier using neural network, support vector machine and k-nearest neighbor. Adv. in Intell. Syst. Comput. 155–163 (2013)Google Scholar
  10. 10.
    Shopon, M., Mohammed, N., Abedin, M.A.: Bangla handwritten digit recognition using auto encoder and deep convolutional neural network. In: International Workshop on Computational Intelligence (2016)Google Scholar
  11. 11.
    Niu, X.-X., Suen, C.Y.: A novel hybrid CNN–SVM classifier for recognizing handwritten digits. Pattern Recogn. 45(4), 1318–1325 (2012)CrossRefGoogle Scholar
  12. 12.
    Ashiquzzaman, A., Tushar, A.K.: Handwritten Arabic numeral recognition using deep learning neural networks. In: IEEE International Conference on Imaging. Vision & Pattern Recognition (2017)Google Scholar
  13. 13.
    Das, N., Mollah, A.F., Saha, S., Haque, S.S.: Handwritten arabic numeral recognition using a multi-layer perceptron. CoRR. vol. abs/1003.1891 (2010)Google Scholar
  14. 14.
    Rathi, R., Ravi, V.C., Jangid, M.: Offline handwritten Devanagari vowels recognition using KNN classifier. Int. J. Comput. Appl. 49(23), 11–16 (2012)Google Scholar
  15. 15.
    Kim, I.-J., Xie, X.: Handwritten hangul recognition using deep convolutional neural networks. Int. J. Doc. Anal. Recogn. (IJDAR). 18(1), 1–13 (2014)Google Scholar
  16. 16.
    Cohen, G., Afshar, S., Tapson, J., Schaik, A.: EMNIST: an extension of MNIST to handwritten letters (2017)Google Scholar
  17. 17.
    Hu, L.-Y., Huang, M.-W., Ke, S.-W., Tsai, C.-F.: The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus, 5(1) (2016)Google Scholar
  18. 18.
    Zheng, S., Zeng, X., Lin, G., Zhao, C., Feng, Y., Tao, J., Xiong, L.: Sunspot drawings handwritten character recognition method based on deep learning. New Astron. 45, 54–59 (2016)CrossRefGoogle Scholar
  19. 19.
    Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)zbMATHGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Soufiane Hamida
    • 1
    Email author
  • Bouchaib Cherradi
    • 1
    • 2
  • Hassan Ouajji
    • 1
  • Abdelhadi Raihani
    • 1
  1. 1.SSDIA LaboratoryENSET Mohammedia, UH2CMohammediaMorocco
  2. 2.CRMEF Casablanca-SettatS. P. El JadidaMorocco

Personalised recommendations