Convolutional Neural Network Architecture for Offline Handwritten Characters Recognition
Abstract
Automatic handwriting recognition systems are a very wide-ranging research topic for many years. This type of intelligent systems is applied in various fields: Checks processing, forms processing, automatic processing of handwritten answers in an examination, etc. The purpose of this work is to propose a new Convolutional Neural Network (CNN) model and compare its performance with those of K-Nearest Neighbors (KNN) technique. Both used for the classification of complex multiclass problems. In this paper, we implement and evaluate the performance of this two-machine learning algorithms used to predict handwritten characters. The training and testing data have been extracted from the MNIST digits and letters database, which contains pre-processed images. The results obtained using different similarity measures such as accuracy, sensitivity and specificity confirm that the classification obtained by our proposed CNN architecture is the most accurate compared to the KNN studied in this work.
Keywords
Machine learning Convolutional neural network K-Nearest Neighbors Prediction ClassificationReferences
- 1.Plamondon, R., Srihari, S.N.: Online and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell., 22 (2000)CrossRefGoogle Scholar
- 2.Jayadevan, R., Kolh, E.S.R., Patil, P.M., Pal, U.: Automatic processing of handwritten bank cheque images: a survey. Int. J. Doc. Anal. Recogn. (IJDAR) 15(4), 267–296 (2011)CrossRefGoogle Scholar
- 3.Karsenti, T.: Intelligence artificielle en éducation: L’urgence de préparer les futurs enseignants aujourd’hui pour l’école de demain ? Formation et profession, 112–119 (2018)Google Scholar
- 4.Mioulet, L.: Reconnaissance de l’écriture manuscrite avec des réseaux récurrents. HAL Id: tel-01301728 (2016)Google Scholar
- 5.Govindarajan, M.: Evaluation of ensemble classifiers for handwriting recognition. Mod. Educ. Comput. Sci. (2013)Google Scholar
- 6.Zhao H., Liu H.: Multiple classifiers fusion and CNN feature extraction for handwritten digits recognition. Granular Comput. (2019)Google Scholar
- 7.Shamsuddin, M.R., Abdul-Rahman, S., Mohamed, A.: Exploratory analysis of MNIST handwritten digit for machine learning modelling. Soft Comput. Data Sci., 134–145 (2018)Google Scholar
- 8.Moazam, S., Muhammad, A., Rana, H.: Performance evaluation of advanced deep learning architectures for offline handwritten character recognition. In: The International IEEE Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan (2017)Google Scholar
- 9.Kaensar, C.: A comparative study on handwriting digit recognition classifier using neural network, support vector machine and k-nearest neighbor. Adv. in Intell. Syst. Comput. 155–163 (2013)Google Scholar
- 10.Shopon, M., Mohammed, N., Abedin, M.A.: Bangla handwritten digit recognition using auto encoder and deep convolutional neural network. In: International Workshop on Computational Intelligence (2016)Google Scholar
- 11.Niu, X.-X., Suen, C.Y.: A novel hybrid CNN–SVM classifier for recognizing handwritten digits. Pattern Recogn. 45(4), 1318–1325 (2012)CrossRefGoogle Scholar
- 12.Ashiquzzaman, A., Tushar, A.K.: Handwritten Arabic numeral recognition using deep learning neural networks. In: IEEE International Conference on Imaging. Vision & Pattern Recognition (2017)Google Scholar
- 13.Das, N., Mollah, A.F., Saha, S., Haque, S.S.: Handwritten arabic numeral recognition using a multi-layer perceptron. CoRR. vol. abs/1003.1891 (2010)Google Scholar
- 14.Rathi, R., Ravi, V.C., Jangid, M.: Offline handwritten Devanagari vowels recognition using KNN classifier. Int. J. Comput. Appl. 49(23), 11–16 (2012)Google Scholar
- 15.Kim, I.-J., Xie, X.: Handwritten hangul recognition using deep convolutional neural networks. Int. J. Doc. Anal. Recogn. (IJDAR). 18(1), 1–13 (2014)Google Scholar
- 16.Cohen, G., Afshar, S., Tapson, J., Schaik, A.: EMNIST: an extension of MNIST to handwritten letters (2017)Google Scholar
- 17.Hu, L.-Y., Huang, M.-W., Ke, S.-W., Tsai, C.-F.: The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus, 5(1) (2016)Google Scholar
- 18.Zheng, S., Zeng, X., Lin, G., Zhao, C., Feng, Y., Tao, J., Xiong, L.: Sunspot drawings handwritten character recognition method based on deep learning. New Astron. 45, 54–59 (2016)CrossRefGoogle Scholar
- 19.Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)zbMATHGoogle Scholar