Skip to main content

Steady Model for Classification of Handwritten Digit Recognition

  • Conference paper
  • First Online:
Innovation in Electrical Power Engineering, Communication, and Computing Technology

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 630))

Abstract

Handwritten digit recognition plays an important role not only in computer vision but also in pattern recognition. Handwritten digit recognition is the competence of a machine to receive, calculate and decipher a human handwritten input from sources such as handwritten manuscripts, especially created before the advent of a digital revolution and digital images.This work implements the system to read the handwritten digits with a custom novel method identical to the amalgamation of different techniques, including principal component analysis, support vector machine and K-nearest neighbours to recognize and classify handwritten digits into their respective labels. PCA algorithm finds out the best linear combinations of the original features so that the variance along the new feature is maximum. Recognition of characters is done using KNN nonparametric machine learning algorithm, and SVM lowers the generalization error of the overall classifier. The proposed work does the analysis on digit data set having a total of 70,000 image samples. The performance of the system is analysed using different measurement metrics like precision, recall, f1 score and support, and the recognition of the patterns in the images shows the result with classification accuracy of 97%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. https://www.outsource2india.com/software/articles/machine-learning-applications-how-it-works-who-uses-it.asp. Last accessed date: Aug 2019

  2. Niu X-X, Suen CY (2012) A novel hybrid CNN-SVM classifier for recognizing handwritten digits. Pattern Recogn 45:1318–1325

    Article  Google Scholar 

  3. LeCun Y, Jackel L, Bottou L (1995) Comparison of learning algorithms for handwritten digit recognition. In: Proceedings of the international conference on artificial neural networks, Nanterre, France, pp 53–60

    Google Scholar 

  4. Decoste D, Scholkope B (2002) Training invariant support vector machines. In: Machine learning, vol 46. Kluwer Academic Publishers, Amsterdam, pp 161–190

    Google Scholar 

  5. Kherallah M, Haddad L, Alimi AM, Mitiche A (2008) On-line handwritten digit recognition based on trajectory and velocity modeling. Pattern Recogn Lett 29:580–594

    Article  Google Scholar 

  6. Li R, Zhang S (2011) Handwritten digit recognition based on principal component analysis and support vector machines. In: International conference on advances in computer science, environment, ecoinformatics, and education, pp 595–599

    Chapter  Google Scholar 

  7. Kaensar C (2013) A comparative study on handwriting digit recognition classifier using neural network, support vector machine and K-nearest neighbor. In: Meesad P et al (eds) IC2 IT2013, AISC 209. Springer, Berlin, pp 155–163. https://doi.org/10.1007/978-3-642-37371-8_19

    Chapter  Google Scholar 

  8. Saeed AL-M (2015) Intelligent handwritten digit recognition using artificial neural network. J Eng Res Appl 5(5) (Part-3):46–51. www.ijera.com. ISSN: 2248-9622

  9. Jou C, Lee H-C (2009) Handwritten numeral recognition based on simplified structural classification and fuzzy memberships. Expert Syst Appl 36:11585–11863

    Article  Google Scholar 

  10. Kussul E, Baidyk T (2004) Improved method of handwritten digit recognition tested on MNIST database. Image Vis Comput 22(12):971–981

    Article  Google Scholar 

  11. Desai AA (2010) Gujarati handwritten numeral optical character reorganization through neural network. Pattern Recogn 43:2582–2589

    Article  Google Scholar 

  12. Meier U, Ciresan DC, Schmidhuber J (2011) Better digit recognition with a committee of simple neural nets. In: International conference on document analysis and recognition, vol 1, pp 1250–1254

    Google Scholar 

  13. Claudiu Ciresan D, Meier U, Gambardella LM (2013) Deep big simple neural nets excel on handwritten digit recognition. Neural Comput 22(12)

    Google Scholar 

  14. Shamim SM, Miah MBA, Angona Sarker MR, Al Jobair A (2018) Handwritten digit recognition using machine learning algorithms. Glob J Comput Sci Technol D Neural Artif Intell 18(1) (Version 1.0)

    Article  Google Scholar 

  15. Lauer F, Suen CY, Bloch G (2007) Atrainable feature extractor for handwritten digit recognition. Pattern Recogn 40:1816–1824

    Article  Google Scholar 

  16. Tayeb S, Pirouz M, Cozzens B, Huang R, Jay M, Khembunjong K, Paliskara S, Zhan F, Zhang M, Zhan J, Latifi S (2017) Toward data quality analytics in signature verification using a convolutional neural network. In: 2017 IEEE international conference on big data (Big Data), pp 2644–2651

    Google Scholar 

  17. Ilmi N, Budi WTA, Nur RK (2016) Handwriting digit recognition using local binary pattern variance and K-nearest neighbor. In: 2016 Fourth international conference on information and communication technologies (ICoICT)

    Google Scholar 

  18. Chherawala Y, Roy PP, Cheriet M (2016) Feature set evaluation for offline handwriting recognition systems: application to the recurrent neural network. IEEE Trans Cybern 46(12)

    Google Scholar 

  19. Ma C, Zhang H (2015) Effective handwritten digit recognition based on multi-feature extraction and deep analysis. In: 2015 12th international conference on fuzzy systems and knowledge discovery (FSKD), pp 297–301

    Google Scholar 

  20. Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(24):509–522

    Article  Google Scholar 

  21. Belongie S, Malik J, Puzicha J (2016) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(24)

    Article  Google Scholar 

  22. http://www.pymvpa.org/datadb/mnist.html

  23. http://yann.lecun.om/exdb/mnist/

  24. Matan O, Kiang RK, Stenard CE, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD, Lecun Y (1990) Handwritten character recognition using neural network architecture. In: Proceedings of the 4th USPS advanced technology conference, Washington D.C., pp 1003–1011, Nov 1990

    Google Scholar 

  25. Yimu W, Yun P, Yanchen L (2014) Parallel implementation of handwritten digit recognition system using self-organizing map. J Zhejiang Univ 48:742–747

    Google Scholar 

  26. Dutt A, Dutt A (2017) Handwritten digit recognition using deep learning. Int J Adv Res Comput Eng Technol (IJARCET) 6(7):990–997. ISSN: 2278-1323

    Google Scholar 

  27. Shamsuddin MR, Abdul-Rahman S, Mohamed A (2019) Exploratory analysis of MNIST handwritten digit for machine learning modelling. In: Yap BW et al (eds) SCDS 2018, CCIS 937, pp 134–145

    Google Scholar 

  28. Liu C-L, Nakashima K, Sako H, Fujisawa H (2003) Handwritten digit recognition: benchmarking of state-of-the-art techniques. Pattern Recogn 2271–2285

    Article  Google Scholar 

  29. Hua Q, Bai L, Wang X (2012) Local similarity and diversity preserving discriminant projection for face and handwriting digits recognition. Neurocomputing 86:150–157

    Article  Google Scholar 

  30. Impedovo S, Mangini FM, Barbuzzi D (2014) A novel prototype generation technique for handwriting digit recognition. Pattern Recogn 47:1002–1010

    Article  Google Scholar 

  31. Kutzner T, Dietze M, Bönninger I, Travieso CM, Dutta MK, Singh A (2016) Online handwriting verification with safe password and increasing number of features. In: 2016 3rd international conference on signal processing and integrated networks (SPIN)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ghosh, A., Pavate, A., Gholam, V., Shenoy, G., Mahadik, S. (2020). Steady Model for Classification of Handwritten Digit Recognition. In: Sharma, R., Mishra, M., Nayak, J., Naik, B., Pelusi, D. (eds) Innovation in Electrical Power Engineering, Communication, and Computing Technology. Lecture Notes in Electrical Engineering, vol 630. Springer, Singapore. https://doi.org/10.1007/978-981-15-2305-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-2305-2_32

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-2304-5

  • Online ISBN: 978-981-15-2305-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics