Skip to main content

Fundamental Concepts of Neural Networks and Deep Learning of Different Techniques to Classify the Handwritten Digits

  • Chapter
  • First Online:
Advances in Systems, Control and Automation

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 442))

Abstract

This paper discusses the various fundamental techniques and algorithms which are used in neural networks to classify the handwritten digits for the smarter applications in this twenty-first century. This paper gives the deep learning of different tools which is used to classify handwritten digits. The maximum accuracy we achieve from this kind of techniques is approximately 96%. But this accuracy can be improved by advanced techniques to 99%. In recent days, the applications of neural network have been increased tremendously in various fields such as bank and post office to classify handwritten patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Deryckere, N., Gevaert, W.: What is the potential of machine learning in a smart city? UG thesis, De Hogeschool west—Vlaanderen (2016)

    Google Scholar 

  2. Krizhevsky, A.: Learning multiple layers of features from tiny images. Master’s thesis, Department of Computer Science, University of Toronto (2009)

    Google Scholar 

  3. Krizhevsky, A., Hinton, G.E.: Using very deep autoencoders for content-based image retrieval. In: ESANN, University of Toronoto, Canada, pp. 1–7 (2011)

    Google Scholar 

  4. Pinto, N., Cox, D.D., DiCarlo, J.J.: Why is real-world visual object recognition hard? PLoS Comput. Biol. 4(1), e27 (2008). pp. 1–9

    Article  MathSciNet  Google Scholar 

  5. Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77(1), 157–173 (2008)

    Article  Google Scholar 

  6. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: Computer Vision and Pattern Recognition, CVPR09 (2009)

    Google Scholar 

  7. Schmidhuber, J.: Deep learning in neural networks: over view. Technical report IDSIA-03-14, The SWISS AI Lab IDSIA, p. 88

    Google Scholar 

  8. Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practices for convolutional neural networks applied to visual document analysis. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, vol. 2, pp. 958–962 (2003)

    Google Scholar 

  9. Turaga, S.C., Murray, J.F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., Seung, H.S.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 22(2), 511–538 (2010)

    Google Scholar 

  10. Sánchez, J., Perronnin, F.: High-dimensional signature compression for large-scale image classification. In: Computer Vision and Pattern Recognition (CVPR), IEEE xplore, pp. 1665–1672 (2011)

    Google Scholar 

  11. Le, Q.V., Ranzato, M., Monga, R., Devin, M., Corrado, G., Chen, K., Dean, J., Ng, A.Y.: Building high-level features using large scale unsupervised learning. In: Proceedings of International Conference in Machine Learning, ICML’12 (2012)

    Google Scholar 

  12. Lampinen, J., Oja, E.: Clustering properties of hierarchical self-organizing maps. J. Math. Imaging Vis. 2(2–3), 261–272

    Google Scholar 

  13. Lang, K., Waibel, A., Hinton, G.E.: A time-delay neural network architecture for isolated word recognition. Neural Networks 3, 23–43 (1990)

    Article  Google Scholar 

  14. Lange., S., Riedmiller, M.: Deep auto-encoder neural networks in reinforcement learning. In: Neural Networks (IJCNN), The 2010 International Joint Conference on, pp. 1–8 (2010)

    Google Scholar 

  15. Madani, O., Hanks, S., Condon, A.: On the undecidability of probabilistic planning and related stochastic optimization problems. Artif. Intell. 147(1), 5–34 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  16. Maei, H.R., Sutton, R.S.: GQ(λ): a general gradient algorithm for temporal-difference prediction learning with eligibility traces. In: Proceedings of the Third Conference on Artificial General Intelligence, vol. 1, pp. 91–96 (2010)

    Google Scholar 

  17. Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431–441 (1963)

    Article  MathSciNet  MATH  Google Scholar 

  18. Merolla, P.A., Arthur, J.V., Alvarez-Icaza, R., Cassidy, A.S., Sawada, J., Akopyan, F., Jackson, B.L., Imam, N., Guo, C., Nakamura, Y., Brezzo, B., Vol, I., Esser, S.K., Appuswamy, R., Taba, B., Amir, A., Flickner, M.D., Risk, W.P., Manohar, R., Modha, D.S.: A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345(6197), 668–673 (2014)

    Article  Google Scholar 

  19. Mesnil, G., Dauphin, Y., Glorot, X., Rifai, S., Bengio, Y., Goodfellow, I., Lavoie, E., Muller, X., Desjardins, G., Warde-Farle, D., Vincent, P., Courville, A., Bergstra, J.: Unsupervised and transfer learning challenge: a deep learning approach. In: JMLR W&CP: Proceedings of Unsupervised and Transfer Learning, vol. 7 (2011)

    Google Scholar 

  20. Meuleau, N., Peshkin, L., Kim, K.E., Kaelbling, L.P.: Learning finite state controllers for partially observable environments. In: 15th International Conference of Uncertainty in AI, pp. 427–436 (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ambikapathy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ambikapathy, Singh, A.V. (2018). Fundamental Concepts of Neural Networks and Deep Learning of Different Techniques to Classify the Handwritten Digits. In: Konkani, A., Bera, R., Paul, S. (eds) Advances in Systems, Control and Automation. Lecture Notes in Electrical Engineering, vol 442. Springer, Singapore. https://doi.org/10.1007/978-981-10-4762-6_27

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4762-6_27

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4761-9

  • Online ISBN: 978-981-10-4762-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics