Abstract
This paper discusses the various fundamental techniques and algorithms which are used in neural networks to classify the handwritten digits for the smarter applications in this twenty-first century. This paper gives the deep learning of different tools which is used to classify handwritten digits. The maximum accuracy we achieve from this kind of techniques is approximately 96%. But this accuracy can be improved by advanced techniques to 99%. In recent days, the applications of neural network have been increased tremendously in various fields such as bank and post office to classify handwritten patterns.
References
Deryckere, N., Gevaert, W.: What is the potential of machine learning in a smart city? UG thesis, De Hogeschool west—Vlaanderen (2016)
Krizhevsky, A.: Learning multiple layers of features from tiny images. Master’s thesis, Department of Computer Science, University of Toronto (2009)
Krizhevsky, A., Hinton, G.E.: Using very deep autoencoders for content-based image retrieval. In: ESANN, University of Toronoto, Canada, pp. 1–7 (2011)
Pinto, N., Cox, D.D., DiCarlo, J.J.: Why is real-world visual object recognition hard? PLoS Comput. Biol. 4(1), e27 (2008). pp. 1–9
Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77(1), 157–173 (2008)
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: Computer Vision and Pattern Recognition, CVPR09 (2009)
Schmidhuber, J.: Deep learning in neural networks: over view. Technical report IDSIA-03-14, The SWISS AI Lab IDSIA, p. 88
Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practices for convolutional neural networks applied to visual document analysis. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, vol. 2, pp. 958–962 (2003)
Turaga, S.C., Murray, J.F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., Seung, H.S.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 22(2), 511–538 (2010)
Sánchez, J., Perronnin, F.: High-dimensional signature compression for large-scale image classification. In: Computer Vision and Pattern Recognition (CVPR), IEEE xplore, pp. 1665–1672 (2011)
Le, Q.V., Ranzato, M., Monga, R., Devin, M., Corrado, G., Chen, K., Dean, J., Ng, A.Y.: Building high-level features using large scale unsupervised learning. In: Proceedings of International Conference in Machine Learning, ICML’12 (2012)
Lampinen, J., Oja, E.: Clustering properties of hierarchical self-organizing maps. J. Math. Imaging Vis. 2(2–3), 261–272
Lang, K., Waibel, A., Hinton, G.E.: A time-delay neural network architecture for isolated word recognition. Neural Networks 3, 23–43 (1990)
Lange., S., Riedmiller, M.: Deep auto-encoder neural networks in reinforcement learning. In: Neural Networks (IJCNN), The 2010 International Joint Conference on, pp. 1–8 (2010)
Madani, O., Hanks, S., Condon, A.: On the undecidability of probabilistic planning and related stochastic optimization problems. Artif. Intell. 147(1), 5–34 (2003)
Maei, H.R., Sutton, R.S.: GQ(λ): a general gradient algorithm for temporal-difference prediction learning with eligibility traces. In: Proceedings of the Third Conference on Artificial General Intelligence, vol. 1, pp. 91–96 (2010)
Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431–441 (1963)
Merolla, P.A., Arthur, J.V., Alvarez-Icaza, R., Cassidy, A.S., Sawada, J., Akopyan, F., Jackson, B.L., Imam, N., Guo, C., Nakamura, Y., Brezzo, B., Vol, I., Esser, S.K., Appuswamy, R., Taba, B., Amir, A., Flickner, M.D., Risk, W.P., Manohar, R., Modha, D.S.: A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345(6197), 668–673 (2014)
Mesnil, G., Dauphin, Y., Glorot, X., Rifai, S., Bengio, Y., Goodfellow, I., Lavoie, E., Muller, X., Desjardins, G., Warde-Farle, D., Vincent, P., Courville, A., Bergstra, J.: Unsupervised and transfer learning challenge: a deep learning approach. In: JMLR W&CP: Proceedings of Unsupervised and Transfer Learning, vol. 7 (2011)
Meuleau, N., Peshkin, L., Kim, K.E., Kaelbling, L.P.: Learning finite state controllers for partially observable environments. In: 15th International Conference of Uncertainty in AI, pp. 427–436 (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Ambikapathy, Singh, A.V. (2018). Fundamental Concepts of Neural Networks and Deep Learning of Different Techniques to Classify the Handwritten Digits. In: Konkani, A., Bera, R., Paul, S. (eds) Advances in Systems, Control and Automation. Lecture Notes in Electrical Engineering, vol 442. Springer, Singapore. https://doi.org/10.1007/978-981-10-4762-6_27
Download citation
DOI: https://doi.org/10.1007/978-981-10-4762-6_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-4761-9
Online ISBN: 978-981-10-4762-6
eBook Packages: EngineeringEngineering (R0)