Skip to main content
SpringerLink
Log in

Handwritten Hangul recognition using deep convolutional neural networks

  • Original Paper
  • Published:
International Journal on Document Analysis and Recognition (IJDAR) Aims and scope Submit manuscript

Abstract

In spite of the advances in recognition technology, handwritten Hangul recognition (HHR) remains largely unsolved due to the presence of many confusing characters and excessive cursiveness in Hangul handwritings. Even the best existing recognizers do not lead to satisfactory performance for practical applications and have much lower performance than those developed for Chinese or alphanumeric characters. To improve the performance of HHR, here we developed a new type of recognizers based on deep neural networks (DNNs). DNN has recently shown excellent performance in many pattern recognition and machine learning problems, but have not been attempted for HHR. We built our Hangul recognizers based on deep convolutional neural networks and proposed several novel techniques to improve the performance and training speed of the networks. We systematically evaluated the performance of our recognizers on two public Hangul image databases, SERI95a and PE92. Using our framework, we achieved a recognition rate of 95.96 % on SERI95a and 92.92 % on PE92. Compared with the previous best records of 93.71 % on SERI95a and 87.70 % on PE92, our results yielded improvements of 2.25 and 5.22 %, respectively. These improvements lead to error reduction rates of 35.71 % on SERI95a and 42.44 % on PE92, relative to the previous lowest error rates. Such improvement fills a significant portion of the large gap between practical requirement and the actual performance of Hangul recognizers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. SERI95a is also known as KU-1.

References

  1. Park, G.-R., Kim, I.-J., Liu, C.-L.: An evaluation of statistical methods in handwritten Hangul recognition. Int. J. Doc. Anal. Recognit. 16(3), 273–283 (2013)

    Article  Google Scholar 

  2. Kang, K.-W., Kim, J.H.: Utilization of hierarchical, stochastic relationship modeling for Hangul character recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1185–1196 (2004)

    Article  MathSciNet  Google Scholar 

  3. Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  4. Liu, C.-L., Yin, F., Wang, Q.-F., Wang, D.-H.: ICDAR 2011 Chinese handwriting recognition competition (2011). http://www.nlpr.ia.ac.cn/events/HRcompetition/Report.html

  5. Cireşan, D.C., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)

  6. Cireşan, D.C., Schmidhuber, J.: Multi-column Deep Neural Networks for Offline Handwritten Chinese Character Classification. IDSIA Technical Report No. IDSIA-05-13 (2013)

  7. ImageNet Large Scale Visual Recognition Challenge 2013 (ILSVRC2013) Result. http://www.image-net.org/challenges/LSVRC/2013/results.php

  8. Kim, H.Y., Kim, J.H.: Hierarchical random graph representation of handwritten characters and its application to Hangul recognition. Pattern Recognit. 34(2), 187–201 (2001)

    Article  MATH  Google Scholar 

  9. Jang, S.I.: Post-Processing of Handwritten Hangul Recognition Using Pair-Wise Grapheme Discrimination, Master Thesis, KAIST (2002)

  10. Kim, D.-I., Lee, S.-W.: Automatic evaluation of handwriting qualities of handwritten hangul image database, KU-1. In: Proceedings of the 6th IWFHR, pp. 455–464, Taejon, Korea (1998)

  11. Kim, D.H., Hwang, Y.S., Park, S.T., Kim, E.J., Paek, S.H., Bang, S.Y.: Handwritten Korean character image database PE92. In: Proceedings of the 2nd ICDAR, pp. 470–473 (1993)

  12. Bae, H.J., Yun, J.M., Cha, E.Y.: Neural network for hand-written character recognition using dynamic bar method. In: Proceedings of the Korea Information Science Autumn Conference, vol. 17, issue 2, pp. 251–254 (1990)

  13. Kim, M.W., Jang, J.S., Lim, C.D., Song, Y.S., Kim, J.H.: Improvements to a Hierarchical Interaction Neural Network for Context-Dependent Pattern Recognition and Its Experimentation with Handwritten Korean Character Recognition. Technical Report, Electronics and Telecommunication Research Institute, Taejon, Korea (1992)

  14. Jeong, S.H.: Handwritten Hangul Recognition Based on Character Cluster Segmentation, Technical Memo. Electronics and Telecommunication Research Institute, Taejon, Korea (2002)

  15. Torralba, A., Fergus, R., Freeman, W.: 80 million tiny images: a large dataset for non-parametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)

    Article  Google Scholar 

  16. Hinton, G.E., Osindero, S., Teh, Y.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  17. Hinton, G.E., Dayan, P., Frey, B.J., Neal, R.: The wake-sleep algorithm for self-organizing neural networks. Science 268, 1158–1161 (1995)

    Article  Google Scholar 

  18. Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.-A.: Extracting and composing robust features with denoising autoencoders. In: Cohen, W.W., McCallum, A., Roweis, S.T. (eds.) Proceedings of the Twenty-Fifth International Conference on Machine Learning (ICML’08), pp. 1096–1103, ACM (2008)

  19. Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193–202 (1980)

    Article  MATH  Google Scholar 

  20. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)

    Article  Google Scholar 

  21. Simard, D., Steinkraus, P.Y., Platt, J.C.: Best practices for convolutional neural networks. In: Proceedings of the International Conference on Document Analysis and Recognition (ICDAR’03), p. 958. IEEE Computer Society, Washington, DC, USA (2003)

  22. Boureau, Y., Ponce, J., LeCun, Y.: A theoretical analysis of feature pooling in vision algorithms. In: Proceedings of the International Conference on Machine Learning (ICML’10) (2010)

  23. http://en.wikipedia.org/wiki/Sigmoid_function

  24. Ozkan, C., Erbek, F.: A comparison of activation functions for multispectral Landsat TM image classification. Photogramm. Eng. Remote Sens. 69(11), 1225–1234 (2003)

    Article  Google Scholar 

  25. http://en.wikipedia.org/wiki/Softmax_activation_function

  26. Nair, V., Hinton, G.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10) (2010)

  27. Glorot, X., Antoine, B., Bengio, Y.: Deep Sparse Rectifier Networks. In: Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. JMLR W&CP, vol. 15 (2011)

  28. Goodhill, G., Barrow, H.: The role of weight normalization in competitive learning. Neural Comput. 6(2), 255–269 (1994)

    Article  Google Scholar 

  29. Liu, H., Ding, X.: Handwritten character recognition using gradient feature and quadratic classifier with multiple discrimination schemes. In: Proceedings. 8th International Conference on Document Analysis and Recognition, IEEE (2005)

  30. Cireşan, D., et al.: Deep Big Multilayer Perceptrons for Digit Recognition, Neural Networks: Tricks of the Trade, pp. 581--598. Springer, Berlin Heidelberg (2012)

  31. http://yann.lecun.com/exdb/mnist

  32. Everitt, B.: The Analysis of Contingency Tables, 2nd edn. Chapman and Hall/CRC, London (1992)

Download references

Author information

Authors and Affiliations

  1. School of CSEE, Handong Global University, 791-708, Heunghae-eup, Bukgu, Pohang, Gyeongbuk, Republic of Korea

    In-Jung Kim

  2. Department of Computer Science, School of Information and Computer Science, University of California, 1 East Peltason Drive, Irvine, CA, 92697, USA

    Xiaohui Xie

Authors
  1. In-Jung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaohui Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to In-Jung Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, IJ., Xie, X. Handwritten Hangul recognition using deep convolutional neural networks. IJDAR 18, 1–13 (2015). https://doi.org/10.1007/s10032-014-0229-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-014-0229-4

Keywords

Search

Navigation