Feature Evaluation for Handwritten Character Recognition with Regressive and Generative Hidden Markov Models

  • Kalyan Ram Ayyalasomayajula
  • Carl Nettelblad
  • Anders Brun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10072)


Hidden Markov Models constitute an established approach often employed for offline handwritten character recognition in digitized documents. The current work aims at evaluating a number of procedures frequently used to define features in the character recognition literature, within a common Hidden Markov Model framework. By separating model and feature structure, this should give a more clear indication of the relative advantage of different families of visual features used for character classification. The effects of model topologies and data normalization are also studied over two different handwritten datasets. The Hidden Markov Model framework is then used to generate images of handwritten characters, to give an accessible visual illustration of the power of different features.


Support Vector Machine Hide Markov Model Discrete Cosine Transform Local Binary Pattern Query Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Plotz, T., Fink, G.A.: Markov models for offline handwriting recognition: a survey. Int. J. Doc. Anal. Rec. 12, 269–298 (2009)CrossRefGoogle Scholar
  2. 2.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 70, 257–286 (1989)CrossRefGoogle Scholar
  3. 3.
    Marti, U., Bunke, H.: Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition systems. In: Hidden Markov Models: Applications in Computer Vision, pp. 65–90. World Scientic Publishing Co., Inc. (2002)Google Scholar
  4. 4.
    Chen, J., Huaigu Cao, R., Natarajan, P.: Gabor features for offline Arabic handwriting recognition. In: Proceedings of International Workshop on Document Analysis and System, IAPR, vol. 9, pp. 53–58 (2010)Google Scholar
  5. 5.
    Cheng-Lin Liu, M.K., Fujisawa., H.: Gabor feature extraction for character recognition: comparison with gradient feature. In: International Conference Document Analysis and Recognition, vol. 8, pp. 121–125. IEEE (2005)Google Scholar
  6. 6.
    Ahmed, N., Natarajan, T., Rao, K.: Discrete cosine transfom. IEEE Trans. Comput. 23, 90–93 (1974)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings CVPR (2005)Google Scholar
  8. 8.
    Felzenszwalb, P.F., Grishick, R.B., McAllister, D., Ramanan, D.: Object detection with discriminatively trained part based models. In: PAMI, vol. 32, pp. 1627–1645. IEEE (2009)Google Scholar
  9. 9.
    Bosch, A., Zisserman, A., Munoz, X.: Image classification using random forests and ferns. In: IEEE International Conference on Computer Vision (2007)Google Scholar
  10. 10.
    Ojala, T., M.P., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings ICPR, vol. 1, pp. 582–585 (1994)Google Scholar
  11. 11.
    Llorens, D.: The UJIpenchars database: a pen-based database of isolated handwritten characters. In: Proceedings of International Conference on Language Resource and Evaluation, vol. 6, pp. 2647–2651. LREC (2008)Google Scholar
  12. 12.
    Grother, P.J.: NIST special database 19 handprinted forms and characters database, National Institute of Standards and Technology (1995)Google Scholar
  13. 13.
    Young, S., Odell, J., Ollason, D., Valtchev, V., Woodland, P.: The HTK Book: Hidden Markov Models Toolkit V2.1. Wiley, Hoboken (1997)Google Scholar
  14. 14.
    LeCun, Y., Bottou, L., Y.B., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE, vol. 86, pp. 2278–2324. IEEE (1998)Google Scholar
  15. 15.
    Moustafa, R.: Parallel coordinate and parallel coordinate density plots. In: Interdisciplinary Reviews: Computational Statistics, vol. 3(2), pp. 134–148. Wiley (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Kalyan Ram Ayyalasomayajula
    • 1
  • Carl Nettelblad
    • 1
  • Anders Brun
    • 1
  1. 1.Division of Scientific Computing, Center for Image AnalysisUppsala UniversityUppsalaSweden

Personalised recommendations