Advertisement

A dominant points-based feature extraction approach to recognize online handwritten strokes

  • Sukhdeep Singh
  • Anuj SharmaEmail author
  • Indu Chhabra
Original Paper

Abstract

The computation of features is an integral part of handwriting recognition as identification of correct features is essential for efficient data representation and benchmarked recognition. In context of handwriting recognition, the aim of feature extraction is to find out the certain properties of a handwritten stroke that best describe the class of a stroke and makes it distinguishable from other stroke classes. The present work proposes a novel approach for feature extraction based on dominant points in online handwritten strokes. The proposed scheme finds the curve directions between the consecutive dominant points of the stroke and prepares the fixed length feature vector for a handwritten stroke, as the input of fixed length feature vector is used for statistical recognition techniques such as support vector machines and hidden Markov models. Therefore, it avoids the limitation of original Ramer–Douglas–Peucker technique that gives variable number of dominant points. Our approach recognizes online handwritten strokes without huge preprocessing and with a smaller length of feature vector. The proposed technique can be used for different writing styles and different character sets. The efficiency of proposed approach is evaluated on two different datasets as inhouse dataset of 39,200 strokes collected from 100 users and UNIPEN dataset, where consistent and reliable recognition accuracy has been attained for both datasets. The major objective of present work is to propose a dominant points-based script-independent feature extraction technique for online handwriting that is suitable for real-life applications.

Keywords

Online handwriting recognition Feature extraction Dominant points-based feature extraction Hidden Markov models Support vector machines 

References

  1. 1.
    Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175185 (1992)MathSciNetGoogle Scholar
  2. 2.
    Zanchettin, C., Bezerra, B.L.D., Azevedo, W.W.: A KNN-SVM hybrid model for cursive handwriting recognition. In: Proceedings of the International Joint Conference on Neural Networks, pp. 1–8 (2012)Google Scholar
  3. 3.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  4. 4.
    Keshari, B., Watt, S.M.: Online mathematical symbol recognition using svms with features from functional approximation. In: Mathematical User-Interfaces Workshop (2008)Google Scholar
  5. 5.
    Simistira, F., Katsouros, V., Carayannis, G.: Recognition of online handwritten mathematical formulas using probabilistic svms and stochastic context free grammars. Pattern Recognit. Lett. 53, 85–92 (2007)CrossRefGoogle Scholar
  6. 6.
    McCulloch, W.S., Pitts, W.: A logical calculus of ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Jaeger, S., Manke, S., Reichert, J., Waibel, A.: Online handwriting recognition: the NPen++ recognizer. Int. J. Doc. Anal. Recognit. 3, 169–180 (2001)CrossRefGoogle Scholar
  8. 8.
    Kunihiko, F.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193–202 (1980)CrossRefzbMATHGoogle Scholar
  9. 9.
    Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Convolutional neural network committees for handwritten character classification. In: Proceedings of the International Conference on Document Analysis and Recognition, pp. 1135–1139 (2011)Google Scholar
  10. 10.
    Dan, C., Ueli, M., Jurgen, S.: Multi-column deep neural networks for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649 (2012)Google Scholar
  11. 11.
    Bluche, T., Ney, H., Kermorvant, C.: Feature extraction with convolutional neural networks for handwritten word recognition. In: Proceedings of the twelfth International Conference on Document Analysis and Recognition, pp. 285–289 (2013)Google Scholar
  12. 12.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989)CrossRefGoogle Scholar
  13. 13.
    Artieres, T., Marukatat, S., Gallinari, P.: Online handwritten shape recognition using segmental hidden Markov models. Pattern Anal. Mach. Intell. 29(2), 205–217 (2007)CrossRefGoogle Scholar
  14. 14.
    Benouaretha, A., Ennajib, A., Sellamia, M.: Semi-continuous hmms with explicit state duration for unconstrained arabic word modeling and recognition. Pattern Recognit. Lett. 29(12), 1742–1752 (2008)CrossRefGoogle Scholar
  15. 15.
    Bharath, A., Madhvanath, S.: HMM-based lexicon-driven and lexicon-free word recognition for online handwritten indic scripts. IEEE Trans. Pattern Anal. Mach. Intell. 34, 670–682 (2012)CrossRefGoogle Scholar
  16. 16.
    Douglas, D.H., Peucker, T.K.: Algorithms for the reuduction of the number of points required to represent a digitized line or its caricature. Int. J. Geogr. Inf. Geovis. 10(2), 112–122 (1973)Google Scholar
  17. 17.
    Guyon, I., Schomaker, L., Plamondon, R., Liberman, M., Janet, S.: Unipen project of on-line data exchange and recognizer benchmarks. In: Proceedings of International Conference on Pattern Recognition, pp. 29–33 (1994)Google Scholar
  18. 18.
    Singh, S., Sharma, A., Chhabra, I.: Online handwritten gurmukhi strokes dataset based on minimal set of words. ACM Trans. Asian Low Resour. Lang. Inf. Process. 16(1), 1–20 (2016)CrossRefGoogle Scholar
  19. 19.
    Prasad, D.K., Leung, M.K.H., Quek, C., Cho, S.Y.: A novel framework for making dominant point detection methods non-parametric. Image Vis. Comput. 30, 843–859 (2012)CrossRefGoogle Scholar
  20. 20.
    Masood, A.: Dominant point detection by reverse polygonization of digital curves. Image Vis. Comput. 26(5), 702–715 (2008)CrossRefGoogle Scholar
  21. 21.
    Carmona-Poyato, A., Madrid-Cuevas, F.J., Medina-Carnicer, R., Munoz-Salinas, R.: Polygonal approximation of digital planar curves through break point suppression. Pattern Recognit. 43(1), 14–25 (2010)CrossRefzbMATHGoogle Scholar
  22. 22.
    Wu, W.Y.: An adaptive method for detecting dominant points. Patten Recognit. 36(10), 2231–2237 (2003)CrossRefzbMATHGoogle Scholar
  23. 23.
    Kolesnikov, A., Franti, P.: Reduced-search dynamic programming for approximation of polygonal curves. Patten Recognit. 24(14), 2243–2254 (2003)CrossRefzbMATHGoogle Scholar
  24. 24.
    Marji, M., Siy, P.: Polygonal representation of digital planar curves through dominant point detectiona nonparametric algorithm. Pattern Recognit. 37(11), 2113–2130 (2004)CrossRefGoogle Scholar
  25. 25.
    Kolesnikov, A., Franti, P.: Polygonal approximation of closed discrete curves. Patten Recognit. 40(4), 1282–1293 (2007)CrossRefzbMATHGoogle Scholar
  26. 26.
    Masood, A., Haq, S.A.: A novel approach to polygonal approximation of digital curves. Image Vis. Comput. 18(3), 264–274 (2007)Google Scholar
  27. 27.
    Bhowmick, P., Bhattacharya, B.B.: Fast polygonal approximation of digital curves using relaxed straightness properties. IEEE Trans. Pattern Anal. Mach. Intell. 29(9), 1590–1602 (2007)CrossRefGoogle Scholar
  28. 28.
    Nguyen, T.P., Debled-Rennesson, I.: A discrete geometry approach for dominant point detection. Patten Recognit. 44(1), 32–44 (2011)CrossRefzbMATHGoogle Scholar
  29. 29.
    Li, X., Yeung, D.Y.: Online handwritten alphanumeric character recognition using dominant points in strokes. Pattern Recognit. 30(1), 31–44 (1997)CrossRefGoogle Scholar
  30. 30.
    Bai, Z., and Huo, Q.: A study on the use of 8 directional features for online handwritten Chinese character recognition. In: Proceedings of the International Conference on Document Analysis and Recognition, pp. 262–266 (2005)Google Scholar
  31. 31.
    Liu, C.L., Zhou, X.D.: Online Japanese character recognition using trajectory based normalization and direction feature extraction. In: Proceedings of the International Workshop on Frontiers in Handwriting Recognition, pp. 217–222 (2006)Google Scholar
  32. 32.
    LaViola, J., Zeleznik, R.: A practical approach for writer-dependent symbol recognition using a writer-independent symbol recognizer. IEEE Trans. Pattern Anal. Mach. Intell. 29, 1917–1926 (2007)CrossRefGoogle Scholar
  33. 33.
    Delaye, A., Anquetil, E.: Hbf49 feature set: a first unified baseline for online symbol recognition. Pattern Recognit. 46(1), 117–130 (2013)CrossRefGoogle Scholar
  34. 34.
    Sharma, A.: Online handwritten Gurmukhi character recognition. PhD thesis, Thapar University Patiala (2009)Google Scholar
  35. 35.
    Sharma, A., Kumar, R., Sharma, R.K.: Rearrangement of recognized strokes in online handwritten Gurmukhi words recognition. In: IEEE Proceedings of 10th International Conference on Document Analysis and Recognition, pp. 1241–1245 (2009)Google Scholar
  36. 36.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Berlin (1995)CrossRefzbMATHGoogle Scholar
  37. 37.
    Fan, R.E., Chen, P.H., Lin, C.J.: Working set selection using second order information for training support vector machines. J. Mach. Learn. Res. 6, 1889–1918 (2005)MathSciNetzbMATHGoogle Scholar
  38. 38.
    Ghosh, D., Dube, T., Shivaprasad, A.P.: Script recognition—a review. IEEE Trans. Pattern Anal. Mach. Intell. 32, 2142–2161 (2010)CrossRefGoogle Scholar
  39. 39.
    Li, X., Parizeau, M., Plamondon, R.: Model-based on-line handwritten digit recognition. In: Proceedings of the Fourteenth International Conference on Pattern Recognition (1998)Google Scholar
  40. 40.
    Hartigan, J.A., Wong, M.A.: Algorithm as 136: a k-means clustering algorithm. J. R. Stat. Soc. Ser. C 28, 100–108 (1979)zbMATHGoogle Scholar
  41. 41.
    Prevost, L., Milgram, M.: Modelizing character allographs in omni-scriptor frame: a new non-supervised clustering algorithm. Pattern Recognit. Lett. 21, 295–302 (2000)CrossRefGoogle Scholar
  42. 42.
    Hu, J., Lim, S .G., Brown, M .K.: Writer independent on-line handwriting recognition using an hmm approach. Pattern Recognit. 33, 133–147 (2000)CrossRefGoogle Scholar
  43. 43.
    Bahlmann, C., Burkhardt, H.: Measuring HMM similarity with the Bayes probability of error and its application to online handwriting recognition. In: Proceedings of the Sixth International Conference on Document Analysis and Recognition (2001)Google Scholar
  44. 44.
    Bahlmann, C., Haasdonk, B., Burkhardt, H.: On-line handwriting recognition with support vector machines a kernel approach. In: Proceedings of the Eighth International Workshop on Frontiers in Handwriting Recognition, pp. 49–54 (2002)Google Scholar
  45. 45.
    Ratzlaff, E.H.: Methods, report and survey for the comparison of diverse isolated character recognition results on the UNIPEN database. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition (ICDAR03) vol. 1, pp. 623–628 (2003)Google Scholar
  46. 46.
    Bahlmann, C., Burkhardt, H.: The writer independent online handwriting recognition system flog on hand and cluster generative statistical dynamic time warping. IEEE Trans. Pattern Anal. Mach. Intell. 26(3), 299–310 (2004)CrossRefGoogle Scholar
  47. 47.
    Mitoma, H., Uchida, S., Sakoe, H.: Online character recognition based on elastic matching and quadratic discrimination. In: Proceedings of the Eighth International Conference on Document Analysis and Recognition (2005)Google Scholar
  48. 48.
    Do, T.M.T., Artieres, T.: Learning mixture models with support vector machines for sequence classification and segmentation. Pattern Recognit. 42(12), 3224–3230 (2009)CrossRefzbMATHGoogle Scholar
  49. 49.
    Mori, M., Uchida, S., Sakano, H.: Global feature for online character recognition. Pattern Recognit. Lett. 35, 142–148 (2014)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.Department of Computer Science and ApplicationsPanjab UniversityChandigarhIndia

Personalised recommendations