Advertisement

A Two Stage Framework for Detection and Segmentation of Writing Events in Air-Written Assamese Characters

  • Ananya ChoudhuryEmail author
  • Kandarpa Kumar Sarma
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11941)

Abstract

Gestural air-writing involves the process of writing continuous characters or words in free space using hand or finger motion. It differs from traditional pen-based writing from the fact that it does not contain delimiting points which helps in demarcation of valid writing segments. Thus, in gestural air-writing, detection of meaningful writing events from a continuous gestural sequence containing irrelevant writing movements is an intricate task which needs special attention. This paper presents an automatic method of gesture spotting and segmentation which identifies the meaningful air-written character segments confined within a continuous character pattern using a hybrid spatiotemporal and statistical feature set. A sliding window-based approach is employed for extracting the writing events from a continuous stream of hand-motion data, suppressing the superfluous idle data points. Consecutive writing events are then categorized into valid character segments and redundant ones. The relative performance of the proposed system is examined by taking various Assamese characters into consideration. Experimental results reveal that the proposed model achieves an overall segment error rate of 1.31%.

Keywords

Gestural air-writing Gesture spotting Gesture segmentation Ligature Human-machine interaction 

References

  1. 1.
    Choudhury, A., Sarma, K.K.: Visual gesture-based character recognition systems for design of assistive technologies for people with special necessities. In: Handmade Teaching Materials for Students with Disabilities, pp. 294–315. IGI Global, Hershey (2019)Google Scholar
  2. 2.
    Agarwal, C., Dogra, D.P., Saini, R., Roy, P.P.: Segmentation and recognition of text written in 3D using leap motion interface. In: 3rd Proceedings on IAPR Asian Conference on Pattern Recognition (ACPR), pp. 539–543. IEEE, Kuala Lumpur (2015)Google Scholar
  3. 3.
    Chen, M., AlRegib, G., Juang, B.-H.: Air-writing recognition—Part I: modeling and recognition of characters, words, and connecting motions. IEEE Trans. Hum.-Mach. Syst. 46(3), 403–413 (2016)CrossRefGoogle Scholar
  4. 4.
    Amma, C., Gehrig, D., Schultz, T.: Airwriting recognition using wearable motion sensors. In: Proceedings of Augmented Human International Conference. ACM (2010)Google Scholar
  5. 5.
    Schick, A., Morlock, D., Amma, C., Schultz, T., Stiefelhagen, R.: Vision-based handwriting recognition for unrestricted text input in mid-air. In: Proceedings of the 14th International Conference on Multimodal Interaction, pp. 217–220. ACM (2012)Google Scholar
  6. 6.
    Frolova, D., Stern, H., Berman, S.: Most probable longest common subsequence for recognition of gesture character input. IEEE Trans. Cybern. 43(3), 871–880 (2013)CrossRefGoogle Scholar
  7. 7.
    Jin, L., Yang, D., Zhen, L.-X., Huang, J.-C.: A novel vision-based finger-writing character recognition system. J. Circ. Syst. Comput. 16(3), 421–436 (2007)CrossRefGoogle Scholar
  8. 8.
    Murata, T., Shin, J.: Hand gesture and character recognition based on kinect sensor. Int. J. Distrib. Sens. Netw. 10(7), 278460 (2014)CrossRefGoogle Scholar
  9. 9.
    Ayachi, N., Kejriwal, P., Kane, L., Khanna, P.: Analysis of the hand motion trajectories for recognition of air-drawn symbols. In: Proceedings of 5th International Conference on Communication Systems and Network Technologies, pp. 505–510. IEEE, Gwalior (2015)Google Scholar
  10. 10.
    Choudhury, A., Sarma, K.K.: A novel approach for gesture spotting in an Assamese gesture-based character recognition system using a unique geometrical feature set. In: Proceedings of 5th International Conference on Signal Processing and Integrated Networks (SPIN), pp. 98–104. IEEE, Noida (2018)Google Scholar
  11. 11.
    Liang, Z., Wei, J., Zhao, J., Liu, H., Li, B., Shen, J., Zheng, C.: The statistical meaning of kurtosis and its new application to identification of persons based on seismic signals. Sensors 8(8), 5106–5119 (2018)CrossRefGoogle Scholar
  12. 12.
    Wang, Q.A.: Probability distribution and entropy as a measure of uncertainty. J. Phys. A: Math. Theor. 41(6), 065004 (2008)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly Media Inc., Sebastopol (2008)Google Scholar
  14. 14.
    Elmezain, M., Al-Hamadi, A., Sadek, S., Michaelis, B.: Robust methods for hand gesture spotting and recognition using hidden markov models and conditional random fields. In: Proceedings of the 10th International Symposium on Signal Processing and Information Technology, pp. 131–136. IEEE, Luxor (2010)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Electronics and Communication EngineeringGauhati UniversityGuwahatiIndia

Personalised recommendations