Advertisement

Converting the Vietnamese Television News into 3D Sign Language Animations for the Deaf

  • Quach Luyl DaEmail author
  • Nguyen Hua Duy Khang
  • Nguyen Chi Ngon
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 257)

Abstract

Sign language (SL) is based on the movement of hands, body gestures and motions to express information instead of speech or written forms. SL has been used since 384-322 BC and developed in many countries, including Vietnam. In some countries, there are several applications of using technology to develop SL and communicate within the deaf community. However, there is lack of studies in these areas in Vietnam. This study is approaching of using 3D avatar of the HamNoSys and building a dictionary for Vietnamese SL animation. The study builds a data set and applies the machine learning decision tree (ID3) to convert the Vietnamese normal sentences into the short sentences of the deaf. The conversion process generates SiGML language to express the SL by a virtual signer leading to present the television news. The assessment results by experts in SL institutions indicate high precision of proposed solution and show the needs of the study.

Keywords

Converted syntax ID3 Machine learning Decision tree Vietnamese sign language 

References

  1. 1.
    Quinlan, J.: C4.5, Programs for Machine Learning. Morgan Kaufmann Publishers, Burlington (1993)Google Scholar
  2. 2.
    Hanke, T. (ed.): Interface Definitions, Virtual Signing: Capture, Animation, Storage and Transmission, Deliverable D5-1 (2001)Google Scholar
  3. 3.
    Al-Ohali, Y.: Identification of most desirable parameters in SIGN language tools: a comparative study. Glob. J. Comput. Sci. Technol. 10(6), 23–29 (2010)Google Scholar
  4. 4.
    Stewart, J.: VCom3D - Sign Smith studio (2012)Google Scholar
  5. 5.
    Waterfall Rainbows, Sign to Me (BSL) - User Guide (2005)Google Scholar
  6. 6.
    Kipp, M., Heloir, A., Nguyen, Q.: Signing avatars: a feasibility study. In: DFKI – Embodied Agents Research Group, Saarbruecken, Germany (2011)Google Scholar
  7. 7.
    Courty, N., Gibet, S.: Why is the creation of a virtual signer challenging computer animation? In: Boulic, R., Chrysanthou, Y., Komura, T. (eds.) MIG 2010. LNCS, vol. 6459, pp. 290–300. Springer, Heidelberg (2010).  https://doi.org/10.1007/978-3-642-16958-8_27CrossRefGoogle Scholar
  8. 8.
    Chai, X., Li, G., et al.: Sign language recognition and translation with kinect. In: The FiDiPro Program of Tekes and Natural Science Foundation of China under contracts, Nos. 61001193 and 60973067. Microsoft Research Asia (2013)Google Scholar
  9. 9.
    Hong Thanh, L., Rathany Chan, S., Hoan Cong, N., Thuy Thanh, N.: Named entity recognition in Vietnamese text using label propagation. In: Proceedings of the 5th International Conference of Soft Computing and Pattern Recognition, SoCPaR (2013)Google Scholar
  10. 10.
    Hong Phuong, L., Thi Minh Huyen, N., Roussanaly, A., Vinh, H.T.: A hybrid approach to word segmentation of Vietnamese texts. In: Martín-Vide, C., Otto, F., Fernau, H. (eds.) LATA 2008. LNCS, vol. 5196, pp. 240–249. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-88282-4_23CrossRefGoogle Scholar
  11. 11.
    Bao, H.T.: About Vietnamese processing in ICT, JAIST, VLSP-KC01/06-10 (2012). (in Vietnamese)Google Scholar
  12. 12.
    Phuong, N.T., Ton, N.D.: Some problems of Vietnamese sign language syntaxes. J. Ngon Ngu (4), 17–31 (2012). ISSN 0866-7519. (in Vietnamese)Google Scholar
  13. 13.
    ISO/TC 37/SC 4 AWI N309: Language Resource Management - Word Segmentation of Written Texts for Mono-lingual and Multi-lingual Information Processing. Technical report. ISO (2006)Google Scholar
  14. 14.
    Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of International Conference on Machine Learning, ICML, pp. 282–289 (2001)Google Scholar
  15. 15.
    Agacy, R.L.: Generalized Kronecker delta and permanent deltas, their spinor and tensor equivalents and applications. J. Math. Phys. 40(4), 2055–2063 (1999)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Byrd, R.H., Lu, P., Nocedal, J.: A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Stat. Comput. 16(5), 1190–1208 (1995)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Forney Jr., G.D.: The Viterbi algorithm. Proc. IEEE 61, 268–278 (1973)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Hanke, T.: Interface Definitions, Virtual Signing: Capture, Animation, Storage and Transmission, Deliverable D5-1 (2001)Google Scholar
  19. 19.
    Hanke, T., Popescu, H.: Intelligent Sign Editor. ESIGN D2.3 Report, Institute of GermanSign Language and Deaf Communication, University of Hamburg (2003)Google Scholar
  20. 20.
    Hanke, T., Marshall, I., Safar, E., Schmaling, C., Langer, G., Metzger, C.: Interface definitions. ViSiCAST Report D5.1 (2001)Google Scholar
  21. 21.
    Shannon, C.-E.: A mathematical theory of communication. Bell Syst. Technol. J. 27, 379–423 (1948). pp. 623–656MathSciNetCrossRefGoogle Scholar
  22. 22.
    Bau, N.T.: Vietnamese synonym an antonym dictionary. Ha Noi Social Sciences Publishing House (2016). (in Vietnamese)Google Scholar
  23. 23.
    VNIES - Trung tam nghien cuu giao duc tre khuyet tat, Ky hieu cu chi dieu bo cua nguoi diec Viet Nam, Ha Noi (2002). (in Vietnamese)Google Scholar
  24. 24.
    Ngon, N.C., Da, Q.L.: Application of HamNoSys and avatar 3D JASigning to construction of Vietnamese sign language animations. J. Sci. Technol. 1(11), 61–65 (2017). ISSN 1859 – 1531. (in Vietnamese)Google Scholar
  25. 25.
    Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of Association for Machine Translation in the Americas (2006)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Quach Luyl Da
    • 1
    Email author
  • Nguyen Hua Duy Khang
    • 2
  • Nguyen Chi Ngon
    • 2
  1. 1.Department of Engineering TechnologyTay Do UniversityCan ThoVietnam
  2. 2.College of Engineering TechnologyCan Tho UniversityCan ThoVietnam

Personalised recommendations