An Avatar-Based Weather Forecast Sign Language System for the Hearing-Impaired

Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 436)


In this paper, we describe a text-to-animation framework for TV weather forecast sign language presentation. To this end, we analyzed the last three years’ weather forecast scripts to obtain the frequency of each word and determine the order of motion capture. About 500 sign language words were chosen and motion-captured for the weather forecast purpose, in addition to the existing 2,700 motions prebuilt for daily life. Words that are absent in the sign language dictionary are replaced with synonyms registered in KorLex, the Korean Wordnet, to improve the translation performance. The weather forecast with sign language is serviced via the Internet in an on-demand manner and can be viewed by PC or mobile devices.


sign language avatar animation closed caption machine translation wordnet 


  1. 1.
    Kaneko, H., Hamaguchi, N., Doke, M., Inoue, S.: Sign language animation using TVML. In: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry. ACM (2010)Google Scholar
  2. 2.
    Kato, N., Kaneko, H., Inoue, S., Shimizu, T., Hiruma, N.: Machine translation to Sign Language with CG-animation. ABU Technical Review 245 (2011)Google Scholar
  3. 3.
    Araújo, T., Ferreira, F., Silva, D., Lemos, F., Neto, G., Omaia, D., Filho, G., Tavares, T.: Automatic generation of Brazilian sign language windows for digital TV systems. Journal of the Brazilian Computer Society 19(2), 107–125 (2013)CrossRefGoogle Scholar
  4. 4.
    Ferreira, F., Lemos, F., Neto, G., Araújo, T., Filho, G.: Providing support for sign language in middlewares compliant with ITU J.202. In: IEEE International Symposium on Multimedia (2011)Google Scholar
  5. 5.
  6. 6.
    Kang, M.: Variable-Length Category-Based N-Gram Part-of-Speech Tagging Model Considering Morph-Syntactic Characteristics of Korean, Doctoral thesis, Pusan National University (2007) (in Korean)Google Scholar
  7. 7.
    Yoon, A., Hwang, S., Lee, E., Kwon, H.: Construction of Korean Wordnet KorLex 1.5. Journal of KIISE: Software and Applications 36(1), 92–108 (2009) (in Korean)Google Scholar
  8. 8.
  9. 9.
  10. 10.
    CyberGlove Systems. CyberGlove II brochure (2009),
  11. 11.
    Slot, K.: Motion Blending. Copenhagen University. Department of Computer Science (2007)Google Scholar
  12. 12.
    Shoemake, K.: Animating rotation with quaternion curves. In: Proceedings of ACM SIGGRAPH 1985. Annual Conference Series, pp. 245–254. ACM Press (1985)Google Scholar
  13. 13.

Copyright information

© IFIP International Federation for Information Processing 2014

Authors and Affiliations

  1. 1.Technical Research InstituteKorean Broadcasting SystemSeoulKorea
  2. 2.Dept. of Computer SciencePusan National UniversityBusanKorea
  3. 3.Bluenine Inc.SeoulKorea

Personalised recommendations