A Novel Approach for Translating English Statements to American Sign Language Gloss

  • Achraf Othman
  • Mohamed Jemni
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8548)


In this paper, we present a study on the relationship between American Sign Language (ASL) statements and English written texts toward building a statistical machine translation (SMT) using 3D avatar for interpretation. The process included a novel algorithm which transforms an English part-of-speech sentence to ASL-Gloss. The algorithm uses a rule-based approach for building big parallel corpus from English to ASL-Gloss using dependency rules of grammatical parts of the sentence. The parallel corpus will be the input of the translation model of the SMT for ASL. The results we obtained are highly consistent, reproducible, with fairly high precision and accuracy.


Sign Language Processing Hybrid Machine Translation Artificial Corpus Gloss Annotation System 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bangham, J., Cox, S., Elliott, R., Glauert, J., Marshall, I., Rankov, S., Wells, M.: Virtual signing: Capture, animation, storage and transmission - an overview of the visicast project. In: IEEE Seminar on Speech and Language Processing for Disabled and Elderly People, pp. 6/1–6/7 (2000)Google Scholar
  2. 2.
    Bellugi, U., Poizner, H., Klima, E.S.: Brain organization for language: Clues from sign aphasia. Human Neurobiology 2, 155–170 (1983)Google Scholar
  3. 3.
    Corbett, G.: Grammatical relations in a typology of agreement systems. In: Argument Structure and Grammatical Relations: A Crosslinguistic Typology. Studies in Language Companion Series, vol. 126, pp. 37–54 (2012)Google Scholar
  4. 4.
    Fischer, S.D.: The role of agreement and auxiliaries in sign languages. Sign Linguistics Phonetics, Phonology and Morphosyntax 98(3), 103–119 (1996)Google Scholar
  5. 5.
    Jaballah, K., Jemni, M.: Toward automatic sign language recognition from web3D based scenes. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 205–212. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Jemni, M., Elghoul, O.: A system to make signs using collaborative approach. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 670–677. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Jemni, M., Ghoul, O.E., Yahya, N.B., Boulares, M.: Sign language mms to make cell phones accessible to deaf and hard-of-hearing community. In: CVHI 2007 Euro-Assist Conference and Workshop on Assistive Technology for People with Vision and Hearing Impairments (2007)Google Scholar
  8. 8.
    Johnston, T., Schembri, A.: Australian Sign Language: An Introduction to Sign Language Linguistics. Cambridge University Press (2007)Google Scholar
  9. 9.
    Liddell, S.K.: Grammar, gesture, and meaning in American Sign Language. Cambridge University Press (2003)Google Scholar
  10. 10.
    Lillo-Martin, D., Klima, E.S.: Pointing out differences: Asl pronouns in syntactic theory. Theoretical Issues in Sign Language Research 1, 191–210 (1990)Google Scholar
  11. 11.
    Othman, A., Jemni, M.: Statistical sign language machine translation: from English written text to american sign language gloss. International Journal of Computer Science Issues 8, 65–73 (2011)Google Scholar
  12. 12.
    Othman, A., Tmar, Z., Jemni, M.: Toward developing a very big sign language parallel corpus. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 192–199. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  13. 13.
    Padden, C.: Interaction of morphology and syntax in american sign language. Doctoral thesis, University of California (1983)Google Scholar
  14. 14.
    de Quadros, R.M., Quer, J.: Back to back(wards) and moving on: On agreement, auxiliaries and verb classes. In: The 9th Theoretical Issues in Sign Language Research Conference (2008)Google Scholar
  15. 15.
    Rathmann, C.: The optionality of agreement phrase: Evidence from signed languages. Doctoral thesis, The University of Texas at Austin (2000)Google Scholar
  16. 16.
    Sáfár, É., Marshall, I.: The architecture of an English-text-to-sign-languages translation system. In: Recent Advances in Natural Language Processing (RANLP), pp. 223–228 (2001)Google Scholar
  17. 17.
    Sutton-Spence, R., Woll, B.: The Linguistics of British Sign Language: An Introduction. Cambridge University Press (1999)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Achraf Othman
    • 1
  • Mohamed Jemni
    • 1
  1. 1.Research Laboratory LaTICE-GEUniversity of TunisTunisTunisia

Personalised recommendations