Skip to main content

Automatic Translation System to Spanish Sign Language with a Virtual Interpreter

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 5726)

Abstract

In this paper, an automatic translation system from Spanish language into Spanish Sign Language (LSE) performed by a virtual interpreter is presented. The translator is based on rules from Spanish grammar considering the syntactical and morphological characteristics of words and the semantics of their meaning. The system has been incorporated to an animation engine in which a virtual character acts as an interpreter that communicates using LSE. The mood of the interpreter is considered, so that the translation and the signs are modified depending on whether the interpreter is happy, angry, etc. The system has been tested with satisfactory results in speed and quality.

Keywords

  • Sign language translation
  • virtual characters
  • animation
  • emotion

References

  1. Ong, S., Ranganath, S.: Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Trans Pattern Analysis and Machine Intelligence 27(6), 873–891 (2005)

    CrossRef  Google Scholar 

  2. http://www.visicast.sys.uea.ac.uk/

  3. http://www.sign-lang.uni-hamburg.de/esign/

  4. San-Segundo, R., Barra, R., Córdoba, R., D’Haro, L.F., Fernández, F., Ferreiros, J., Lucas, J.M., Macías-Guirasa, J., Monero, J.M., Pardo, J.M.: Speech to sign language translation system for Spanish. Speech Communication 50, 1009–1020 (2008)

    CrossRef  Google Scholar 

  5. Olivrin, G.: Composing Facial expressions with signing avatars. In: Speech and Face-to-Face Communication Workshop, Grenoble (2008)

    Google Scholar 

  6. FreeLing, http://garraf.epsevg.upc.es/freeling

  7. Baldassarri, S., Cerezo, E., Seron, F.: Maxine: A platform for embodied animated agents. Computer & Graphics 32, 430–437 (2008)

    CrossRef  Google Scholar 

  8. Cerezo, E., Hupont, I., Manresa, C., Varona, J., Baldassarri, S., Perales, F., Seron, F.: Real-time Facial Expression Recognition for Natural Interaction. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 40–47. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 IFIP International Federation for Information Processing

About this paper

Cite this paper

Baldassarri, S., Cerezo, E., Royo-Santas, F. (2009). Automatic Translation System to Spanish Sign Language with a Virtual Interpreter. In: , et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03655-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03655-2_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03654-5

  • Online ISBN: 978-3-642-03655-2

  • eBook Packages: Computer ScienceComputer Science (R0)