Sign Language Recognition, Generation, and Modelling: A Research Effort with Applications in Deaf Communication

  • Eleni Efthimiou
  • Stavroula-Evita Fotinea
  • Christian Vogler
  • Thomas Hanke
  • John Glauert
  • Richard Bowden
  • Annelies Braffort
  • Christophe Collet
  • Petros Maragos
  • Jérémie Segouat
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5614)

Abstract

Sign language and Web 2.0 applications are currently incompatible, because of the lack of anonymisation and easy editing of online sign language contributions. This paper describes Dicta-Sign, a project aimed at developing the technologies required for making sign language-based Web contributions possible, by providing an integrated framework for sign language recognition, animation, and language modelling. It targets four different European sign languages: Greek, British, German, and French. Expected outcomes are three showcase applications for a search-by-example sign language dictionary, a sign language-to-sign language translator, and a sign language-based Wiki.

Keywords

Sign Language Deaf communication HCI Web accessibility 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ong, A.C.W., Ranganath, S.: Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning. IEEE Trans. PAMI 27(6), 873–891 (2005)CrossRefGoogle Scholar
  2. 2.
    Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)CrossRefGoogle Scholar
  3. 3.
    Maragos, P.: Morphological Filtering for Image Enhancement and Detection. In: Bovik, A.C. (ed.) The Image and Video Processing Handbook, 2nd edn., pp. 135–156. Elsevier Acad. Press, Amsterdam (2005)CrossRefGoogle Scholar
  4. 4.
    Sofou, A., Maragos, P.: Generalized Flooding and Multicue PDE-based Image Segmentation. IEEE Transactions on Image Processing 17(3), 364–376 (2008)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. PAMI 23(6), 681–685 (2001)CrossRefGoogle Scholar
  6. 6.
    Papandreou, G., Maragos, P.: Multigrid Geometric Active Contour Models. IEEE Trans. Image Processing 16(1), 229–240 (2007)MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    Starner, T., Weaver, J., Pentland, A.: Real-Time American Sign Language Recognition Using Desk and Wearable Computer-Based Video. IEEE Trans. Pattern Analysis and Machine Intelligence 20(12), 1371–1375 (1998)CrossRefGoogle Scholar
  8. 8.
    Vogler, C., Metaxas, D.: A Framework for Recognizing the Simultaneous Aspect of ASL. CVIU 81, 358–384 (2001)MATHGoogle Scholar
  9. 9.
    Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.G.: The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. MIT Press, Cambridge (2000)Google Scholar
  10. 10.
    Gravier, G., Potamianos, G., Neti, C.: Asynchrony modeling for audiovisual speech recognition. In: Proc. Human Language Technology Conference, San Diego, California (March 2002)Google Scholar
  11. 11.
    Fotinea, S.-E., Efthimiou, E., Karpouzis, K., Caridakis, G., Glauert, J. (eds.): A Knowledge-based Sign Synthesis Architecture. Emerging Technologies for Deaf Accessibility in the Information Society: Editorial. Journal of Universal Access in the Information Society 6(4), 405–418 (special issue, 2008)Google Scholar
  12. 12.
    Marshall, I., Sáfár, E.: Grammar Development for Sign Language Avatar-Based Synthesis. In: Proceedings HCII 2005, 11th International Conference on Human Computer Interaction (CD-ROM), Las Vegas, USA (July 2005)Google Scholar
  13. 13.
    Braffort, A., Bossard, B., Segouat, J., et al.: Modélisation des relations spatiales en langue des signes française. In: TALS 2005, atelier de TALN 2005 (2005)Google Scholar
  14. 14.
    Elliott, R., Glauert, J.R.W., Kennaway, J.R., Marshall, I.: Development of Language Processing Support for the Visicast Project. In: ASSETS 2000 4th International ACM SIGCAPH Conference on Assistive Technologies, Washington, DC, USA (2000)Google Scholar
  15. 15.
    Hanke, T.: HamNoSys - representing sign language data in language resources and language processing contexts. In: Streiter, O., Vettori, C. (eds.) LREC 2004, Workshop proceedings: Representation and processing of sign languages, pp. 1–6. ELRA, Paris (2004)Google Scholar
  16. 16.
    Efthimiou, E., Sapountzaki, G., Karpouzis, K., Fotinea, S.-E.: Developing an e-Learning Platform for the Greek Sign Language. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 1107–1113. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  17. 17.
    Braffort, A., Choisier, A., Collet, C., et al.: Toward an annotation software for video of Sign Language, including image processing tools and signing space modelling. In: LREC 2004 (2004)Google Scholar
  18. 18.
    Gianni, F., Collet, C., Dalle, P.: Robust tracking for processing of videos of communication’s gestures. In: International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2007), Lisbon, Portugal (May 2007)Google Scholar
  19. 19.
    Efthimiou, E., Fotinea, S.-E.: GSLC: Creation and Annotation of a Greek Sign Language Corpus for HCI. In: Stephanidis, C. (ed.) HCI 2007. LNCS, vol. 4554, pp. 657–666. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  20. 20.
    Neidle, C., Sclaroff, S.: Data collected at the National Center for Sign Language and Gesture Resources, Boston University (2002), http://www.bu.edu/asllrp/ncslgr.html
  21. 21.
    Koehn, P., Och, F.J., Marcu, D.: Statistical Phrase-Based Translation. In: Proceedings of the Human Language Technology Conference 2003 (HLT-NAACL 2003), Edmonton, Canada (May 2003)Google Scholar
  22. 22.
    Diab, M., Finch, S.: A Statistical Word-Level Translation Model for Comparable Corpora. In: Proceedings of the Conference on Content-Based Multimedia Information Access, RIAO 2000, Paris, France, April 12-14 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Eleni Efthimiou
    • 1
  • Stavroula-Evita Fotinea
    • 1
  • Christian Vogler
    • 1
  • Thomas Hanke
    • 2
  • John Glauert
    • 3
  • Richard Bowden
    • 4
  • Annelies Braffort
    • 5
  • Christophe Collet
    • 6
  • Petros Maragos
    • 7
  • Jérémie Segouat
    • 8
  1. 1.Institute for Language and Speech ProcessingGreece
  2. 2.Universität HamburgGermany
  3. 3.University of East AngliaUK
  4. 4.University of SurreyUK
  5. 5.LIMSI/CNRSFrance
  6. 6.Université Paul SabatierFrance
  7. 7.National Technical University of AthensGreece
  8. 8.WebSourdUK

Personalised recommendations