Skip to main content

Toward a Motor Theory of Sign Language Perception

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 7206)

Abstract

Researches on signed languages still strongly dissociate linguistic issues related on phonological and phonetic aspects, and gesture studies for recognition and synthesis purposes. This paper focuses on the imbrication of motion and meaning for the analysis, synthesis and evaluation of sign language gestures. We discuss the relevance and interest of a motor theory of perception in sign language communication. According to this theory, we consider that linguistic knowledge is mapped on sensory-motor processes, and propose a methodology based on the principle of a synthesis-by-analysis approach, guided by an evaluation process that aims to validate some hypothesis and concepts of this theory. Examples from existing studies illustrate the different concepts and provide avenues for future work.

Keywords

  • motor theory
  • sign language

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. van der Hulst, H.: The phonological structure of words. An introduction. Cambridge University Press, Cambridge (2001) (with C. Ewen)

    Google Scholar 

  2. Johnson, R.E., Liddell, S.K.: Toward a phonetic representation of signs: Sequentiality and contrast, vol. 11. Gallaudet University Press (2010)

    Google Scholar 

  3. Gibet, S., Kamp, J.F., Poirier, F.: Gesture Analysis: Invariant Laws in Movement. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 1–9. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  4. Kennaway, R.: Experience with and Requirements for a Gesture Description Language for Synthetic Animation. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 300–311. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  5. Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J.: Hamburg Notation System for Sign Languages - An Introductory Guide. University of Hamburg Press (1989)

    Google Scholar 

  6. Gibet, S., Courty, N., Duarte, K., Le Naour, T.: The SignCom system for data-driven animation of interactive virtual signers: Methodology and evaluation. ACM Transactions on Interactive Intelligent Systems, TiiS 1(1), 6 (2011)

    Google Scholar 

  7. Courty, N., Gibet, S.: Why Is the Creation of a Virtual Signer Challenging Computer Animation? In: Boulic, R., Chrysanthou, Y., Komura, T. (eds.) MIG 2010. LNCS, vol. 6459, pp. 290–300. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  8. Goldman, A.: Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading. Oxford University Press (2006)

    Google Scholar 

  9. Arbib, M.: From grasp to language: embodied concepts and the challenge of abstraction. Journal of Physiology 102(1-3), 4–20 (2008)

    Google Scholar 

  10. Liberman, A., Cooper, F., Shankweiler, D., Studdert-Kennedy, M.: Perception of the speech code. Psychological Review 74, 431–461 (2005)

    CrossRef  Google Scholar 

  11. Gibet, S., Marteau, P.F.: A self-organized model for the control, planning and learning of nonlinear multi-dimensional systems using a sensory feedback. Applied Intelligence 4(4), 337–349 (1994)

    CrossRef  Google Scholar 

  12. Lebourque, T., Gibet, S.: A Complete System for the Specification and the Generation of Sign Language Gestures. In: Braffort, A., Gibet, S., Teil, D., Gherbi, R., Richardson, J. (eds.) GW 1999. LNCS (LNAI), vol. 1739, pp. 227–238. Springer, Heidelberg (2000)

    CrossRef  Google Scholar 

  13. Gibet, S., Marteau, P.F.: Expressive gesture animation based on non parametric learning of sensory-motor models. In: CASA, 79–85 (2003)

    Google Scholar 

  14. (2011), http://www-irisa.univ-ubs.fr/SEASIDE/signcom/en/

  15. Duarte, K., Gibet, S.: Corpus design for signing avatars. In: Proceedings of the 4th Workshop on Representation and Processing of Sign Languages: Corpora and Sign Language Technologies, Valletta, Malta (2010)

    Google Scholar 

  16. Duarte, K., Gibet, S.: Heterogeneous data sources for signed language analysis and synthesis: The signcom project. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation, Valletta, Malta. European Language Resources Association (2010)

    Google Scholar 

  17. Stokoe, W.C.: Sign language structure: an outline of the communication systems of the American deaf. Journal of Deaf Studies and Deaf Education 10(1), 3–37 (2005)

    CrossRef  Google Scholar 

  18. Héloir, A., Gibet, S., Multon, F., Courty, N.: Captured Motion Data Processing for Real Time Synthesis of Sign Language. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 168–171. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  19. Gibet, S., Marteau, P.-F.: Analysis of Human Motion, Based on the Reduction of Multidimensional Captured Data – Application to Hand Gesture Compression, Segmentation and Synthesis. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2008. LNCS, vol. 5098, pp. 72–81. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  20. Héloir, A., Gibet, S.: A Qualitative and Quantitative Characterisation of Style in Sign Language Gestures. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds.) GW 2007. LNCS (LNAI), vol. 5085, pp. 122–133. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  21. Duarte, K., Gibet, S.: Reading between the signs: How are transitions built in signed languages? In: Proceedings of the 10th International Conference on Theoretical Issues in Sign Language Research, West Lafayette, Indiana USA (2010)

    Google Scholar 

  22. Attina, V., Beautemps, D., Cathiard, M.A., Odisio, M.: A pilot study of temporal organization in cued speech production of french syllables: rules for a cued speech synthesizer. Speech Communication 44(1-4), 197–214 (2004)

    CrossRef  Google Scholar 

  23. Awad, C., Courty, N., Duarte, K., Le Naour, T., Gibet, S.: A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 432–438. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gibet, S., Marteau, PF., Duarte, K. (2012). Toward a Motor Theory of Sign Language Perception. In: Efthimiou, E., Kouroupetroglou, G., Fotinea, SE. (eds) Gesture and Sign Language in Human-Computer Interaction and Embodied Communication. GW 2011. Lecture Notes in Computer Science(), vol 7206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34182-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34182-3_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34181-6

  • Online ISBN: 978-3-642-34182-3

  • eBook Packages: Computer ScienceComputer Science (R0)