Language Resources and Evaluation

, Volume 41, Issue 3–4, pp 341–365

A case study of gesture expressivity breaks

  • Nicolas Ech Chafai
  • Catherine Pelachaud
  • Danielle Pelé
Article
  • 118 Downloads

Abstract

In this paper we propose a study of co-verbal gesture expressivity during a conversational interaction. The work is based on the analysis of gesture expressivity over time, that we have conducted on two clips of 2D animations. The first results point out two types of modulations in gesture expressivity that we relate to the rhetorical functions of the discourse. These results extend the knowledge about gesture expressivity from emotion and personality issues to pragmatical ones. An evaluation study is proposed to measure the effects of the modulations.

Keywords

Gesture expressivity Cartoon animation Annotation schema for gestures 

References

  1. Barrier, G., Caelen, J., & Meillon, B. (2005). La visibilité des gestes: Paramètres directionnels, intentionnalité du signe et attribution de pertinence. In Workshop Francophone sur les Agents Conversationnels Animés. Grenoble, France, pp. 113–123.Google Scholar
  2. Beckman, M. E., & Elam, G. A. (1997). Guidelines for ToBI labelling, version 3.0. The Ohio State University Research Foundation.Google Scholar
  3. Bouvet, D. (2001). La dimension corporelle de la parole. Paris: Peeters.Google Scholar
  4. Bregler, C., Loeb, L., Chuang, E., & Desphande, H. (2002). Turning to masters: Motion capturing cartoons. SIGGRAPH 2002.Google Scholar
  5. Cassell, J. (1999). Embodied conversation: Integrating face and gesture into automatic spoken dialogue systems. In S. Luperfoy (Ed.), Spoken dialogue systems. Cambridge, MA: MIT Press.Google Scholar
  6. Cassell, J., & McNeill, D. (1991). Gesture and the poetics of prose. Poetics Today, 12(3), 375–404.CrossRefGoogle Scholar
  7. Choi, J., Kim, D., & Lee, I. (2004). Anticipation for facial animation. CASA’04. Geneva, Switzerland: CGS.Google Scholar
  8. de Carolis, B., Pelachaud, C., Poggi, I., & Steedman, M. (2004). APML, a mark-up language for believable behavior generation. In H. Prendinger (Ed.), Life-like characters. Tools, affective functions and applications. Springer.Google Scholar
  9. Feyereisen, P. (1997). La compréhension des gestes référentiels. Geste, cognition et communication, PULIM, 20–48.Google Scholar
  10. Gullberg, M., & Holmqvist, K. (1999). Keeping an eye on gestures: Visual perception of gestures in face-to-face communication. Pragmatics and Cognition, 7, 35–63.Google Scholar
  11. Gussenhoven, C. (2002). Intonation and interpretation: Phonetics and phonology. In Speech Prosody 2002: Proceedings of the First International Conference on Speech Prosody. Aix-en-Provence, France, pp. 47–57.Google Scholar
  12. Hartmann, B., Mancini, M., & Pelachaud, C. (2005). Implementing expressive gesture synthesis for embodied conversational agents. In Gesture Workshop. Google Scholar
  13. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press.Google Scholar
  14. Kipp, M. (2004). Gesture generation by imitation: From human behaviour to computer character animation. Boca Raton, Florida: Faculties of Natural Sciences and Technology.Google Scholar
  15. Kita, S., Van Gijn, I., & Van der Hulst, H. (1997). Movement phases in signs and co-speech gestures, and their transcription by human coders. Gesture Workshop. Bielefeld, Germany: Springer-Verlag.Google Scholar
  16. Kochanek, D. H. U., & Bartels, R. H. (1984). Interpolating splines with local tension, continuity, and bias control. Computer Graphics of SIGGRAPH’84, ACM.Google Scholar
  17. Kopp, S., & Wachsmuth, I. (2002). Model-based animation of coverbal gesture. In Proceedings of Computer Animation 2002. Los Alamitos, CA: IEEE Press, pp. 252–257.Google Scholar
  18. Lance, B., Marsella, S., & Koizumi, D. (2004). Towards expressive gaze manner in embodied virtual agents. New York: AAMAS Workshop on Empathic Agents.Google Scholar
  19. Lasseter, J. (1987). Principles of traditional animation applied to 3D computer animation. ACM Computer Graphics, 21, 4.CrossRefGoogle Scholar
  20. Mann, W., & Thompson, S. (1988). Rhetorical structure theory. Toward a functional theory of text organization. Text, 8(3), 243–281.Google Scholar
  21. Mcneill, M. (1992). Hand and mind: What gestures reveal about thought. Chicago and London: University of Chicago Press.Google Scholar
  22. Pelachaud, C. (2005). Multimodal expressive embodied conversational agent. Singapore: ACM Multimedia, Brave New Topics Session.Google Scholar
  23. Poggi, I. (2001). From a typology of gestures to a procedure for gesture production. In Gesture Workshop (pp. 158–168). Springer Verlag.Google Scholar
  24. Poggi, I., & Pelachaud, C. (2000). Performative facial expressions in animated faces. In J. Cassell, S. Prevost, & E. Churchill (Eds.), Embodied conversational agents (pp. 155–188). Cambridge, Mass: MIT Press.Google Scholar
  25. Sperber, D. & Wilson, D. (1986, trad: 1989). La pertinence, Communication et cognition. Paris: Editions de Minuit.Google Scholar
  26. Thomas, F., & Johnston, O. (1981). Disney animation, the illusion of life. New York, USA: Abbeville Press.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Nicolas Ech Chafai
    • 1
    • 2
  • Catherine Pelachaud
    • 1
  • Danielle Pelé
    • 2
  1. 1.Université of Paris 8MontreuilFrance
  2. 2.France Télécom R&DParisFrance

Personalised recommendations