Language Resources and Evaluation

, Volume 41, Issue 3, pp 367–388

Virtual agent multimodal mimicry of humans

  • George Caridakis
  • Amaryllis Raouzaiou
  • Elisabetta Bevacqua
  • Maurizio Mancini
  • Kostas Karpouzis
  • Lori Malatesta
  • Catherine Pelachaud
Article

DOI: 10.1007/s10579-007-9057-1

Cite this article as:
Caridakis, G., Raouzaiou, A., Bevacqua, E. et al. Lang Resources & Evaluation (2007) 41: 367. doi:10.1007/s10579-007-9057-1

Abstract

This work is about multimodal and expressive synthesis on virtual agents, based on the analysis of actions performed by human users. As input we consider the image sequence of the recorded human behavior. Computer vision and image processing techniques are incorporated in order to detect cues needed for expressivity features extraction. The multimodality of the approach lies in the fact that both facial and gestural aspects of the user’s behavior are analyzed and processed. The mimicry consists of perception, interpretation, planning and animation of the expressions shown by the human, resulting not in an exact duplicate rather than an expressive model of the user’s original behavior.

Keywords

Emotional ECA synthesisExpressivity featuresFacial features extractionGesture analysisVirtual agents

Copyright information

© Springer Science+Business Media B.V. 2007

Authors and Affiliations

  • George Caridakis
    • 1
  • Amaryllis Raouzaiou
    • 1
  • Elisabetta Bevacqua
    • 2
  • Maurizio Mancini
    • 2
  • Kostas Karpouzis
    • 1
  • Lori Malatesta
    • 1
  • Catherine Pelachaud
    • 2
  1. 1.Image, Video and Multimedia Systems LaboratoryNational Technical University of AthensAthensGreece
  2. 2.LINC, IUT de MontreuilUniversite de Paris 8ParisFrance