Skip to main content
SpringerLink
Log in

Towards modeling embodied conversational agent character profiles using appraisal theory predictions in expression synthesis

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Appraisal theories in psychology study facial expressions in order to deduct information regarding the underlying emotion elicitation processes. Scherer’s component process model provides predictions regarding particular face muscle deformations that are attributed as reactions to the cognitive appraisal stimuli in the study of emotion episodes. In the current work, MPEG-4 facial animation parameters are used in order to evaluate these theoretical predictions for intermediate and final expressions of a given emotion episode. We manipulate parameters such as intensity and temporal evolution of synthesized facial expressions. In emotion episodes originating from identical stimuli, by varying the cognitive appraisals of the stimuli and mapping them to different expression intensities and timings, various behavioral patterns can be generated and thus different agent character profiles can be defined. The results of the synthesis process are consequently applied to Embodied Conversational Agents (ECAs), aiming to render their interaction with humans, or other ECAs, more affective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Scherer KR (2001) Appraisal considered as a process of multilevel sequential checking. In: Scherer KR, Schorr A, Johnstone T (eds) Appraisal processes in emotion: theory methods, research. Oxford University Press, Oxford, pp 92–129

    Google Scholar 

  2. Sander G, Didier D, Scherer K (2005) A systems approach to appraisal mechanisms in emotion. Neural Netw 18:317–352

    Article  Google Scholar 

  3. Raouzaiou A, Tsapatsoulis N, Karpouzis K, Kollias S (2002) Parameterized facial expression synthesis based on MPEG-4. EURASIP J Appl Signal Process 2002(10):1021–1038

    Article  MATH  Google Scholar 

  4. Picard RW (1997) Affective computing. MIT Press, Cambridge

    Google Scholar 

  5. Roseman IJ, Smith CA (2001) Appraisal theory: overview, assumptions, varieties, controversies. In: Scherer KR, Schorr A, Johnstone T (eds) Appraisal processes in emotion: theory methods, research. Oxford University Press, Oxford, pp 3–19

    Google Scholar 

  6. Ortony A, Clore GL, Collins A (1988) The cognitive structure of emotions. Cambridge University Press, Cambridge

    Google Scholar 

  7. Pegna AJ, Khateb A, Lazeyras F, Seghier ML (2004) Discriminating emotional faces without primary visual cortices involves the right amygdala. Nature Neurosci 8(1):24–25

    Article  Google Scholar 

  8. Scherer KR (1984) On the nature and function of emotion: a component process approach. In: Scherer KR, Ekman P (eds) Approaches to emotion. Hillsdale, New Jersey, pp 293–318

    Google Scholar 

  9. Tekalp M, Ostermann J (2000) Face and 2-D mesh animation in MPEG-4. Image Commun J 15(4–5):387–421

    Google Scholar 

  10. Wehrle T, Kaiser S, Schmidt S, Scherer KR (2000) Studying the dynamics of emotional expression using synthesized facial muscle movements. J Pers Soc Psychol 78(1):105–119

    Article  Google Scholar 

  11. Ekman P (1993) Facial expression and emotion. Am Psychol 48:384–392

    Article  Google Scholar 

  12. Hartmann B, Mancini M, Pelachaud C (2005) Implementing expressive gesture synthesis for embodied conversational agents. In: Gesture workshop, Vannes

  13. Wallbott HG (1998) Bodily expression of emotion. Eur J Soc Psychol 28:879–896

    Article  Google Scholar 

  14. Caridakis G, Raouzaiou A, Karpouzis K, Kollias S (2006) Synthesizing gesture expressivity based on real sequences. In: Workshop on multimodal corpora: from multimodal behavior theories to usable models, LREC 2006 conference, Genoa, Italy

  15. Gratch J, Marsella S (2004) A domain-independent framework for modeling emotion. Cogn Syst Res 5(4):269–306

    Article  Google Scholar 

  16. Wehrle T, Kaiser S (2000) Emotion and facial expression. In: Paiva A (ed) Affect in interactions: towards a new generation of interfaces. Springer, Heidelberg, pp 49–64

    Google Scholar 

  17. Gebhard P (2005) ALMA: a layered model of affect. In: AAMAS ’05: Proceedings of the fourth international joint conference on autonomous agents and multiagent systems. ACM, New York, pp 29–36

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, 9, Heroon Politechniou str., Zografou, 15780, Greece

    L. Malatesta, A. Raouzaiou, K. Karpouzis & S. Kollias

Authors
  1. L. Malatesta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. Raouzaiou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. Karpouzis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Kollias
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to L. Malatesta.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Malatesta, L., Raouzaiou, A., Karpouzis, K. et al. Towards modeling embodied conversational agent character profiles using appraisal theory predictions in expression synthesis. Appl Intell 30, 58–64 (2009). https://doi.org/10.1007/s10489-007-0076-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-007-0076-9

Keywords

Search

Navigation