Abstract
In this paper we present a model of facial behaviour encompassing interpersonal relations for an Embodied Conversational Agent (ECA). Although previous solutions of this problem exist in ECA’s domain, in our approach a variety of facial expressions (i.e. expressed, masked, inhibited, and fake expressions) is used for the first time. Moreover, our rules of facial behaviour management are consistent with the predictions of politeness theory as well as the experimental data (i.e. annotation of the video-corpus). Knowing the affective state of the agent and the type of relations between interlocutors the system automatically adapts the facial behaviour of an agent to the social context. We present also the evaluation study we have conducted of our model. In this experiment we analysed the perception of interpersonal relations from the facial behaviour of our agent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Albrecht, I., Schröder, M., Haber, J., Seidel, H.: Mixed feelings: expression of non-basic emotions in a muscle-based talking head. Virtual Reality 8(4), 201–212 (2005)
André, E., Rehm, M., Minker, W., Buhler, D.: Endowing spoken language dialogue systems with emotional intelligence. In: André, E., Dybkjaer, L., Minker, W., Heisterkamp, P. (eds.) Affective Dialogue Systems, pp. 178–187. Springer, Heidelberg (2004)
Ballin, D., Gillies, M.F., Crabtree, I.B.: A framework for interpersonal attitude and non-verbal communication in improvisational visual media production, First European Conference on Visual Media Production (CVMP), pp. 203–210 (2004)
Bevacqua, E., Mancini, M., Niewiadomski, R., Pelachaud, C.: An expressive ECA showing complex emotions. In: Proceedings of the AISB Annual Convention, Newcastle, UK, pp. 208–216 (2007)
Brown, P., Levinson, S.C.: Politeness: some universals on language usage. Cambridge University Press, Cambridge (1987)
Buck, R., Losow, J., Murphy, M., Costanzo, P.: Social facilitation and inhibition of emotional expression and communication. Journal of Personality and Social Psychology 63(6), 962–968 (1992)
Cassell, J., Bickmore, T.: Negotiated Collusion. Modeling Social Language and its Relationship Effects in Intelligent Agents 13(1-2), 89–132 (2003)
De Carolis, B., Pelachaud, C., Poggi, I., De Rosis, F.: Behavior Planning for a Reflexive Agent. In: Proceedings of IJCAI 2001, Oporto, Portugal (April 2001)
Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behavior’s: Categories, Origins, Usage and Coding. Semiotica 1, 49–98 (1969)
Goleman, D.: Inteligencja Emocjonalna, Media Rodzina, Poznan (1997)
Gross, J.J., Oliver, P., Richards, J.M.: The Dissociation of Emotion Expression from Emotion Experience: a Personality Perspective, Personality and Social Psychology Bulletin 26(6), 712–726 (2000)
Johnson, W.L., Rizzo, P., Bosma, W., Kole, S., Ghijsen, M., van Welbergen, H.: Generating Socially Appropriate Tutorial Dialog. In: ISCA Workshop on Affective Dialogue Systems, pp. 254–264 (2004)
La France, M., Hecht, M.A.: Option or Obligation to Smile: The Effects of Power and Gender and Facial Expression. In: Philippot, P., Feldman, R.S., Coats, E.J. (eds.) The Social Context of Nonverbal Behavior (Studies in Emotion and Social Interaction), pp. 45–70. Cambridge University Press, Cambridge (2005)
Manstead, A.S.R., Fischer, A.H., Jakobs, E.B.: The Social and Emotional Functions of Facial Displays. In: Philippot, P., Feldman, R.S., Coats, E.J. (eds.) The Social Context of Nonverbal Behavior (Studies in Emotion and Social Interaction), pp. 287–316. Cambridge University Press, Cambridge (2005)
Niewiadomski, R.: A model of complex facial expressions in interpersonal relations for animated agents, Ph.D. dissertation, University of Perugia (2007)
Prendinger, H., Ishizuka, M.: Social role awareness in animated agents. In: Proceedings of the fifth international conference on Autonomous agents, Montreal, Quebec, Canada, pp. 270–277 (2001)
Reeves, B., Nass, C.: The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, Cambridge (1996)
Rehm, M., André, E.: Informing the Design of Embodied Conversational Agents by Analysing Multimodal Politeness Behaviors in Human-Human Communication, In: Workshop on Conversational Informatics for Supporting Social Intelligence and Interaction (2005)
Wagner, H., Lee, V.: Facial Behavior Alone and in the Presence of Others. In: Philippot, P., Feldman, R.S., Coats, E.J. (eds.) The Social Context of Nonverbal Behavior (Studies in Emotion and Social Interaction), pp. 262–286. Cambridge University Press, Cambridge (2005)
Wagner, H.L., Smith, J.: Facial expression in the presence of friends and strangers. Journal of Nonverbal Behavior 15(4), 201–214 (1991)
Walker, M., Cahn, J., Whittaker, S.: Linguistic style improvisation for lifelike computer characters. In: Proceedings of the AAAI Workshop on AI, Alife and Entertainment (1996)
Wiggins, J.S., Trapnell, P., Phillips, N.: Psychometric and geometric characteristics of the Revised Interpersonal Adjective Scales (IAS-R). Multivariate Behavioral Research 23(3), 517–530 (1988)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Niewiadomski, R., Pelachaud, C. (2007). Model of Facial Expressions Management for an Embodied Conversational Agent. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2007. Lecture Notes in Computer Science, vol 4738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74889-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-74889-2_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74888-5
Online ISBN: 978-3-540-74889-2
eBook Packages: Computer ScienceComputer Science (R0)