Abstract
Facial mimicry is crucial in social interactions as it communicates the intent to bond with another person. While human-human mimicry has been extensively studied, human-agent and human-robot mimicry have been addressed only recently, and the individual characteristics that affect them are still unknown. This paper explores whether the humanlikeness and embodiment of an agent affect human facial mimicry and which personality and empathy traits are related to facial mimicry of human and artificial agents. We exposed 46 participants to the six basic emotions displayed by a video-recorded human and three artificial agents (a physical robot, a video-recorded robot, and a virtual agent) differing in humanlikeness (humanlike, characterlike, and a morph between the two). We asked participants to recognize the facial expressions performed by each agent and measured their facial mimicry using automatic detection of facial action unit activation. Results showed that mimicry was affected by the agents’ embodiment, but not by their humanlikeness, and that it correlated both with individual traits denoting sociability and sympathy and with traits advantageous for emotion recognition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aifanti, N., Papachristou, C., Delopoulos, A.: The MUG facial expression database. In: IEEE Int. Workshop on Image Analysis for Multimedia Interactive Services, pp. 1–4 (2010)
Al Moubayed, S., Beskow, J., Skantze, G., Granström, B.: Furhat: a back-projected human-like robot head for multiparty human-machine interaction. In: Esposito, A., Esposito, A.M., Vinciarelli, A., Hoffmann, R., Müller, V.C. (eds.) Cognitive Behavioural Systems. LNCS, vol. 7403, pp. 114–130. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34584-5_9
Baron-Cohen, S., Wheelwright, S.: The empathy quotient: an investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J. Autism Dev. Disord. 34(2), 163–175 (2004)
Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)
Cerekovic, A., Aran, O., Gatica-Perez, D.: Rapport with virtual agents: what do human social cues and personality explain? IEEE Trans. Affect. Comput. 8(3), 382–395 (2016)
Chartrand, T.L., Bargh, J.A.: The chameleon effect: the perception-behavior link and social interaction. J. of Pers. Soc. Psychol. 76(6), 893 (1999)
Davis, M.H., et al.: A multidimensional approach to individual differences in empathy. JSAS Cat. Sel. Doc. Psychol. 10, 1–19 (1980)
Dimberg, U.: Facial reactions to facial expressions. Psychophysiology 19(6), 643–647 (1982)
Dimberg, U.: Facial electromyography and the experience of emotion. J. Psychophysiol. 2(4), 277–282 (1988)
Dimberg, U., Thunberg, M.: Rapid facial reactions to emotional facial expressions. Scand. J. Psychol. 39(1), 39–45 (1998)
Dimberg, U., Thunberg, M., Elmehed, K.: Unconscious facial reactions to emotional facial expressions. Psychol. Sci. 11(1), 86–89 (2000)
Drimalla, H., Landwehr, N., Hess, U., Dziobek, I.: From face to face: the contribution of facial mimicry to cognitive and emotional empathy. Cogn. Emot. 33(8), 1672–1686 (2019)
Eisenberg, N., Fabes, R.A.: Empathy: conceptualization, measurement, and relation to prosocial behavior. Motiv. Emot. 14(2), 131–149 (1990)
Ekman, P., Rosenberg, E.L.: What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, USA (1997)
Fischer, A., Becker, D., Veenstra, L.: Emotional mimicry in social context: the case of disgust and pride. Front. Psychol. 3, 475 (2012)
Hager, J.C., Ekman, P., Friesen, W.V.: Facial Action Coding System. A Human Face, Salt Lake City, UT (2002)
Harms, C., Biocca, F.: Internal consistency and reliability of the networked minds measure of social presence (2004)
Hess, U., Banse, R., Kappas, A.: The intensity of facial expression is determined by underlying affective state and social situation. J. Pers. Soc. Psychol. 69(2), 280 (1995)
Hess, U., Fischer, A.: Emotional mimicry as social regulation. Pers. Soc. Psychol. Rev. 17(2), 142–157 (2013)
Hofree, G., Ruvolo, P., Bartlett, M.S., Winkielman, P.: Bridging the mechanical and the human mind: spontaneous mimicry of a physically present android. PLoS ONE 9(7), e99934 (2014)
Hofree, G., Ruvolo, P., Reinert, A., Bartlett, M.S., Winkielman, P.: Behind the robot’s smiles and frowns: in social context, people do not mirror android’s expressions but react to their informational value. Front. Neurorobot. 12, 14 (2018)
Hupont, I., Chetouani, M.: Region-based facial representation for real-time action units intensity detection across datasets. Pattern Anal. Appl. 22(2), 477–489 (2019)
Ito, T., Murano, E.Z., Gomi, H.: Fast force-generation dynamics of human articulatory muscles. J. Appl. Physiol. 96(6), 2318–2324 (2004)
Ivaldi, S., Lefort, S., Peters, J., Chetouani, M., Provasi, J., Zibetti, E.: Towards engagement models that consider individual factors in HRI: on the relation of extroversion and negative attitude towards robots to gaze and speech during a human-robot assembly task. Int. J. Soc. Robot. 9(1), 63–86 (2017)
Lakin, J.L., Chartrand, T.L.: Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol. Sci. 14(4), 334–339 (2003)
Mattheij, R., Nilsenova, M., Postma, E.: Vocal and facial imitation of humans interacting with virtual agents. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 815–820. IEEE (2013)
McIntosh, D.N.: Spontaneous facial mimicry, liking and emotional contagion. Pol. Psychol. Bull. 37(1), 31 (2006)
Moody, E.J., McIntosh, D.N., Mann, L.J., Weisser, K.R.: More than mere mimicry? the influence of emotion on rapid facial reactions to faces. Emotion 7(2), 447 (2007)
Niedenthal, P.M., Mermillod, M., Maringer, M., Hess, U.: The simulation of smiles (SIMS) model: embodied simulation and the meaning of facial expression. Behav. Brain Sci. 33(6), 417 (2010)
Paetzel, M., Hupont, I., Varni, G., Chetouani, M., Peters, C., Castellano, G.: Exploring the link between self-assessed mimicry and embodiment in HRI. In: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 245–246 (2017)
Philip, L., Martin, J., Clavel, C.: Rapid facial reactions in response to facial expressions of emotion displayed by real versus virtual faces. i-Perception 9(4), 2041669518786527 (2018)
Rosenthal-von der Pütten, A.M., Krämer, N.C.: How design characteristics of robots determine evaluation and uncanny valley related responses. Comput. Hum. Behav. 36, 422–439 (2014)
Rammstedt, B., John, O.P.: Measuring personality in one minute or less: a 10-item short version of the big five inventory in English and German. J. Res. Pers. 41(1), 203–212 (2007)
von der Pütten, A.M., Krämer, N.C., Gratch, J.: How our personality shapes our interactions with virtual characters - implications for research and development. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS (LNAI), vol. 6356, pp. 208–221. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15892-6_23
Rymarczyk, K., Żurawski, Ł., Jankowiak-Siuda, K., Szatkowska, I.: Empathy in facial mimicry of fear and disgust: simultaneous EMG-fMRI recordings during observation of static and dynamic facial expressions. Front. Psychol. 10, 701 (2019)
Skantze, G., Al Moubayed, S.: IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In: International Conference on Multimodal Interaction, pp. 69–76 (2012)
Sonnby-Borgström, M., Jönsson, P., Svensson, O.: Emotional empathy as related to mimicry reactions at different levels of information processing. J. Nonverbal Behav. 27(1), 3–23 (2003)
Acknowledgement
We thank Isabelle Hupont, Mohamed Chetouani, Giovanna Varni, and Christopher Peters for the collaboration in the overall project. This work is partly supported by the Swedish Foundation for Strategic Research under the COIN project (RIT15-0133).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Perugia, G., Paetzel, M., Castellano, G. (2020). On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. In: Wagner, A.R., et al. Social Robotics. ICSR 2020. Lecture Notes in Computer Science(), vol 12483. Springer, Cham. https://doi.org/10.1007/978-3-030-62056-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-62056-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62055-4
Online ISBN: 978-3-030-62056-1
eBook Packages: Computer ScienceComputer Science (R0)