Emotion Recognition in Nonverbal Face-to-Face Communication
- 3k Downloads
The perception of emotional facial expressions may activate corresponding facial muscles in the receiver, also referred to as facial mimicry. Facial mimicry is highly dependent on the context and type of facial expressions. While previous research almost exclusively investigated mimicry in response to pictures or videos of emotional expressions, studies with a real, face-to-face partner are still rare. Here we compared facial mimicry of angry, happy, and sad expressions and emotion recognition in a dyadic face-to-face setting. In sender-receiver dyads, we recorded facial electromyograms in parallel. Senders communicated to the receivers—with facial expressions only—the emotions felt during specific personal situations in the past, eliciting anger, happiness, or sadness. Receivers mostly mimicked happiness, to a lesser degree, sadness, and anger as the least mimicked emotion. In actor-partner interdependence models we showed that the receivers’ own facial activity influenced their ratings, which increased the agreement between the senders’ and receivers’ ratings for happiness, but not for angry and sad expressions. These results are in line with the Emotion Mimicry in Context View, holding that humans mimic happy expressions according to affiliative intentions. The mimicry of sad expressions is less intense, presumably because it signals empathy and might imply personal costs. Direct anger expressions are mimicked the least, possibly because anger communicates threat and aggression. Taken together, we show that incidental facial mimicry in a face-to-face setting is positively related to the recognition accuracy for non-stereotype happy expressions, supporting the functionality of facial mimicry.
KeywordsFacial mimicry Facial EMG Emotion recognition Face-to-face-interaction Actor-partner interdependence model (APIM)
- Barton, K., & Barton, M. K. (2015). Package ‘mumin’. Version, 1, 18. https://cran.r-project.org/web/packages/MuMIn/MuMIn.pdf.
- Chartrand, T. L., & van Baaren, R. (2009) Chapter 5 human mimicry. 41, 219–274. doi: 10.1016/s0065-2601(08)00405-x.
- Draine, S. (1998). Inquisit [computer software]. Seattle, WA: Millisecond Software.Google Scholar
- Ekman, P., Friesen, W. V., & Ellsworth, P. C. (1972). Emotion in the humanface: Guidelinesfor research and an integration offindings. New York: Pergamon.Google Scholar
- Fridlund, A. J. (1994). Human facial expression: An evolutionary view. San Diego, CA: Academic Press.Google Scholar
- Kenny, D. A., Kashy, D. A., & Cook, W. L. (2006). Dyadic data analysis. New York: Guilford Press.Google Scholar
- Kulesza, W. M., Cisłak, A., Vallacher, R. R., Nowak, A., Czekiel, M., & Bedynska, S. (2015). The face of the chameleon: The experience of facial mimicry for the mimicker and the mimickee. The Journal of Social Psychology, 155(6), 590–604. doi: 10.1080/00224545.PubMedPubMedCentralCrossRefGoogle Scholar
- Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2013). Lmertest: Tests for random and fixed effects for linear mixed effect models (LMER objects of LME4 package). R package version, 2(6). http://www2.uaem.mx/r-mirror/web/packages/lmerTest/lmerTest.pdf.
- Niedenthal, P. M., Brauer, M., Halberstadt, J. B., & Innes-Ker, Å. H. (2001). When did her smile drop? Facial mimicry and the influences of emotional state on the detection of change in emotional expression. Cognition and Emotion, 15(6), 853–864. doi: 10.1080/02699930143000194.CrossRefGoogle Scholar
- R Core Team. (2014). R: A language and environment for statistical computing. R foundation for statistical computing (Version R version 3.1.2). Vienna, Austria. Retrieved from http://www.R-project.org/.
- Safdar, S., Friedlmeier, W., Matsumoto, D., Yoo, S. H., Kwantes, C. T., Kakai, H., et al. (2009). Variations of emotional display rules within and across cultures: A comparison between canada, USA, and japan. Canadian Journal of Behavioural Science, 41(1), 1–10. doi: 10.1037/a0014387.CrossRefGoogle Scholar
- Sonnby-Borgström, M. (2002). The facial expression says more than words: Emotional “contagion” related to empathy? Lakartidningen, 99(13), 1438–1442. Retrieved from <Go to ISI>://WOS:000174751300002.Google Scholar
- van Baaren, R., Janssen, L., Chartrand, T. L., & Dijksterhuis, A. (2009). Where is the love? The social aspects of mimicry. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 364(1528), 2381–2389. doi: 10.1098/rstb.2009.0057.PubMedPubMedCentralCrossRefGoogle Scholar