Although emotion expressions are typically dynamic and include the whole person, much emotion recognition research uses static, posed facial expressions. In this study, we created a stimulus set of dynamic, naturalistic expressions drawn from professional tennis matches to determine whether movement would result in better recognition. We examined participants’ judgments of static versus dynamic expressions when viewing an isolated face, an isolated body, or a whole person. Dynamic expressions increased recognition of whether the player had won or lost the point. In addition, recognition improved when the whole person was presented as opposed to only the face or body. However, overall recognition of wins and losses was poor, with recognition for isolated faces being poorer than chance for winning players. Our findings highlight the importance of incorporating dynamic stimuli and support previous research showing that recognition of naturalistic expressions differs greatly from the commonly-used posed and isolated facial expressions of emotion. Using a wider range of naturalistic stimuli should be incorporated into future research to better understand how emotion recognition functions in daily life.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Abramson, L., Marom, I., Petranker, R., & Aviezer, H. (2017). Is fear in your head? A comparison of instructed and real-life expressions of emotion in the face and body. Emotion, 17(3), 557–565. https://doi.org/10.1037/emo0000252
Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16(5), 403–410. https://doi.org/10.1111/j.0956-7976.2005.01548.x
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., & Young, A. W. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception, 33(6), 717–746. https://doi.org/10.1068/p5096
Aviezer, H., Dudarev, V., Bentin, S., & Hassin, R. R. (2011). The automaticity of emotional face-context integration. Emotion, 11(6), 1406–1414. https://doi.org/10.1037/a0023578.The
Aviezer, H., Ensenberg, N., & Hassin, R. R. (2017a). The inherently contextualised nature of facial emotion perception. Current Opinion in Psychology, 17, 47–54.
Aviezer, H., Ensenberg, N., & Hassin, R. R. (2017b). The inherently contextualized nature of facial emotion perception. Current Opinion in Psychology, 17, 47–54. https://doi.org/10.1016/j.copsyc.2017.06.006
Aviezer, H., Trope, Y., & Todorov, A. (2012a). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225–1230. https://doi.org/10.1126/science.1224313
Aviezer, H., Trope, Y., & Todorov, A. (2012b). Holistic person processing: Faces with bodies tell the whole story. Journal of Personality and Social Psychology, 103(1), 20–37. https://doi.org/10.1037/a0027411
Barker, M. S., Bidstrup, E. M., Robinson, G. A., & Nelson, N. L. (2020). “Grumpy” or “furious”? Arousal of emotion labels influences judgments of facial expressions. PLoS ONE, 15(7), e0235390. https://doi.org/10.1371/journal.pone.0235390
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019). Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest, 20(1), 1–68. https://doi.org/10.1177/1529100619832930
Bould, E., & Morris, N. (2008). Role of motion signals in recognizing subtle facial expressions of emotion. British Journal of Psychology, 99, 167–189. https://doi.org/10.1348/000712607X206702
Cowen, A. S., & Keltner, D. (2019). What the face displays: Mapping 28 emotions conveyed by naturalistic expression. American Psychologist. https://doi.org/10.1037/amp0000488
Cowen, A. S., Keltner, D., Schroff, F., Jou, B., Adam, H., & Prasad, G. (2021). Sixteen facial expressions occur in similar contexts worldwide. Nature, 589(7841), 251–257. https://doi.org/10.1038/s41586-020-3037-7
Crivelli, C., Russell, J., Jarillo, S., & Fernández-Dols, J. M. (2017). Recognizing spontaneous facial expressions of emotion in a small-scale society of Papua New Guinea. Emotion, 17(2), 337–347. https://doi.org/10.1037/emo0000236
Dawel, A., Wright, L., Dumbleton, R., & McKone, E. (2019). All tears are crocodile tears: Impaired perception of emotion authenticity in psychopathic traits. Personality Disorders: Theory, Research, and Treatment, 10(2), 185–197. https://doi.org/10.1037/per0000301
De Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society b: Biological Sciences, 364(1535), 3475–3484. https://doi.org/10.1098/rstb.2009.0190
Douglas-Cowie, E., Cox, C., Martin, J. C., Devillers, L., Cowie, R., Sneddon, I., McRorie, M., Pelachaud, C., Peters, C., Lowry, O., Batliner, A., & Hönig, F. (2011). The HUMAINE database. In P. Petta, C. Pelachaud, & R. Cowie (Eds.), Emotion oriented systems (pp. 243–284). https://doi.org/10.1007/978-3-642-15184-2_14
Dukes, D., Clément, F., Audrin, C., & Mortillaro, M. (2017). Looking beyond the static face in emotion recognition: The informative case of interest. Visual Cognition, 25(4–6), 575–588. https://doi.org/10.1080/13506285.2017.1341441
Duran, J., & Fernández-Dols, J. M. (2018). Do emotions result in their predicted facial expressions? A meta-analysis of studies on the link between expression and emotion. PsyArXiv Preprints, 118–121. https://doi.org/10.31234/osf.io/65qp7
Duran, J., Reisenzein, R., & Fernández-Dols, J. M. (2017). Coherence between emotions and facial expressions. In J. A. Russell & J.-M. Fernández-Dols (Eds.), The science of facial expressions. https://doi.org/10.1093/acprof:oso/9780190613501.003.0007
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behaviour Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
Fernández-Dols, J. M., & Crivelli, C. (2013). Emotion and expression: Naturalistic studies. Emotion Review, 5(1), 24–29. https://doi.org/10.1177/1754073912457229
Fernández-Dols, J. M., Sanchez, F., Carrera, P., & Angeles, R.-B.-M. (1997). Are spontaneous expressions and emotions linked? An experimental test of coherence. Journal of Nonverbal Behavior, 21(3), 163–177. https://doi.org/10.1007/BF01335828
Hess, U., & Kleck, R. E. (1990). Differentiating emotion elicited and deliberate emotional facial expressions. European Journal of Social Psychology, 20(5), 369–385. https://doi.org/10.1002/ejsp.2420200502
Kraut, R. E., & Johnston, R. E. (1979). Social and emotional messages of smiling: An ethological approach. Journal of Personality and Social Psychology, 37(9), 1539–1553. https://doi.org/10.1037/0022-35220.127.116.119
Krumhuber, E. G., Kappas, A., & Manstead, A. S. R. (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5(1), 41–46. https://doi.org/10.1177/1754073912451349
Krumhuber, E. G., Küster, D., Namba, S., Shah, D., & Calvo, M. G. (2019). Emotion recognition from posed and spontaneous dynamic expressions: Human observers versus machine analysis. Emotion. https://doi.org/10.1037/emo0000712
Krumhuber, E. G., Skora, L., Küster, D., & Fou, L. (2017). A review of dynamic datasets for facial expression research. Emotion Review, 9(3), 280–292. https://doi.org/10.1177/1754073916670022
Lecker, M., Shoval, R., Aviezer, H., & Eitam, B. (2017). Temporal integration of bodies and faces: United we stand, divided we fall? Visual Cognition. https://doi.org/10.1080/13506285.2017.1310164
Martinez, L., Falvello, V. B., Aviezer, H., & Todorov, A. (2016). Contributions of facial expressions and body language to the rapid perception of dynamic emotions. Cognition and Emotion, 30(5), 939–952. https://doi.org/10.1080/02699931.2015.1035229
Mondloch, C. J., Nelson, N. L., & Horner, M. (2013). Asymmetries of influence: Differential effects of body postures on perceptions of emotional facial expressions. PLoS ONE, 8(9), 1–16. https://doi.org/10.1371/journal.pone.0073605
Namba, S., Kabir, R. S., Miyatani, M., Nakao, T., & Douglas, K. (2018). Dynamic displays enhance the ability to discriminate genuine and posed facial expressions of emotion. Frontiers in Psychology, 9(672), 1–12. https://doi.org/10.3389/fpsyg.2018.00672
Namba, S., Makihara, S., Kabir, R. S., Miyatani, M., & Nakao, T. (2017). Spontaneous facial expressions are different from posed facial expressions: Morphological properties and dynamic sequences. Current Psychology, 36(3), 593–605. https://doi.org/10.1007/s12144-016-9448-9
Namba, S., Matsui, H., & Zloteanu, M. (2021). Distinct temporal features of genuine and deliberate facial expressions of surprise. Scientific Reports. https://doi.org/10.1038/s41598-021-83077-4
Nelson, N. L., & Mondloch, C. J. (2017). Adults’ and children’s perception of facial expressions is influenced by body postures even for dynamic stimuli. Visual Cognition. https://doi.org/10.1080/13506285.2017.1301615
Reisenzein, R., Bördgen, S., Holtbernd, T., & Matz, D. (2006). Evidence for strong dissociation between emotion and facial displays: The case of surprise. Journal of Personality and Social Psychology, 91(2), 295–315. https://doi.org/10.1037/0022-3518.104.22.1685
Reisenzein, R., Studtmann, M., & Horstmann, G. (2013). Coherence between emotion and facial expression: Evidence from laboratory experiments. Emotion Review, 5(1), 16–23. https://doi.org/10.1177/1754073912457228
Ruiz-Belda, M. A., Fernández-Dols, J. M., Carrera, P., & Barchard, K. (2003). Spontaneous facial expressions of happy bowlers and soccer fans. Cognition and Emotion, 17(2), 315–326. https://doi.org/10.1080/02699930302288
Sauter, D. A., & Fischer, A. H. (2018). Can perceivers recognise emotions from spontaneous expressions? Cognition and Emotion, 32(3), 504–515. https://doi.org/10.1080/02699931.2017.1320978
Schützwohl, A., & Reisenzein, R. (2012). Facial expressions in response to a highly surprising event exceeding the field of vision: A test of Darwin’s theory of surprise. Evolution and Human Behavior, 33(6), 657–664. https://doi.org/10.1016/j.evolhumbehav.2012.04.003
Wenzler, S., Levine, S., van Dick, R., Oertel-Knöchel, V., & Aviezer, H. (2016). Beyond pleasure and pain: Facial expression ambiguity in adults and children during intense situations. Emotion, 16(6), 807–814. https://doi.org/10.1037/emo0000185
Zloteanu, M., Krumhuber, E. G., & Richardson, D. C. (2018). Detecting genuine and deliberate displays of surprise in static and dynamic faces. Frontiers in Psychology, 9(1184), 1–9. https://doi.org/10.3389/fpsyg.2018.01184
Conflict of Interest
The authors declare they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Below is the link to the electronic supplementary material.
About this article
Cite this article
Van Der Zant, T., Nelson, N.L. Motion Increases Recognition of Naturalistic Postures but not Facial Expressions. J Nonverbal Behav (2021). https://doi.org/10.1007/s10919-021-00372-4
- Emotional expressions
- Naturalistic emotional expressions
- Real-world expressions