Abstract
Emotion expressions facilitate interpersonal communication by conveying information about a person’s affective state. The current work investigates how facial coloration (i.e., subtle changes in chromaticity from baseline facial color) impacts the perception of, and memory for, emotion expressions, and whether these depend on dynamic (vs. static) representations of emotional behavior. Emotion expressive stimuli that either did or did not vary in facial coloration were shown to participants who were asked to categorize and rate the stimuli’s intensity (Exps. 1 & 2), as well as recall their degree of facial coloration (Exps. 3 & 4). Results showed that changes in facial coloration facilitated emotion categorization accuracy in dynamic (Exp. 1) but not static expressions (Exp. 2). Facial coloration further increased perceived emotion intensity, with participants misremembering the coloration of both dynamic and static expressions differently depending on emotion category prototype (Exps. 3 & 4). Together, these findings indicate that facial coloration conveys affective information to observers and contributes to biases in how emotion expressions are perceived and remembered.
Similar content being viewed by others
Data availability
Data is publicly available at https://osf.io/83b29/?view_only=fdb1894287bc41609a9d40ab8e2bf0bc. Materials will be made available upon request.
References
Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16, 403–410. https://doi.org/10.1111/j.0956-7976.2005.01548.x
Benitez-Quiroz, C. F., Srinivasan, R., & Martinez, A. M. (2018). Facial color is an efficient mechanism to visually transmit emotion. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1716084115
Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models in social and behavioral research: Applications and data analysis methods (1st edn.). Newbury Park, CA: SAGE.
Changizi, M., Zhang, Q., & Shimojo, S. (2006). Bare skin, blood and the evolution of primate colour vision. Biology Letters, 2(2), 217–221. https://doi.org/10.1098/rsbl.2006.0440
Chen, C., Garrod, O. G., Zhan, J., Beskow, J., Schyns, P. G., & Jack, R. E. (2018). Reverse engineering psychologically valid facial expressions of emotion into social robots. In 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) (pp. 448–452). IEEE
Cooper, R., & Gerlach, A. L. (2013). Measurement of the blush. In W. R. Crozier & P. J. De Jong (Eds.), The psychological significance of the blush (pp. 39–59). Cambridge University Press.
Corneille, O., Huart, J., Becquart, E., & Brédart, S. (2004). When memory shifts toward more typical category exemplars: Accentuation effects in the recollection of ethnically ambiguous faces. Journal of Personality and Social Psychology, 86(2), 236–250.
Drummond, P., & Quah, S. H. (2001). The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. Psychophysiology, 38(2), 190–196. https://doi.org/10.1111/1469-8986.3820190
Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384–392. https://doi.org/10.1037/0003-066x.48.4.384
Fairchild, M. D. (2013). Color appearance models (3rd ed.). Wiley.
Hasantash, M., Lafer-Sousa, R., Afraz, A., & Conway, B. R. (2019). Paradoxical impact of memory on color appearance of faces. Nature Communications, 10(1), 1–10.
Henderson, A. J., Lasselin, J., Lekander, M., Olsson, M. J., Powis, S. J., Axelsson, J., & Perrett, D. I. (2017). Skin colour changes during experimentally-induced sickness. Brain, Behavior, and Immunity, 60, 312–318.
Hiramatsu, C., Melin, A. D., Allen, W. L., Dubuc, C., & Higham, J. P. (2017). Experimental evidence that primate trichromacy is well suited for detecting primate social colour signals. Proceedings of the Royal Society B: Biological Sciences, 284(1856), 20162458.
Huart, J., Corneille, O., & Becquart, E. (2005). Face-based categorization, context-based categorization, and distortions in the recollection of gender ambiguous faces. Journal of Experimental Social Psychology, 41(6), 598–608.
Hugenberg, K., Young, S. G., Sacco, D. F., & Bernstein, M. J. (2011). Social categorization influences face perception and face memory (pp. 245–257). Oxford Handbook of Face Perception.
Hugenberg, K., & Sacco, D. F. (2008). Social categorization and stereotyping: How social categorization biases person perception and face memory. Social and Personality Psychology Compass, 2(2), 1052–1072.
Keltner, D., Haidt, J., & Shiota, M. N. (2006). Social functionalism and the evolution of emotions. In M. Schaller, J. A. Simpson, & D. T. Kenrick (Eds.), Evolution and social psychology (pp. 115–142). Psychosocial Press.
Krumhuber, E. G., Kappas, A., & Manstead, A. S. R. (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5, 41–46.
Krumhuber, E. G., Skora, L., Küster, D., & Fou, L. (2017). A review of dynamic datasets for facial expression research. Emotion Review, 9(3), 280–292. https://doi.org/10.1177/1754073916670022
Krumhuber, E., & Skora, P. (2016). Perceptual study on facial expressions. In B. Müller & S. Wolf (Eds.), Handbook of human motion (pp. 1–15). Springer.
Küster, D., Krumhuber, E., & Kappas, A. (2014). Nonverbal behavior online: A focus on interactions with and via artificial agents and avatars. In A. Kostic & D. Chadee (Eds.), Social psychology of nonverbal communications (pp. 272–302). Palgrave Macmillan.
Lefevre, C. E., Ewbank, M. P., Calder, A. J., Von Dem Hagen, E., & Perrett, D. I. (2013). It is all in the face: Carotenoid skin coloration loses attractiveness outside the face. Biology Letters, 9(6), 20130633.
Minami, T., Nakajima, K., & Nakauchi, S. (2018). Effects of face and background color on facial expression perception. Frontiers in Psychology, 9, 1012.
Nakajima, K., Minami, T., & Nakauchi, S. (2017). Interaction between facial expression and color. Scientific Reports, 7(1), 1–9.
Pazda, A. D., Thorstenson, C. A., Elliot, A. J., & Perrett, D. I. (2016). Women’s facial redness increases their perceived attractiveness: Mediation through perceived healthiness. Perception, 45(7), 739–754.
Peromaa, T., & Olkkonen, M. (2019). Red color facilitates the detection of facial anger—but how much? PLoS ONE, 14(4), 1–13. https://doi.org/10.1371/journal.pone.0215610
Re, D. E., Whitehead, R. D., Xiao, D., & Perrett, D. I. (2011). Oxygenated-blood colour change thresholds for perceived facial redness, health, and attractiveness. PLoS ONE, 6(3), e17859.
Rowland, H. M., & Burriss, R. P. (2017). Human colour in mate choice and competition. Philosophical Transactions of the Royal Society B: Biological Sciences, 372(1724), 20160350.
Scherer, K. R., & Bänziger, T. (2010). On the use of actor portrayals in research on emotional expression. In K. R. Scherer, T. Bänziger, & E. Roesch (Eds.), A blueprint for affective computing: A sourcebook (pp. 166–178). Oxford University Press.
Schloss, K. B. (2018). A color inference framework. In C. Bakya (Ed.), Progress in colour studies: Cognition, language and beyond (pp. 107–122). John Benjamins Publishing Company.
Shaver, P., Schwartz, J., Kirson, D., & O’Connor, C. (1987). Emotion knowledge: Further exploration of a prototype approach. Journal of Personality and Social Psychology, 52(6), 1061–1086. https://doi.org/10.1037/0022-3514.52.6.1061
Shimojo, S., Simion, C., Shimojo, E., & Scheier, C. (2003). Gaze bias both reflects and influences preference. Nature Neuroscience, 6(12), 1317.
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on generality (COG): A proposed addition to all empirical papers. Perspectives on Psychological Science, 12(6), 1123–1128.
Stephen, I. D., Coetzee, V., Smith, M. L., & Perrett, D. I. (2009). Skin blood perfusion and oxygenation colour affect perceived human health. PloS ONE, 4(4), e5083.
Stephen, I. D., Oldham, F. H., Perrett, D. I., & Barton, R. A. (2012). Redness enhances perceived aggression, dominance and attractiveness in men’s faces. Evolutionary Psychology, 10(3), 147470491201000320.
Thorstenson, C. A. (2018). The social psychophysics of human face color: Review and recommendations. Social Cognition, 36(2), 247–273.
Thorstenson, C. A., Elliot, A. J., Pazda, A. D., Perrett, D. I., & Xiao, D. (2018). Emotion-color associations in the context of the face. Emotion, 18(7), 1032–1042. https://doi.org/10.1037/emo0000358
Thorstenson, C. A., McPhetres, J., Pazda, A. D., & Young, S. G. (2021). The role of facial coloration in emotion disambiguation. Emotion. https://doi.org/10.1037/emo0000900
Thorstenson, C. A., Pazda, A. D., & Elliot, A. J. (2020). Social perception of facial color appearance for human trichromatic versus dichromatic color vision. Personality and Social Psychology Bulletin, 46(1), 51–63.
Thorstenson, C. A., Pazda, A. D., Elliot, A. J., & Perrett, D. I. (2017). Facial redness increases men’s perceived healthiness and attractiveness. Perception, 46(6), 650–664.
Thorstenson, C. A., Pazda, A. D., & Lichtenfeld, S. (2019a). Facial blushing influences perceived embarrassment and related social functional evaluations. Cognition and Emotion. https://doi.org/10.1080/02699931.2019.1634004
Thorstenson, C. A., Pazda, A. D., Young, S. G., & Elliot, A. J. (2019b). Face color facilitates the disambiguation of confusing emotion expressions: Toward a social functional account of face color in emotion communication. Emotion, 19(5), 799–807.
Tong, F., & Nakayama, K. (1999). Robust representations for faces: Evidence from visual search. Journal of Experimental Psychology: Human Perception and Performance, 25(4), 1016–1035.
van Der Schalk, J., Hawk, S. T., Fischer, A. H., & Doosje, B. (2011). Moving faces, looking places: Validation of the Amsterdam dynamic facial expression set (ADFES). Emotion, 11(4), 907. https://doi.org/10.1037/a0023853
Wang, X., Guinote, A., & Krumhuber, E. G. (2018). Dominance biases in the perception and memory for the faces of powerholders, with consequences for social inferences. Journal of Experimental Social Psychology, 78, 23–33. https://doi.org/10.1016/j.jesp.2018.05.003
Wehrle, T., Kaiser, S., Schmidt, S., & Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78, 105–119. https://doi.org/10.1037/0022-3514.78.1.105
Wingenbach, T. S., Ashwin, C., & Brosnan, M. (2016). Validation of the Amsterdam dynamic facial expression set-bath intensity variations (ADFES-BIV): A set of videos expressing low, intermediate, and high intensity emotions. PloS one, 11(1), e0147112.
Young, S. G., Thorstenson, C. A., & Pazda, A. D. (2018). Facial redness, expression, and masculinity influence perceptions of anger and health. Cognition and Emotion, 32, 49–60. https://doi.org/10.1080/02699931.2016.1273201
Zeng, H., & Luo, R. (2013). Colour and tolerance of preferred skin colours on digital photographic images. Color Research & Application, 38(1), 30–45.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
CAT handled the experimental stimuli, designed the experiments, oversaw data collection, and contributed to the manuscript text. ADP conducted data analyses and contributed to the manuscript text. EGK contributed to the experimental stimuli, to the manuscript text, and designed the experiments.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflicts of interest.
Ethical approval
The study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Ethics Committee of the University of Rochester.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Thorstenson, C.A., Pazda, A.D. & Krumhuber, E.G. The influence of facial blushing and paling on emotion perception and memory. Motiv Emot 45, 818–830 (2021). https://doi.org/10.1007/s11031-021-09910-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11031-021-09910-5