Abstract
This chapter focuses on emotion-relevant information that is consistently and reliably extracted from so-called “neutral” faces. We argue that individuals draw strong inferences about others’ personalities, inner thoughts, and beliefs from facial appearance alone, and do so in what appears to be an effortless, nonreflective manner. Our central thesis rests on two primary assumptions: First, individuals are predisposed to process expressive signals in the face as meaningful forecasts of others’ intentions toward us. Second, individuals are so predisposed to extract expressive meaning from a face that we do so even from so-called “neutral” faces, despite the absence of an expression. As evidence of this proclivity, we present three different ways emotional meaning can be derived from otherwise non-expressive facial displays: facial appearance cues, actual emotional tone, and contextual factors. For these three reasons, we argue that rarely do we perceive non-expressive faces to be emotional blank slates. Instead, we readily derive emotional meaning from them, which then guides our impressions of and responses to others. We couch this review in a theoretical discussion of the question: what is a neutral face?
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adams, R. B., Jr., & Kleck, R. (2003). Perceived gaze direction and the processing of facial displays of emotion. Psychological Science, 14(6), 644–647. https://doi.org/10.1046/j.0956-7976.2003.psci_1479.x.
Adams, R. B., Jr., & Kleck, R. (2005). Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5(1), 3–11. https://doi.org/10.1037/1528-3542.5.1.3.
Adams, R. B., Jr., Nelson, A. J., Soto, J. A., Hess, U., & Kleck, R. (2012). Emotion in the neutral face: A mechanism for impression formation? Cognition & Emotion, 26(3), 431–441. https://doi.org/10.1080/02699931.2012.666502.
Adams, R. B., Jr., Hess, U., & Kleck, R. E. (2015). The intersection of gender-related facial appearance and facial displays of emotion. Emotion Review, 7, 5–13. https://doi.org/10.1177/1754073914544407.
Adams, R. B., Jr., Garrido, C. O., Albohn, D. N., Hess, U., & Kleck, R. E. (2016). What facial appearance reveals over time: When perceived expressions in neutral faces reveal stable emotion dispositions. Frontiers in Psychology, 7, 986. https://doi.org/10.3389/fpsyg.2016.00986.
Akechi, H., Senju, A., Uibo, H., Kikuchi, Y., Hasegawa, T., & Hietanen, J. K. (2013). Attention to eye contact in the west and east: Autonomic responses and evaluative ratings. PLoS One, 8(3). https://doi.org/10.1371/journal.pone.005931.
Albohn, D. N., & Adams, R. B., Jr. (2019, June 5). Emotion residue: Emotion lingers in a face intended to display neutrality. Retrieved from https://psyarxiv.com/aw5ns/.
Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., et al. (2008). Angry, disgust, or afraid? Studies on the malleability of emotion perception. Psychological Science, 19(7), 724–732. https://doi.org/10.1111/j.1467-9280.2008.02148.
Aviezer, H., Trope, Y., & Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225–1229. https://doi.org/10.1126/science.1224313.
Bar, M., Neta, M., & Linz, H. (2006). Very first impressions. Emotion, 6(2), 269.
Baron-Cohen, S., Wheelwright, S., & Jolliffe, T. (1997). Is there a “language of the eyes”? Evidence from normal adults, and adults with autism or Asperger syndrome. Visual Cognition, 4(3), 311–331. https://doi.org/10.1080/713756761.
Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with asperger syndrome or high-functioning autism. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 42(2), 241–251. https://doi.org/10.1017/S0021963001006643.
Baugh, R. F., Basura, G. J., Ishii, L. E., Schwartz, S. R., Drumheller, C. M., Burkholder, R., et al. (2013). Clinical practice guideline: Bell’s palsy. Otolaryngology-Head and Neck Surgery, 149(c), S1–S27. https://doi.org/10.1177/0194599813505967.
Bijlstra, G., Holland, R. W., Dotsch, R., Hugenberg, K., & Wigboldus, D. H. J. (2014). Stereotype associations and emotion recognition. Personality and Social Psychology Bulletin, 40(5), 567–577. https://doi.org/10.1177/0146167213520458.
Blaison, C., Hareli, S., Strauss, C., & Hess, U. (2012, May). Imitating eyes: Mimicry of emotions shown in the eyes. Paper presented at the CERE 2012, Canterbury, Kent.
Bowling, N. C., & Banissy, M. J. (2017). Emotion expression modulates perception of animacy from faces. Journal of Experimental Social Psychology, 71, 83–95. https://doi.org/10.1016/j.jesp.2017.02.004.
Bugental, D. E., Love, L. R., & Gianetto, R. M. (1971). Perfidious feminine faces. Journal of Personality and Social Psychology, 17(3), 314–318. https://doi.org/10.1037/h0030586.
Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205–218. https://doi.org/10.1037//0022-3514.70.2.205.
Cosmides, L. (1989). The logic of social exchange: Has natural selection shaped how humans reason? Studies with the watson selection task. stanford. Cognition, 31(10), 187–276. https://doi.org/10.1016/0010-0277(89)90023-1.
Cross, J. F., Cross, J., & Daly, J. (1971). Sex, race, age, and beauty as factors in recognition of faces. Perception & Psychophysics, 10(6), 393–396. https://doi.org/10.3758/bf03210319.
Daros, A. R., Ruocco, A. C., & Rule, N. O. (2016). Identifying mental disorder from the faces of women with borderline personality disorder. Journal of Nonverbal Behavior, 40, 255–281. https://doi.org/10.1007/s10919-016-0237-9.
De Gelder, B., Morris, J. S., & Dolan, R. J. (2005). Unconscious fear influences emotional awareness of faces and voices. Proceedings of the National Academy of Sciences, 102(51), 18682–18687.
Dobson, S., & Sherwood, C. (2010). Correlated evolution of brain regions involved in producing and processing facial expressions in anthropoid primates. Biology Letters, 7(1). https://doi.org/10.1098/rsbl.2010.04.
Dotsch, R., Wigboldus, D. H. J., Langner, O., & van Knippenberg, A. (2008). Ethnic out-group faces are biased in the prejudiced mind. Psychological Science, 19(10), 978–980. https://doi.org/10.1111/j.1467-9280.2008.02186.x.
Dunbar, R. I. M. (1997). The social brain hypothesis. Evolutionary Anthropology, 6, 178–190. https://doi.org/10.1002/(sici)1520-6505(1998)6:5<178::aid-evan5>3.3.co;2-p.
Ebner, N. C., Riediger, M., & Lindenberger, U. (2010). FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods, 42(1), 351–362.
Ekman, P. (1973). Cross-cultural studies of facial expression. In P. Ekman (Ed.), Darwin and facial expression: A century of research in review (pp. 169–222). New York: Academic.
Ekman, P., & Friesen, W. (1978). Unmasking the face: A guide to recognizing emotions from facial expressions. California: Consulting Psychologists Press. https://doi.org/10.3389/neuro.09.023.2009/full.
Emery, N. J. (2000). The eyes have it: The neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews, 24, 581–604.
Fabes, R. A., & Martin, C. L. (1991). Gender and age stereotypes of emotionality. Personality and Social Psychology Bulletin, 17(5), 532–540. https://doi.org/10.1177/0146167291175008.
Franklin, R. G., Jr., & Adams, R. B., Jr. (2010). What makes a face memorable? The relationship between face memory and emotional state reasoning. Personality and Individual Differences, 49(1), 8–12.
Freudenberg, M., Adams, R. B., Jr., Kleck, R. E., & Hess, U. (2015). Through a glass darkly: Facial wrinkles affect our processing of emotion in the elderly. Frontiers in Psychology, 6, 1–12. https://doi.org/10.3389/fpsyg.2015.01476.
Fridlund, A. J. (1994). Human facial expression: An evolutionary view. San Diego: Academic. https://doi.org/10.1016/b978-0-12-267630-7.50008-3.
Frijda, N. H., & Tcherkassof, A. (1997). Facial expressions as modes of action readiness. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 78–102). Cambridge University Press. https://doi.org/10.1017/cbo9780511659911.006.
Frischen, A., Bayliss, A. P., & Tipper, S. P. (2007). Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychological Bulletin, 133(4), 694–724. https://doi.org/10.1037/0033-2909.133.4.694.
Garrido, C. O., Albohn, D. N., & Adams, R. B., Jr. (in review). At face value: Gender emotions, sexual orientation, and biases in person perception.
Geniole, S. N., Denson, T. F., Dixson, B. J., Carré, J. M., & McCormick, C. M. (2015). Evidence from meta-analyses of the facial width-to-height ratio as an evolved cue of threat. PLoS One, 10(7), 1–18. https://doi.org/10.1371/journal.pone.0132726.
Gibson, J. J. (1979/2015). The ecological approach to visual perception. Yale University Press. https://doi.org/10.2307/j.ctt1xp3nmm.20.
Hareli, S., & Hess, U. (2008). The role of causal attribution in hurt feelings and related social emotions elicited in reaction to other’s feedback about failure. Cognition & Emotion, 22, 862–880. https://doi.org/10.1080/02699930701541641.
Hareli, S., & Hess, U. (2010). What emotional reactions can tell us about the nature of others: An appraisal perspective on person perception. Cognition and Emotion, 24, 128–140. https://doi.org/10.1080/02699930802613828.
Harker, L. A., & Keltner, D. (2001). Expressions of positive emotion in women’s college yearbook pictures and their relationship to personality and life outcomes across adulthood. Journal of Personality and Social Psychology, 80(1), 112–124. https://doi.org/10.1037/0022-3514.80.1.112.
Haselhuhn, M. P., Ormiston, M. E., & Wong, E. M. (2015). Men’s facial width-to-height ratio predicts aggression: A meta-analysis. PLoS One, 10(4), 1–10. https://doi.org/10.1371/journal.pone.0122637.
Haselton, M. G., & Ketelaar, T. (2006). Irrational emotions or emotional wisdom? The evolutionary psychology of affect and social behavior. In J. P. Forgas (Ed.), Affect in social thinking and behavior (pp. 21–39). New York: Psychology Press.
Hess, E. H. (1975). The tell-tale eye: How your eyes reveal hidden thoughts and emotions. New york: Van Nostrand Reinhold.
Hess, U., Blairy, S., & Kleck, R. (2000). The influence of facial emotion displays, gender, and ethnicity on judgments of dominance and affiliation. Journal Nonverbal Behavior, 24(4), 265–283. https://doi.org/10.1023/A:1006623213355.
Hess, U., Adams, R. B., Grammer, K., & Kleck, R. E. (2009). Face gender and emotion expression: Are angry women more like men? Journal of Vision, 9(12), 19–19. https://doi.org/10.1167/9.12.19.
Hess, U., Adams, R. B., Jr., Simard, A., Stevenson, M. T., & Kleck, R. (2012). Smiling and sad wrinkles: Age-related changes in the face and the perception of emotions and intentions. Journal of Experimental Social Psychology, 48(6), 377–1380. https://doi.org/10.1016/j.jesp.2012.05.018.
Hess, U., & Hareli, S. (2018). On the malleability of the meaning of contexts: the influence of another person’s emotion expressions on situation perception. Cognition and Emotion, 32(1), 185–191. https://doi.org/10.1080/02699931.2016.1269725.
Hugenberg, K. (2005). Social categorization and the perception of facial affect: Target race moderates the response latency advantage for happy faces. Emotion, 5(3), 267–276. https://doi.org/10.1037/1528-3542.5.3.267.
Ishii, L., Carey, J., Byrne, P., Zee, D. S., & Ishii, M. (2009). Measuring attentional bias to peripheral facial deformities. Laryngoscope, 119(3), 459–465. https://doi.org/10.1002/lary.20132.
Ito, T. A., & Urland, G. R. (2003). Race and gender on the brain: Electrocortical measures of attention to the race and gender of multiply categorizable individuals. Journal of Personality and Social Psychology, 85(4), 616–626. https://doi.org/10.1037/0022-3514.85.4.616.
Ito, T. A., & Urland, G. R. (2005). The influence of processing objectives on the perception of faces: An ERP study of race and gender perception. Cognitive, Affective, & Behavioral Neuroscience, 5(1), 21–36. https://doi.org/10.3758/CABN.5.1.21.
Izard, C. E. (1971). The face of emotion. New York: Appleton Century Crofts. https://doi.org/10.1002/tia2.20012/full.
Keil, M. S. (2009). “I look in your eyes, honey”: Internal face features induce spatial frequency preference for human face processing. PLoS Computational Biology, 5(3). https://doi.org/10.1371/journal.pcbi.1000329.
Knutson, B. (1996). Facial expressions of emotion influence interpersonal trait inferences. Journal of Nonverbal Behavior, 20, 165–182. https://doi.org/10.1007/bf02281954.
Kret, M. E., Roelofs, K., Stekelenburg, J. J., & de Gelder, B. (2013). Emotional signals from faces, bodies and scenes influence observers’ face expressions, fixations and pupil-size. Frontiers in Human Neuroscience, 7(December), 1–9. doi:https://doi.org/10.3389/fnhum.2013.00810.
Lazarus, R. S. (1991). Emotion and adaptation. New York: Oxford University Press.
Lewis, K. M. (2000). When leaders display emotion: How followers respond to negative emotional expression of male and female leaders. Journal of Organizational Behavior, 21, 221–234. https://doi.org/10.1002/(sici)1099-1379(200003)21:2<221::aid-job36>3.0.co;2-0.
Liu, J., Li, J., Feng, L., Li, L., Tian, J., & Lee, K. (2014). Seeing jesus in toast: Neural and behavioral correlates of face pareidolia. Cortex, 53(1), 60–77. https://doi.org/10.1016/j.cortex.2014.01.013.
Looser, C. E., & Wheatley, T. (2010). The tipping point of animacy: How, when, and where we perceive life in a face. Psychological Science, 21(12), 1854–1862. https://doi.org/10.1177/0956797610388044.
Malatesta, C. Z., Fiore, M. J., & Messina, J. J. (1987). Affect, personality, and facial expressive characteristics of older people. Psychology and Aging, 2(1), 64–69. https://doi.org/10.1037/0882-7974.2.1.64.
Marsh, A. A., Adams, R. B., & Kleck, R. E. (2005). Why do fear and anger look the way they do? Form and social function in facial expressions. Personality and Social Psychology Bulletin, 31(1), 73–86. https://doi.org/10.1177/0146167204271306.
McPherson, M. B., & Young, S. L. (2004). What students think when teachers get upset: Fundamental attribution error and student-generated reasons for teacher anger. Communication Quarterly, 52(4), 357–369. https://doi.org/10.1080/01463370409370206.
Meeren, H. K. M., van Heijnsbergen, C. C. R. J., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 102(45), 16518–16523. https://doi.org/10.1073/pnas.0507650102.
Montepare, J., & Dobish, H. (2003). The contribution of emotion perceptions and their overgeneralizations to trait impressions. Journal of Nonverbal Behavior, 27, 237–254. https://doi.org/10.1023/a:1027332800296.
Mori, M. (1970). Bukimi no tani [The uncanny valley]. Energy, 7(4), 33–35.
Neth, D., & Martinez, A. M. (2009). Emotion perception in emotionless face images suggests a norm-based representation. Journal of Vision, 9(5), 1–11. https://doi.org/10.1167/9.1.5.
Newport, C., Wallis, G., Reshitnyk, Y., & Siebeck, U. E. (2016). Discrimination of human faces by archerfish (Toxotes chatareus). Scientific Reports, 6, 27523.
Nichols, D. F., Betts, L. R., & Wilson, H. R. (2010). Decoding of faces and face components in face-sensitive human visual cortex. Frontiers in Psychology, 1(7), 1–13. https://doi.org/10.3389/fpsyg.2010.00028.
Nummenmaa, T. (1964). The language of the face. Jyvaskyla studies in education, psychology social research. Findland: Jyvaskylan Yllopistoyhdisys.
Oosterhof, N. N., & Todorov, A. (2009). Shared perceptual basis of emotional expressions and trustworthiness impressions from faces. Emotion, 9(1), 128–133. https://doi.org/10.1037/a0014520.
Palumbo, R., Adams, R. B., Jr., Hess, U., Kleck, R. E., & Zebrowitz, L. (2017). Age and gender differences in facial attractiveness, but not emotion resemblance, contribute to age and gender stereotypes. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.01704.
Re, D. E., & Rule, N. O. (2016). Predicting firm success from the facial appearance of chief executive officers of non-profit organizations. Perception, 45(10), 1137–1150.
Redican, W. K. (1982). An evolutionary perspective on human facial displays. In P. Ekman (Ed.), Emotion in the human face (2nd ed., pp. 212–280). Elmsford: Pergamon.
Riggio, R. E., & Friedman, H. S. (1986). Impression formation. The role of expressive behavior. Journal of Personality and Social Psychology, 50(2), 421–427. https://doi.org/10.1037/0022-3514.50.2.421.
Righart, R., & de Gelder, B. (2008). Rapid influence of emotional scenes on encoding of facial expressions: An ERP study. Social Cognitive and Affective Neuroscience, 3(3), 270–278. https://doi.org/10.1093/scan/nsn021.
Rule, N. O. (2017). Perceptions of sexual orientation from minimal cues. Archives of Sexual Behavior, 46, 129–139. https://doi.org/10.1007/s10508-016-0779-2.
Russell, J. A. (1997). Reading emotion from and into faces: Resurrecting a dimensional-contextual perspective. In J.A. Russell & J.M. Fernández-Dols’ (Eds.), The psychology of facial expression, Cambridge University Press, New York 295–320. https://doi.org/10.1017/cbo9780511659911.015.
Russell, J. A., & Fehr, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology, 116(3), 223–237. https://doi.org/10.1037//0096-3445.116.3.223.
Said, C. P., Sebe, N., & Todorov, A. (2009). Structural resemblance to emotional expressions predicts evaluation of emotionally neutral faces. Emotion, 9(2), 260–264. https://doi.org/10.1037/a0014681.
Secord, P. F. (1958). Facial features and inferential processes on interpersonal perception. In R. Tagiviri & L. Ptrullo (Eds.), Person perception and interpersonal behavior (pp. 300–316). Standford: Standford University Press.
Todorov, A., & Porter, J. M. (2014). Misleading first impressions: Different for different facial images of the same person. Psychological Science, 25(7), 1404–1417. https://doi.org/10.1177/0956797614532474.
Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., et al. (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 168(3), 242–249.
Třebický, V., Fialová, J., Kleisner, K., Roberts, S. C., Little, A. C., & Havlíček, J. (2015). Further evidence for links between facial width-to-height ratio and fighting success: Commentary on Zilioli et al. (2014). Aggressive Behavior, 41(4), 331–334. https://doi.org/10.1002/ab.21559.
Tronick, E., Als, H., Adamson, L., Wise, S., & Brazelton, T. B. (1978). The infant’s response to entrapment between contradictory messages in face-to-face interaction. Journal of the American Academy of Child Psychiatry, 17, 1–13. https://doi.org/10.1016/s0002-7138(09)62273-1.
Tskhay, K. O., & Rule, N. O. (2015). Emotions facilitate the communication of ambiguous group memberships. Emotion, 15, 812–826. https://doi.org/10.1037/emo0000077.
Wiggins, J. C., Trapnell, P. D., & Phillips, N. (1988). Psychometric and geometric characteristics of the revised Interpersonal Adjective Scales (IAS-R). Multivariate Behavioral Research, 23(4), 517–530. https://doi.org/10.1207/s15327906mbr2304_8.
Willis, M. L., Palermo, R., & Burke, D. (2011). Social judgments are influenced by both facial expression and direction of eye gaze. Social Cognition, 29(4), 415–429. https://doi.org/10.1521/soco.2011.29.4.415.
World Health Organization. (2018). International statistical classification of diseases and related health problems (11th Revision). Retrieved from https://icd.who.int/browse11/l-m/en.
Zebrowitz, L. A. (2003). Commentary: Overgeneralization effects in perceiving nonverbal behavior: Evolutionary and ecological origins. Journal of Nonverbal Behavior, 27(2), 133–138. https://doi.org/10.1023/A:1023966526601.
Zebrowitz, L. A., & Rhodes, G. (2004). Sensitivity to “bad genes” and the anomalous face overgeneralization effect: Cue validity, cue utilization, and accuracy in judging intelligence and health. Journal of Nonverbal Behavior, 28(3), 167–185. https://doi.org/10.1023/B:JONB.0000039648.30935.1b.
Zebrowitz, L. A., & Collins, M. A. (1997). Accurate social perception at zero acquaintance: The affordances of a gibsonian approach. Personality & Social Psychology Review (Lawrence Erlbaum Associates), 1(3), 204. https://doi.org/10.1207/s15327957pspr0103_2.
Zebrowitz, L. A., Kikuchi, M., & Fellous, J. M. (2007). Are effects of emotion expression on Trait Impressions mediated by babyfaceness? evidence from connectionist modeling. Personality and Social Psychology Bulletin, 33(5), 648–662. https://doi.org/10.1177/0146167206297399.
Zebrowitz, L. A., Kikuchi, M., & Fellous, J-M. (2010). Facial resemblance to emotions: group differences, impression effects, and race stereotypes. Journal of Personality and Social Psychology, 98(2), 175–189. https://doi.org/10.1037/a0017990.
Zebrowitz, L. A. (2017). First impressions from faces. Current Directions in Psychological Science, 26(3), 237–242. https://doi.org/10.1177/0963721416683996.
Zebrowitz L. A. (1996). Physical appearance as a basis for stereotyping. In C. N. MacRae, C. Stangor, & M. Hewstone (Eds.), Foundation of stereotypes and stereotyping. (pp. 79–120). New York: Guilford Press.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Albohn, D.N., Brandenburg, J.C., Adams, R.B. (2019). Perceiving Emotion in the “Neutral” Face: A Powerful Mechanism of Person Perception. In: Hess, U., Hareli, S. (eds) The Social Nature of Emotion Expression . Springer, Cham. https://doi.org/10.1007/978-3-030-32968-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-32968-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32967-9
Online ISBN: 978-3-030-32968-6
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)