Abstract
Accurate perception of emotional expressions plays a critical role in empathic accuracy, but are emotional expressions truly informative for affect? Classic theories of emotion assert a direct, causal link between the emotional experience and its consequent manifestation in the face and voice. Such theories predict that distinct emotional experiences would yield distinct emotional expressions, each diagnostic for the valence of its occurring situation. However, although the hallmark of emotional expressions is their spontaneous expressive nature, the prevalent approach in contemporary studies of emotional expressions relies on posed or simulated expressions of actors. In this chapter, we discuss recent evidence from studies that pursued more ecological and naturalistic stimuli in emotion perception research. A special emphasis is placed on intense emotional expressions, in which empathic accuracy may be most critical. Converging recent evidence casts doubt on the diagnostic nature of emotional expressions and highlights the role of contextual information in the perception of emotion. Finally, the methodological and theoretical implications to the fields of both emotion perception and empathic accuracy are discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16(5), 403–410. https://doi.org/10.1111/j.0956-7976.2005.01548.x
Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research, 166(3), 559–571. https://doi.org/10.1007/s00221-005-2396-5
Anikin, A., Bååth, R., & Persson, T. (2018). Human non-linguistic vocal repertoire: Call types and their meaning. Journal of Nonverbal Behavior, 42(1), 53–80. https://doi.org/10.1007/s10919-017-0267-y
Anikin, A., & Lima, C. F. (2017). Perceptual and acoustic differences between authentic and acted nonverbal emotional vocalizations. Quarterly Journal of Experimental Psychology, 17470218(2016), 1. https://doi.org/10.1080/17470218.2016.1270976
Anikin, A., & Persson, T. (2017). Nonlinguistic vocalizations from online amateur videos for emotion research: A validated corpus. Behavior Research Methods, 49(2), 758–771. https://doi.org/10.3758/s13428-016-0736-y
Atias, D., Todorov, A., Liraz, S., Eidinger, A., Dror, I., Maymon, Y., & Aviezer, H. (2019). Loud and unclear: Intense real-life vocalizations during affective situations are perceptually ambiguous and contextually malleable. Journal of Experimental Psychology: General, 148(10), 1842. https://doi.org/10.1037/xge0000535
Aviezer, H., Ensenberg, N., & Hassin, R. R. (2017). The inherently contextualized nature of facial emotion perception. Emotion, 17, 47–54. https://doi.org/10.1016/j.copsyc.2017.06.006
Aviezer, H., Trope, Y., & Todorov, A. (2012a). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225–1229. https://doi.org/10.1126/science.1224313
Aviezer, H., Trope, Y., & Todorov, A. (2012b). Holistic person processing: Faces with bodies tell the whole story. Journal of Personality and Social Psychology, 103(1), 20–37. https://doi.org/10.1037/a0027411
Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. https://doi.org/10.1037/0022-3514.70.3.614
Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 42(2), 241–251.
Behrmann, M., Thomas, C., & Humphreys, K. (2006). Seeing it differently: Visual processing in autism. Trends in Cognitive Sciences, 10(6), 258–264. https://doi.org/10.1016/j.tics.2006.05.001
Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal affective voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40(2), 531–539. https://doi.org/10.3758/BRM.40.2.531
Besel, L. D. S., & Yuille, J. C. (2010). Individual differences in empathy: The role of facial expression recognition. Personality and Individual Differences, 49(2), 107–112. https://doi.org/10.1016/j.paid.2010.03.013
Chen, Z., & Whitney, D. (2019). Tracking the affective state of unseen persons. Proceedings of the National Academy of Sciences, 116(15), 7559. https://doi.org/10.1073/pnas.1812250116
Clark, T. F., Winkielman, P., & McIntosh, D. N. (2008). Autism and the extraction of emotion from briefly presented facial expressions: Stumbling at the first step of empathy. Emotion, 8(6), 803–809. https://doi.org/10.1037/a0014124
Darwin, C. (1872). Expression of the emotions in man and animals. London: Albemarle.
de Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7(3), 242–249. https://doi.org/10.1038/nrn1872
de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society, B: Biological Sciences, 364(1535), 3475–3484. https://doi.org/10.1098/rstb.2009.0190
de Gelder, B., & Van den Stock, J. (2011). The bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology, 2, 181. https://doi.org/10.3389/fpsyg.2011.00181
de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14(3), 289–311. https://doi.org/10.1080/026999300378824
Demurie, E., De Corel, M., & Roeyers, H. (2011). Empathic accuracy in adolescents with autism spectrum disorders and adolescents with attention-deficit/hyperactivity disorder. Research in Autism Spectrum Disorders, 5(1), 126–134. https://doi.org/10.1016/j.rasd.2010.03.002
Ekman, P. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3–4), 169–200. https://doi.org/10.1080/02699939208411068
Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48, 384.
Ekman, P., Friesen, W. V., & Ellsworth, P. (1972). Emotion in the human face: Guidelines for research and an integration of findings. Oxford: Pergamon Press.
Ekman, P., & Rosenberg, E. (Eds.). (1997). What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195179644.001.0001
Fernández-Dols, J.-M., & Crivelli, C. (2013). Emotion and expression: Naturalistic studies. Emotion Review, 5(1), 24–29. https://doi.org/10.1177/1754073912457229
Fridlund, A. J. (1994). Human facial expression: An evolutionary view. San Diego, CA: Academic Press.
Gendron, M., Lindquist, K. A., Barsalou, L., & Barrett, L. F. (2012). Emotion words shape emotion percepts. Emotion, 12(2), 314–325. https://doi.org/10.1037/a0026007
Gesn, P. R., & Ickes, W. (1999). The development of meaning contexts for empathic accuracy: Channel and sequence effects. Journal of Personality and Social Psychology, 77(4), 746–761. https://doi.org/10.1037/0022-3514.77.4.746
Graf, H. P., Cosatto, E., Strom, V., & Huang, F. J. (2002). Visual prosody: Facial movements accompanying speech. In Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition (pp. 396–401). Washington, DC: IEEE. https://doi.org/10.1109/AFGR.2002.1004186
Hall, J. A., & Schmid Mast, M. (2007). Sources of accuracy in the empathic accuracy paradigm. Emotion, 7(2), 438–446. https://doi.org/10.1037/1528-3542.7.2.438
Hassin, R. R., Aviezer, H., & Bentin, S. (2013). Inherently ambiguous: Facial expressions of emotions, in context. Emotion Review, 5(1), 60–65.
Hawk, S. T., Van der Schalk, J., & Fischer, A. H. (2008). Moving faces, looking places: The Amsterdam dynamic facial expressions set (ADFES). In 12th European Conference on Facial Expressions, Geneva, Switzerland.
Ickes, W. (1993). Empathic accuracy. Journal of Personality, 61(4), 587–610. https://doi.org/10.1111/j.1467-6494.1993.tb00783.x
Ickes, W. (2001). Measuring empathic accuracy. Interpersonal sensitivity: Theory and measurement (pp. 219–241). Mahwah, NJ: Lawrence Erlbaum Associates.
Ickes, W., Stinson, L., Bissonnette, V., & Garcia, S. (1990). Naturalistic social cognition: Empathic accuracy in mixed-sex dyads. Journal of Personality and Social Psychology, 59(4), 730–742. https://doi.org/10.1037/0022-3514.59.4.730
Israelashvili, J., Hassin, R. R., & Aviezer, H. (2019). When emotions run high: A critical role for context in the unfolding of dynamic, real-life facial affect. Emotion, 19(3), 558–562. https://doi.org/10.1037/emo0000441
Kayser, C., & Logothetis, N. K. (2007). Do early sensory cortices integrate cross-modal information? Brain Structure and Function, 212(2), 121–132. https://doi.org/10.1007/s00429-007-0154-0
Keltner, D., Sauter, D., Tracy, J., & Cowen, A. (2019). Emotional expression: Advances in basic emotion theory. Journal of Nonverbal Behavior, 43(2), 133–160. https://doi.org/10.1007/s10919-019-00293-3
Keltner, D., Tracy, J., Sauter, D. A., Cordaro, D. C., & McNeil, G. (2016). Expression of emotion. In Handbook of emotions (pp. 467–482). New York, NY: Guilford Press.
Levenson, R. W., & Ruef, A. M. (1992). Empathy: A physiological substrate. Journal of Personality and Social Psychology, 63(2), 234–246. https://doi.org/10.1037/0022-3514.63.2.234
Lindquist, K. A., & Barrett, L. F. (2008). Constructing emotion: The experience of fear as a conceptual act. Psychological Science, 19(9), 898–903. https://doi.org/10.1111/j.1467-9280.2008.02174.x
Lindquist, K. A., & Gendron, M. (2013). What’s in a word? Language constructs emotion perception. Emotion Review, 5(1), 66–71. https://doi.org/10.1177/1754073912451351
Marsh, A. A., Kozak, M. N., & Ambady, N. (2007). Accurate identification of fear facial expressions predicts prosocial behavior. Emotion, 7(2), 239–251. https://doi.org/10.1037/1528-3542.7.2.239
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746–748. https://doi.org/10.1038/264746a0
Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility: Head movement improves auditory speech perception. Psychological Science, 15(2), 133–137. https://doi.org/10.1111/j.0963-7214.2004.01502010.x
Posner, J., Russell, J. A., & Peterson, B. S. (2005). The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and Psychopathology, 17(3), 715–734. https://doi.org/10.1017/S0954579405050340
Roseman, I. J. (1984). Cognitive determinants of emotion: A structural theory. Review of Personality & Social Psychology, 5, 11–36.
Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
Russell, J. A. (1997). Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective. In The psychology of facial expression (pp. 295–320). Cambridge: Cambridge University Press.
Russell, J. A., Bachorowski, J.-A., & Fernández-Dols, J.-M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54(1), 329–349. https://doi.org/10.1146/annurev.psych.54.101601.145102
Russell, J. A., & Bullock, M. (1986). Fuzzy concepts and the perception of emotion in facial expressions. Social Cognition, 4(3), 309–341. https://doi.org/10.1521/soco.1986.4.3.309
Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2010). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences, 107(6), 2408–2412. https://doi.org/10.1073/pnas.0908239106
Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2015). Emotional vocalizations are recognized across cultures regardless of the valence of distractors. Psychological Science, 26(3), 354–356. https://doi.org/10.1177/0956797614560771
Scherer, K. R. (1984). On the nature and function of emotion: A component process approach. In K. R. Scherer & D. D. Clarke (Eds.), Approaches to emotion. Hillsdale, NJ: Erlbaum. Retrieved from http://www.nottingham.ac.uk/is/gateway/esl/local/pdf/0898594065(293-317).pdf
Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2), 143–165. https://doi.org/10.1037/0033-2909.99.2.143
Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40(1), 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5
Scherer, K. R. (2009). The dynamic architecture of emotion: Evidence for the component process model. Cognition and Emotion, 23(7), 1307–1351. https://doi.org/10.1080/02699930902928969
Scherer, K. R., & Moors, A. (2019). The emotion process: Event appraisal and component differentiation. Annual Review of Psychology, 70(1), 719–745. https://doi.org/10.1146/annurev-psych-122216-011854
Scherer, K. R., Mortillaro, M., & Mehu, M. (2017). Facial expression is driven by appraisal and generates appraisal inference. In The science of facial expression (pp. 353–373). New York, NY: Oxford University Press.
Schlosberg, H. (1941). A scale for the judgment of facial expressions. Journal of Experimental Psychology, 29(6), 497–510. https://doi.org/10.1037/h0061489
Schlosberg, H. (1952). The description of facial expressions in terms of two dimensions. Journal of Experimental Psychology, 44(4), 229–237. https://doi.org/10.1037/h0055778
Senkowski, D., Schneider, T. R., Foxe, J. J., & Engel, A. K. (2008). Crossmodal binding through neural coherence: Implications for multisensory processing. Trends in Neurosciences, 31(8), 401–409. https://doi.org/10.1016/j.tins.2008.05.002
Shams, L., Kamitani, Y., & Shimojo, S. (2002). Visual illusion induced by sound. Multisensory Proceedings, 14(1), 147–152. https://doi.org/10.1016/S0926-6410(02)00069-1
Silvia, P. J., Allan, W. D., Beauchamp, D. L., Maschauer, E. L., & Workman, J. O. (2006). Biased recognition of happy facial expressions in social anxiety. Journal of Social and Clinical Psychology, 25(6), 585–602. https://doi.org/10.1521/jscp.2006.25.6.585
Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48(4), 813–838. https://doi.org/10.1037/0022-3514.48.4.813
Smith, M. L., Cottrell, G. W., Gosselin, F., & Schyns, P. G. (2005). Transmitting and decoding facial expressions. Psychological Science, 16(3), 184–189. https://doi.org/10.1111/j.0956-7976.2005.00801.x
Tomkins, S. S. (1962). Affect, imagery, consciousness: Vol. 1. The positive affects. New York, NY: Springer. https://doi.org/10.1037/14351-000
Tomkins, S. S. (1963). Affect, imagery, consciousness: Vol. 2. The negative affects. New York, NY: Springer.
Tracy, J. L., & Matsumoto, D. (2008). The spontaneous expression of pride and shame: Evidence for biologically innate nonverbal displays. Proceedings of the National Academy of Sciences, 105(33), 11655. https://doi.org/10.1073/pnas.0802686105
Tracy, J. L., & Robins, R. W. (2004). Show your pride: Evidence for a discrete emotion expression. Psychological Science, 15(3), 194–197. https://doi.org/10.1111/j.0956-7976.2004.01503008.x
Tracy, J. L., & Robins, R. W. (2008). The nonverbal expression of pride: Evidence for cross-cultural recognition. Journal of Personality and Social Psychology, 94(3), 516.
Wenzler, S., Levine, S., van Dick, R., Oertel-Knöchel, V., & Aviezer, H. (2016). Beyond pleasure and pain: Facial expression ambiguity in adults and children during intense situations. Emotion, 16(6), 807–814. https://doi.org/10.1037/emo0000185
Woodworth, R. S., & Schlosberg, H. (1938). Experimental psychology. New York, NY: Henry Holt and Company.
Zaki, J., Weber, J., Bolger, N., & Ochsner, K. (2009). The neural bases of empathic accuracy. Proceedings of the National Academy of Sciences, 106(27), 11382–11387. https://doi.org/10.1073/pnas.0902666106
Zaki, J., Bolger, N., & Ochsner, K. (2008). It takes two: The interpersonal nature of empathic accuracy. Psychological Science, 19(4), 399–404. https://doi.org/10.1111/j.1467-9280.2008.02099.x
Zaki, J., Bolger, N., & Ochsner, K. (2009). Unpacking the informational bases of empathic accuracy. Emotion, 9(4), 478–487. https://doi.org/10.1037/a0016551
Zaki, J., & Ochsner, K. (2011). The cognitive neuroscience of sharing and understanding others’ emotions. In J. Decety (Ed.), Empathy: From bench to bedside. Cambridge, MA: MIT Press.
Acknowledgments
This work was supported by an Israel Science Foundation [ISF#259/18] grant to Hillel Aviezer.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Atias, D., Aviezer, H. (2021). Empathic Accuracy: Lessons from the Perception of Contextualized Real-Life Emotional Expressions. In: Gilead, M., Ochsner, K.N. (eds) The Neural Basis of Mentalizing. Springer, Cham. https://doi.org/10.1007/978-3-030-51890-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-51890-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-51889-9
Online ISBN: 978-3-030-51890-5
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)