Skip to main content
Log in

Looking angry and sounding sad: The perceptual analysis of emotional expression

  • Published:
Synthese Aims and scope Submit manuscript

Abstract

According to the Perceptual Analysis of Emotional Expression, behaviors express emotions by making them perceptually manifest. A smile is an expression of joy because an observer who sees a smile can see joy. A pout is an expression of grief because an observer who sees a pout can see grief. And a growl is an expression of anger because an observer who hears a growl can hear anger. The idea is not simply that expressions can enable the perception of emotion, but that expressions essentially do so. In the course of defending this analysis against challenges, I develop a novel account of the relationship between language and expression.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. As we shall see in §3.2, however, it is possible for coughing and wheezing to be expressions of emotion, but, in those cases, they will also enable the perception of emotion.

  2. Classic formulations include Scheler (1970, p. 256, for commentary, see Gallagher and Zahavi 2012, pp. 201–204), Wittgenstein (1980, §570, for commentary, see Overgaard 2006), and Taylor (1979, pp. 73, 74, for commentary, see Campbell 1997, pp. 59–63). Recent formulations include Green (2007, pp. 84–93, 2010a), Bar-On (2004, pp. 264–284, 2010), Zahavi (2007), Smith (2015), and Newen et al. (2015).

  3. Green (2007) defends this view. In his analysis of “self-expression,” which includes only those behaviors that signal and show an agent’s own occurrent mental state, Green argues that the enabling of perception is but one of three ways of showing. We can also show that we have an emotion by providing evidence of it, and show how an emotion feels by helping others to empathize with us. Green contends that agents can express their mental states via these other means of showing as well (2007, pp. 25, 212). Thus while Green agrees that emotional expressions can and sometimes do enable the perception of an agent’s occurrent emotions, he denies that all do so, and thus he denies that the enabling of perception is essential to self-expression (and, a fortiori, to expression more generally).

  4. Charles Taylor is perhaps the only other philosopher to defend the perceptual claim specifically as a conceptual claim (Taylor 1979, pp. 73, 74). My version of the Perceptual Analysis differs from Taylor’s in several important respects, and answers objections that his version cannot. Bar-On (2004, 2010) defends a version of the Perceptual Analysis with respect to “natural expressions” of emotion, but not with respect to the expression of emotion more generally. See note 10, below, for my take on Bar-On’s view.

  5. In note 27, below, I respond to what seems like an obvious objection to this claim, namely the possibility of expressing our emotions in writing.

  6. Is it ever possible for one person to express another person’s emotions? I am tempted to say yes, as long as the first person “embodies” the second person, e.g. in a theatrical or musical performance. The actor who breaks down crying on stage during a production of Antigone isn’t expressing his grief; he’s expressing Creons grief, which he does by expressing grief while embodying Creon. Similarly, the violinist who plays a moving sonata may not be expressing her sadness, but rather the composer’s, whose subjectivity is embodied in the performance.

  7. Green (2007, p. 12) distinguishes between three kinds of voluntary expressions: (1) those that are allowed to occur spontaneously without being willed, (2) those that are willed, and (3) those that are willed and overt. My category of “voluntary expressions” includes 2 and 3 but not 1.

  8. An expression is “sincere” only if the expresser feels the emotion that she expresses. An expression is “non-sincere,” in turn, only if the expresser does not feel the emotion that she expresses. (See Green 1970, p. 556 for a helpful discussion of how the term “insincere” can be misleading in this context.) There are at least three ways in which an expression can be non-sincere: (1) a person can put on an expression when she feels no emotion; (2) a person can put on an expression that differs in kind from the emotion that she does feel; and (3) a person can put on an expression that differs in intensity from the emotion that she feels (Ekman and Friesen 2003, p. 141).

  9. Alston (1965), Green (1970), Tormey (1971), Finn (1975), and Bar-On (2004), among others, insist that non-sincere expressions are not truly emotional expressions. Green (2007) argues that there are no such things as non-sincere self-expressions, although he allows for the possibility of non-sincere expressions more generally (see Green 2010b).

  10. Had I more space, I would also demonstrate that the Perceptual Analysis outperforms another competitor, namely the Hydraulic Analysis of Emotional Expression, or the view that a behavior expresses an emotion just in case the emotion causes that behavior to occur. Though less popular than the Evidential Analysis, the Hydraulic Analysis has enjoyed a recent resurgence following Bar-On’s (2004) spirited defense of it. Very briefly, Bar-On distinguishes between “expressing” as a process and “expression” as a product, and argues that a behavior counts as an emotional expression just in case it was produced by the process of “airing,” “voicing,” “pressing out,” or “giving vent to one’s present state” (2004, pp. 241, 257). Less metaphorically, a person expresses an emotion whenever her behavior “comes directly from” that emotion (2004, p. 254), which is to say that the emotion is either a brute or rational cause of that behavior (2004, p. 249). Any behavior brought about through this process is, accordingly, an “expression” of that emotion. I see two major problems with the Hydraulic Analysis. First, insincere expressions cannot be caused by the emotions they express. Second, coping behaviors are caused by emotions, yet do not express them (see below). Thus, the Hydraulic Analysis is both too narrow and too broad.

  11. See, for instance, Britton (1957, p. 101), Green (1970, p. 551), Tormey (1971, p. 43), Bach and Harnish (1979, p. 15), and Davis (1988, p. 280, 2003). Green’s (2007) analysis of self-expression overlaps with the Evidential Analysis insofar as he claims that signaling and showing-that a person experiences an emotion (namely by providing evidence of it) is sufficient—though not necessary—to express that emotion.

  12. Compare Green (2007, p. 212) and Bach and Harnish (1979, p. 15) with Davis (1988, p. 280).

  13. I assume that if the weaker modal claim is false, then the stronger conceptual claim must also be false.

  14. Stout (2010) objects to Green’s claim, although I am persuaded by Green’s (2010a) subsequent response (see also Bar-On 2010). Green (2007, p. 89) goes on to add that, in some cases, observers may require certain conceptual capacities in order to perceive an emotion in its expression. I think this is a mistake. Certain conceptual capacities may be necessary to perceive a behavior as emotional, but not to perceive an emotion via part-whole perception. In another mood, Green (2007, p. 141) appears to agree.

  15. For alternative answers to this objection, see Overgaard (2006) and Gallagher and Zahavi (2012, pp. 201–204).

  16. Although my formulation of the Perceptual Analysis can overcome this objection, any formulation that takes the enabling of perception-as to be necessary for expression will have difficulty doing so (e.g. Taylor 1979). Green’s analysis of self-expression can accommodate individual-typical self-expressions (2007, pp. 89, 140, 141), but not individual-atypical self-expressions.

  17. Some philosophers argue that perceiving does entail awareness of what one has seen (e.g. Searle 2015). I am persuaded by arguments to the contrary (e.g. Dretske 2006), but I concede that the truth of the Perceptual Analysis depends upon the falsity of that view of perceiving.

  18. However, Green (2007) is giving an account of “self-expression,” rather than of “expression” more generally, and thus Davis’ objection, while raising an important fact about expression, misses its mark. See Green (2010b).

  19. Alston (1965), Green (1970), Tormey (1971), Finn (1975), and Bar-On (2004), among others, insist that non-sincere expressions are not truly emotional expressions. Goodman (1976), Bach and Harnish (1979), Taylor (1979), Davis (1988, 2003), and Eriksson (2010), among others, take it to be equally obvious that expressions can be non-sincere.

  20. The fact that a behavior resembles a component of an emotion does not entail that the behavior is not a component of an emotion. On my view, natural expressions resemble characteristic components of emotions whereas idiosyncratic expressions do not, although both are in fact components of emotions.

  21. Davis (1988, 2003), Bar-On (2004), and Green (2007) offer spirited defenses of the claim that language is a means of emotional expression. A more comprehensive defense of the claim that language is not a means of emotional expression would need to address their arguments directly, a task that I must unfortunately put off for another day.

  22. Bar-On (2004, p. 299) makes a strong case for linguistic utterances becoming components of mental states as they become habitual responses to specific stimuli. Thus, if “Ouch!” or “That hurts!” is a spontaneous response to stubbing one’s toe, then it is as much a component of pain as is a wince. However, I follow psychologists in classifying expressions as components of emotions only if they are coordinated changes in the somatic nervous system. Since the production of language is never such a change, I conclude that linguistic utterances are never components of emotions.

  23. The best candidates for language that enables the perception of someone as emotional would be metaphors and poetry. My take, however, is that metaphors and poetry typically evoke emotions without expressing them.

  24. As I read her, Bar-On responds to this objection by giving up on the Perceptual Analysis. She argues that linguistic expressions replace non-linguistic ones, and that, while the latter do indeed enable the perception of emotion, the former do not. Rather, the former express emotion by being produced by the same kind of causal process that produces the latter. See note 10 for more on Bar-On’s view, and why I disagree with it.

  25. I am by no means the first to advocate such a view (Wollheim 1968, p. 228; Green 1970, p. 563). However, I believe that I am the first to defend it and to explore its implications.

  26. Indeed, clinicians who specialize in prosody disorders, which impair individuals’ ability to inflect their speech with emotional tones of voice, conclude that such individuals cannot express their emotions in speech at all (Marchi et al. 2012).

  27. Surely we can express our emotions in writing. However, when we write, we record only what we wish to say, and not how we wish to say it. A spoken utterance of “I am sorry” can be accompanied by a regretful tone of voice, facial expression, or gesture. A written inscription of “I am sorry” cannot. Thus, if a speech act must be accompanied by such nonverbal behaviors to count as an expression, then it would seem to follow that written language cannot be used to express our emotions at all. But, intuitively, we can express our emotions in writing, so there must be something wrong with my view.

          In response, I contend that Perceptual Analysis, far from contradicting the possibility of written expression, in fact sheds light on how the written expression of emotion works. Although it is true that our facial expressions, gestures, and tones of voice are not preserved in writing, we can nevertheless substitute for these nonverbal behaviors in a number of interesting ways. An obvious example involves the use of emoji. By inserting a smiley face into a text, we substitute for the real smile that would accompany a spoken utterance of the same words. More interesting are the ways in which we substitute for vocal prosody (tones of voice). We use (1) typographical styling, (2) punctuation, and (3) nonstandard spellings, among other techniques, to insert a dimension of tone into our writings. By italicizing a word, for instance, we substitute for the vocal emphasis that we deploy in speech. By ending a sentence with an exclamation mark instead of a period, we substitute for an emotionally excited tone of voice. And by using nonstandard spellings, we turn the reader’s attention to how something would be said in speech, beyond simply what has been said. Take the following line of dialogue from Huckleberry Finn: “Oh, Huck, I bust out a-cryin’ en grab her up in my arms, en say, ‘Oh, de po’ little thing! De Lord God Amighty fogive po’ ole Jim, kaze he never gwyne to fogive hisself as long’s he live!”’ We do not just read and understand Jim’s words; we imaginatively hear them being spoken with a particular accent, with particular emphases, and with particular affects.

          Context also plays a crucial role, since these techniques will be more or less effective, depending on the context (Yigit 2005). Furthermore, context can influence how we read default sentences, or sentences that lack alternative stylings, punctuation, and spelling. In so-called “task-functional contexts,” where an author is interested in conveying information rather than expressing his or her mental states, readers do not read tone into default sentences. In so-called “socio-emotional contexts,” by contrast, where an author is interested in expressing his or her mental states rather than conveying information, readers do read tone into default sentences, thereby reading them as expressions (Yigit 2005). Much more on this topic needs to be said, and I am developing an account of written expression elsewhere. The take-away point is that, for writing as well as for speech, it’s not what one says that matters for expression, it’s how one says it.

  28. It’s not the only place. Language is also used to “punctuate” expressions, or to call attention to how we say something. When I say “I’m sorry,” for instance, I call upon you to attend to my tone and facial expression, since it’s them, and not my words, that will ultimately convince you that I am indeed sorry.

  29. Bar-On (2004, Chap. 6) also discusses the “articulation” of expressed mental states, but does not distinguish expression from articulation as starkly as I do. In particular, Bar-On claims that articulation is sometimes sufficient for expression (cf. Davis 1988, pp. 283, 284), a claim that I deny. Similarly, Mitchell Green (2007, pp. 13, 14) claims that self-expressions are translucent in the sense that they can convey both the type and the content of an emotion. However, this claim conflates what I am calling “expression” and “articulation.” Notice that we can use language to articulate the content of an emotion without at the same time expressing that emotion. When I stoically report that I have lost my job, home, and lover, I have informed you of why I am sad—i.e. the content of my sadness—even though I have not expressed my sadness to you. When I speak the identical words to you in a pitiful tone of voice, I express the same thing that I express by simply crying, namely sadness. Neither the tone of voice nor the tears express the content of my sadness. Motivating Green’s conflation, I believe, is a version of the familiar de re/de dicto ambiguity. The claim, “Anya expressed her fear of bunnies,” admits of two readings: Anya can de re express her fear of bunnies by expressing a type of emotion, namely fear, regardless of whether Anya also articulates the content of her fear. Anya can de dicto express her fear of bunnies, on the other hand, by expressing both the type and content of emotion, namely fear of bunnies. The arguments of this section support my conclusion that it is possible to express a fear of bunniesde re, but not to express that fearde dicto. What appears to be a de dicto expression is in fact a nonverbal expression of fear coupled with a verbal articulation of the content of that fear.

  30. Although beliefs are dispositional states, whenever we express a belief we express an occurrent attitude toward the content of that belief. Thus, even though I may believe that Paris is west of Berlin without thinking about it, I cannot express the belief that Paris is west of Berlin without thinking about it. The expression of belief, like the expression of emotion, is an expression of an occurrent mental state.

  31. One might also worry about the expressions of beliefs in writing and in sign language. My account of the written expression of emotion (sketched in note 27) applies to the written expression of cognitive states as well. We use a variety of techniques, within appropriate contexts, to substitute for the tones of voice and gestures that express cognitive states in speech, thereby expressing those states in writing. Similarly, although tones of voice are not typically deployed in sign language, expressive facial expressions and gestures are, and I maintain that a token sign expresses a mental state if and only if it is accompanied by an appropriate facial expression or gesture. In short, it’s not what one signs that matters for expression, it’s how one signs it.

  32. If this claim turns out to be false, then we would have good reason to think that the expression of emotion is different, in principle, from the expression of belief (since the distinction between claiming to be in a state and expressing that state doesn’t hold for the expression of belief), in which case the fifth objection would lose its grip.

References

  • Alston, W. P. (1965). Expressing. In M. Black (Ed.), Philosophy in America (pp. 15–34). New York: Cornell University Press.

    Google Scholar 

  • Bach, K., & Harnish, R. (1979). Linguistic communication and speech acts. Massachusetts: MIT Press.

    Google Scholar 

  • Banse, R., & Scherer, K. (1996). Acoustic profiles in vocal emotional expression. Journal of Personality and Social Psychology, 70(3), 614–636.

    Article  Google Scholar 

  • Bar-On, D. (2004). Speaking my mind. New York: Oxford University Press.

    Book  Google Scholar 

  • Bar-On, D. (2010). Expressing as ‘showing what’s within’: On Mitchell Green’s Self-expression OUP 2007. Philosophical Books, 51(4), 212–227.

    Article  Google Scholar 

  • Brewer, B. (2011). Perception and its objects. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Britton, K. (1957). Feelings and their expression. Philosophy, 32(121), 97–111.

    Article  Google Scholar 

  • Campbell, S. (1997). Interpreting the personal. Ithaca: Cornell University Press.

    Google Scholar 

  • Davies, S. (1980). The expression of emotion in music. Mind, 89(353), 67–86.

    Article  Google Scholar 

  • Davis, W. (1988). Expression of emotion. American Philosophical Quarterly, 25(4), 279–291.

    Google Scholar 

  • Davis, W. (2003). Meaning, expression, and thought. New York: Cambridge University Press.

    Google Scholar 

  • Davis, W. (2008). Expressing, meaning, showing, and intending to indicate. Intercultural Pragmatics, 5(2), 111–129.

    Article  Google Scholar 

  • Deigh, J. (1994). Cognitivism in the theory of emotions. Ethics, 104(4), 824–854.

    Article  Google Scholar 

  • Dretske, F. (1969). Seeing and knowing. Chicago: University of Chicago Press.

    Google Scholar 

  • Dretske, F. (2006). Perception without awareness. In T. Gendler & J. Hawthorne (Eds.), Perceptual experience (pp. 147–180). New York: Oxford University Press.

    Chapter  Google Scholar 

  • Ekman, P. (1994). All emotions are basic. In P. Ekman & R. Davidson (Eds.), The nature of emotion (pp. 15–19). New York: Oxford University Press.

    Google Scholar 

  • Ekman, P., & Friesen, W. (2003). Unmasking the face. Massachusetts: Malor Books.

    Google Scholar 

  • Eriksson, J. (2010). Self-expression, expressiveness, and sincerity. Acta Analytica, 25, 71–79.

    Article  Google Scholar 

  • Finn, D. (1975). Expression. Mind, 84(334), 192–209.

    Article  Google Scholar 

  • Gallagher, S., & Zahavi, D. (2012). The phenomenological mind (2nd ed.). New York: Routledge.

    Google Scholar 

  • Goodman, N. (1976). Languages of art. Indianapolis: Hackett.

    Google Scholar 

  • Green, M. (2007). Self-expression. New York: Oxford University Press.

    Book  Google Scholar 

  • Green, M. (2010a). Perceiving emotions. Proceedings of the Aristotelian Society Supplementary Volume, 83, 45–61.

    Article  Google Scholar 

  • Green, M. (2010b). Replies to Eriksson, Martin, and Moore. Acta Analytica, 25, 105–117.

    Article  Google Scholar 

  • Green, O. H. (1970). The expression of emotion. Mind, 79(316), 551–568.

    Article  Google Scholar 

  • Griffiths, P. (1998). What emotions really are. Chicago: Chicago University Press.

    Google Scholar 

  • Hampshire, S. (1976). Feeling and expression. In J. Glover (Ed.), The philosophy of mind (pp. 73–83). New York: Oxford University Press.

    Google Scholar 

  • Hanson, N. R. (1958). Patterns of discovery. New York: Cambridge University Press.

    Google Scholar 

  • Izard, C. E. (1977). Human emotions. New York: Plenum Press.

    Book  Google Scholar 

  • Kivy, P. (1980). The corded shell. New Jersey: Princeton University Press.

    Google Scholar 

  • Koch, P. J. (1983). Expressing emotion. Pacific Philosophical Quarterly, 64, 176–191.

    Article  Google Scholar 

  • Mahmoud, M., & Robinson, P. (2011). Interpreting hand-over-face gestures. Affective Computing and Intelligent Interaction, Lecture Notes in Computer Science, 6975, 248–255.

    Article  Google Scholar 

  • Marchi, E., Schuller, B., Batliner, A., Fridenzon, S., Tal, S., & Golan, O. (2012). Emotion in the speech of children with autism spectrum conditions: Prosody and everything else. In T. M. Mitchell (Ed.), WOCCI (pp. 17–24). Maidenhead: McGraw-Hill.

    Google Scholar 

  • Maynard Smith, J., & Harper, D. (2004). Animal signals. New York: Oxford University Press.

    Google Scholar 

  • Mehrabian, A., & Ferris, S. R. (1967). Inference of attitudes from nonverbal communication in two channels. Journal of Consulting Psychology, 31(3), 248–252.

    Article  Google Scholar 

  • Mehrabian, A., & Wiener, M. (1967). Decoding of inconsistent communications. Journal of Personality and Social Psychology, 6(1), 109–114.

    Article  Google Scholar 

  • Morris, J. S., Ohman, A., & Dolan, R. J. (1999). A subcortical pathway to the right amygdala mediating ‘Unseen’ fear. PNAS, 96, 1680–1685.

    Article  Google Scholar 

  • Newen, A., Welpinghus, A., & Juckel, G. (2015). Emotion recognition as pattern recognition: The relevance of perception. Mind and Language, 30(2), 187–208.

    Article  Google Scholar 

  • Orlandi, N. (2011). The innocent eye: Seeing-as without concepts. American Philosophical Quarterly, 48(1), 17–31.

    Google Scholar 

  • Overgaard, S. (2006). Rethinking other minds: Wittgenstein and Levinas on expression. Inquiry, 48(3), 249–274.

    Article  Google Scholar 

  • Panskepp, J. (2000). Emotions as natural kinds within the mammalian brain. In M. Lewis & J. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 137–156). New York: Guilford Press.

    Google Scholar 

  • Prinz, J. (2004). Gut reactions. New York: Oxford University Press.

    Google Scholar 

  • Reddy, V. (2008). How infants know minds. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Russell, J. (2003). Core affect and the psychological construction of emotion. Psychological Review, 110(1), 145–172.

    Article  Google Scholar 

  • Scheler, M. (1970). The nature of sympathy. London: Archon Books.

    Google Scholar 

  • Scherer, K. (2009). The dynamic architecture of emotion: Evidence for the component process model. Cognition & Emotion, 23(7), 1307–1351.

    Article  Google Scholar 

  • Scherer, K. (2005). What are emotions? And how can they be measured? Social Science Information, 44(4), 695–729.

    Article  Google Scholar 

  • Searle, J. (2015). Seeing things as they are. New York: Oxford University Press.

    Book  Google Scholar 

  • Searle, J. (1969). Speech acts: An essay in the philosophy of language. New York: Cambridge University Press.

    Book  Google Scholar 

  • Sellars, W. (1969). Language as thought and as communication. Philosophy and Phenomenological Research, 29(4), 506–527.

    Article  Google Scholar 

  • Smith, J. (2015). The phenomenology of face-to-face mindreading. Philosophy and Phenomenological Research, 90(2), 274–293.

    Article  Google Scholar 

  • Stout, R. (2010). Seeing the anger in someone’s face. Proceedings of the Aristotelian Society Supplementary Volume, 84, 29–43.

    Article  Google Scholar 

  • Taylor, C. (1979). Action as expression. In C. Diamond & J. Teichmann (Eds.), Intention and intentionality: Essays in honour of G.E.M. Anscombe (pp. 73–89). Brighton: Harvester Books.

    Google Scholar 

  • Tomkins, S. (1962). Affect, imagery, consciousness (Vol. 1). New York: Springer.

    Google Scholar 

  • Tormey, A. (1971). The concept of expression. New Jersey: Princeton University Press.

    Google Scholar 

  • Wittgenstein, L. (1980). Remarks on the philosophy of psychology. Chicago: University of Chicago Press.

    Google Scholar 

  • Wittgenstein, L. (2006). Philosophical investigations. Massachusetts: Blackwell Publishing.

    Google Scholar 

  • Wollheim, R. (1968). Expression. In G. N. A. Vesey (Ed.), Human agent, royal institute of philosophy lectures, 1966–1967 (pp. 227–244). New York: Macmillan.

    Google Scholar 

  • Yigit, O. T. (2005). Emoticon usage in task-oriented and socio-emotional contexts in online discussion board. M.S. thesis, The Florida State University, Tallahassee, FL.

  • Zahavi, D. (2007). Expression and empathy. In D. D. Hutt & M. Ratcliffe (Eds.), Folk psychology re-assessed (pp. 25–40). New York: Springer.

    Chapter  Google Scholar 

Download references

Acknowledgments

I would like to thank Rebecca Kukla, Nancy Sherman, Bryce Huebner, Mark Lance, and Andrea Scarantino for commenting on previous drafts of this paper. I would also like to thank two anonymous reviewers for Synthese, whose generous and thoughtful comments helped me to improve the paper dramatically.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Trip Glazer.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Glazer, T. Looking angry and sounding sad: The perceptual analysis of emotional expression. Synthese 194, 3619–3643 (2017). https://doi.org/10.1007/s11229-016-1113-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11229-016-1113-1

Keywords

Navigation