Skip to main content
Log in

Faces and situational Agency

  • Published:
Topoi Aims and scope Submit manuscript

Abstract

Though there are many challenges to Ekman’s thesis that there are basic emotions with universal corresponding facial expressions, our main criticism revolves around the extent to which grounding situations alter how people read faces. To that end, we recruit testifying experimental studies that show identical faces expressing varying emotions when contextualized differently. Rather than dismissing these as illusions, we start with the position—generally favored by embodied thinkers—that situations are primary: they are where specifiable and hence knowable properties first show up. We further argue that situationally inflected emotional expressions are informationally meaningful. We reject the idea that reading expressions is primarily about ascertaining internal mental states, arguing instead that people are registering overall situations when looking at faces. However, if mind is understood as a situated phenomenon that extends into active ecological frames, then one can still argue that mindreading is going on. Although we do not claim isolated things like cliffs or cars have agency, we speculate networked systems with cliffs, people, cars, bears, etc., collectively function with intentionality, more so if advancing a robust situated mind thesis, contra figures like Dennett who argue that people over-impute mind to things. Our position has practical implications insofar as it casts doubts on recent attempts to develop AI systems that extract emotional intent out of facial expressions since many of these systems are grounded on Ekman’s basic view.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. For bikini example, visit https://www.youtube.com/watch?v=hCAE0t6KwJY.

  2. For Vader example, visit https://www.youtube.com/watch?v=kRvvlRbHfqM.

  3. Similarly, Peter Hujar’s Orgasmic Man series consists of photographs of faces of men having orgasms, some of whom look sad or agonized precisely when background contexts are missing. One of these portraits was used for the cover of Hanya Yanagihara’s novel, A Little Life.

References

  • Aviezer H, Trope Y, Todorov A (2012a) Holistic person processing: Faces with bodies tell the whole story. J Personal Soc Psychol 103:20–37

    Article  Google Scholar 

  • Aviezer H, Yaacov T, Todorov A (2012b) Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science 338(6111):1225–1229

    Article  Google Scholar 

  • Baron-Cohen S (1995) Mindblindness: An Essay on Autism and Theory of Mind. MIT Press, Cambridge, MA

  • Barrett Feldman L, Adolphs R, Marsella S, Martinez A, Pollak S (2019) Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychol Sci Public Interest 20(1):1–68

    Article  Google Scholar 

  • Berridge K (2018) Evolving concepts of emotion and motivation. Front Psychol 9. https://doi.org/10.3389/fpsyg.2018.01647

  • Block N (2014) Seeing-as in the light of Vision Science. Philos Phenomenol Res 89:560–572. https://doi.org/10.1111/phpr.12135

    Article  Google Scholar 

  • Boden M (2006) Mind as machine: A history of cognitive science, vol 1, 2 edn. Oxford University Press, Oxford

    Google Scholar 

  • Boutet I, Chaudhuri A (2001) Multistability of overlapped face stimuli is dependent upon orientation. Perception 30:743–753. https://doi.org/10.1068/p3183

    Article  Google Scholar 

  • Brooks R (1990) Elephants don’t play chess. Robot Auton Syst 6:3–15

    Article  Google Scholar 

  • Buck R (1994) Social and emotional functions in facial expression and communication: The readout hypothesis. Biol Psychol 38:95–115

    Article  Google Scholar 

  • Collingwood RG (1939) An Autobiography. Oxford University Press, Oxford

    Google Scholar 

  • Carroll JM, Russell JA (1996) Do facial expressions signal specific emotions? Judging emotion from the face in context. J Personal Soc Psychol 70:205–218

    Article  Google Scholar 

  • Carroll N (1993) Toward a theory of point-of-view editing: Communication, emotion, and the movies. Poetics Today 14:123–141

    Article  Google Scholar 

  • Chemero A (2009) Radical Embodied Cognitive Science. The MIT Press, Cambridge, MA

  • Clark A, Chalmers D (1998) The extended mind. Analysis 58:7–19

    Article  Google Scholar 

  • Crawford K (2021) The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence. Yale University Press, New Haven

  • Crippen M (2016) Dewey, enactivism and Greek thought. In: Madzia R, Jung M (eds) Pragmatism and embodied cognitive science: From bodily interaction to symbolic articulation. De Gruyter, Berlin, pp 229–246

    Google Scholar 

  • Crippen M (2017) Embodied cognition and perception: Dewey, science and skepticism. Contemp Pragmatism 14:121–134. https://doi.org/10.1163/18758185-01401007

    Article  Google Scholar 

  • Crippen M (2019) Pragmatic evolutions of the Kantian a priori: From the mental to the bodily. In: Skowronski K, Pihlstrom S, (eds), Pragmatist Kant. Nordic Pragmatism Network, Helsinki, pp 150–171

  • Crippen M (2020) Enactive pragmatism and ecological psychology. Front Psychol 11. https://doi.org/10.3389/fpsyg.2020.538644

  • Crippen M (2021) Aesthetics and Action: Situations, Emotional Perception and the Kuleshov Effect. Synthese 198(S9):2345–2363. https://doi.org/10.1007/s11229-019-02110-2

    Article  Google Scholar 

  • Crippen M, Schulkin J (2020) Mind ecologies: Body, brain, and world. Columbia University Press, New York

    Book  Google Scholar 

  • Crivelli C, Jarillo S, Fridlund AJ (2016) A multidisciplinary approach to research in small-scale societies: studying emotions and facial expression in the field. Front Psychol. https://doi.org/10.3389/fpsyg.2016.01073

    Article  Google Scholar 

  • De Jaegher H (2009) Social understanding through direct perception? Yes, by interacting. Conscious Cogn 18:535–542. https://doi.org/10.1016/j.concog.2008.10.007

    Article  Google Scholar 

  • Dennett D (2006) Breaking the spell: Religion as a natural phenomenon. Viking, New York

    Google Scholar 

  • Davies, S (2006) Artistic expression and the hard case of pure music. In: Kieran M (ed), Contemporary debates in aesthetics and the philosophy of art, Blackwell, Malden, pp 179–191

  • Dewey J (1920) Reconstruction in philosophy. Henry Holt and Company, New York

    Book  Google Scholar 

  • Dewey, J (1925) Experience and nature. Open Court, Chicago

  • Dewey J (1929) The quest for certainty. Minton, Balch and Company, New York

    Google Scholar 

  • Dewey J (1934) Art as experience. Minton, Balch and Company, New York

    Google Scholar 

  • Di Paolo E, Buhrmann T, Barandiaran X (2017) Sensorimotor life: An enactive proposal. Oxford University Press, Oxford

    Book  Google Scholar 

  • Di Paolo E, Cuffari EC, De Jaegher H (2018) Linguistic Bodies: The Continuity Between Life and Language. MIT Press, Cambridge, MA

  • Dumouchel P (2022) Making Faces. Topoi. https://doi.org/10.1007/s11245-022-09799-w

  • Dreyfus H (1991) Being-in-the-world: A commentary on Heidegger’s Being and time. division I, London: MIT Press, Cambridge, MA

    Google Scholar 

  • Dreyfus H (2007) Why Heideggerian AI failed and how fixing it would require making it more Heideggerian. Philosophical Psychol 20:247–268. https://doi.org/10.1080/09515080701239510

    Article  Google Scholar 

  • Du S, Tao Y, Martinez AM (2014) Compound facial expressions of emotion. Proceedings of the National Academy of Sciences, 111, E1454-E1462. https://doi.org/10.1073/pnas.1322355111

  • Ekman P (1972) Universals and cultural differences in facial expressions of emotion. In: Cole JK (ed.) Nebraska symposium on motivation (vol. 19), 207–283). Lincoln: University of Nebraska Press

  • Ekman P (1992) Are there basic emotions? Psychol Rev 99:550–553

    Article  Google Scholar 

  • Ekman P (2016) What scientists who study emotion agree about. Perspect Psychol Sci 11:31–34. https://doi.org/10.1177/1745691615596992

    Article  Google Scholar 

  • Ekman P, Friesen WV (2003) Unmasking the face: A guide to recognizing emotions from facial clues. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Ekman P, O’Sullivan M (1988) The role of context in interpreting facial expression: Comment on Russell and Fehr (1987). J Exp Psychol: General, 117, 86–88

  • Feigenbaum E (1968) Artificial intelligence: Themes in the second decade (memo 67). Stanford University Intelligence Project, Stanford

    Google Scholar 

  • Feldman Barrett L (2012) Emotions are real. Emotion 12(3):413–429. https://doi.org/10.1037/a0027555

    Article  Google Scholar 

  • Feldman Barrett L, Gendron M, Huang Y (2009) Do discrete emotions exist? Philos Psychol 22:427–437. https://doi.org/10.1080/09515080903153634

    Article  Google Scholar 

  • Gallagher S (2008) Understanding Others: Embodied Social Cognition. In: Calvo P, Gomila T (eds) Handbook of Cognitive Science: An Embodied Approach. Elsevier, Boston, pp 439–452

  • Gallagher S (2017) Enactivist Interventions: Rethiking the Mind. Oxford University Press. https://doi.org/10.1093/oso/9780198794325.001.0001

  • Gallagher S, Varga S (2014) Social Constraints on the Direct Perception of Emotions and Intentions. Topoi 33:195–199

    Article  Google Scholar 

  • Gallese V, Goldman A (1998) Mirror neurons and the simulation theory of mind-reading. Trends Cogn Sci 2(12):493–501

    Article  Google Scholar 

  • Gibson JJ (1966) The senses considered as perceptual systems. Houghton-Mifflin, Boston

    Google Scholar 

  • Gibson JJ (1979) The ecological approach to visual perception. Houghton-Mifflin, Boston

    Google Scholar 

  • Gibson, E. J., and Pick, A. (2000). An ecological approach to perceptual learning and development. Oxford University Press, Oxford

  • Gopnik A, Wellmann HM (1992) Why the Child’s theory of mind really is a theory. Mind & Language 7(1–2):145–171. https://doi.org/10.1111/j.1468-0017.1992.tb00202.x

    Article  Google Scholar 

  • Gordon RM (1986) Folk psychology as simulation. Mind Lang 1:158–171. https://doi.org/10.1111/j.1468-0017.1986.tb00324.x

    Article  Google Scholar 

  • Gu S, Wang F, Patel NP, Bourgeois JA, Huang JH (2019) A model for basic emotions using observations of behavior in drosophila. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00781

  • Heal J (1986) Replication and functionalism. In: Butterfield J (ed) Language, Mind and Logic. Cambridge University Press, Cambridge, 135-150

  • Heaven D (2020) Why faces don’t always tell the truth about feelings. Nature 578(7796):502–504

    Article  Google Scholar 

  • Heras-Escribano M (2019) Pragmatism, enactivism, and ecological psychology: towards a unified approach to post-cognitivism. Synthese, 0123456789. https://doi.org/10.1007/s11229-019-02111-1

  • Hutto D, Myin E (2013) Radicalizing enactivism: Basic minds without content. MIT Press, Cambridge, MA

  • Jack R, Garrod O, Yu H, Caldara R, Schyns P (2012) Facial expressions of emotion are not culturally universal. Proceedings of the National Academy of Sciences 109:7241–7244. doi:https://doi.org/10.1073/pnas.1200155109

  • Jack R, Sun W, Delis I, Garrod O, Schyns P (2016) Four not six: Revealing culturally common facial expressions of emotion. J Exp Psychol Gen 145:708–730

    Article  Google Scholar 

  • Kaplan R, Kaplan S (1989) The experience of nature: A psychological perspective. Cambridge University Press, Cambridge

  • Koffka K (1935) Principles of gestalt psychology. Harcourt, Brace and Company, New York

    Google Scholar 

  • Köhler W (1947) Gestalt psychology: An introduction to new concepts in modern psychology. Liveright, New York

    Google Scholar 

  • Krueger J (2021) Enactivism, other minds, and mental disorders. Synthese 198(S1):365–389. https://doi.org/10.1007/s11229-019-02133-9

    Article  Google Scholar 

  • Lewis D (1972) Psychophysical and theoretical identifications. Australas J Philos 50(3):249–258

    Article  Google Scholar 

  • Merleau-Ponty M (1945/1962) Phenomenology of perception (trans: Smith C) Routledge, London

  • Merleau-Ponty M (1947/1964) Film and the new psychology. In Sense and non-sense (trans: Dreyfus H, Dreyfus P) Northwestern University Press, Evanston, pp 43–59

  • Myin E, van den Herik JC (2020) A twofold tale of one mind: revisiting REC’s multi-storey story. Synthese. https://doi.org/10.1007/s11229-020-02857-z

    Article  Google Scholar 

  • Nakagaki T, Yamada H, Tóth Á (2000) Maze-solving by an amoeboid organism. Nature 407(6803):470–470. https://doi.org/10.1038/35035159

    Article  Google Scholar 

  • Overgaard S (2017) Enactivism and the erception of others’ emotions. Midwest Stud Philos 41:105–129. https://doi.org/10.1111/misp.12068

    Article  Google Scholar 

  • Peirce, CS (1878). How to make our ideas clear. Pop Sci Month 12:286–302

  • Pudovkin V (1926) /1968 Film technique. In Montagu I (ed. & trans) Film technique and film acting London: Vision Press, pp. 19–220

  • Riener CR, Stefanucci JK, Proffitt DR, Clore GL (2011) An effect of mood on the perception of geographical slant. Cogn Emot 25:174–182

    Article  Google Scholar 

  • Rolla G, Figueiredo N (2021) Bringing forth a world, literally. Phenomenol Cogn Sci. https://doi.org/10.1007/s11097-021-09760-z

  • Rolla G, Huffermann J (2021) Converging enactivisms: radical enactivism meets linguistic bodies. Adapt Behav. https://doi.org/10.1177/10597123211020782

    Article  Google Scholar 

  • Rosar, WH (1994) Film music and Heinz Werner’s theory of physiognomic perception. Psychomusicology J Res Music Cognit, 13:154–165

    Article  Google Scholar 

  • Rowlands M (2010) The New Science of the Mind: From Extended Mind to Embodied Phenomenology. MIT Press, Cambridge, MA

  • Russell J (1993) Forced-choice response format in the study of facial expression. Motivation and Emotion 17:41–51

    Article  Google Scholar 

  • Russell J (1994) Is there universal recognition of emotion from facial expression? A review of cross- cultural studies. Psychol Bull 115:102–141

    Article  Google Scholar 

  • Russell J (2006) Emotions are not modules. Can J Philos 36:53–71

    Google Scholar 

  • Simon H (1969) The Sciences of the Artificial. Cambridge, MA: MIT Press, 1969

  • Smith M, Cottrell G, Gosselin F, Schyns P (2005) Transmitting and decoding facial expressions. Psychol Sci 16:184–189

    Article  Google Scholar 

  • Stadler M, Kruse P (1995) The function of meaning in cognitive order formation. Ambiguity in mind and nature: Multistable cognitive phenomena. Springer, Berlin, pp 6–21

    Google Scholar 

  • Sterelny K (2010) Minds: Extended or scaffolded? Phenomenol Cogn Sci 9(4):465–481. https://doi.org/10.1007/s11097-010-9174-y

    Article  Google Scholar 

  • Thompson E (2004) Life and mind: From autopoiesis to neurophenomenology. A tribute to Francisco Varela. Phenomenol Cogn Sci 4:381–398

    Article  Google Scholar 

  • Tomkins S, McCarter R (1964) What and where are the primary effects: Some evidence for a theory. Percept Mot Skills 18:119–158

    Article  Google Scholar 

  • Varela F, Thompson E, Rosch E (1991) The embodied mind. MIT Press, Cambridge, MA

    Book  Google Scholar 

  • Walter WG (1950) An imitation of life. Sci Am 182(5):42–45

    Article  Google Scholar 

  • Weinberger S (2010) Airport security: Intent to deceive. Nature 465(7297):412–415

    Article  Google Scholar 

  • Werner H (1927/1978) On physiognomic modes of perception and their experimental investigation. In: Barten, Franklin MB (ed) Developmental processes: Heinz Werner’s selected writings, vol 1. International Universities Press, New York, pp 149–152

  • Wilson RA (2004) Boundaries of the Mind. Cambridge University Press, Cambridge

    Google Scholar 

  • Wittgenstein L (1953) Philosophical investigations. Trans. GEM. Anscombe. Oxford: Basil Blackwell, 1953

Download references

Acknowledgements

This paper is part of the special issue of Topoi “What’s so special about faces? Visages at the crossroad between philosophy, semiotics and cognition”, edited by Marco Viola and Massimo Leone, which results from a project that has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (Grant Agreement No 819649-FACETS). We are grateful to Aimée Lê for her conceptual and linguistic suggestions. We also thank Marco Viola, Massimo Leone and the anonymous reviewers for their helpful feedback.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthew Crippen.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Crippen, M., Rolla, G. Faces and situational Agency. Topoi 41, 659–670 (2022). https://doi.org/10.1007/s11245-022-09816-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11245-022-09816-y

Keywords

Navigation