The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions

Article
  • 2.5k Downloads

Abstract

To investigate the time course of emotional expression processing, we recorded ERP responses to stimulus arrays containing neutral versus angry, disgusted, fearful, happy, sad, or surprised faces. In one half of the experiment, the task was to discriminate emotional and neutral facial expressions. Here, an enhanced early frontocentral positivity was elicited in response to emotional as opposed to neutral faces, followed by a broadly distributed positivity and an enhanced negativity at lateral posterior sites. These emotional expression effects were very similar for all six basic emotional expressions. In the other half of the experiment, attention was directed away from the faces toward a demanding perceptual discrimination task. Under these conditions, emotional expression effects were completely eliminated, demonstrating that brain processes involved in the detection and analysis of facial expression require focal attention. The face-specific N170 component was unaffected by any emotional expression, supporting the hypothesis that structural encoding and expression analysis are independent processes.

References

  1. Adolphs, R. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral Cognitive Neuroscience Review, 1, 21–61.CrossRefGoogle Scholar
  2. Adolphs, R., Tranel, D., & Damasio, A. R. ( 2003). Dissociable neural systems for recognizing emotions. Brain & Cognition, 52, 61–69.CrossRefGoogle Scholar
  3. Amaral, D. G., & Price, J. L. (1984). Amygdalo-cortical projections in the monkey (Macaca fasicularis). Journal of Comparative Neurology, 230, 465–496.PubMedCrossRefGoogle Scholar
  4. Amaral, D. G., Price, J. L., Pitkanen, A., & Carmichael, S. T. (1992). Anatomical organization of the primate amygdaloid complex. In J. P. Aggleton (Ed.), The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction (pp. 1–66). New York: Wiley-Liss.Google Scholar
  5. Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: An event-related fMRI study. Neuropsychologia, 7, 817–826.CrossRefGoogle Scholar
  6. Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8, 551–565.PubMedCrossRefGoogle Scholar
  7. Bisti, S., & Sireteanu, R. C. (1976). Sensitivity to spatial frequency and contrast of visual cells in the cat superior colliculus. Vision Research, 16, 247–251.PubMedCrossRefGoogle Scholar
  8. Blair, R. J. R., Morris, J. S., Frith, C. D., Perrett, D. I., & Dolan, R. J. (1999). Dissociable neural responses to facial expressions of sadness and anger. Brain, 122, 883–893.PubMedCrossRefGoogle Scholar
  9. Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M. M., Hyman, S. E., & Rosen, B. R. (1996). Response and habituation of the human amygdala during visual processing of facial expression. Neuron, 17, 875–887.PubMedCrossRefGoogle Scholar
  10. Bruce, V., & Young, A. (1986). Understanding face recognition. British Journal of Psychology, 77, 305–327.PubMedGoogle Scholar
  11. Calder, A. J., Keane, J., Manes, F., Antoun, N., & Young, A. W. (2000). Impaired recognition and experience of disgust following brain injury. Nature Neuroscience, 3, 1077–1078.PubMedCrossRefGoogle Scholar
  12. Calder, A. J., Lawrence, A. D., & Young, A. W. (2001). Neuropsychology of fear and loathing. Nature Reviews Neuroscience, 2, 352–363.PubMedCrossRefGoogle Scholar
  13. Carrasco, M., Penpeci-Talgar, C., & Eckstein, M. (2000). Spatial covert attention increases contrast sensitivity across the CSF: Support for signal enhancement. Vision Research, 40, 1203–1215.PubMedCrossRefGoogle Scholar
  14. Critchley, H. [D.], Daly, E. [M.], Phillips, M., Brammer, M., Bullmore, E., Williams, S. [C.], van Amelsvoort, T., Robertson, D., David, A., & Murphy, D. [G. M.] (2000). Explicit and implicit neural mechanisms for processing of social information from facial expressions: A functional magnetic resonance imaging study. Human Brain Mapping, 9, 93–105.PubMedCrossRefGoogle Scholar
  15. Cuthbert, B. N., Schupp, H. T., Bradley, M. M., Birbaumer, N., & Lang, P. J. (2000). Brain potentials in affective picture processing: Covariation with autonomic arousal and affective report. Biological Psychology, 52, 95–111.PubMedCrossRefGoogle Scholar
  16. Damasio, A. R. (1994). Descartes’ error: Emotion, reason, and the human brain. New York: G. P. Putnam’s Sons.Google Scholar
  17. Diedrich, O., Naumann, E., Maier, S., & Becker, G. (1997). A frontal slow wave in the ERP associated with emotional slides. Journal of Psychophysiology, 11, 71–84.Google Scholar
  18. Eastwood, J. D., Smilek, D., & Merikle, P. M. (2001). Differential attentional guidance by unattended faces expressing positive and negative emotion. Perception & Psychophysics, 63, 1004–1013.CrossRefGoogle Scholar
  19. Eimer, M. (1998). Does the face-specif ic N170 component reflect the activity of a specialized eye detector? NeuroReport, 9, 2945–2948.PubMedCrossRefGoogle Scholar
  20. Eimer, M. (2000). The face-specific N170 component reflects late stages in the structural encoding of faces. NeuroReport, 11, 2319–2324.PubMedCrossRefGoogle Scholar
  21. Eimer, M., & Holmes, A. (2002). An ERP study on the time course of emotional face processing. NeuroReport, 13, 427–431.PubMedCrossRefGoogle Scholar
  22. Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.Google Scholar
  23. Fox, E., Lester, V., Russo, R., Bowles, R. J., Pichler, A., & Dutton, K. (2000). Facial expressions of emotion: Are angry faces detected more efficiently? Cognition & Emotion, 14, 61–92.CrossRefGoogle Scholar
  24. Hansen, C. H., & Hansen, R. D. (1988). Finding the face in the crowd: An anger superiority effect. Journal of Personality & Social Psychology, 54, 917–924.CrossRefGoogle Scholar
  25. Hariri, A. R., Bookheimer, S. Y., & Mazziotta, J. C. (2000). Modulating emotional responses: Effects of a neocortical network on the limbic system. NeuroReport, 11, 43–48.PubMedCrossRefGoogle Scholar
  26. Harmer, C. J., Thilo, K. V., Rothwell, J. C., & Goodwin, G. M. (2001). Transcranial magnetic stimulation of medial-frontal cortex impairs the processing of angry facial expressions. Nature Neuroscience, 4, 17–18.PubMedCrossRefGoogle Scholar
  27. Holmes, A., Vuilleumier, P., & Eimer, M. (2003). The processing of emotional facial expression is gated by spatial attention: Evidence from event-related brain potentials. Cognitive Brain Research, 16, 174–184.PubMedCrossRefGoogle Scholar
  28. Jones, E. G., & Burton, H. (1976). A projection from the medial pulvinar to the amygdala in primates. Brain Research, 104, 142–147.PubMedCrossRefGoogle Scholar
  29. Kawasaki, H., Kaufman, O., Damasio, H., Damasio, A. R., Granner, M., Bakken, H., Hori, T., Howard, M. A., III, & Adolphs, R. (2001). Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex. Nature Neuroscience, 4, 15–16.PubMedCrossRefGoogle Scholar
  30. Lane, R. D., Chua, P. M., & Dolan, R. J. (1999). Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures. Neuropsychologia, 37, 989–997.PubMedCrossRefGoogle Scholar
  31. Lang, P. J., Bradley, M. M., Fitzsimmons, J. R., Cuthbert, B. N., Scott, J. D., Moulder, B., & Nangia, V. (1998). Emotional arousal and activation of the visual cortex: An fMRI analysis. Psychophysiology, 35, 199–210.PubMedCrossRefGoogle Scholar
  32. Le Doux, J. E. (1996). The emotional brain. New York: Simon & Schuster.Google Scholar
  33. Liu, L., Ioannides, A. A., & Streit, M. (1999). Single trial analysis of neurophysiological correlates of the recognition of complex objects and facial expressions of emotion. Brain Topography, 11, 291–303.PubMedCrossRefGoogle Scholar
  34. McCarthy, G., Puce, A., Belger, A., & Allison, T. (1999). Electrophysiological studies of human face perception II. Response properties of face-specific potentials generated in occipitotemporal cortex. Cerebral Cortex, 9, 431–444.PubMedCrossRefGoogle Scholar
  35. Mogg, K., & Bradley, B. P. (1999). Orienting of attention to threatening facial expressions presented under conditions of restricted awareness. Cognition & Emotion, 13, 713–740.CrossRefGoogle Scholar
  36. Mogg, K., McNamara, J., Powys, M., Rawlinson, H., Seiffer, A., & Bradley, B. P. (2000). Selective attention to threat: A test of two cognitive models of anxiety. Cognition & Emotion, 14, 375–399.CrossRefGoogle Scholar
  37. Morris, J. S., Friston, K. J., Buechel, C., Frith, C.D., Young, A.W., Calder, A. J., & Dolan, R. J. (1998). A neuromodulatory role for the human amygdala in processing emotional facial expressions. Brain, 121, 47–57.PubMedCrossRefGoogle Scholar
  38. Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A.W., Calder, A. J., & Dolan, R. J. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature, 383, 812–815.PubMedCrossRefGoogle Scholar
  39. Morris, J. S., Öhman, A., & Dolan, R. J. (1999). A subcortical pathway to the right amygdala mediating “unseen” fear. Proceedings of the National Academy of Sciences, 96, 1680–1685.CrossRefGoogle Scholar
  40. Öhman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130, 466–478.CrossRefGoogle Scholar
  41. Öhman, A., Flykt, A., & Lundqvist, D. (2000). Unconscious emotion: Evolutionary perspectives, psychophysiological data and neuropsychological mechanisms. In R. D. Lane & L. Nadel (Eds.), Cognitive neuroscience of emotion (pp. 296–327). New York: Oxford University Press.Google Scholar
  42. Öhman, A., Lundqvist, D., & Esteves, F. (2001). The face in the crowd revisited: A threat advantage with schematic stimuli. Journal of Personality & Social Psychology, 80,381–3966.CrossRefGoogle Scholar
  43. Pessoa, L., Kastner, S., & Ungerleider, L.G. (2002). Attentional control of the processing of neutral and emotional stimuli. Cognitive Brain Research, 15, 31–45.PubMedCrossRefGoogle Scholar
  44. Pessoa, L., McKenna, M., Gutierrez, E., & Ungerleider, L.G. (2002). Neural processing of emotional faces requires attention. Proceedings of the National Academy of Sciences, 99, 11458–11463.CrossRefGoogle Scholar
  45. Phillips, M. L., Young, A.W., Scott, S.K., Calder, A. J., Andrew,C., Giampietro, V., Williams, S. C.R., Bullmore, E. T., Brammer, M., & Gray, J. A. (1998). Neural responses to facial and vocal expressions of fear and disgust. Proceedings of the Royal Society London: Series B, 265, 1809–1817.CrossRefGoogle Scholar
  46. Phillips, M. L., Young, A.W., Senior, C., Brammer, M., Andrew, C., Calder, A. J., Bullmore, E. T., Perrett, D. I., Rowland, D., & Williams, S. C. R., et al. (1997). A specif ic neural substrate for perceiving facial expressions of disgust. Nature, 389, 495–498.PubMedCrossRefGoogle Scholar
  47. Pizzagalli, D., Regard, M., & Lehmann, D. (1999). Rapid emotional face processing in the human right and left brain hemispheres: An ERP study. NeuroReport, 10, 2691–2698.PubMedCrossRefGoogle Scholar
  48. Rapcsak, S.Z., Galper, S.R., Comer, J.F., Reminger, S.L., Nielsen,L., Kaszniak, A. W., Verfaellie, M., Laguna, J. F., Labiner, D. M., & Cohen, R. A. (2000). Fear recognition deficits after focal brain damage. Neurology, 54, 575–581.PubMedGoogle Scholar
  49. Rolls, E. T. (1999). The brain and emotion. Oxford: Oxford University Press.Google Scholar
  50. Sato, W., Kochiyama, T., Yoshikawa, S., & Matsumura, M. (2001). Emotional expression boosts early visual processing of the face: ERP recording and its decomposition by independent component analysis. NeuroReport, 12, 709–714.PubMedCrossRefGoogle Scholar
  51. Schyns, P. G., & Oliva, A. (1999). Dr. Angry and Mr. Smile: When categorization flexibly modifies the perception of faces in rapid visual presentations. Cognition, 69, 243–265.PubMedCrossRefGoogle Scholar
  52. Sprengelmeyer, R., Rausch, M., Eysel, U. T., & Przuntek, H. (1998). Neural structures associated with recognition of facial expressions of basic emotions. Proceedings of the Royal Society London: Series B, 265, 1927–1931.CrossRefGoogle Scholar
  53. Stepniewska, I., Qi, H. X., & Kaas, J. H. (1999). Do superior colliculus projection zones in the inferior pulvinar project to MT in primates? European Journal of Neuroscience, 11, 469–480.PubMedCrossRefGoogle Scholar
  54. Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2001). Effects of attention and emotion on face processing in the human brain: An event-related fMRI study. Neuron, 30, 829–841.PubMedCrossRefGoogle Scholar
  55. Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2003). Distinct spatial frequency sensitivities for processing faces and emotional expressions. Nature Neuroscience, 6, 624–631.PubMedCrossRefGoogle Scholar
  56. Vuilleumier, P., & Schwartz, S. (2001a). Beware and be aware: Capture of spatial attention by fear-related stimuli in neglect. Neuro Report, 12, 1119–1122.Google Scholar
  57. Vuilleumier, P., & Schwartz, S. (2001b). Emotional expressions capture attention. Neurology, 56, 153–158.PubMedGoogle Scholar
  58. Whalen, P. J., Rach, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. B., & Jenike, M. A. (1998). Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. Journal of Neuroscience, 18, 411–418.PubMedGoogle Scholar
  59. Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., Wright, C. I., & Rauch, S. L. (2001). A functional MRI study of human amygdala responses to facial expressions of fear versus anger. Emotion, 1, 70–83.PubMedCrossRefGoogle Scholar
  60. Yeterian, E. H., & Pandya, D. N. (1991). Corticothalamic connections of the superior temporal sulcus in rhesus monkeys. Experimental Brain Research, 83, 268–284.CrossRefGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 2003

Authors and Affiliations

  • Martin Eimer
    • 1
  • Amanda Holmes
    • 1
  • Francis P. McGlone
    • 2
  1. 1.Department of Psychology, Birkbeck CollegeUniversity of LondonLondonEngland
  2. 2.Port Sunlight LaboratoriesUnilever ResearchWirralEngland

Personalised recommendations