Emotional scenes elicit more pronounced self-reported emotional experience and greater EPN and LPP modulation when compared to emotional faces

  • Nathaniel ThomEmail author
  • Justin Knight
  • Rod Dishman
  • Dean Sabatinelli
  • Douglas C. Johnson
  • Brett Clementz


Emotional faces and scenes carry a wealth of overlapping and distinct perceptual information. Despite widespread use in the investigation of emotional perception, expressive face and evocative scene stimuli are rarely assessed in the same experiment. Here, we evaluated self-reports of arousal and pleasantness, as well as early and late event-related potentials (e.g., N170, early posterior negativity [EPN], late positive potential [LPP]) as subjects viewed neutral and emotional faces and scenes, including contents representing anger, fear, and joy. Results demonstrate that emotional scenes were rated as more evocative than emotional faces, as only scenes produced elevated self-reports of arousal. In addition, viewing scenes resulted in more extreme ratings of pleasantness (and unpleasantness) than did faces. EEG results indicate that both expressive faces and emotional scenes evoke enhanced negativity in the N170 component, while the EPN and LPP components show significantly enhanced modulation only by scene, relative to face stimuli. These data suggest that viewing emotional scenes results in a more pronounced emotional experience that is associated with reliable modulation of visual event-related potentials that are implicated in emotional circuits in the brain.


Emotion N170 Late-positive potential 


  1. Ashley, V., Vuilleumier, P., & Swick, D. (2004). Time course and specificity of event-related potentials to emotional expressions. Neuroreport, 15(1), 211–216.CrossRefPubMedGoogle Scholar
  2. Batty, M., & Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Brain Reserch Cognitive Brain Research, 17(3), 613–620.CrossRefGoogle Scholar
  3. Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8(6), 551–565.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Blau, V. C., Maurer, U., Tottenham, N., & McCandliss, B. D. (2007). The face-specific N170 component is modulated by emotional facial expression. Behavioral and Brain Functions, 3, 7–19.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Bradley, M. M., Hamby, S., Low, A., & Lang, P. J. (2007). Brain potentials in perception: Picture complexity and emotional arousal. Psychophysiology, 44(3), 364–373.CrossRefPubMedGoogle Scholar
  6. Bruce, V., & Young, A. (1986). Understanding face recognition. British Journal of Psychology, 77, 305–327.CrossRefPubMedGoogle Scholar
  7. Cacioppo, J. T., Crites, S. L., & Gardner, W. L. (1996). Attitudes to the right: Evaluative processing is associated with lateralized late positive event-related brain potentials. Personality and Social Psychology Bulletin, 22(12), 1205–1219.CrossRefGoogle Scholar
  8. Cano, M. E., Class, Q. A., & Polich, J. (2009). Affective valence, stimulus attributes, and P300: Color vs. black/white and normal vs. scrambled images. International Journal of Psychophysiology, 71(1), 17–24.CrossRefPubMedGoogle Scholar
  9. Carretié, L., Hinojosa, J. A., López-Martín, S., & Tapia, M. (2007). An electrophysiological study on the interaction between emotional content and spatial frequency of visual stimuli. Neuropsychologia, 45(6), 1187.CrossRefPubMedGoogle Scholar
  10. Carretié, L., Albert, J., López-Martín, S., & Tapia, M. (2009). Negative brain: An integrative review on the neural processes activated by unpleasant stimuli. International Journal of Psychophysiology, 71(1), 57.CrossRefPubMedGoogle Scholar
  11. Carretié, L., Hinojosa, J. A., & Mercado, F. (2003). Cerebral patterns of attentional habituation to emotional visual stimuli. Psychophysiology, 40(3), 381–388.CrossRefPubMedGoogle Scholar
  12. Carver, C. S., & Harmon-Jones, E. (2009). Anger is an approach-related affect: Evidence and implications. Psychological Bulletin, 135(2), 183.CrossRefPubMedGoogle Scholar
  13. Codispoti, M., Ferrari, V., Junghöfer, M., & Schupp, H. T. (2006). The categorization of natural scenes: Brain attention networks revealed by dense sensor ERPs. NeuroImage, 32(2), 583–591.CrossRefPubMedGoogle Scholar
  14. Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29, 162–173.CrossRefPubMedGoogle Scholar
  15. Cuthbert, B. N., Schupp, H. T., Bradley, M. M., Birbaumer, N., & Lang, P. J. (2000). Brain potentials in affective picture processing: Covariation with autonomic arousal and affective report. Biological Psychology, 52(2), 95–111.CrossRefPubMedGoogle Scholar
  16. Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9–21.CrossRefPubMedGoogle Scholar
  17. Donchin, E., & Coles, M. G. H. (1998). Context updating and the P300. Behavioral and Brain Sciences, 21(01), 152–154.CrossRefGoogle Scholar
  18. Eimer, M., & Holmes, A. (2002). An ERP study on the time course of emotional face processing. Neuroreport, 13(4), 427–431.CrossRefPubMedGoogle Scholar
  19. Eimer, M., & Holmes, A. (2007). Event-related brain potential correlates of emotional face processing. Neuropsychologia, 45(1), 15–31.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Eimer, M., Holmes, A., & McGlone, F. P. (2003). The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions. Cognitive, Affective, & Behavioral Neuroscience, 3(2), 97–110.CrossRefGoogle Scholar
  21. Ferree, T. C., Luu, P., Russell, G. S., & Tucker, D. M. (2001). Scalp electrode impedance, infection risk, and EEG data quality. Clinical Neurophysiology, 112(3), 536–544.CrossRefPubMedGoogle Scholar
  22. Ferri, J., Weinberg, A., & Hajcak, G. (2012). I see people: The presence of human faces impacts the processing of complex emotional scenes. Social Neuroscience, 7(4), 436–443.CrossRefPubMedGoogle Scholar
  23. Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995). Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold. Magnetic Resonance in Medicine, 33, 636–647.CrossRefPubMedGoogle Scholar
  24. Gilmore, C. S., Clementz, B. A., & Berg, P. (2009). Hemispheric differences in auditory oddball responses during monaural versus binaural stimulation. International Journal of Psychophysiology, 73, 326–333.CrossRefPubMedPubMedCentralGoogle Scholar
  25. Greischar, L. L., Burghy, C. A., van Reekum, C. M., Jackson, D. C., Pizzagalli, D. A., Mueller, C., & Davidson, R. J. (2004). Effects of electrode density and electrolyte spreading in dense array electroencephalographic recording. Clinical Neurophysiology, 115(3), 710–720.CrossRefPubMedGoogle Scholar
  26. Hajcak, G., Moser, J. S., & Simons, R. F. (2006). Attending to affect: Appraisal strategies modulate the electrocortical response to arousing pictures. Emotion, 6(3), 517–522.CrossRefPubMedGoogle Scholar
  27. Harmon-Jones, E. (2007). Trait anger predicts relative left frontal cortical activation to anger-inducing stimuli. International Journal of Psychophysiology, 66(2), 154–160.CrossRefPubMedGoogle Scholar
  28. Harmon-Jones, E., & Allen, J. J. (1998). Anger and frontal brain activity: EEG asymmetry consistent with approach motivation despite negative affective valence. Journal of Personality and Social Psychology, 74(5), 1310–1316.CrossRefPubMedGoogle Scholar
  29. Harmon-Jones, E., Lueck, L., Fearn, M., & Harmon-Jones, C. (2006). The effect of personal relevance and approach-related action expectation on relative left frontal cortical activity. Psychological Science, 17(5), 434–440.CrossRefPubMedGoogle Scholar
  30. Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4(6), 223–233.CrossRefPubMedGoogle Scholar
  31. Holmes, A., Nielsen, M. K., Tipper, S., & Green, S. (2009). An electrophysiological investigation into the automaticity of emotional face processing in high versus low trait anxious individuals. Cognitive, Affective, & Behavioral Neuroscience, 9(3), 323–334.CrossRefGoogle Scholar
  32. Holmes, A., Vuilleumier, P., & Eimer, M. (2003). The processing of emotional facial expression is gated by spatial attention: Evidence from event-related brain potentials. Brain Research Cognitive Brain Research, 16(2), 174–184.CrossRefPubMedGoogle Scholar
  33. Jung, T. P., Makeig, S., Humphries, C., Lee, T. W., McKeown, M. J., Iragui, V., & Sejnowski, T. J. (2000). Removing electroencephalographic artifacts by blind source separation. Psychophysiology, 37(2), 163–178.CrossRefPubMedGoogle Scholar
  34. Junghöfer, M., Bradley, M. M., Elbert, T. R., & Lang, P. J. (2001). Fleeting images: A new look at early emotion discrimination. Psychophysiology, 38(2), 175–178.CrossRefPubMedGoogle Scholar
  35. Junghöfer, M., Elbert, T., Tucker, D. M., & Rockstroh, B. (2000). Statistical control of artifacts in dense array EEG/MEG studies. Psychophysiology, 37(4), 523–532.CrossRefPubMedGoogle Scholar
  36. Kaestner, E. J., & Polich, J. (2011). Affective recognition memory processing and event-related brain potentials. Cognitive, Affective, & Behavioral Neuroscience, 11(2), 186–198.CrossRefGoogle Scholar
  37. Kanwisher, N. (2001). Faces and places: Of central (and peripheral) interest. Nature Neuroscience, 4(5), 455–456.PubMedGoogle Scholar
  38. Keil, A., Bradley, M. M., Hauk, O., Rockstroh, B., Elbert, T., & Lang, P. J. (2002). Large-scale neural correlates of affective picture processing. Psychophysiology, 39(5), 641–649.CrossRefPubMedGoogle Scholar
  39. Keil, A., Müller, M. M., Gruber, T., Wienbruch, C., Stolarova, M., & Elbert, T. (2001). Effects of emotional arousal in the cerebral hemispheres: A study of oscillatory brain activity and event-related potentials. Clinical Neurophysiology, 112(11), 2057.CrossRefPubMedGoogle Scholar
  40. Krolak-Salmon, P., Fischer, C., Vighetto, A., & Mauguière, F. (2001). Processing of facial emotional expression: Spatio-temporal data as assessed by scalp event-related potentials. The European Journal of Neuroscience, 13(5), 987–994.CrossRefPubMedGoogle Scholar
  41. Krusemark, E. A., Campbell, W. A., & Clementz, B. A. (2008). Attributions, deception, and eventrelated potentials: An investigation of the self-serving bias. Psychophysiology, 45, 511–515.CrossRefPubMedGoogle Scholar
  42. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual (Technical Report A-8). Gainesville: University of Florida.Google Scholar
  43. Loew, A., Lang, P. J., Smith, J. C., & Bradley, M. M. (2008). Both predator and prey: Emotional arousal in threat and reward. Psychological Science, 19(9), 865–873.CrossRefGoogle Scholar
  44. McCarthy, G., Puce, A., Gore, J. C., & Allison, T. (1997). Face-specific processing in the human fusiform gyrus. Journal of Cognitive Neuroscience, 9(5), 605–610.CrossRefPubMedGoogle Scholar
  45. Mikels, J. A., Fredrickson, B. L., Larkin, G. R., Lindberg, C. M., Maglio, S. J., & Reuter-Lorenz, P. A. (2005). Emotional category data on images from the International Affective Picture System. Behavior Research Methods, 37(4), 626–630.CrossRefPubMedPubMedCentralGoogle Scholar
  46. Munte, T. F., Brack, M., Grootheer, O., Wieringa, B. M., Matzke, M., & Johannes, S. (1998). Brain potentials reveal the timing of face identity and expression judgments. Neuroscience Research, 30(1), 25–34.CrossRefPubMedGoogle Scholar
  47. Olofsson, J. K., Nordin, S., Sequeira, H., & Polich, J. (2008). Affective picture processing: An integrative review of ERP findings. Biological Psychology, 77(3), 247–265.CrossRefPubMedGoogle Scholar
  48. Onton, J., Westerfield, M., Townsend, J., & Makeig, S. (2006). Imaging human EEG dynamics using independent component analysis. Neuroscience and Biobehavioral Reviews, 30(6), 808–822.CrossRefPubMedGoogle Scholar
  49. Paulus, M. P., Simmons, A. N., Fitzpatrick, S. N., Potterat, E. G., Van Orden, K. F., Bauman, J., & Swain, J. L. (2010). Differential brain activation to angry faces by elite warfighters: Neural processing evidence for enhanced threat detection. PLoS ONE, 5(4), e10096.CrossRefPubMedPubMedCentralGoogle Scholar
  50. Pizzagalli, D. A., Lehmann, D., Hendrick, A. M., Regard, M., Pascual-Marqui, R. D., & Davidson, R. J. (2002). Affective judgments of faces modulate early activity (not similar to 160 ms) within the fusiform gyri. NeuroImage, 16(3), 663–677.CrossRefPubMedGoogle Scholar
  51. Puce, A., Allison, T., Spencer, S. S., Spencer, D. D., & McCarthy, G. (1997). Comparison of cortical activation evoked by faces measured by intracranial field potentials and functional MRI: Two case studies. Human Brain Mapping, 5(4), 298–305.CrossRefPubMedGoogle Scholar
  52. Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., & Crommelinck, M. (2000). The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: An electrophysiological account of face-specific processes in the human brain. Neuroreport, 11(1), 69–74.CrossRefPubMedGoogle Scholar
  53. Sabatinelli, D., Fortune, E. E., Li, Q. Y., Siddiqui, A., Krafft, C., Oliver, W. T., & Jeffries, J. (2011). Emotional perception: Meta-analyses of face and natural scene processing. NeuroImage, 54(3), 2524–2533.CrossRefPubMedGoogle Scholar
  54. Sabatinelli, D., Lang, P. J., Keil, A., & Bradley, M. M. (2007). Emotional perception: Correlation of functional MRI and event-related potentials. Cerebral Cortex, 17(5), 1085–1091.CrossRefPubMedGoogle Scholar
  55. Sato, W., Kochiyama, T., Yoshikawa, S., & Matsumura, M. (2001). Emotional expression boosts early visual processing of the face: ERP recording and its decomposition by independent component analysis. Neuroreport, 12(4), 709–714.CrossRefPubMedGoogle Scholar
  56. Schacht, A., & Sommer, W. (2009). Emotions in word and face processing: Early and late cortical responses. Brain and Cognition, 69(3), 538.CrossRefPubMedGoogle Scholar
  57. Schupp, H. T., Junghöfer, M., Weike, A. I., & Hamm, A. O. (2003a). Attention and emotion: An ERP analysis of facilitated emotional stimulus processing. Neuroreport, 14(8), 1107–1110.CrossRefPubMedGoogle Scholar
  58. Schupp, H. T., Junghöfer, M., Weike, A. I., & Hamm, A. O. (2003b). Emotional facilitation of sensory processing in the visual cortex. Psychological Science, 14(1), 7–13.CrossRefPubMedGoogle Scholar
  59. Schupp, H. T., Junghöfer, M., Weike, A. I., & Hamm, A. O. (2004a). The selective processing of briefly presented affective pictures: An ERP analysis. Psychophysiology, 41(3), 441–449.CrossRefPubMedGoogle Scholar
  60. Schupp, H. T., Ohman, A., Junghöfer, M., Weike, A. I., Stockburger, J., & Hamm, A. O. (2004b). The facilitated processing of threatening faces: An ERP analysis. Emotion, 4(2), 189–200.CrossRefPubMedGoogle Scholar
  61. Schupp, H. T., Cuthbert, B. N., Bradley, M. M., Cacioppo, J. T., Ito, T., & Lang, P. J. (2000). Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology, 37(2), 257–261.CrossRefPubMedGoogle Scholar
  62. Schupp, H. T., Flaisch, T., Stockburger, J., & Junghöfer, M. (2006). Emotion and attention: Event-related brain potential studies. Progress in Brain Research, 156, 31–59.CrossRefPubMedGoogle Scholar
  63. Smith, E., Weinberg, A., Moran, T., & Hajcak, G. (2013). Electrocortical responses to NIMSTIM facial expressions of emotion. International Journal of Psychophysiology, 88, 17–25.CrossRefPubMedGoogle Scholar
  64. Tenke, C. E., & Kayser, J. (2001). A convenient method for detecting electrolyte bridges in multichannel electroencephalogram and event-related potential recordings. Clinical Neurophysiology, 112(3), 545–550.CrossRefPubMedGoogle Scholar
  65. Thom, N.J., Johnson, D.C., Flagan, T., Simmons, A.N., Koturri, S., Van Orden, K.F., Potterat, E.G., Swain, J.L., & Paulus, M.P. (2012). Detecting Emotion in Others: Increased Insula and Decreased Medial Prefrontal Cortex Activation During Emotion Processing in Elite Adventure Racers. Social Cognitive and Affective Neuroscience, In press.Google Scholar
  66. Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., & Nelson, C. (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 163(3), 242–249.CrossRefGoogle Scholar
  67. Tranel, D., Damasio, A. R., & Damasio, H. (1988). Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity. Neurology, 38, 690–696.CrossRefPubMedGoogle Scholar
  68. Vuilleumier, P., & Pourtois, G. (2007). Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging. Neuropsychologia, 45(1), 174–194.CrossRefPubMedGoogle Scholar
  69. Wiens, S., Sand, A., & Olofsson, J. K. (2011). Nonemotional features suppress early and enhance late emotional electrocortical responses to negative pictures. Biological Psychology, 86(1), 83–89.CrossRefPubMedGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 2013

Authors and Affiliations

  • Nathaniel Thom
    • 1
    • 5
    Email author
  • Justin Knight
    • 2
    • 6
  • Rod Dishman
    • 3
  • Dean Sabatinelli
    • 2
    • 6
  • Douglas C. Johnson
    • 4
  • Brett Clementz
    • 2
    • 6
  1. 1.Department of Applied Health ScienceWheaton CollegeWheatonUSA
  2. 2.Department of PsychologyThe University of GeorgiaAthensUSA
  3. 3.Department of Exercise ScienceThe University of GeorgiaAthensUSA
  4. 4.Department of PsychiatryThe University of California - San DiegoLa JollaUSA
  5. 5.Leidos CorporationRestonUSA
  6. 6.Biomedical and Health Science InstituteThe University of GeorgiaAthensUSA

Personalised recommendations