Advertisement

Cognitive, Affective, & Behavioral Neuroscience

, Volume 19, Issue 1, pp 98–108 | Cite as

Associated valence impacts early visual processing of letter strings: Evidence from ERPs in a cross-modal learning paradigm

  • Mareike BayerEmail author
  • Annika Grass
  • Annekathrin Schacht
Article
  • 49 Downloads

Abstract

Emotion effects in event-related potentials (ERPs) during reading have been observed at very short latencies of around 100 to 200 ms after word onset. The nature of these effects remains a matter of debate: First, it is possible that they reflect semantic access, which might thus occur much faster than proposed by most reading models. Second, it is possible that associative learning of a word’s shape might contribute to the emergence of emotion effects during visual processing. The present study addressed this question by employing an associative learning paradigm on pronounceable letter strings (pseudowords). In a learning session, letter strings were associated with positive, neutral, or negative valence by means of monetary gain, loss, or zero outcome. Crucially, half of the stimuli were learned in the visual modality, while the other half was presented acoustically, allowing for experimental separation of associated valence and physical percept. In a test session one or two days later, acquired letter strings were presented in an old/new decision task while we recorded ERPs. Behavioural data showed an advantage for gain-associated stimuli both during learning and in the delayed old/new task. Early emotion effects in ERPs were limited to visually acquired letter strings, but absent for acoustically acquired letter strings. These results imply that associative learning of a word’s visual features might play an important role in the emergence of emotion effects at the stage of perceptual processing.

Keywords

Emotion Word recognition ERPs Associative learning 

Notes

Funding

This research was supported by the German Research Foundation (DFG; grant #SCHA1848/1-1 to A.S.).

References

  1. Anderson, B. (2013). A value-driven mechanism of attentional selection. Journal of Vision, 13, 1–16.  https://doi.org/10.1167/13.3.7 Google Scholar
  2. Barber, H. A., & Kutas, M. (2007). Interplay between computational models and cognitive electrophysiology in visual word recognition. Brain Research Reviews, 53(1), 98–123.  https://doi.org/10.1016/j.brainresrev.2006.07.002 Google Scholar
  3. Bayer, M., Sommer, W., & Schacht, A. (2012). P1 and beyond: Functional separation of multiple emotion effects in word recognition. Psychophysiology, 49(7), 959–969.Google Scholar
  4. Boersma, P., & Weenink, D. (2009). Praat: doing phonetics by computer (Version 5.1. 05) [Computer program]. Retrieved May 1, 2009Google Scholar
  5. Bourgeois, A., Chelazzi, L., & Vuilleumier, P. (2016). How motivation and reward learning modulate selective attention. In B. Studer & S. Knecht (Eds.), Progress in brain research (Vol. 229, pp. 325–342).  https://doi.org/10.1016/bs.pbr.2016.06.004
  6. Cuthbert, B. N., Schupp, H. T., Bradley, M. M., Birbaumer, N., & Lang, P. J. (2000). Brain potentials in affective picture processing: Covariation with autonomic arousal and affective report. Biological Psychology, 52(2), 95–111.  https://doi.org/10.1016/S0301-0511(99)00044-7 Google Scholar
  7. Delplanque, S., Lavoie, M. E., Hot, P., Silvert, L., & Sequeira, H. (2004). Modulation of cognitive processing by emotional valence studied through event-related potentials in humans. Neuroscience Letters, 356(1), 1–4.  https://doi.org/10.1016/j.neulet.2003.10.014 Google Scholar
  8. Fritsch, N., & Kuchinke, L. (2013). Acquired affective associations induce emotion effects in word recognition: An ERP study. Brain and Language, 124(1), 75–83.  https://doi.org/10.1016/j.bandl.2012.12.001 Google Scholar
  9. Goucha, T., & Friederici, A. D. (2015). The language skeleton after dissecting meaning: A functional segregation within Broca’s area. NeuroImage.  https://doi.org/10.1016/j.neuroimage.2015.04.011
  10. Hammerschmidt, W., Kagan, I., Kulke, L., & Schacht, A. (2018). Implicit reward associations impact face processing: Time-resolved evidence from event-related brain potentials and pupil dilations. NeuroImage, 179, 557–569.  https://doi.org/10.1016/J.NEUROIMAGE.2018.06.055 Google Scholar
  11. Hammerschmidt, W., Sennhenn-Reulen, H., & Schacht, A. (2017). Associated motivational salience impacts early sensory processing of human faces. NeuroImage  https://doi.org/10.1016/j.neuroimage.2017.04.032
  12. Hauk, O., Pulvermüller, F., Ford, M., Marslen-Wilson, W. D., & Davis, M. H. (2009). Can I have a quick word? Early electrophysiological manifestations of psycholinguistic processes revealed by event-related regression analysis of the EEG. Biological Psychology, 80(1), 64–74.  https://doi.org/10.1016/j.biopsycho.2008.04.015 Google Scholar
  13. Heister, J., Würzner, K. M., Bubenzer, J., Pohl, E., Hanneforth, T., Geyken, A., & Kliegl, R. (2011). dlexDB—Eine lexikalische datenbank für die psychologische und linguistische forschung [dlexDB: A lexical database for psychological and linguistic research]. Psychologische Rundschau, 62(1), 10–20.  https://doi.org/10.1026/0033-3042/a000029 Google Scholar
  14. Hintze, P., Junghöfer, M., & Bruchmann, M. (2014). Evidence for rapid prefrontal emotional evaluation from visual evoked responses to conditioned gratings. Biological Psychology, 99C, 125–136.  https://doi.org/10.1016/j.biopsycho.2014.03.010 Google Scholar
  15. Hofmann, M. J., Kuchinke, L., Tamm, S., Võ, M. L.-H., & Jacobs, A. M. (2009). Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words. Cognitive, Affective & Behavioral Neuroscience 9(4), 389–397.  https://doi.org/10.3758/9.4.389 Google Scholar
  16. Ille, N., Berg, P., & Scherg, M. (2002). Artifact correction of the ongoing EEG using spatial filters based on artifact and brain signal topographies. Journal of Clinical Neurophysiology, 19(2), 113–124.  https://doi.org/10.1097/00004691-200203000-00002 Google Scholar
  17. Johnson, R. (1986). A triarchic model of P300 amplitude. Psychophysiology  https://doi.org/10.1111/j.1469-8986.1986.tb00649.x
  18. Keuper, K., Zwanzger, P., Nordt, M., Eden, A., Laeger, I., Zwitserlood, P., … Dobel, C. (2014). How “love” and “hate” differ from “sleep”: Using combined electro/magnetoencephalographic data to reveal the sources of early cortical responses to emotional words. Human Brain Mapping, 35(3), 875–888.  https://doi.org/10.1002/hbm.22220 Google Scholar
  19. Keuper, K., Zwitserlood, P., Rehbein, M. A., Eden, A. S., Laeger, I., Junghöfer, M., … Dobel, C. (2013). Early prefrontal brain responses to the Hedonic quality of emotional words—A simultaneous EEG and MEG study. PLOS ONE, 8(8), e70788.  https://doi.org/10.1371/journal.pone.0070788 Google Scholar
  20. Kissler, J., & Herbert, C. (2013). Emotion, Etmnooi, or Emitoon?—Faster lexical access to emotional than to neutral words during reading. Biological Psychology, 92(3), 464–479.  https://doi.org/10.1016/j.biopsycho.2012.09.004 Google Scholar
  21. Kuchinke, L., Fritsch, N., & Müller, C. J. (2015). Evaluative conditioning of positive and negative valence affects P1 and N1 in verbal processing. Brain Research, 1624, 405–413.  https://doi.org/10.1016/j.brainres.2015.07.059 Google Scholar
  22. Kuchinke, L., Krause, B., Fritsch, N., & Briesemeister, B. B. (2014). A familiar font drives early emotional effects in word recognition. Brain and Language, 137, 142–147.  https://doi.org/10.1016/j.bandl.2014.08.007 Google Scholar
  23. Lang, P. J., & Bradley, M. M. (2010). Emotion and the motivational brain. Biological Psychology, 84(3), 437–450.  https://doi.org/10.1016/j.biopsycho.2009.10.007 Google Scholar
  24. Montoya, P., Larbig, W., Pulvermüller, F., Flor, H., & Birbaumer, N. (1996). Cortical correlates of semantic classical conditioning. Psychophysiology  https://doi.org/10.1111/j.1469-8986.1996.tb02359.x
  25. Navalpakkam, V., Koch, C., & Perona, P. (2009). Homo economicus in visual search. Journal of Vision, 9(1), 31–31.  https://doi.org/10.1167/9.1.31 Google Scholar
  26. Öhman, A., & Mineka, S. (2001). Fears, phobias, and preparedness: Toward an evolved module of fear and fear learning. Psychological Review, 108(3), 483–522.  https://doi.org/10.1037/0033-295X.108.3.483 Google Scholar
  27. Palazova, M., Mantwill, K., Sommer, W., & Schacht, A. (2011). Are effects of emotion in single words non-lexical? Evidence from event-related brain potentials. Neuropsychologia, 49(9), 2766–2775.  https://doi.org/10.1016/j.neuropsychologia.2011.06.005 Google Scholar
  28. Paulmann, S., & Kotz, S. A. (2008). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain and Language  https://doi.org/10.1016/j.bandl.2007.11.005
  29. Pizzagalli, D. A., Greischar, L. L., & Davidson, R. J. (2003). Spatio-temporal dynamics of brain mechanisms in aversive classical conditioning: High-density event-related potential and brain electrical tomography analyses. Neuropsychologia  https://doi.org/10.1016/S0028-3932(02)00148-3
  30. Polich, J. (2007). Updating P300: An integrative theory of P3a and P3b. Clinical Neurophysiology  https://doi.org/10.1016/j.clinph.2007.04.019
  31. Pourtois, G., Schettino, A., & Vuilleumier, P. (2013). Brain mechanisms for emotional influences on perception and attention: What is magic and what is not. Biological Psychology, 92(3), 492–512.  https://doi.org/10.1016/j.biopsycho.2012.02.007 Google Scholar
  32. Pulvermüller, F., Shtyrov, Y., & Hauk, O. (2009). Understanding in an instant: Neurophysiological evidence for mechanistic language circuits in the brain. Brain and Language, 110(2), 81–94.  https://doi.org/10.1016/j.bandl.2008.12.001 Google Scholar
  33. Rabovsky, M., Sommer, W., & Abdel Rahman, R. (2012). Depth of conceptual knowledge modulates visual processes during word reading. Journal of Cognitive Neuroscience, 24(4), 990–1005.  https://doi.org/10.1162/jocn_a_00117 Google Scholar
  34. Rehbein, M. A., Steinberg, C., Wessing, I., Pastor, M. C., Zwitserlood, P., Keuper, K., & Junghöfer, M. (2014). Rapid plasticity in the prefrontal cortex during affective associative learning. PLOS ONE  https://doi.org/10.1371/journal.pone.0110720
  35. Rehbein, M. A., Wessing, I., Zwitserlood, P., Steinberg, C., Eden, A. S., Dobel, C., & Junghöfer, M. (2015). Rapid prefrontal cortex activation towards aversively paired faces and enhanced contingency detection are observed in highly trait-anxious women under challenging conditions. Frontiers in Behavioral Neuroscience  https://doi.org/10.3389/fnbeh.2015.00155
  36. Rellecke, J., Palazova, M., Sommer, W., & Schacht, A. (2011). On the automaticity of emotion processing in words and faces: Event-related brain potentials evidence from a superficial task. Brain and Cognition, 77(1), 23–32.  https://doi.org/10.1016/j.bandc.2011.07.001 Google Scholar
  37. Rellecke, J., Sommer, W., & Schacht, A. (2012). Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biological Psychology, 90(1), 23–32.  https://doi.org/10.1016/j.biopsycho.2012.02.002 Google Scholar
  38. Rossi, V., Vanlessen, N., Bayer, M., Grass, A., Pourtois, G., & Schacht, A. (2017). Motivational salience modulates early visual cortex responses across task sets. Journal of Cognitive Neuroscience, 29(6), 968–979.  https://doi.org/10.1162/jocn_a_01093 Google Scholar
  39. Rugg, M. D., & Curran, T. (2007). Event-related potentials and recognition memory. Trends in Cognitive Sciences  https://doi.org/10.1016/j.tics.2007.04.004
  40. Schacht, A., Adler, N., Chen, P., Guo, T., & Sommer, W. (2012). Association with positive outcome induces early effects in event-related brain potentials. Biological Psychology, 89(1), 130–136.  https://doi.org/10.1016/j.biopsycho.2011.10.001 Google Scholar
  41. Schacht, A., & Sommer, W. (2009). Time course and task dependence of emotion effects in word processing. Cognitive, Affective, & Behavioral Neuroscience, 9(1), 28–43.  https://doi.org/10.3758/CABN.9.1.28 Google Scholar
  42. Scott, G. G., O’Donnell, P. J., Leuthold, H., & Sereno, S. C. (2009). Early emotion word processing: Evidence from event-related potentials. Biological Psychology, 80(1), 95–104.  https://doi.org/10.1016/j.biopsycho.2008.03.010 Google Scholar
  43. Sereno, S. C., & Rayner, K. (2003). Measuring word recognition in reading: Eye movements and event-related potentials. Trends in Cognitive Sciences  https://doi.org/10.1016/j.tics.2003.09.010
  44. Sereno, S. C., Rayner, K., & Posner, M. I. (1998). Establishing a time-line of word recognition: Evidence from eye movements and event-related potentials. Cognitive Neuroscience  https://doi.org/10.1097/00001756-199807130-00009
  45. Steinberg, C., Bröckelmann, A. K., Rehbein, M., Dobel, C., & Junghöfer, M. (2013). Rapid and highly resolving associative affective learning: Convergent electro- and magnetoencephalographic evidence from vision and audition. Biological Psychology  https://doi.org/10.1016/j.biopsycho.2012.02.009
  46. Stolarova, M., Keil, A., & Moratti, S. (2006). Modulation of the C1 visual event-related component by conditioned stimuli: Evidence for sensory plasticity in early affective perception. Cerebral Cortex, 16(6), 876–887.  https://doi.org/10.1093/cercor/bhj031 Google Scholar
  47. Vuilleumier, P. (2015). Affective and motivational control of vision. Current Opinion in Neurology, 28, 29–35.  https://doi.org/10.1097/WCO.0000000000000159 Google Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  • Mareike Bayer
    • 1
    • 2
    Email author
  • Annika Grass
    • 1
    • 3
  • Annekathrin Schacht
    • 1
    • 3
  1. 1.Department of Affective Neuroscience and Psychophysiology, Institute of Psychology, Goßlerstraße 14Göttingen UniversityGöttingenGermany
  2. 2.Berlin School of Mind and Brain, Department of PsychologyHumboldt-Universität zu BerlinBerlinGermany
  3. 3.Leibniz ScienceCampus Primate CognitionGöttingenGermany

Personalised recommendations