Advertisement

Oculomotor Control, Brain Potentials, and Timelines of Word Recognition During Natural Reading

  • Reinhold Kliegl
  • Michael Dambacher
  • Olaf Dimigen
  • Werner Sommer
Chapter

Abstract

Reading requires the orchestration of vision, attention, and language processes, usually along with the programming of eye movements. The co-registration of eye movements and electroencephalography (EEG) during natural reading promises to deliver two complementary sets of information. Fixation durations reflect the difficulty of sublexical, lexical, and sentence-level properties, such as the frequency and predictability of the fixated word and (at least) its left and right neighbors; they reveal space-related constraints of distributed processing in the perceptual span. Co-registered fixation-related potentials (FRPs) yield time-related constraints of word recognition within fixation durations. Effects of word frequency and predictability in FRPs are shown to be qualitatively similar to those in event-related potentials (ERPs) measured during serial visual presentation of sentence words. However, FRPs and ERPs differ with respect to the timelines associated with frequency and predictability effects. It is anticipated that space-related and time-related constraints of word recognition during reading will guide the further development of computational models of eye-movement control during reading as well as their integration with computational models of (isolated) word recognition.

Keywords

Stimulus Onset Asynchrony Target Word Word Recognition Brain Potential Preview Benefit 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgments

This research was supported by DFG Research Unit 868, Project A2. Address for correspondence: Reinhold Kliegl, Department of Psychology, University of Potsdam, Karl-Liebknecht-Str. 24/24, 14476 Potsdam, Germany.

References

  1. Baccino, T., & Manunta, Y. (2005). Eye-fixation-related potentials: Insight into parafoveal processing. Journal of Psychophysiology, 19, 204–215.CrossRefGoogle Scholar
  2. Baccino, T. (2011). Eye movements and concurrent event-related potentials: Eye fixation-related potential investigations in reading. In: S.P. Liversedge, I.D. Gilchrist, & S. Everling (Eds.), Eye Movements Handbook (pp. 857–870). Oxford: Oxford University Press.Google Scholar
  3. Berg, P., & Scherg, M. (1994). A multiple source approach to the correction of eye artifacts. Electroencephalography and Clinical Neurophysiology, 90, 229–241.CrossRefGoogle Scholar
  4. Dambacher, M. (2010). Bottom-up and top-down processes in reading. Potsdam: Universitätsverlag Potsdam.Google Scholar
  5. Dambacher, M., Dimigen, O., Braun, M., Wille, K., Jacobs, A. M., & Kliegl, R. (2012). Stimulus onset asynchrony and the timeline of word recognition: Event-related potentials during sentence reading. Neuropsychologia, 50(8), 1852–70CrossRefGoogle Scholar
  6. Dambacher, M., & Kliegl, R. (2007). Synchronizing timelines: Relations between fixation durations and N400 amplitudes during sentence reading. Brain Research, 1155, 147–162.CrossRefGoogle Scholar
  7. Dambacher, M., Kliegl, R., Hofmann, M., & Jacobs, A. M. (2006). Frequency and predictability effects on event-related potentials during reading. Brain Research, 1084, 89–103.CrossRefGoogle Scholar
  8. Dambacher, M., Rolfs, M., Göllner, K., Kliegl, R., & Jacobs, A. M. (2009). Event-related potentials reveal rapid verification of predicted visual input. PLoS ONE, 4(3), e5047.CrossRefGoogle Scholar
  9. Dimigen, O., Kliegl, R., & Sommer, W. (2012). Trans-saccadic parafoveal preview benefits in fluent reading: A study with fixation-related brain potentials. NeuroImage, 62, 381–393.CrossRefGoogle Scholar
  10. Dimigen, O., Sommer, W., Hohlfeld, A., Jacobs, A. M., & Kliegl, R. (2011). Co-registration of eye movements and EEG in natural reading: Analyses and review. Journal of Experimental Psychology: General, 140, 552–572.CrossRefGoogle Scholar
  11. Dimigen, O., Valsecchi, M., Sommer, W., & Kliegl, R. (2009). Human microsaccade-related visual brain responses. Journal of Neuroscience, 29, 12321–12331.CrossRefGoogle Scholar
  12. Engbert, R., & Kliegl, R. (2011). Parallel graded attention models of reading. In: S.P. Liversedge, I.D. Gilchrist, & S. Everling (Eds.), Eye Movements Handbook (pp. 787–800). Oxford: Oxford University Press.Google Scholar
  13. Ehrlich, S. F., & Rayner, K. (1981). Contextual effects on word recognition and eye movements during reading. Journal of Verbal Learning and Verbal Behavior, 20, 641–655.CrossRefGoogle Scholar
  14. Hauk, O., & Pulvermüller, F. (2004). Effects of word length and frequency on the human event-related potential. Clinical Neurophysiology, 115, 1090–1103.CrossRefGoogle Scholar
  15. Hohenstein, S., & Kliegl, R. (2012). Semantic preview benefit during reading. Manuscript submitted for publication.Google Scholar
  16. Hohenstein, S., Laubrock, J., & Kliegl, R. (2010). Semantic preview benefit in eye movements during reading: A parafoveal fast-priming study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 1150–1170.Google Scholar
  17. Ille, N., Berg, P., & Scherg, M. (2002). Artifact correction of the ongoing EEG using spatial filters based on artifact and brain signal topographies. Journal of Clinical Neurophysiology, 19, 113–124.CrossRefGoogle Scholar
  18. Keren, A. S., Yuval-Greenberg, S., & Deouell, L. Y. (2010). Saccadic spike potentials in gamma-band EEG: Characterization, detection, and suppression. NeuroImage, 49, 2248–2263.CrossRefGoogle Scholar
  19. Kliegl, R. (2007). Toward a perceptual-span theory of distributed processing in reading: A reply to Rayner, Pollatsek, Drieghe, Slattery, and Reichle (2007). Journal of Experimental Psychology: General, 136, 530–537.CrossRefGoogle Scholar
  20. Kliegl, R., Dambacher, M., Dimigen, O., Jacobs, A. M., & Sommer, W. (2012). Eye movements and brain electric potentials during reading. Psychological Research, 76, 145–158.CrossRefGoogle Scholar
  21. Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of Experimental Psychology: General, 135, 12–35.CrossRefGoogle Scholar
  22. Kretzschmar, F., Bornkessel-Schlesewsky, I., & Schlesewsky, M. (2009). Parafoveal versus foveal N400s dissociate spreading activation from contextual fit. Neuroreport, 20, 1613–1618.CrossRefGoogle Scholar
  23. Kuperman, V., Dambacher, M., Nuthmann, A., Kliegl, R., (2010). The effect of word position on eye-movements in sentence and paragraph reading. Quarterly Journal of Experimental Psychology, 63, 1838–1357.CrossRefGoogle Scholar
  24. Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62, 621–647.CrossRefGoogle Scholar
  25. Kutas, M., & Hillyard, S. A. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207, 203–205.CrossRefGoogle Scholar
  26. Kutas, M., Van Petten, C., & Kluender, R. (2006). Psycholinguistics electrified II: 1994–2005. In M. Gernsbacher & M. Traxler (Eds.), Handbook of psycholinguistics, 2nd edition (pp. 659–724). New York: Elsevier Press.CrossRefGoogle Scholar
  27. Lee, C.-Y., Liu, Y.-N., & Tsai, J.-L. (2012). The time course of contextual effects on visual word recognition. Frontiers in Psychology. doi:10.3389/fpsyg.2012.00285.Google Scholar
  28. McConkie, G. W., & Rayner, K. (1975). The span of effective stimulus during a fixation in reading. Perception & Psychophysics, 17, 578–586.CrossRefGoogle Scholar
  29. Rayner, K. (1975). The perceptual span and peripheral cues in reading. Cognitive Psychology, 7, 65–81.CrossRefGoogle Scholar
  30. Rayner, K., & Duffy, S. (1986) Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory & Cognition, 14, 191–201.CrossRefGoogle Scholar
  31. Rayner, K., Pollatsek, A., Drieghe, D., Slattery, T., & Reichle, E. D. (2007).Google Scholar
  32. Reichle, E. D. (2011). Serial-attention models in reading. In: S.P. Liversedge, I.D. Gilchrist, & S. Everling (Eds.), Eye Movements Handbook (pp. 767–786). Oxford: Oxford University Press.Google Scholar
  33. Reilly, R. G., & Radach, R. (2006). Some empirical tests of an interactive activation model of eye movement control in reading. Journal of Cognitive Systems Research, 7, 34–55.CrossRefGoogle Scholar
  34. Rugg, M. D. (1987). Dissociation of semantic priming, word and non-word repetition effects by event-related potentials. Quarterly Journal of Experimental Psychology, 39, 123–148.CrossRefGoogle Scholar
  35. Rugg, M. D. (1990). Event-related brain potentials dissociate repetition effects of high- and low-frequency words. Memory and Cognition, 18, 367–379.CrossRefGoogle Scholar
  36. Taylor, W. L. (1953). Cloze procedure: A new tool for measuring readability. Journalism Quarterly, 30, 415–433.Google Scholar
  37. Sereno, S. C., & Rayner, K. (2003). Measuring word recognition in reading: Eye movements and event- related potentials. Trends in Cognitive Science, 7, 489–493.CrossRefGoogle Scholar
  38. Sereno, S. C., Rayner, K., & Posner, M. I. (1998). Establishing a time-line of word recognition: Evidence from eye movements and event-related potentials. Neuroreport, 9, 2195–2200.CrossRefGoogle Scholar
  39. Van Berkum, J. J. A., Brown, C. M., Zwitserlood, P., Kooijman, V., & Hagoort, P. (2005). Anticipating upcoming words in discourse: Evidence from ERPs and reading times. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 443–467.Google Scholar
  40. Van Petten, C., & Kutas, M. (1990). Interactions between sentence context and word frequency in event-related brain potentials. Memory and Cognition, 18, 380–393.CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Reinhold Kliegl
    • 1
  • Michael Dambacher
    • 2
  • Olaf Dimigen
    • 3
  • Werner Sommer
    • 3
  1. 1.University of PotsdamPotsdamGermany
  2. 2.University of KonstanzKonstanzGermany
  3. 3.Humboldt UniversityBerlinGermany

Personalised recommendations