Advertisement

Brain Topography

, Volume 31, Issue 4, pp 640–660 | Cite as

An Eye Fixation-Related Potential Study in Two Reading Tasks: Reading to Memorize and Reading to Make a Decision

  • Aline Frey
  • Benoît Lemaire
  • Laurent Vercueil
  • Anne Guérin-Dugué
Original Paper

Abstract

We investigated how two different reading tasks, namely reading to memorize [Read & Memorize (RM)] and reading to decide whether a text was relevant to a given topic [Read & Decide (RD)], modulated both eye movements (EM) and brain activity. To this end, we set up an ecological paradigm using the eye fixation-related potentials (EFRP) technique, in which participants freely moved their eyes to process short paragraphs, while their electroencephalography (EEG) activity was recorded in synchronization with their EM. A general linear model was used to estimate at best EFRP, taking account of the overlap between adjacent potentials, and more precisely with the potential elicited at text onset, as well as saccadic potentials. Our results showed that EM patterns were top-down modulated by different task demands. More interestingly, in both tasks, we observed slow-wave potentials that gradually increased across the first eye fixations. These slow waves were larger in the RD task than in the RM task, specifically over the left hemisphere. These results suggest that the decision-making process during reading in the RD task engendered a greater memory load in working memory than that generated in a classic reading task. The significance of these findings is discussed in the light of recent theories and models of working memory processing.

Keywords

Reading Eye movements (EM) Working memory (WM) Eye fixation-related potentials (EFRP) EEG Slow wave potentials General linear model (GLM) 

Notes

Acknowledgements

The authors thank the “Délégation à la Recherche Clinique et à l’Innovation” of Grenoble “Centre Hospitalier Universitaire” (CHU) for its role in the ethics committee, particularly Beatrice Portal and Dominique Garin. EEG/eye-tracker co-registration was performed at the IRMaGe Neurophysiology facility in Grenoble (France), which was partly funded by the French program “Investissement d’Avenir” run by the “Agence Nationale pour la Recherche” (grant ‘Infrastructure d’Avenir en Biologie Santé’ - ANR-11-INBS-0006). The present study was part-funded by grants from the “Pôle Grenoble Cognition” (PGC_AAP2014), and by a grant from the LabEx PERSYVAL-Lab (ANR-11-LABX-0025-01).

References

  1. Alhola P, Polo-Kantola P (2007) Sleep deprivation: impact on cognitive performance. Neurospychiatric Dis Treat 3(5):553–567Google Scholar
  2. Awh E, Vogel EK, Oh S-H (2006) Interactions between attention and working memory. Neurosciences 139:201–208CrossRefGoogle Scholar
  3. Baggio G, Hagoort P (2011) The balance between memory and unification in semantics: towards a dynamic account of the N400. Lang Cogn Process 26:1338–1367CrossRefGoogle Scholar
  4. Bardy F, Dillon H, Dun BV (2014) Least-squares deconvolution of evoked potentials and sequence optimization for multiple stimuli under low-jitter conditions. Clin Neurophysiol 125:727–737CrossRefPubMedGoogle Scholar
  5. Barrouillet P, Camos V (2015) Working memory: loss and reconstruction. Psychology Press, HoveGoogle Scholar
  6. Barrouillet P, Bernardin S, Camos V (2004) Time constraints and resource-sharing in adults’ working memory spans. J Exp Psychol Gen 133:83–100CrossRefPubMedGoogle Scholar
  7. Barrouillet P, Bernardin S, Portrat S, Vergauwe E, Camos V (2007) Time and cognitive load in working memory. J Exp Psychol 33(3):570–585Google Scholar
  8. Barrouillet P, Portrat S, Camos V (2011) On the law relating processing to storage in working memory. Psychol Rev 118:175–192CrossRefPubMedGoogle Scholar
  9. Barrouillet P, Plancher G, Guida A, Camos V (2013) Forgetting at short term: when do event-based interference and temporal factors have an effect? Acta Physiol (Oxford) 142:155–167Google Scholar
  10. Bastiaansen MCM, Hagoort P (2015) Frequency-based segregation of syntactic and semantic unification during online sentence level language comprehension. J Cogn Neurosci 27(11):2095–2107CrossRefPubMedGoogle Scholar
  11. Burle B, Spieser L, Roger C, Casini L, Hasbroucq T, Vidal F (2015) Spatial and temporal resolutions of EEG: is it really black and white? a scalp current density view. Int J Psychophysiol 97(3):210–220CrossRefPubMedPubMedCentralGoogle Scholar
  12. Burns MD, Bigdely-Shamlo N, Smith NJ, Kreutz- Delgado K, Makeig S (2013) Comparison of averaging and regression techniques for estimating event related potentials. In IEEE engineering in biology and medicine conference, Osaka, pp 1680–1683Google Scholar
  13. Carver R (1990) Reading rate: a review of research and theory. Academic Press, New YorkGoogle Scholar
  14. Cheng SY (2018) Evaluation of effect on cognition response to time pressure by using EEG. In: Duffy V, Lightner N (eds) Advances in human factors and ergonomics in healthcare and medical devices. AHFE 2017. Advances in intelligent systems and computing, vol 590. Springer, ChamGoogle Scholar
  15. Congedo M, Korczowski L, Delorme A, da Silva FL (2016) Spatio-temporal common pattern: a companion method for ERP analysis in the time domain. J Neurosci Methods 267:74–88CrossRefPubMedGoogle Scholar
  16. Cowan N (1995) Attention and memory: an integrated framework. Oxford Psychology Series, No. 26. Oxford University Press, New YorkGoogle Scholar
  17. Dandekar S, Privitera C, Carney T, Klein SA (2012) Neural saccadic response estimation during natural viewing. J Neurophysiol 107:1776–1790CrossRefPubMedGoogle Scholar
  18. Dimigen O, Sommer W, Hohlfeld A, Jacobs AM, Kliegl R (2011) Coregistration of eye movements and EEG in natural reading: analysis and review. J Exp Psychol Gen 140:552–572CrossRefPubMedGoogle Scholar
  19. Ditman T, Holcomb PJ, Kuperberg GR (2007) An investigation of concurrent ERP and self-paced reading methodologies. Psychophysiology 44(6):927–935CrossRefPubMedPubMedCentralGoogle Scholar
  20. Duggan GB, Payne SJ (2009) Text skimming: the process and effectiveness of foraging through text under time pressure. J Exp Psychol Appl 15(3):228–242CrossRefPubMedGoogle Scholar
  21. Elward RL, Wilding EL (2010) Working memory capacity is related to variations in the magnitude of an electrophysiological marker of recollection. Brain Res 1342:55–62CrossRefPubMedGoogle Scholar
  22. Elward RL, Evans LH, Wilding EL (2013) The role of working memory capacity in the control of recollection. Cortex 49:1452–1462CrossRefPubMedGoogle Scholar
  23. Frey A, Ionescu G, Lemaire B, Lopez-Orozco F, Baccino T, Guérin-Dugué A (2013) Decision-making in information seeking on texts: an eye-fixation-related potentials investigation. Front Neurosci (Syst Neurosci) 7:39Google Scholar
  24. Golby AJ, Poldrack RA, Brewer JB, Spencer D, Desmond JE, Aron AP, Gabrieli JD (2001) Material-specific lateralization in the medial temporal lobe and prefrontal cortex during memory encoding. Brain 124:1841–1854CrossRefPubMedGoogle Scholar
  25. Gordon M, Pathak P (1999) Finding information on the world wide web: the retrieval effectiveness of search engines. Inf Process Manag 35(2):141–180CrossRefGoogle Scholar
  26. Gordon PC, Hendrick R, Levine WH (2002) Memory-load interference in syntactic processing. Psychol Sci 13:425–430CrossRefPubMedGoogle Scholar
  27. Greenhouse S, Geisser S (1959) On methods in the analysis of profile data. Psychometrika 24:95–112CrossRefGoogle Scholar
  28. Hagoort P (2013) MUC (memory, unification, control) and beyond. Front Psychol 4:416PubMedPubMedCentralGoogle Scholar
  29. Hagoort P (2016) MUC (memory, unification, control): a model on the neurobiology of language beyond single word processing. In: Hickok G, Small S (eds) Neurobiology of language, vol 28. Elsevier, Amsterdam, pp 339–347CrossRefGoogle Scholar
  30. Henderson JM, Luke SG, Schmidt J, Richards JE (2013) Co-registration of eye movements and event-related potentials in connected-text paragraph reading. Front Syst Neurosci 7:28CrossRefPubMedPubMedCentralGoogle Scholar
  31. Hutzler F, Braun M, Võ M-L, Engl V, Hofmann M, Dambacher M, Leder H, Jacobs AM (2007) Welcome to the real world: validating fixation-related brain potentials for ecologically valid settings. Brain Res 1172:124–129CrossRefPubMedGoogle Scholar
  32. Ionescu G, Guyader N, Guérin-Dugué A (2009) SoftEye software. Registration number: IDDNFR001.200017.000.S.P.2010.003.31235Google Scholar
  33. Jasper H (1958) The ten-twenty electrode system of the International Federation. Electroencephalogr Clin Neurophysiol 10:371–375Google Scholar
  34. Jung TP, Makeig S, Humphiers C, Lee TW, McKeown MJ, Iragui V, Sejnowski TJ (2000) Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37(2):163–178CrossRefPubMedGoogle Scholar
  35. Kaakinen JK, Hyönä J (2010) Task effects on eye movements during reading. J Exp Psychol 36:1561–1566Google Scholar
  36. Khader P, Heil M, Rösler F (2005) Material-specific long-term memory representations of faces and spatial positions: evidence from slow event-related brain potentials. Neuropsychologia 43:2109–2124CrossRefPubMedGoogle Scholar
  37. Kintsch W (1988) The use of knowledge in discourse processing: a construction-integration model. Psychol Rev 95:163–182CrossRefPubMedGoogle Scholar
  38. Kintsch W (1998) Comprehension: a paradigm for cognition. Cambridge University, New YorkGoogle Scholar
  39. Kiyonaga A, Egner T (2014a) The working memory stroop effect: when internal representations clash with external stimuli. Psychol Sci 25(8):1619–1629CrossRefPubMedPubMedCentralGoogle Scholar
  40. Kiyonaga A, Egner T (2014b) Resource-sharing between internal maintenance and external selection modulates attentional capture by working memory content. Front Hum Neurosci 8:670CrossRefPubMedPubMedCentralGoogle Scholar
  41. Kliegl R, Dambacher M, Dimigen O, Jacobs AM, Sommer W (2012) Eye movements and brain electric potentials during reading. Psychol Res 76(2):145–158CrossRefPubMedGoogle Scholar
  42. Körner C, Braunstein V, Stangl M, Schlögl A, Neuper C, Ischebeck A (2014) Sequential effects in continued visual search: using fixation related potentials to compare distractor processing before and after target detection. Psychophysiology 51:385–395CrossRefPubMedPubMedCentralGoogle Scholar
  43. Kristensen E, Guerin-Dugué A, Rivet B (2017a) Regularization and a general linear model for event-related potential estimation. Behav Res Methods 8:1–20Google Scholar
  44. Kristensen E, Rivet B, Guérin-Dugué A (2017b) Estimation of overlapped eye fixation related potentials: the General Linear Model, a more flexible framework than the ADJAR algorithm. J Eye Mov Res 10(1):1–27Google Scholar
  45. Landauer TK, McNamara DS, Dennis S, Kintsch W (eds) (2007) Handbook of latent semantic analysis. Erlbaum, MahwahGoogle Scholar
  46. Lemaire B, Denhière G, Bellissens C, Jhean-Larose S (2006) A computational model for simulating text comprehension. Behav Res Methods 38(4):628–637CrossRefPubMedGoogle Scholar
  47. Leu DL, Forzani E, Rhoads C, Maykel C, Kennedy C, Timbrell N (2015) The new literacies of online research and comprehension: rethinking the reading achievement gap. Read Res Q 50(1):37–59CrossRefGoogle Scholar
  48. Liefooghe B, Barrouillet P, Vandierendonck A, Camos V (2008) Working memory costs of task switching. J Exp Psychol 34(3):478–494Google Scholar
  49. Lowe CJ, Safati A, Hall PA (2017) The neurocognitive consequences of sleep restriction: a meta-analytic review. Neurosci Biobehav Rev 80:586–604CrossRefPubMedGoogle Scholar
  50. Luck S (2005) An introduction to the event-related potential technique. MIT Press, CamdridgeGoogle Scholar
  51. Makeig S, Bell AJ, Jung T-P, Ghahremani D, Sejnowski TJ (1997) Blind separation of auditory event-related brain responses into independent components. Proc Natl Acad Sci USA 94:10979–10984CrossRefPubMedPubMedCentralGoogle Scholar
  52. Missonnier P, Leonards U, Gold G, Palix J, Ibanez V, Giannakopoulos P (2003) A new electrophysiological index for working memory load in humans. Neuroreport 14:1451–1455CrossRefPubMedGoogle Scholar
  53. Montfort V, Pouthas V (2003) Effects of working memory demands on frontal slow waves in time-interval reproduction tasks in humans. Neurosci Lett 343:195–199CrossRefGoogle Scholar
  54. Nagel BJ, Herting MM, Maxwell EC, Bruno R, Fair D (2013) Hemispheric lateralization of verbal and spatial working memory during adolescence. Brain cognition 82(1):58–68CrossRefPubMedPubMedCentralGoogle Scholar
  55. Nikolaev AR, Pannasch S, Ito J, Belopolsky AV (2014) Eye movement-related brain activity during perceptual and cognitive processing. Front Syst Neurosci 8:62CrossRefPubMedPubMedCentralGoogle Scholar
  56. Nikolaev AR, Meghanathan RN, van Leeuwen C (2016) Combining EEG and eye movement recording in free viewing: pitfalls and possibilities. Brain Cogn 107:55–83CrossRefPubMedGoogle Scholar
  57. Oberauer K (2002) Access to information in working memory: exploring the focus of attention. J Exp Psychol 28(3):411–421Google Scholar
  58. Oberauer K, Lange E, Engle RW (2004) Working memory capacity and resistance to interference. J Mem Lang 51:80–96CrossRefGoogle Scholar
  59. Ossandón JP, Helo AV, Montefusco-Siegmund R, Maldonado PE (2010) Superposition model predicts EEG occipital activity during free viewing of natural scenes. J Neurosci 30(13):4787–4795CrossRefPubMedGoogle Scholar
  60. Paas FG, Van Merriënboer JJ, Adam JJ (1994) Measurement of cognitive load in instructional research. Percept Mot Skills 79:419–430CrossRefPubMedGoogle Scholar
  61. Pan B, Hembrooke H, Joachims T, Lorigo L, Gay G, Granka L (2007) In google we trust: users’ decisions on rank, position, and relevance. J Comput-Mediat Commun 12(3):801–823CrossRefGoogle Scholar
  62. Radach R, Huestegge L, Reilly R (2008) The role of top down factors in local eye movement control during reading. Psychol Res 72:675–688CrossRefPubMedGoogle Scholar
  63. Reichle ED, Reingold EM (2013) Neurophysiological constraints on the eye-mind link. Front Hum Neurosci 7:361CrossRefPubMedPubMedCentralGoogle Scholar
  64. Rösler F (1993) Beyond reaction time and error rate: monitoring mental processes by means of slow event-related brain potentials. In: McCallum WC, Curry SH (eds) Slow potential changes in the human brain. Plenum Press, New York, pp 105–119CrossRefGoogle Scholar
  65. Ruchkin DS (1965) An analysis of average response computations based upon aperiodic stimuli. IEEE Trans Biomed Eng 12(2):87–94CrossRefPubMedGoogle Scholar
  66. Rypma B, Prabhakaran V, Desmond JE, Glover GH, Gabrieli JD (1999) Load-dependent roles of frontal brain regions in the maintenance of working memory. Neuroimage 9:216–226CrossRefPubMedGoogle Scholar
  67. Scharinger C, Kammerer Y, Gerjets P (2015) Pupil dilatation and EEG alpha frequency band power reveal load on executive functions for link-selection processes during text reading. PLoS ONE 10(6):1–24CrossRefGoogle Scholar
  68. Simola J (2011) Investigating online reading with eye tracking and EEG: the influence of text format, reading task and parafoveal stimuli on reading processes. Academic dissertation, University of Helsinki, Institute of Behavioural Sciences, Studies in Psychology, 81:2011Google Scholar
  69. Simola J, Salojärvi J, Kojo I (2008) Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn Syst Res 9(4):237–251CrossRefGoogle Scholar
  70. Simola J, Holmqvist K, Lindgren M (2009) Right visual field advantage in parafoveal processing: evidence from eye-fixation-related potentials. Brain Lang 111(2):101–113CrossRefPubMedGoogle Scholar
  71. Simola J, Torniainen J, Moisala M, Kivikangas M, Krause CM (2013) Eye movement related brain responses to emotional scenes during free viewing. Front Syst Neurosci 7(41):1–16Google Scholar
  72. Simola J, LeFevre K, Torniainen J, Baccino T (2015) Affective processing in natural scene viewing: valence and arousal interactions in eye-fixation-related potentials. Neuroimage 106:21–33CrossRefPubMedGoogle Scholar
  73. Smith NJ, Kutas M (2015a) Regression-based estimation of ERP waveforms: I. The rERP framework. Psychophysiology 52(2):157–168CrossRefPubMedGoogle Scholar
  74. Smith NJ, Kutas M (2015b) Regression-based estimation of ERP waveforms: II. Non-linear effects, overlap correction, and practical considerations. Psychophysiology 52(2):169–181CrossRefPubMedGoogle Scholar
  75. Spironelli C, Angrilli A (2010) Developmental aspects of language lateralization in delta, theta, alpha and beta EEG bands. Biol Psychol 85:258–267CrossRefPubMedGoogle Scholar
  76. Strauß A, Kotz S, Scharinger M, Obleser J (2014) Alpha and theta brain oscillations index dissociable processes in spoken word recognition. Neuroimage 97:387–395CrossRefPubMedGoogle Scholar
  77. Underwood G, Radach R (1998) Eye guidance and visual information processing: reading, visual search, picture perception and driving. In: Underwood G (ed) Eye guidance in reading and scene perception. Elsevier, Oxford, pp 1–27Google Scholar
  78. van Vugt MK, Simen P, Nystrom L, Holmes P, Cohen JD (2014) Lateralized readiness potentials reveal properties of a neural mechanism for implementing a decision threshold. PLoS ONE, 9(3):e90943CrossRefPubMedPubMedCentralGoogle Scholar
  79. Vergauwe E, Hartstra E, Barrouillet P, Brass M (2015) Domain-general involvement of the posterior frontolateral cortex in time-based resource-sharing in working memory: an fMRI study. NeuroImage 115:104–116CrossRefPubMedGoogle Scholar
  80. Weaver CA III, Mannes S, Fletcher CR (2012) Discourse comprehension: essays in Honor of Walter Kintsch. Lawrence Erlbaum Associates, HillsdaleGoogle Scholar
  81. Weger UW, Inhoff AW (2007) Long-range regressions to previously read words are guided by spatial and verbal memory. Mem Cogn 35(6):1293–1306CrossRefGoogle Scholar
  82. Woldorff MG (1993) Distortion of ERP averages due to overlap from temporally adjacent ERPs: analysis and correction. Psychophysiology 30:98–119CrossRefPubMedGoogle Scholar
  83. Woodman GF (2010) A brief introduction to the use of event-related potentials (ERPs) in studies of perception and attention. Attent Percept Psychophys 72(8):2031–2046CrossRefGoogle Scholar
  84. Wotschack C (2009) Eye movements in reading strategies: how reading strategies modulate effects of distributed processing and oculomotor control. Doctoral dissertation, Universität Potsdam, Potsdam, GermanyGoogle Scholar
  85. Xie J, Xu G, Wang J, Li M, Han C, Jia Y (2016) Effects of mental load and fatigue on steady-state evoked potential based brain computer interface tasks: a comparison of periodic flickering and motion-reversal based visual attention. PLoS ONE 11(9):e0163426CrossRefPubMedPubMedCentralGoogle Scholar
  86. Yang S (2012) Effects of processing difficulty on eye movements in reading: a review of behavioral and neural observations. J Eye Mov Res 5(4):1, 1–16Google Scholar
  87. Yarbus AL (1967) Eye movements and vision. Plenum, New YorkCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Aline Frey
    • 1
  • Benoît Lemaire
    • 2
  • Laurent Vercueil
    • 3
    • 4
  • Anne Guérin-Dugué
    • 5
  1. 1.CHArt Laboratory, ESPE of the Créteil Academy, University of East-Paris CréteilLivry-GarganFrance
  2. 2.Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNCGrenobleFrance
  3. 3.Univ. Grenoble Alpes, Inserm, CHU Grenoble Alpes, GINGrenobleFrance
  4. 4.EFSN, PPNR, CHU Grenoble Alpes38043France
  5. 5.Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-labGrenobleFrance

Personalised recommendations