Employing ET to Explore Test Takers’ Cognitive Processes

  • Jufang KongEmail author


This chapter is devoted to operationalizing an eye tracking (ET for short) paradigm to investigate the potential effect(s) of response formats on test takers’ reading comprehension test-testing processes. In this chapter, the paradigm of ET is first put forward with its strengths and weaknesses carefully considered.


  1. Ahern, S., & Beatty, J. (1979). Pupillary responses during information processing vary with Scholastic Aptitude Test scores. Science, 205(4412), 1289–1292.Google Scholar
  2. Al Dahhan, N. Z., Kirby, J. R., Brien, D. C., & Munoz, D. P. (2016). Eye movements and articulations during a letter naming speed task: Children with and without dyslexia. Journal of Learning Disabilities, 50(3), 275–285.Google Scholar
  3. Al Dahhan, N. Z., Georgiou, G. K., Hung, R., Munoz, D. P., Parrila, R., & Kirby, J. R. (2014). Eye movements of university students with and without reading difficulties during naming speed tasks. Annals of Dyslexia, 64(2), 137–150.Google Scholar
  4. Altarriba, J., Kroll, J. F., Sholl, A., & Rayner, K. (1996). The influence of lexical and conceptual constraints on reading mixed-language sentences: Evidence from eye fixations and naming times. Memory and Cognition, 24(4), 477–492.Google Scholar
  5. Bax, S. (2013). The cognitive processing of candidates during reading tests: Evidence from eye-tracking. Language Testing, 30(4), 441–465.Google Scholar
  6. Bax, S., & Weir, C. (2012). Investigating learners’ cognitive processes during a computer-based CAE reading test. Cambridge ESOL: Research Notes, 47, 3–14.Google Scholar
  7. Bicknell, K., & Levy, R. (2011). Why readers regress to previous words: A statistical analysis. In L. Carlson, C. Holscher, & T. Shipley (Eds.), Proceedings of the 33rd annual conference of the cognitive science society (pp. 931–936). Austin: Cognitive Science Society.Google Scholar
  8. Bojko, A. (2009). Informative or misleading? Heatmaps deconstructed. In J. Jacko (Ed.), Human-computer interaction: New trends (pp. 30–39). Berlin: Springer.Google Scholar
  9. Booth, R. W., & Weger, U. W. (2013). The function of regressions in reading: Backward eye movements allow rereading. Memory & Cognition, 41(1), 82–97.Google Scholar
  10. Boraston, Z., & Blakemore, S. J. (2007). The application of eye-tracking technology in the study of autism. The Journal of Physiology, 581(3), 893–898.Google Scholar
  11. Brunfaut, T. (2016). Looking into reading II: A follow-up study on test-takers’ cognitive processes while completing Aptis B1 reading tasks. London: British Council.Google Scholar
  12. Brunfaut, T., & McCray, G. (2015). Looking into test-takers’ cognitive processes while completing reading tasks: A mixed-method eye-tracking and stimulated recall study. London: British Council.Google Scholar
  13. Brysbaert, M., & Nazir, T. (2005). Visual constraints in written word recognition: Evidence from the optimal viewing-position effect. Journal of Research in Reading, 28(3), 216–228.Google Scholar
  14. Carpenter, R. H. S. (1988). Movements of the eyes (2nd ed.). London: Pion.Google Scholar
  15. Carpenter, R. H. S. (1991). The visual origins of ocular motility. Vision and Visual Function, 8, 1–10.Google Scholar
  16. Clifton, C., Jr., Staub, A., & Rayner, K. (2007). Eye movements in reading words and sentences. In R. P. G. van Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye-movements: A window on mind and brain (pp. 341–372). Amsterdam: Elsevier.Google Scholar
  17. Conklin, K., & Pellicer-Sanchez, A. (2016). Using eye-tracking in applied linguistics and second language research. Second Language Research, 32(3), 453–467.Google Scholar
  18. Di Stasi, L. L., Antoli, A., & Canas, J. J. (2013). Evaluating mental workload while interacting with computer-generated artificial environments. Entertainment Computing, 4(1), 63–69.Google Scholar
  19. Duchowski, A. T. (2007). Eye tracking methodology: Theory and practice (2nd ed.). London: Springer.Google Scholar
  20. Dussias, P. E. (2010). Uses of eye-tracking data in second language sentence processing research. Annual Review of Applied Linguistics, 30, 149–166.Google Scholar
  21. Everatt, J., & Underwood, G. (1994). Individual differences in reading subprocesses: Relationships between reading ability, lexical access, and eye movement control. Language and Speech, 37(3), 283–297.Google Scholar
  22. Findlay, J. M., & Gilchrist, I. D. (2003). Active vision: The psychology of looking and seeing. Oxford: Oxford University Press.Google Scholar
  23. Frazier, L., & Rayner, K. (1982). Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology, 14(2), 178–210.Google Scholar
  24. Frenck-Mestre, C. (2005). Eye-movement recording as a tool for studying syntactic processing in a second language: A review of methodologies and experimental findings. Second Language Research, 21(2), 175–198.Google Scholar
  25. Goodman, K., Fries, P. H., & Strauss, S. L. (2016). Reading—The grand illusion: How and why people make sense of print. New York: Routledge.Google Scholar
  26. Godfroid, A., Winke, P., & Gass, S. (2013). Special issue: Eye-movement recordings in second language research. Studies in Second Language Acquisition, 35(2), 205–422.Google Scholar
  27. Harvey, H., & Walker, R. (2018). Reading comprehension and its relationship with working memory capacity when reading horizontally scrolling text. Quarterly Journal of Experimental Psychology, 71(9), 1887–1897.Google Scholar
  28. Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford: Oxford University Press.Google Scholar
  29. Huey, E. B. (1908). The psychology and pedagogy of reading. New York: Macmillan.Google Scholar
  30. Hyona, J., & Olson, R. K. (1995). Eye fixation patterns among dyslexic and normal readers: Effects of word length and word frequency. Journal of Experimental Psychology. Learning, Memory, and Cognition, 21(6), 1430–1440.Google Scholar
  31. Javal, L. E. (1879). Essai sur la physiologie de la lecture. Annales d’Oculistique, 82, 242–253.Google Scholar
  32. Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354.Google Scholar
  33. Kaakinen, J. K., & Hyona, J. (2010). Task effects on eye movements during reading. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36(6), 1561–1566.Google Scholar
  34. Kahneman, D., & Beatty, J. (1966). Pupil diameter and load on memory. Science, 154(756), 1583–1585.Google Scholar
  35. Keating, G. (2014). Eye-tracking with text. In J. Jegerski, & B. Van Patten (Eds.), Research methods in second language psycholinguistics (pp. 69–92). London: Taylor and Francis.Google Scholar
  36. Khalifa, H., & Weir, C. J. (2009). Examining reading: Research and practice in assessing second language reading. Cambridge: Cambridge University Press.Google Scholar
  37. Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of Experimental Psychology: General, 135(1), 12–35.Google Scholar
  38. Kliegl, R., Grabner, E., Rolfs, M., & Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading. European Journal of Cognitive Psychology, 16(1–2), 262–284.Google Scholar
  39. Klingner, J., Kumar, R., & Hanrahan, P. (2008). Measuring the task-evoked pupillary response with a remote eye tracker. In Proceedings of the 2008 symposium on eye tracking research & applications. Savannah.Google Scholar
  40. Land, M. F., & Tatler, B. W. (2009). Looking and acting: Vision and eye movements in natural behaviour. Oxford: Oxford University Press.Google Scholar
  41. Levy, R., Bicknell, K., Slattery, T., & Rayner, K. (2009). Eye movement evidence that readers maintain and act on uncertainty about past linguistic input. Proceedings of the National Academy of Sciences, 106(50), 21086–21090.Google Scholar
  42. Liversedge, S. P., Gilchrist, I. D., & Everling, S. (2011). The Oxford handbook of eye movements. Oxford: Oxford University Press.Google Scholar
  43. Majooni, A., Masood, M., & Akhavan, A. (2017). An eye-tracking study on the effect of infographic structures on viewer’s comprehension and cognitive load. Information Visualization, 17(3), 257–266.Google Scholar
  44. McCray, G., & Brunfaut, T. (2018). Investigating the construct measured by banked gap-fill items: Evidence from eye-tracking. Language Testing, 35(1), 51–73.Google Scholar
  45. Neuert, C. E. (2017). Processing forced-choice versus check-all-that-apply question formats: Evidence from eye tracking. Field Methods, 29(4), 383–394.Google Scholar
  46. Olitsky, S. E., & Nelson, L. B. (2003). Reading disorders in children. Pediatric Clinics of North America, 50(1), 213–224.Google Scholar
  47. Ozuru, Y., Best, R., Bell, C., Witherspoon, A., & McNamara, D. S. (2007). Influence of question format and text availability on the assessment of expository text comprehension. Cognition and Instruction, 25(4), 399–438.Google Scholar
  48. Paulson, E. J., & Freeman, A. (2003). Insight from the eyes: The science of effective reading instruction. Portsmouth: Heinemann.Google Scholar
  49. Paulson, E. J., & Henry, J. (2002). Does the degrees of reading power assessment reflect the reading process? An eye-movement examination. Journal of Adolescent and Adult Literacy, 46(3), 234–244.Google Scholar
  50. Pickering, M., Frisson, S., McElree, B., & Traxler, M. (2004). Eye movements and semantic composition. In M. Carreriras, & C. Clifton (Eds.), The on-line study of sentence comprehension: Eyetracking, ERPs and beyond (pp. 33–50). New York: Psychology Press.Google Scholar
  51. Radach, R., & Kennedy, A. (2004). Theoretical perspectives on eye movements in reading: Past controversies, current issues, and an agenda for future research. European Journal of Cognitive Psychology, 16(1–2), 3–26.Google Scholar
  52. Radach, R., Huestegge, L., & Railey, R. (2008). The role of global top-down factors in local eye-movement control in reading. Psychological Research, 72(6), 675–688.Google Scholar
  53. Rayner, K. (1978). Eye movements in reading and information processing. Psychological Bulletin, 85(3), 618–660.Google Scholar
  54. Rayner, K. (1985). The role of eye movements in learning to read and reading disability. Remedial and Special Education, 6(6), 53–60.Google Scholar
  55. Rayner, K. (1997). Understanding eye movements in reading. Scientific Studies of Reading, 1(4), 317–339.Google Scholar
  56. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422.Google Scholar
  57. Rayner, K. (2009a). Eye movements in reading: Models and data. Journal of Eye Movement Research, 2(5), 1–10.Google Scholar
  58. Rayner, K. (2009b). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457–1506.Google Scholar
  59. Rayner, K., & Liversedge, S. P. (2011). Linguistic and cognitive influences on eye movements during reading. In S. P. Liversedge, I. D. Gilchrist, & S. Everling (Eds.), The Oxford handbook of eye movements (pp. 751–766). Oxford: Oxford University Press.Google Scholar
  60. Rayner, K., Juhasz, B. J., & Brown, S. J. (2007a). Do readers obtain preview benefit from word N + 2? A test of serial attention shift versus distributed lexical processing models of eye movement control in reading. Journal of Experimental Psychology. Human Perception and Performance, 33(1), 230–245.Google Scholar
  61. Rayner, K., Pollatsek, A., Drieghe, D., Slattery, T. J., & Reichle, E. D. (2007b). Tracking the mind during reading via eye movements: Comments on Kliegl, Nuthmann, and Engbert (2006). Journal of Experimental Psychology: General, 136(3), 520–529.Google Scholar
  62. Rayner, K., Reichle, E. D., & Pollatsek, A. (2005). Eye movement control in reading and the E-Z Reader model. In G. Underwood (Ed.), Cognitive processes in eye guidance (pp. 131–162). Oxford: Oxford University Press.Google Scholar
  63. Rayner, K., Pollatsek, A., Ashby, J., & Clifton, C., Jr. (2012). The psychology of reading (2nd ed.). New York: Psychology Press.Google Scholar
  64. Rayner, K., Foorman, B. R., Perfetti, C. A., Pesetsky, D., & Seidenberg, M. S. (2001). How psychological science informs the teaching of reading. Psychological Science in the Public Interest, 2(2), 31–74.Google Scholar
  65. Rayner, K., Sereno, S. C., Morris, R. K., Schmauder, A. R., & Clifton, C. (1989). Eye movements and on-line language comprehension processes. Language and Cognitive Processes, 4(3–4), 21–49.Google Scholar
  66. Reichle, E. D., Rayner, K., & Pollatsek, A. (2003). The E-Z Reader model of eye-movement control in reading: Comparisons to other models. Behavioral and Brain Sciences, 26(4), 445–526.Google Scholar
  67. Scheiter, K., & van Gog, T. (2009). Using eye tracking in applied research to study and stimulate the processing of information from multi-representational sources. Applied Cognitive Psychology, 23(9), 1209–1214.Google Scholar
  68. Schotter, E. R., Tran, R., & Rayner, K. (2014). Don’t believe what you read (only once): Comprehension is supported by regressions during reading. Psychological Science, 25(6), 1218–1226.Google Scholar
  69. Seagull, F. J., Wickens, C. D., & Loeb, R. G. (2001). When is less more? Attention and workload in auditory, visual, and redundant patient-monitoring conditions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 45(18), 1395–1399.Google Scholar
  70. Solheim, O. J., & Uppstad, P. H. (2011). Eye-tracking as a tool in process-oriented reading test validation. International Electronic Journal of Elementary Education, 4(1), 153–168.Google Scholar
  71. Spivey, M., Richardson, D., & Dale, R. (2009). The movement of eye and hand as a window into language and cognition. In E. Morsella & J. Bargh (Eds.), Oxford handbook of human action (pp. 225–248). New York: Oxford University Press.Google Scholar
  72. SR Research. (2006). Eyelink II user manual version 2.12. Mississauga: SR Research Ltd.Google Scholar
  73. Starr, M. S., & Rayner, K. (2001). Eye movements during reading: Some current controversies. Trends in Cognitive Sciences, 5(4), 156–163.Google Scholar
  74. Staub, A. (2015). Reading sentences: Syntactic parsing and semantic interpretation. In A. Pollatsek, & R. Treiman (Eds.), The Oxford handbook of reading (pp. 202–216). Oxford: Oxford University Press.Google Scholar
  75. Staub, A., & Rayner, K. (2007). Eye movements and on-line comprehension processes. In M. G. Gaskell (Ed.), The Oxford handbook of psycholinguistics (pp. 327–342). Oxford: Oxford University Press.Google Scholar
  76. Tai, R. H., Loehr, J. F., & Brigham, F. J. (2006). An exploration of the use of eye-gaze tracking to study problem-solving on standardized science assessments. International Journal of Research and Method in Education, 29(2), 185–208.Google Scholar
  77. Tatler, B. W. (2009). Eye guidance in natural scenes. Hove: Psychology Press.Google Scholar
  78. Tatler, B. W., & Wade, N. J. (2003). On nystagmus, saccades, and fixations. Perception, 32(2), 167–184.Google Scholar
  79. Underwood, G., Hubbard, A., & Wilkinson, H. (1990). Eye fixations predict reading comprehension: The relationships between reading skill, reading speed, and visual inspection. Language and Speech, 33(1), 69–81.Google Scholar
  80. Vidal-Abarca, E., Mana, A., & Gil, L. (2010). Individual differences for self-regulating task-oriented reading activities. Journal of Educational Psychology, 102(4), 817–826.Google Scholar
  81. Vitu, F. (2011). On the role of visual and oculomotor processes in reading. In S. P. Liversedge, I. D. Gilchrist, & S. Everling (Eds.), The Oxford handbook of eye movements (pp. 731–749). Oxford: Oxford University Press.Google Scholar
  82. Wade, N. J. (2007). Scanning the seen: Vision and the origins of eye movement research. In R. P. G. van Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements: A window on mind and brain (pp. 31–61). Oxford: Elsevier.Google Scholar
  83. Wade, N. J., & Tatler, B. W. (2005). The moving tablet of the eye: The origins of modern eye movement research. Oxford: Oxford University Press.Google Scholar
  84. Wade, N. J., Tatler, B. W., & Heller, D. (2003). Dodge-ing the issue: Dodge, Javal, Hering, and the measurement of saccades in eye-movement research. Perception, 32(7), 793–804.Google Scholar
  85. Winke, P. M. (2013). The effects of input enhancement on grammar learning and comprehension: A modified replication of Lee (2007) with eye-movement data. Studies in Second Language Acquisition, 35(2), 323–352.Google Scholar
  86. Wolverton, G. S., & Zola, D. (1983). The temporal characteristics of visual information extraction during reading. In K. Rayner (Ed.), Eye movements in reading: Perceptual and language processes (pp. 41–51). New York: Academic Press.Google Scholar
  87. Wotschack, C., & Kliegl, R. (2013). Reading strategy modulates parafoveal-on-foveal effects in sentence reading. Quarterly Journal of Experimental Psychology, 66(3), 548–562.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Zhejiang Normal UniversityJinhuaChina

Personalised recommendations