Eye-Tracking and the Visual World Paradigm

  • Sanne M. Berends
  • Susanne M. Brouwer
  • Simone A. Sprenger
Part of the SpringerBriefs in Linguistics book series (SBIL)


This chapter will focus on the use of eye-tracking in the visual world paradigm. This method can be employed to investigate a number of language comprehension issues, and we will begin with a brief overview of the history of the method and some of the applications. More centrally, we will discuss how it can be used to assess the impact of cross-linguistic interference, proficiency levels, and age of onset in L2 acquisition and L1 attrition, with an introduction to the issues that are involved in designing a study using this technique. As a case in point, we present and discuss the specific experiment employed within the multi-task, multi-language and multi-lab study on which this book is based, with special attention to the issues for analysis that arise when data from multiple systems must be combined.


Bilingualism Grammatical gender Eye-tracking Second language acquisition First language attrition  

Supplementary material (1.3 mb)
Eyetracking (ZIP 1380 kb)

Suggestions for Further Reading

  1. Dussias, P.E., J.V. Kroff, and C. Gerfen. 2013a. Visual world eye-tracking. In Research methods in second language psycholinguistics, ed. J. Jegerski, and B. van Patten, 93–126. New York: Routledge.Google Scholar
  2. Ferreira, F., M. Tanenhaus. 2008. Language-vision interaction [Special issue]. Journal of Memory and Language, 57(4).Google Scholar
  3. Huettig, F., J. Rommers, and A.S. Meyer. 2011a. Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica 137: 151–171.CrossRefGoogle Scholar


  1. Allopenna, P.D., J.S. Magnuson, and M.K. Tanenhaus. 1998. Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language 38: 419–439.CrossRefGoogle Scholar
  2. Altmann, G.T.M. 2011. The mediation of eye movements by spoken language. In The oxford handbook of eye movements, ed. S.P. Liversedge, I.D. Gilchrist, and S. Everling, 979–1004. Oxford: Oxford University Press.Google Scholar
  3. Altmann, G.T.M., and Y. Kamide. 1999. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73: 247–264.CrossRefGoogle Scholar
  4. Barr, D.J. 2008. Analyzing ‘visual world’ eyetracking data using multilevel logistic regression. Journal of Memory and Language 59: 457–474.CrossRefGoogle Scholar
  5. Boersma, P., D. Weenink. 2012. Praat: Doing phonetics by computer (Version 5.3.08) [Computer software].
  6. Clifton, C., A. Staub, and K. Rayner. 2007. Eye movements in reading words and sentences. In Eye movements: A window on mind and brain, ed. R.P.G. van Gompel, M.H. Fischer, W.S. Murray, and R.L. Hill, 341–372. Amsterdam: Elsevier.CrossRefGoogle Scholar
  7. Cooper, R.M. 1974. The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology 6: 84–107.CrossRefGoogle Scholar
  8. Dahan, D., J.S. Magnuson, and M.K. Tanenhaus. 2001. Time course of frequency effects in spoken word recognition: Evidence from eye movements. Cognitive Psychology 42: 317–367.CrossRefGoogle Scholar
  9. Dahan, D., D. Swingley, M.K. Tanenhaus, and J.S. Magnuson. 2000. Linguistic gender and spoken-word recognition in French. Journal of Memory and Language 42: 465–480.CrossRefGoogle Scholar
  10. Duchowski, A.T. 2002. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers 34(4): 455–470.CrossRefGoogle Scholar
  11. Dussias, P.E., J.V. Kroff, and C. Gerfen. 2013a. Visual world eye-tracking. In Research methods in second language psycholinguistics, ed. J. Jegerski, and B. VanPatten, 93–126. New York: Routledge.Google Scholar
  12. Dussias, P.E., J.R. Valdés Kroff, R.E. Guzzardo Tamargo, and C. Gerfen. 2013b. When gender and looking go hand in hand: Grammatical gender processing in L2 Spanish. Studies in Second Language Acquisition 35: 353–387.CrossRefGoogle Scholar
  13. Ferreira, F., A. Foucart, and P.E. Engelhardt. 2013. Language processing in the visual world: Effects of preview, visual complexity, and prediction. Journal of Memory and Language, 69(3), 165−182.Google Scholar
  14. Grüter, T., C. Lew-Williams, and A. Fernald. 2012. Grammatical gender in L2: A production or a real-time processing problem? Second Language Research 28: 191–215.CrossRefGoogle Scholar
  15. Henderson, J.M., and F. Ferreira. 2004. Scene perception for psycholinguists. In The interface of language, vision, and action, ed. J.M. Henderson, and F. Ferreira, 1–58. New York: Psychology Press.Google Scholar
  16. Hopp, H. 2013. Grammatical gender in adult L2 acquisition: Relations between lexical and syntactic variability. Second Language Research 29(1): 33–56.CrossRefGoogle Scholar
  17. Huettig, F., and J.M. McQueen. 2007. The tug of war between phonological, semantic and shape information in language-mediated visual search. Journal of Memory and Language 57(4): 460–482.CrossRefGoogle Scholar
  18. Huettig, F., J. Rommers, and A.S. Meyer. 2011b. Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica 137: 151–171.CrossRefGoogle Scholar
  19. Lew-Williams, C., and A. Fernald. 2007. Young children learning Spanish make rapid use of grammatical gender in spoken word recognition. Psychological Science 33: 193–198.CrossRefGoogle Scholar
  20. Lew-Williams, C., and A. Fernald. 2010. Real-time processing of gender-marked articles by native and non-native Spanish speakers. Journal of Memory and Language 63: 447–464.CrossRefGoogle Scholar
  21. Loerts, H., M. Wieling, and M.S. Schmid. 2013. Neuter is not common in Dutch: Eye movements reveal asymmetrical gender processing. Journal of Psycholinguistic Research 42(6): 551–570.CrossRefGoogle Scholar
  22. Matin, E., K.C. Shao, and K.R. Boff. 1993. Saccadic overhead: Information-processing time with and without saccades. Perception and Psychophysics 53: 372–380.CrossRefGoogle Scholar
  23. Mirman, D., J.A. Dixon, and J.S. Magnuson. 2008. Statistical and computational models of the visual world paradigm: Growth curves and individual differences. Journal of Memory and Language 59: 475–494.CrossRefGoogle Scholar
  24. McQueen, J.M., and M.C. Viebahn. 2007. Tracking recognition of spoken words by tracking looks to printed words. Quarterly Journal of Experimental Psychology 60: 661–671.CrossRefGoogle Scholar
  25. Oehler, H., and O.S. Gerretsen. 1973. Duitse woordenschat—Alfabetische basisvocabulaire met systematische uitbreiding. Groningen: Wolters Noordhoff.Google Scholar
  26. Oostdijk, N. 2000. The spoken Dutch corpus. Overview and first evaluation. In Gavralidou, M., G. Carayannis, S. Markantonatou, S. Piperidis, G. Stainhaouer (eds.), Proceedings of the second international conference on language resources and evaluation, 887−893. Paris: ELRA.Google Scholar
  27. Paris, G., A. Weber, and M.W. Crocker. 2006. German morphosyntactic gender and lexical access. Poster presented at the 12th annual conference on architectures and mechanisms for language processing (AMLaP 2006), Nijmegen, Netherlands.Google Scholar
  28. Schneider, W., A. Eschman, and A. Zuccolotto. 2002. E-Prime user’s guide. Pittsburgh: Psychology Software Tools Inc.Google Scholar
  29. Snodgrass, J.G., and M. Vanderwart. 1980. A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 6: 174–215.Google Scholar
  30. Spivey, M.J., and V. Marian. 1999. Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science 10: 281–284.CrossRefGoogle Scholar
  31. Tanenhaus, M.K., and J.C. Trueswell. 2006. Eye movements and spoken language comprehension. In Handbook of psycholinguistics, 2nd ed, ed. M. Traxler, and M. Gernsbacher, 86–900. Amsterdam: Elsevier.Google Scholar
  32. Tanenhaus, M.K., M.J. Spivey-Knowlton, K.M. Eberhard, and J.C. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science 268: 1632–1634.CrossRefGoogle Scholar
  33. Weber, A., G. Paris. 2004. The origin of the linguistic gender effect in spoken-word recognition: Evidence from non-native listening. Poster presented at the 26th Annual Meeting of the Cognitive Science Society (CogSci 2004), Chicago, IL.Google Scholar
  34. Wood, S. 2006. Generalized additive models: An introduction with R. Boca Raton: Chapman & Hall/CRC Press.Google Scholar

Copyright information

© The Author(s) 2016

Authors and Affiliations

  • Sanne M. Berends
    • 1
  • Susanne M. Brouwer
    • 2
  • Simone A. Sprenger
    • 1
  1. 1.Center for Language and Cognition, Faculty of ArtsUniversity of GroningenGroningenThe Netherlands
  2. 2.Department of Special Education: Cognitive and Motor DisabilitiesUniversity of UtrechtUtrechtThe Netherlands

Personalised recommendations