Experimental Brain Research

, Volume 179, Issue 3, pp 427–442 | Cite as

Look-ahead fixations: anticipatory eye movements in natural tasks

Research Article

Abstract

During performance of natural tasks subjects sometimes fixate objects that are manipulated several seconds later. Such early looks are known as “look-ahead fixations” (Pelz and Canosa in Vision Res 41(25–26):3587–3596, 2001). To date, little is known about their function. To investigate the possible role of these fixations, we measured fixation patterns in a model-building task. Subjects assembled models in two sequences where reaching and grasping were interrupted in one sequence by an additional action. Results show look-ahead fixations prior to 20% of the reaching and grasping movements, occurring on average 3 s before the reach. Their frequency was influenced by task sequence, suggesting that they are purposeful and have a role in task planning. To see if look-aheads influenced the subsequent eye movement during the reach, we measured eye-hand latencies and found they increased by 122 ms following a look-ahead to the target. The initial saccades to the target that accompanied a reach were also more accurate following a look-ahead. These results demonstrate that look-aheads influence subsequent visuo-motor coordination, and imply that visual information on the temporal and spatial structure of the scene was retained across intervening fixations and influenced subsequent movement programming. Additionally, head movements that accompanied look-aheads were significantly smaller in amplitude (by 10°) than those that accompanied reaches to the same locations, supporting previous evidence that head movements play a role in the control of hand movements. This study provides evidence of the anticipatory use of gaze in acquiring information about objects for future manipulation.

Keywords

Eye movements Complex action Natural tasks Prediction Human 

Supplementary material

Video object (MPG 26,454 kb)

References

  1. Abrams R, Meyer D, Kornblum S (1990) Eye-hand coordination: oculomotor control in rapid aimed limb movements. J Exp Psychol Hum Percept Perform 15:248–267Google Scholar
  2. Aivar MP, Hayhoe MM, Chizk CL, Mruczek REB (2005) Spatial memory and saccadic targeting in a natural task. J Vis 5(3):177–193PubMedCrossRefGoogle Scholar
  3. Andrews TJ, Coppola DM (1999) Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments. Vision Res 39(17):2947–2953PubMedCrossRefGoogle Scholar
  4. Babcock JS, Pelz JB (2004) The RIT Wearable Eyetracker. In: ACM SIGCHI eye tracking research & applications symposium 2000, pp 109–114Google Scholar
  5. Ballard DH, Hayhoe MM, Li F, Whitehead SD (1992) Hand-eye coordination during sequential tasks. Philos Trans R Soc Lond B Biol Sci 337(1281):331–338; discussion 338–339Google Scholar
  6. Ballard DH, Hayhoe MM, Pelz JB (1995) Memory representations in natural tasks. J Cogn Neurosci 7(1):66–80CrossRefGoogle Scholar
  7. Ballard D, Sprague N (2005) Modeling the brain's operating system. Lect Notes Comput Sci 3704: 347–366CrossRefGoogle Scholar
  8. Batista AP, Buneo CA, Snyder LH, Andersen RA (1999) Reach plans in eye-centered coordinates. Science 285(5425):257–260PubMedCrossRefGoogle Scholar
  9. Biguer B, Jeannerod M, Prablanc C (1985) The role of position of gaze in movement accuracy. In: Posner M, Marin O (eds) Mechanisms of attention (attention and performance XI). Erlbaum, HillsdaleGoogle Scholar
  10. Boussaoud D, Jouffrais C, Bremmer F (1998) Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. J Neurophysiol 80(3):1132–1150PubMedGoogle Scholar
  11. Buneo CA, Jarvis MR, Batista AP, Andersen RA (2002) Direct visuomotor transformations for reaching. Nature 416(6881):632–636PubMedCrossRefGoogle Scholar
  12. Calton JL, Dickinson AR, Snyder LH (2002) Non-spatial, motor-specific activation in posterior parietal cortex. Nature Neurosci 5(6):580–588PubMedCrossRefGoogle Scholar
  13. Carey DP (2000) Eye-hand coordination: Eye to hand or hand to eye? Curr Biol 10(11):R416–R419PubMedCrossRefGoogle Scholar
  14. Chun MM (2000) Contextual cueing of visual attention. Trends Cogn Sci 4(5):170–178PubMedCrossRefGoogle Scholar
  15. Chun MM, Jiang YH (1998) Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cogn Psychol 36(1):28–71CrossRefPubMedGoogle Scholar
  16. Chun MM, Nakayama K (2000) On the functional role of implicit visual memory for the adaptive deployment of attention across scenes. Vision Cogn 7(1–3):65–81Google Scholar
  17. De Graef P, Verfaille K, Lamote C (2001) Transsaccadic coding of object position: effects of saccadic status and allocentric reference frame. Psychol Belg 41:29–54Google Scholar
  18. Epelboim J, Steinman RM, Kowler E, Edwards M, Pizlo Z, Erkelens CJ et al (1995) The function of visual-search and memory in sequential looking tasks. Vision Res 35(23–24):3401–3422PubMedCrossRefGoogle Scholar
  19. Flanders M, Daghestani L, Berthoz A (1999) Reaching beyond reach. Exp Brain Res 126(1):19–30PubMedCrossRefGoogle Scholar
  20. Forde EME, Humphreys GW (2002) Dissociations in routine behaviour across patients and everyday tasks. Neurocase 8(1–2):151–167PubMedCrossRefGoogle Scholar
  21. Forde EME, Humphreys GW, Remoundou M (2004) Disordered knowledge of action and action disorganization syndrome. Neurocase 10(1):19–28PubMedCrossRefGoogle Scholar
  22. Forde E, Rusted J, Humphreys G, Mennie N, Land M (2006) The eyes have it: an exploration of eye movements in action disorganisation syndrome (under review)Google Scholar
  23. Freedman EG, Stanford TR, Sparks DL (1996) Combined eye-head gaze shifts produced by electrical stimulation of the superior colliculus in rhesus monkeys. J Neurophysiol 76(2):927–952PubMedGoogle Scholar
  24. Fujii N, Mushiake H, Tanji J (2002) Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and pre-SMA of monkeys. J Neurophysiol 87(4):2158–2166PubMedGoogle Scholar
  25. Hayhoe M (2000) Vision using routines: a functional account of vision. Vision Cogn 7(1–3):43–64CrossRefGoogle Scholar
  26. Hayhoe M, Lachter J, Moeller P (1992) Spatial memory and integration across saccadic eye movements. In: Rayner K (ed) Eye movements and visual cognition: scene perception and reading. Springer, Berlin Heidelberg New York, pp 130–145Google Scholar
  27. Hayhoe MM, Shrivastava A, Mruczek R, Pelz JB (2003) Visual memory and motor planning in a natural task. J Vis 3(1):49–63PubMedCrossRefGoogle Scholar
  28. Henderson JM, Hollingworth A (1999) High-level scene perception. Ann Rev Psychol 50:243–271CrossRefGoogle Scholar
  29. Henderson JM, Williams CC, Falk RJ (2005) Eye movements are functional during face learning. Mem Cogn 33:98–106Google Scholar
  30. Hodgson TL, Bajwa A, Owen AM, Kennard C (2000) The strategic control of gaze direction in the tower of London task. J Cogn Neurosci 12(5):894–907PubMedCrossRefGoogle Scholar
  31. Hollingworth A, Henderson JM (2002) Accurate visual memory for previously attended objects in natural scenes. J Exp Psychol-Hum Percept Perform 28(1):113–136CrossRefGoogle Scholar
  32. Humphreys GW, Forde EME (1998) Disordered action schema and action disorganisation syndrome. Cogn Neuropsychol 15(6–8):771–811Google Scholar
  33. Irwin D, Andrews R (1996) Integration and accumulation of information across saccadic eye movements. In: Inui T, McClelland JL (eds) Attention and performance XVI: information integration in perception and communication. MIT, Cambridge, pp 125–155Google Scholar
  34. Irwin DE (1991) Information integration across saccadic eye movements. Cognit Psychol 23(3):420–456PubMedCrossRefGoogle Scholar
  35. Irwin DE, Zacks JL, Brown JS (1990) Visual memory and the perception of a stable visual environment. Percept Psychophys 47(1):35–46PubMedGoogle Scholar
  36. Jeannerod M (1988) The neural and behavioral organisation of goal-directed movements. Oxford University Press, OxfordGoogle Scholar
  37. Johansson RS, Westling GR, Backstrom A, Flanagan JR (2001) Eye-hand coordination in object manipulation. J Neurosci 21(17):6917–6932PubMedGoogle Scholar
  38. Land M, Mennie N, Rusted J (1999) The roles of vision and eye movements in the control of activities of daily living. Perception 28(11):1311–1328PubMedCrossRefGoogle Scholar
  39. Land MF, Furneaux S (1997) The knowledge base of the oculomotor system. Philos Trans R Soc Lond Ser B-Biol Sci 352(1358):1231–1239CrossRefGoogle Scholar
  40. Land MF, Lee DN (1994) Where we look when we steer. Nature 369(6483):742–744PubMedCrossRefGoogle Scholar
  41. Land MF, McLeod P (2000) From eye movements to actions: how batsmen hit the ball. Nature Neurosci 3(12):1340–1345PubMedCrossRefGoogle Scholar
  42. Melcher D, Kowler E (2001) Visual scene memory and the guidance of saccadic eye movements. Vision Res 41(25–26):3597–3611PubMedCrossRefGoogle Scholar
  43. O’Regan JK (1992) Solving the “real” mysteries of visual perception: the world as an outside memory. Can J Psychol 46(3):461–488PubMedGoogle Scholar
  44. O’Regan JK, Levy-Schoen A (1983) Integrating visual information from successive fixations: does trans-saccadic fusion exist? Vision Res 23(8):765–768PubMedCrossRefGoogle Scholar
  45. Patla AE, Vickers JN (1997) Where and when do we look as we approach and step over an obstacle in the travel path? Neuroreport 8(17):3661–3665PubMedCrossRefGoogle Scholar
  46. Pelz J, Hayhoe M, Loeber R (2001) The coordination of eye, head, and hand movements in a natural task. Exp Brain Res 139(3):266–277PubMedCrossRefGoogle Scholar
  47. Pelz JB, Canosa R (2001) Oculomotor behavior and perceptual strategies in complex tasks. Vision Res 41(25–26):3587–3596PubMedCrossRefGoogle Scholar
  48. Rothkopf C, Pelz J (2004) Head movement estimation for wearable eye trackers. In: Paper presented at the ACM SIGCHI eye tracking research & applications symposium 2000, San AntonioGoogle Scholar
  49. Schwartz MF, Montgomery MW, Fitzpatrick-DeSalme EJ, Ochipa C, Coslett H, Mayer N (1995) Analysis of a disorder of everyday action. Cognit Neuropsychol 12:863–892CrossRefGoogle Scholar
  50. Smeets JBJ, Hayhoe MM, Ballard DH (1996) Goal-directed arm movements change eye-head coordination. Exp Brain Res 109(3):434–440PubMedCrossRefGoogle Scholar
  51. Tatler BW, Gilchrist ID, Rusted J (2003) The time course of abstract visual representation. Perception 32(5):579–592PubMedCrossRefGoogle Scholar
  52. Terao Y, Andersson NEM, Flanagan JR, Johansson RS (2002) Engagement of gaze in capturing targets for future sequential manual actions. J Neurophysiol 88(4):1716–1725PubMedGoogle Scholar

Copyright information

© Springer-Verlag 2006

Authors and Affiliations

  1. 1.School of PsychologyUniversity of NottinghamNottinghamUK
  2. 2.Department of PsychologyThe University of Texas at AustinAustinUSA

Personalised recommendations