Probing the time course of facilitation and inhibition in gaze cueing of attention in an upper-limb reaching task
Abstract
Previous work has revealed that social cues, such as gaze and pointed fingers, can lead to a shift in the focus of another person’s attention. Research investigating the mechanisms of these shifts of attention has typically employed detection or localization button-pressing tasks. Because in-depth analyses of the spatiotemporal characteristics of aiming movements can provide additional insights into the dynamics of the processing of stimuli, in the present study we used a reaching paradigm to further explore the processing of social cues. In Experiments 1 and 2, participants aimed to a left or right location after a nonpredictive eye gaze cue toward one of these target locations. Seven stimulus onset asynchronies (SOAs), from 100 to 2,400 ms, were used. Both the temporal (reaction time, RT) and spatial (initial movement angle, IMA) characteristics of the movements were analyzed. RTs were shorter for cued (gazed-at) than for uncued targets across most SOAs. There were, however, no statistical differences in IMAs between movements to cued and uncued targets, suggesting that action planning was not affected by the gaze cue. In Experiment 3, the social cue was a finger pointing to one of the two target locations. Finger-pointing cues generated significant cueing effects in both RTs and IMAs. Overall, these results indicate that eye gaze and finger-pointing social cues are processed differently. Perception–action coupling (i.e., a tight link between the response and the social cue that is presented) might play roles in both the generation of action and the deviation of trajectories toward cued and uncued targets.
Keywords
Attention Eye movements Visual attention Goal-directed movementsNotes
Acknowledgements
This research was supported by grants and scholarships from the Natural Sciences and Engineering Research Council of Canada. The authors thank Joëlle Hajj and Saba Taravati for their help with data collection.
Compliance with ethical standards
Open Practices Statement
None of the data or materials for the experiments reported here is openly available, and none of the experiments was preregistered.
References
- Ariga, A., & Watanabe, K. (2009). What is special about the index finger? The index finger advantage in manipulating reflexive attentional shift. Japanese Psychological Research, 51, 258–265. https://doi.org/10.1111/j.1468-5884.2009.00408.x CrossRefGoogle Scholar
- Atkinson, M. A., Simpson, A., Skarratt, P. A., & Cole, G. G. (2014). Is social inhibition of return due to action co-representation? Acta Psychologica, 150, 85–93. https://doi.org/10.1016/j.actpsy.2014.04.003 CrossRefPubMedPubMedCentralGoogle Scholar
- Atkinson, M. A., Simpson, A. A., & Cole, G. G. (2018). Visual attention and action: How cueing, direct mapping, and social interactions drive orienting. Psychonomic Bulletin & Review, 25, 1585–1605. https://doi.org/10.3758/s13423-017-1354-0 CrossRefGoogle Scholar
- Bekkering, H., & Neggers, S. F. W. (2002). Visual search is modulated by action intentions. Psychological Research, 13, 370–374. https://doi.org/10.1111/j.0956-7976.2002.00466.x CrossRefGoogle Scholar
- Böckler, A., van der Wel, R. P. R. D., & Welsh, T. N. (2014). Catching eyes: Effects of social and nonsocial cues on attention capture. Psychological Science, 25, 720–727. https://doi.org/10.1177/0956797613516147 CrossRefPubMedPubMedCentralGoogle Scholar
- Böckler, A., van der Wel, R. P. R. D., & Welsh, T. N. (2015). Eyes only? Perceiving eye contact is neither sufficient nor necessary for attentional capture by face direction. Acta Psychologica, 160, 134–140. https://doi.org/10.1016/J.ACTPSY.2015.07.009 CrossRefPubMedGoogle Scholar
- Chapman, C. S., Gallivan, J. P., Wood, D. K., Milne, J. L., Culham, J. C., & Goodale, M. A. (2010). Reaching for the unknown: Multiple target encoding and real-time decision-making in a rapid reach task. Cognition, 116, 168–176. https://doi.org/10.1016/j.cognition.2010.04.008 CrossRefPubMedPubMedCentralGoogle Scholar
- Cheal, M., & Lyon, D. R. (1991). Central and peripheral precuing of forced-choice discrimination. Quarterly Journal of Experimental Psychology, 43A, 859–880. https://doi.org/10.1080/14640749108400960 CrossRefGoogle Scholar
- Cisek, P., & Kalaska, J. F. (2010). Neural mechanisms for interacting with a world full of action choices. Annual Review of Neuroscience, 33, 269–298. https://doi.org/10.1146/annurev.neuro.051508.135409 CrossRefPubMedPubMedCentralGoogle Scholar
- Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E., & Baron-Cohen, S. (1999). Gaze perception triggers reflexive visuospatial orienting. Visual Cognition, 6, 509–540. https://doi.org/10.1080/135062899394920 CrossRefGoogle Scholar
- Elliott, D., Hansen, S., Grierson, L. E. M., Lyons, J., Bennett, S. J., & Hayes, S. J. (2010). Goal-directed aiming: two components but multiple processes. Psychological Bulletin, 136, 1023–1044. https://doi.org/10.1037/a0020958 CrossRefGoogle Scholar
- Flanagan, J. R., & Johansson, R. S. (2003). Action plans used in action observation. Nature, 424, 769.CrossRefGoogle Scholar
- Friesen, C. K., & Kingstone, A. (1998). The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin & Review, 5, 490–495. https://doi.org/10.3758/BF03208827 CrossRefGoogle Scholar
- Friesen, C. K., Ristic, J., & Kingstone, A. (2004). Attentional effects of counterpredictive gaze and arrow cues. Journal of Experimental Psychology: Human Perception and Performance, 30, 319–329. https://doi.org/10.1037/0096-1523.30.2.319 CrossRefPubMedGoogle Scholar
- Frischen, A., Bayliss, A. P., & Tipper, S. P. (2007a). Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychological Bulletin, 133, 694–724. https://doi.org/10.1037/0033-2909.133.4.694 CrossRefPubMedPubMedCentralGoogle Scholar
- Frischen, A., Smilek, D., Eastwood, J. D., & Tipper, S. P. (2007b). Inhibition of return in response to gaze cues: The roles of time course and fixation cue. Visual Cognition, 15, 881–895. https://doi.org/10.1080/13506280601112493 CrossRefGoogle Scholar
- Frischen, A., & Tipper, S. P. (2004). Orienting attention via observed gaze shift evokes longer term inhibitory effects: implications for social interactions, attention, and memory. Journal of Experimental Psychology: General, 133, 516–533. https://doi.org/10.1037/0096-3445.133.4.516 CrossRefGoogle Scholar
- Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119, 593–609. https://doi.org/10.1093/brain/119.2.593 CrossRefPubMedGoogle Scholar
- Gallivan, J. P., & Chapman, C. S. (2014). Three-dimensional reach trajectories as a probe of real-time decision-making between multiple competing targets. Frontiers in Neuroscience, 8, 215:1–19. https://doi.org/10.3389/fnins.2014.00215 CrossRefGoogle Scholar
- Grèzes, J., & Decety, J. (2001). Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta-analysis. Human Brain Mapping, 12, 1–19. https://doi.org/10.1002/1097-0193(200101)12:1<1::AID-HBM10>3.0.CO;2-V CrossRefPubMedGoogle Scholar
- Kandel, E. R., Schwartz, J. H., & Jessell, T. M. (2000). Principles of neural science (4th). New York: McGraw-Hill.Google Scholar
- Klein, R. M. (2000). Inhibition of return. Trends in Cognitive Sciences, 4, 138–147. https://doi.org/10.1016/S1364-6613(00)01452-2 CrossRefPubMedGoogle Scholar
- Lee, D. (1999). Effects of exogenous and endogenous attention on visually guided hand movements. Cognitive Brain Research, 8, 143–156. https://doi.org/10.1016/S0926-6410(99)00014-2 CrossRefPubMedGoogle Scholar
- Lins, J., & Schöner, G. (2019). Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding. Attention, Perception, & Psychophysics, 81, xxx–xxx. Google Scholar
- Marotta, A., Lupiáñez, J., Martella, D., & Casagrande, M. (2012). Eye gaze versus arrows as spatial cues: Two qualitatively different modes of attentional selection. Journal of Experimental Psychology: Human Perception and Performance, 38, 326–335. https://doi.org/10.1037/a0023959 CrossRefPubMedGoogle Scholar
- Marotta, A., Román-Caballero, R., & Lupiáñez, J. (2018). Arrows don’t look at you: Qualitatively different attentional mechanisms triggered by gaze and arrows. Psychonomic Bulletin & Review, 25, 2254–2259. https://doi.org/10.3758/s13423-018-1457-2 CrossRefGoogle Scholar
- Moher, J., & Song, J.-H. (2013). Context-dependent sequential effects of target selection for action. Journal of Vision, 13(8):1–13. https://doi.org/10.1167/13.8.10 CrossRefGoogle Scholar
- Muller, H. J., & Rabbitt, P. M. A. (1989). Reflexive and voluntary orienting of visual attention: Time course of activation and resistance to interruption. Journal of Experimental Psychology: Human Perception and Performance, 15, 315–330. https://doi.org/10.1037/0096-1523.15.2.315 CrossRefPubMedGoogle Scholar
- Neyedli, H. F., & Welsh, T. N. (2012). The processes of facilitation and inhibition in a cue–target paradigm: Insight from movement trajectory deviations. Acta Psychologica, 139, 159–165. https://doi.org/10.1016/j.actpsy.2011.11.001 CrossRefPubMedPubMedCentralGoogle Scholar
- Peelen, M. V, & Downing, P. E. (2007). The neural basis of visual body perception. Nature Reviews Neuroscience, 8, 636.CrossRefGoogle Scholar
- Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3–25. https://doi.org/10.1080/00335558008248231 CrossRefPubMedPubMedCentralGoogle Scholar
- Posner, M. I., & Cohen, Y. (1984). Components of visual orienting. In H. Bouma & D. G. Bowhuis (Eds.), Attention and performance X (pp. 531–556). Hillsdale: Erlbaum. https://doi.org/10.1162/jocn.1991.3.4.335 CrossRefGoogle Scholar
- Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192. https://doi.org/10.1146/annurev.neuro.27.070203.144230 CrossRefGoogle Scholar
- Song, J.-H., & Nakayama, K. (2009). Hidden cognitive states revealed in choice reaching tasks. Trends in Cognitive Sciences, 13, 360–366. https://doi.org/10.1016/j.tics.2009.04.009 CrossRefPubMedPubMedCentralGoogle Scholar
- Tipper, S. P., Lortie, C., & Baylis, G. C. (1992). Selective reaching: Evidence for action-centered attention. Journal of Experimental Psychology: Human Perception and Performance, 18, 891–905. https://doi.org/10.1037//0096-1523.18.4.891 CrossRefPubMedPubMedCentralGoogle Scholar
- Welsh, T. N. (2011). The relationship between attentional capture and deviations in movement trajectories in a selective reaching task. Acta Psychologica, 137, 300–308. https://doi.org/10.1016/j.actpsy.2011.03.011 CrossRefPubMedGoogle Scholar
- Welsh, T. N., & Elliott, D. (2004). Movement trajectories in the presence of a distracting stimulus: evidence for a response activation model of selective reaching. Quarterly Journal of Experimental Psychology, 57A, 1031–1057. https://doi.org/10.1080/02724980343000666 CrossRefGoogle Scholar
- Welsh, T. N., Neyedli, H. F., & Tremblay, L. (2013). Refining the time course of facilitation and inhibition in attention and action. Neuroscience Letters, 554, 6–10. https://doi.org/10.1016/j.neulet.2013.08.055 CrossRefPubMedPubMedCentralGoogle Scholar
- Welsh, T. N., Pacione, S. M., Neyedli, H. F., Ray, M., & Ou, J. (2015). Trajectory deviations in spatial compatibility tasks with peripheral and central stimuli. Psychological Research, 79, 650–657. https://doi.org/10.1007/s00426-014-0597-x CrossRefPubMedPubMedCentralGoogle Scholar
- Welsh, T. N., & Pratt, J. (2008). Actions modulate attentional capture. Quarterly Journal of Experimental Psychology, 61, 968–976. https://doi.org/10.1080/17470210801943960 CrossRefGoogle Scholar
- Welsh, T. N., & Weeks, D. J. (2010). Visual selective attention and action. In D. Elliott & M. A. Khan (Eds.), Vision and goal-directed movement: Neurobehavioural perspectives (pp. 39–58). Champaign: Human Kinetics.Google Scholar
- Welsh, T. N., & Zbinden, M. (2009). Fitts’s law in a selective reaching task: The proximity-to-hand effect of action-centered attention revisited. Motor Control, 13, 100–112.CrossRefGoogle Scholar