Psychonomic Bulletin & Review

, Volume 17, Issue 5, pp 718–724 | Cite as

Coordinating spatial referencing using shared gaze

  • Mark B. NeiderEmail author
  • Xin Chen
  • Christopher A. Dickinson
  • Susan E. Brennan
  • Gregory J. Zelinsky
Brief Reports


To better understand the problem of referencing a location in space under time pressure, we had two remotely located partners (A, B) attempt to locate and reach consensus on a sniper target, which appeared randomly in the windows of buildings in a pseudorealistic city scene. The partners were able to communicate using speech alone (shared voice), gaze cursors alone (shared gaze), or both. In the shared-gaze conditions, a gaze cursor representing Partner A’s eye position was superimposed over Partner B’s search display and vice versa. Spatial referencing times (for both partners to find and agree on targets) were faster with shared gaze than with speech, with this benefit due primarily to faster consensus (less time needed for one partner to locate the target after it was located by the other partner). These results suggest that sharing gaze can be more efficient than speaking when people collaborate on tasks requiring the rapid communication of spatial information. Supplemental materials for this article may be downloaded from


Joint Attention Communication Condition Spatial Reference Locate Partner Search Error 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Supplementary material (5.3 mb)
Supplementary material, approximately 340 KB.


  1. Baldwin, D. A. (1995). Understanding the link between joint attention and language. In C. Moore & P. J. Dunhams (Eds.), Joint attention: Its origins and role in development (pp. 131–158). Hillsdale, NJ: Erlbaum.Google Scholar
  2. Baron-Cohen, S. (1995). The eye direction detector (EDD) and the shared attention mechanism (SAM): Two cases for evolutionary psychology. In C. Moore & P. J. Dunhams (Eds.), Joint attention: Its origins and role in development (pp. 41–60). Hillsdale, NJ: Erlbaum.Google Scholar
  3. Brennan, S. E. (2005). How conversation is shaped by visual and spoken evidence. In J. C. Trueswell & M. Tannenhaus (Eds.), Approaches to studying world-situated language use: Bridging the language-asproduct and language-action traditions (pp. 95–129). Cambridge, MA: MIT Press.Google Scholar
  4. Brennan, S. E., Chen, X., Dickinson, C. A., Neider, M. B., & Zelinsky, G. J. (2008). Coordinating cognition: The costs and benefits of shared gaze during collaborative search. Cognition, 106, 1465–1477.CrossRefPubMedGoogle Scholar
  5. Brennan, S. E., & Lockridge, C. B. (2006). Computer-mediated communication: A cognitive science approach. In K. Brown (Ed. in chief ), Encyclopedia of language and linguistics (2nd ed., pp. 775–780). Boston: Elsevier.CrossRefGoogle Scholar
  6. Carletta, J., Hill, R. L., Nicol, C., Taylor, T., De Ruiter, J. P., & Bard, E. G. (2010). Eyetracking for two-person tasks with manipulation of a virtual world. Behavior Research Methods, 42, 254–265.CrossRefPubMedGoogle Scholar
  7. Carlson, L. A., & Logan, G. D. (2001). Using spatial terms to select an object. Memory & Cognition, 29, 883–892.CrossRefGoogle Scholar
  8. Clark, H. H. (1996). Using language. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  9. Clark, H. H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick, J. Levine, & S. D. Behrend (Eds.), Perspectives on socially shared cognition (pp. 127–149). San Mateo, CA: Morgan Kaufman.CrossRefGoogle Scholar
  10. Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 22, 1–39.CrossRefPubMedGoogle Scholar
  11. Garrod, S., & Anderson, A. (1987). Saying what you mean in dialogue: A study in conceptual and semantic co-ordination. Cognition, 27, 181–219.CrossRefPubMedGoogle Scholar
  12. Gergle, D., Kraut, R. E., & Fussell, S. R. (2004). Language efficiency and visual technology: Minimizing collaborative effort with visual information. Journal of Language & Social Psychology, 23, 491–517.CrossRefGoogle Scholar
  13. Gibson, J. J., & Pick, A. D. (1963). Perception of another person’s looking behavior. American Journal of Psychology, 76, 386–394.CrossRefPubMedGoogle Scholar
  14. Hanna, J. E., & Brennan, S. E. (2007). Speakers’ eye gaze disambiguates referring expressions early during face-to-face conversation. Journal of Memory & Language, 57, 596–615.CrossRefGoogle Scholar
  15. Jacob, R. J. K. (1995). Eye tracking in advanced interface design. In W. Barfield & T. A. Furness (Eds.), Virtual environments and advanced interface design (pp. 258–308). New York: Oxford University Press.Google Scholar
  16. Logan, G. D. (1995). Linguistic and conceptual control of visual spatial attention. Cognitive Psychology, 28, 103–174.CrossRefPubMedGoogle Scholar
  17. Logan, G. D., & Sadler, D. D. (1996). A computational analysis of the apprehension of spatial relations. In P. Bloom, M. A. Peterson, L. Nadel, & M. Garret (Eds.), Language and space (pp. 493–529), Cambridge, MA: MIT Press.Google Scholar
  18. Pechmann, T., & Deutsch, W. (1982). The development of verbal and nonverbal devices for reference. Journal of Experimental Child Psychology, 34, 330–341.CrossRefGoogle Scholar
  19. Pusch, M., & Loomis, J. M. (2001). Judging another person’s facing direction using peripheral vision. Journal of Vision, 1(3), 288a.CrossRefGoogle Scholar
  20. Schmidt, C. L. (1999). Adult understanding of spontaneous attentiondirecting events: What does gesture contribute? Ecological Psychology, 11, 139–174.CrossRefGoogle Scholar
  21. Velichkovsky, B. M. (1995). Communicating attention: Gaze position transfer in cooperative problem solving. Pragmatics & Cognition, 3, 199–222.CrossRefGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 2010

Authors and Affiliations

  • Mark B. Neider
    • 1
    Email author
  • Xin Chen
    • 2
  • Christopher A. Dickinson
    • 3
  • Susan E. Brennan
    • 4
  • Gregory J. Zelinsky
    • 4
  1. 1.Beckman Institute for Advanced Science and TechnologyUniversity of Illinois at Urbana-ChapaignUrbana
  2. 2.Stony Brook UniversityStony Brook
  3. 3.Appalachian State UniversityBoone
  4. 4.Stony Brook UniversityStony Brook

Personalised recommendations