Attention, Perception, & Psychophysics

, Volume 81, Issue 1, pp 158–172 | Cite as

Visual perspective taking for avatars in a Simon task

  • Christian BöffelEmail author
  • Jochen Müsseler


In modern digital applications, users often interact with virtual representations of themselves or others, called avatars. We examined how these avatars and their perspectives influence stimulus–response compatibility in a Simon task. Participants responded to light/dark blue stimuli with left/right key presses in the presence of a task-irrelevant avatar. Changes in stimulus–response compatibility were used to quantify changes in the mental representation of the task and perspective taking toward this avatar. Experiments 1 and 2 showed that perspective taking for an avatar occurred in orthogonal stimulus–response mappings, causing a compatibility effect from the avatar’s point of view. In the following two experiments we introduced a larger variety of angular disparities between the participant and avatar. In Experiment 3, the Simon effect with lateralized stimulus positions remained largely unaffected by the avatar, pointing toward an absence of perspective taking. In Experiment 4, after avatar hand movements were added in order to strengthen the participants’ sense of agency over the avatar, a spatial compatibility effect from the avatar’s perspective was observed again, and hints of the selective use of perspective taking on a trial-by-trial basis were found. Overall, the results indicate that users can incorporate the perspective of an avatar into their mental representation of a situation, even when this perspective is unnecessary to complete a task, but that certain contextual requirements have to be met.


Avatar Orthogonal compatibility Perspective taking Simon effect Stimulus–response compatibility Action effects 


  1. Ansorge, U., & Wühr, P. (2004). A response-discrimination account of the Simon effect. Journal of Experimental Psychology: Human Perception and Performance, 30, 365–377. PubMedGoogle Scholar
  2. Avraamides, M. N., Hatzipanayioti, A., & Galati, A. (2015). What’s so difficult with adopting imagined perspectives? Cognitive Processing, 16, 121–124. CrossRefPubMedGoogle Scholar
  3. Bauer, D. W., & Miller, J. (1982). Stimulus–response compatibility and the motor system. Quarterly Journal of Experimental Psychology, 34A, 367–380. CrossRefGoogle Scholar
  4. Böffel, C., & Müsseler, J. (2018). Perceived ownership of avatars influences visual perspective taking, Frontiers in Psychology, 9(May), 1–9.
  5. Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10, 433–436. CrossRefPubMedGoogle Scholar
  6. Brebner, J., Shephard, M., & Cairney, P. (1972). Spatial relationships and S–R compatibility. Acta Psychologica, 36, 1–15. CrossRefPubMedGoogle Scholar
  7. Cho, Y. S., & Proctor, R. W. (2003). Stimulus and response representations underlying orthogonal stimulus–response compatibility effects. Psychonomic Bulletin & Review, 10, 45–73. CrossRefGoogle Scholar
  8. Cho, Y. S., & Proctor, R. W. (2005). Representing response position relative to display location: Influence on orthogonal stimulus–response compatibility. Quarterly Journal of Experimental Psychology, 58A, 839–864. CrossRefGoogle Scholar
  9. Cho, Y. S., Proctor, R. W., & Yamaguchi, M. (2008). Influences of response position and hand posture on the orthogonal Simon effect. Quarterly Journal of Experimental Psychology, 61, 1020–1035. CrossRefGoogle Scholar
  10. Cooper, L. A., & Shepard, R. N. (1973). The time required to prepare for a rotated stimulus. Memory & Cognition, 1, 246–250. CrossRefGoogle Scholar
  11. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. CrossRefPubMedGoogle Scholar
  12. Fitts, P. M., & Deininger, R. L. (1954). S–R compatibility: Correspondence among paired elements within stimulus and response codes. Journal of Experimental Psychology, 48, 483–492. CrossRefPubMedGoogle Scholar
  13. Flavell, J. H., Green, F. L., Flavell, E. R., Watson, M. W., & Campione, J. C. (1986). Development of knowledge about the appearance–reality distinction. Monographs of the Society for Research in Child Development, 51(1), 1–87. CrossRefGoogle Scholar
  14. Franz, E. A., Sebastian, A., Hust, C., & Norris, T. (2008). Viewer perspective affects central bottleneck requirements in spatial translation tasks. Journal of Experimental Psychology: Human Perception and Performance, 34, 398–412. PubMedGoogle Scholar
  15. Freundlieb, M., Kovács, Á. M., & Sebanz, N. (2016). When do humans spontaneously adopt another’s visuospatial perspective? Journal of Experimental Psychology: Human Perception and Performance, 42, 401–412. PubMedGoogle Scholar
  16. Freundlieb, M., Sebanz, N., & Kovács, Á. M. (2017). Out of your sight, out of my mind: Knowledge about another person’s visual access modulates spontaneous visuospatial perspective-taking. Journal of Experimental Psychology: Human Perception and Performance, 43, 1065–1072. PubMedGoogle Scholar
  17. Gardner, M. R., & Potts, R. (2011). Domain general mechanisms account for imagined transformations of whole body perspective. Acta Psychologica, 137, 371–381. CrossRefPubMedGoogle Scholar
  18. Hedge, A., & Marsh, N. W. A. (1975). The effect of irrelevant spatial correspondences on two-choice response-time. Acta Psychologica, 39, 427–439. CrossRefPubMedGoogle Scholar
  19. Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32, 175–191. CrossRefGoogle Scholar
  20. Hommel, B. (2011). The Simon effect as tool and heuristic. Acta Psychologica, 136, 189–202. CrossRefPubMedGoogle Scholar
  21. Hommel, B. (2015). The theory of event coding (TEC) as embodied-cognition framework. Frontiers in Psychology, 6, 1318:1–5. Google Scholar
  22. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The Theory of Event Coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849–878, disc. 878–937. CrossRefPubMedGoogle Scholar
  23. Janczyk, M. (2013). Level 2 perspective taking entails two processes: Evidence from PRP experiments. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 1878–1887.
  24. Kornblum, S., Hasbroucq, T., & Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy. Psychological Review, 97, 253–270. CrossRefPubMedGoogle Scholar
  25. Kunde, W. (2001). Response–effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance, 27, 387–394. PubMedGoogle Scholar
  26. Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t tests and ANOVAs. Frontiers in Psychology, 4, 1–12. CrossRefGoogle Scholar
  27. Lippa, Y., & Adam, J. J. (2001). An explanation of orthogonal S–R compatibility effects that vary with hand or response position: the end-state comfort hypothesis. Perception & Psychophysics, 63, 156–174. CrossRefGoogle Scholar
  28. May, M., & Wendt, M. (2013). Visual perspective taking and laterality decisions: Problems and possible solutions. Frontiers in Human Neuroscience, 7, 549:1–7. Google Scholar
  29. Michelon, P., & Zacks, J. M. (2006). Two kinds of visual perspective taking. Perception & Psychophysics, 68, 327–337. CrossRefGoogle Scholar
  30. Morey, R. D. (2008). Confidence intervals from normalized data: A correction to Cousineau (2005). Tutorials in Quantitative Methods for Psychology, 4, 61–64. CrossRefGoogle Scholar
  31. Müsseler, J., Kunde, W., Gausepohl, D., & Heuer, H. (2008). Does a tool eliminate spatial compatibility effects? European Journal of Cognitive Psychology, 20, 211–231. CrossRefGoogle Scholar
  32. Müsseler, J., Ruhland, L., & Böffel, C. (2018). Reversed effect of spatial compatibility when taking avatar’s perspective. Quarterly Journal of Experimental Psychology. Advance online publication.
  33. Müsseler, J., & Skottke, E.-M. (2011). Compatibility relationships with simple lever tools. Human Factors, 53, 383–390. CrossRefPubMedGoogle Scholar
  34. Nishimura, A., & Yokosawa, K. (2006). Orthogonal stimulus–response compatibility effects emerge even when the stimulus position is task irrelevant. Quarterly Journal of Experimental Psychology, 59, 1021–1032. CrossRefGoogle Scholar
  35. Nishimura, A., & Yokosawa, K. (2010). Visual and auditory accessory stimulus offset and the Simon effect. Attention, Perception, & Psychophysics, 72, 1965–1974. CrossRefGoogle Scholar
  36. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442. doi: CrossRefPubMedGoogle Scholar
  37. Shepard, R. N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171, 701–703. CrossRefPubMedGoogle Scholar
  38. Simon, J. R., & Rudell, A. P. (1967). Auditory S–R compatibility: The effect of an irrelevant cue on information processing. Journal of Applied Psychology, 51, 300–304. CrossRefPubMedGoogle Scholar
  39. Simon, J. R., & Small, A. M., Jr. (1969). Processing auditory information: Interference from an irrelevant cue. Journal of Applied Psychology, 53, 433–435. CrossRefPubMedGoogle Scholar
  40. Sutter, C., & Müsseler, J. (2010). Action control while seeing mirror images of one’s own movements: Effects of perspective on spatial compatibility. Quarterly Journal of Experimental Psychology, 63, 1757–1769. CrossRefGoogle Scholar
  41. Taylor, A., Flynn, M., Edmonds, C. J., & Gardner, M. R. (2016). Observed bodies generate object-based spatial codes. Acta Psychologica, 169, 71–78. CrossRefPubMedGoogle Scholar
  42. Tversky, B., & Hard, B. M. (2009). Embodied and disembodied cognition: Spatial perspective-taking. Cognition, 110, 124–129. CrossRefPubMedGoogle Scholar
  43. Weeks, D. J., & Proctor, R. W. (1990). Salient-features coding in the translation between orthogonal stimulus and response dimensions. Journal of Experimental Psychology: General General, 119, 355–366. CrossRefGoogle Scholar
  44. Weeks, D. J., Proctor, R. W., & Beyak, B. (1995). Stimulus–response compatibility for vertically oriented stimuli and horizontally oriented responses: Evidence for spatial coding. Quarterly Journal of Experimental Psychology, 48A, 367–383. CrossRefGoogle Scholar
  45. World Medical Association. (2013). World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. Journal of the American Medical Association, 310, 2191–2194. CrossRefGoogle Scholar

Copyright information

© The Psychonomic Society, Inc. 2018

Authors and Affiliations

  1. 1.Institute of PsychologyRWTH Aachen UniversityAachenGermany

Personalised recommendations