Advertisement

Attention, Perception, & Psychophysics

, Volume 81, Issue 1, pp 20–34 | Cite as

Meaning guides attention during scene viewing, even when it is irrelevant

  • Candace E. PeacockEmail author
  • Taylor R. Hayes
  • John M. Henderson
Article

Abstract

During real-world scene viewing, humans must prioritize scene regions for attention. What are the roles of low-level image salience and high-level semantic meaning in attentional prioritization? A previous study suggested that when salience and meaning are directly contrasted in scene memorization and preference tasks, attentional priority is assigned by meaning (Henderson & Hayes in Nature Human Behavior, 1, 743–747, 2017). Here we examined the role of meaning in attentional guidance using two tasks in which meaning was irrelevant and salience was relevant: a brightness rating task and a brightness search task. Meaning was represented by meaning maps that captured the spatial distribution of semantic features. Meaning was contrasted with image salience, represented by saliency maps. Critically, both maps were represented similarly, allowing us to directly compare how meaning and salience influenced the spatial distribution of attention, as measured by fixation density maps. Our findings suggest that even in tasks for which meaning is irrelevant and salience is relevant, meaningful scene regions are prioritized for attention over salient scene regions. These results support theories in which scene semantics play a dominant role in attentional guidance in scenes.

Keywords

Attention Scene perception Eye movements Meaning Salience 

References

  1. Anderson, N. C., Donk, M., & Meeter, M. (2016). The influence of a scene preview on eye movement behavior in natural scenes. Psychonomic Bulletin & Review, 23, 1794–1801.  https://doi.org/10.3758/s13423-016-1035-4 CrossRefGoogle Scholar
  2. Anderson, N. C., Ort, E., Kruijne, W., Meeter, M., & Donk, M. (2015). It depends on when you look at it: Salience influences eye movements in natural scene viewing and search early in time. Journal of Vision, 15(5), 9:1–22.  https://doi.org/10.1167/15.5.9
  3. Antes, J. R. (1974). The time course of picture viewing. Journal of Experimental Psychology, 103, 62–70.  https://doi.org/10.1037/h0036799 CrossRefGoogle Scholar
  4. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57, 289–300.Google Scholar
  5. Borji, A., Parks, D., & Itti, L. (2014). Complementary effects of gaze direction and early saliency in guiding fixaitons during free viewing. Journal of Vision, 14(13), 3.  https://doi.org/10.1167/14.13.3 CrossRefGoogle Scholar
  6. Borji, A., Sihite, D. N., & Itti, L. (2013). Quantative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Transactions on Image Processing, 22, 55–69.  https://doi.org/10.1109/TIP.2012.2210727 CrossRefGoogle Scholar
  7. Buswell, G. T. (1935). How people look at pictures: A study of the psychology of perception in art. Chicago: University of Chicago Press.Google Scholar
  8. Carmi, R., & Itti, L. (2006). The role of memory in guiding attention during natural vision. Journal of Vision, 6(9), 4:898–914.  https://doi.org/10.1167/6.9.4
  9. Greene, M. R., & Fei-Fei, L. (2014). Visual categorization is automatic and obligatory: Evidence from Stroop-like paradigm. Journal of Vision, 14(1), 14.  https://doi.org/10.1167/14.1.14 CrossRefGoogle Scholar
  10. Harel, J., Koch, C., & Perona, P. (2006). Graph-based visual saliency. In B. Schölkopf, J. C. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems: Proceedings of NIPS’06 (pp. 545–552). Cambridge, US: MIT Press.Google Scholar
  11. Hayhoe, M., & Ballard, D. (2005). Eye movements in natural behavior. Trends in Cognitive Sciences, 9, 188–194.  https://doi.org/10.1016/j.tics.2005.02.009 CrossRefGoogle Scholar
  12. Hayhoe, M. M., Shrivastava, A., Mruczek, R., & Pelz, J. B. (2003). Visual memory and motor planning in a natural task. Journal of Vision, 3(1), 6:49–63.  https://doi.org/10.1167/3.1.6
  13. Henderson, J. M. (2007). Regarding scenes. Current Directions in Psychological Science, 16, 219–222.  https://doi.org/10.1111/j.1467-8721.2007.00507.x CrossRefGoogle Scholar
  14. Henderson, J. M. (2017). Gaze control as prediction. Trends in Cognitive Sciences, 21, 15–23.  https://doi.org/10.1016/j.tics.2016.11.003 CrossRefGoogle Scholar
  15. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007). Visual saliency does not account for eye movements during visual search in real-world scenes. In R. P. G. van Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements: A window on mind and brain (pp. 537–562). Amsterdam: Elsevier.CrossRefGoogle Scholar
  16. Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguists. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 1–58). New York: Psychology Press.Google Scholar
  17. Henderson, J. M., & Hayes, T. R. (2017). Meaning-based guidance of attention in scenes as revealed by meaning maps. Nature Human Behaviour, 1, 743–747.  https://doi.org/10.1038/s41562-017-0208-0.CrossRefGoogle Scholar
  18. Henderson, J. M., & Hayes, T. R. (2018). Meaning guides attention in real-world scene images: Evidence from eye movements and meaning maps. Journal of Vision, 18(6), 10:1–18.  https://doi.org/10.1167/18.6.10
  19. Henderson, J. M., Hayes, T. R., Rehrig, G., & Ferreira, F. (2018). Meaning guides attention during real-world scene description. Scientific Reports, 8.  https://doi.org/10.1038/s41598-018-31894-5
  20. Henderson, J. M., & Hollingworth, A. (1999). High-level scene perception. Annual Review of Psychology, 50, 243–271.  https://doi.org/10.1146/annurev.psych.50.1.243 CrossRefGoogle Scholar
  21. Henderson, J. M., Malcolm, G. L., & Schandl, C. (2009). Searching in the dark: Cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review, 16, 850–856.  https://doi.org/10.3758/PBR.16.5.850 CrossRefGoogle Scholar
  22. Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2, 194–203.  https://doi.org/10.1038/35058500 CrossRefGoogle Scholar
  23. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 1254–1259.  https://doi.org/10.1109/34.730558 CrossRefGoogle Scholar
  24. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4, 219–227.Google Scholar
  25. Land, M. F., & Hayhoe, M. (2001). In what ways to eye movements contribute to everyday activities? Vision Research, 41, 3559–3565.  https://doi.org/10.1016/S0042-6989(01)00102-X CrossRefGoogle Scholar
  26. Mackworth, N. H., & Morandi, A. J. (1967). The gaze selects informative details within pictures. Perception & Psychophysics, 2, 547–552.  https://doi.org/10.3758/BF03210264 CrossRefGoogle Scholar
  27. Navalpakkam, V., & Itti, L. (2005). Modeling the influence of task on attention. Vision Research, 45, 205–231.  https://doi.org/10.1016/j.visres.2004.07.042 CrossRefGoogle Scholar
  28. Navalpakkam, V., & Itti, L. (2007). Search goal tunes visual features optimally. Neuron, 53, 605–617.  https://doi.org/10.1016/j.neuron.2007.01.018 CrossRefGoogle Scholar
  29. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107–123.  https://doi.org/10.1016/S0042-6989(01)00250-4 CrossRefGoogle Scholar
  30. Rahman, S., & Bruce, N. (2015). Visual saliency prediction and evaluation across different perceptual tasks. PLoS ONE, 15, e138053.  https://doi.org/10.1371/journal.pone.0138053 Google Scholar
  31. Rothkopf, C. A., Ballard, D. H., & Hayhoe, M. M. (2016). Task and context determine where you look. Journal of Vision, 7(14), 16:1–20.  https://doi.org/10.1167/7.14.16
  32. Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), 5.  https://doi.org/10.1167/11.5.5 CrossRefGoogle Scholar
  33. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113, 766–786.  https://doi.org/10.1037/0033-295X.113.4.766 CrossRefGoogle Scholar
  34. Yarbus, A. L. (1967). Eye movements during perception of complex objects. In Eye movements and vision (pp. 171–211). New York: Plenum Press.CrossRefGoogle Scholar

Copyright information

© The Psychonomic Society, Inc. 2018

Authors and Affiliations

  • Candace E. Peacock
    • 1
    • 2
    Email author
  • Taylor R. Hayes
    • 1
  • John M. Henderson
    • 1
    • 2
  1. 1.Center for Mind and BrainUniversity of CaliforniaDavisUSA
  2. 2.Department of PsychologyUniversity of CaliforniaDavisUSA

Personalised recommendations