Advertisement

Attention, Perception, & Psychophysics

, Volume 80, Issue 5, pp 1083–1095 | Cite as

Pavlovian reward learning elicits attentional capture by reward-associated stimuli

  • Chisato Mine
  • Jun Saiki
Article
  • 216 Downloads

Abstract

Feature–reward association elicits value-driven attentional capture (VDAC) regardless of the task relevance of associated features. What are the necessary conditions for feature–reward associations in VDAC? Recent studies claim that VDAC is based on Pavlovian conditioning. In this study, we manipulated the temporal relationships among feature, response, and reward in reward learning to elucidate the necessary components of VDAC. We presented reward-associated features in a variety of locations in a flanker task to form a color–reward association (training phase) and then tested VDAC in a subsequent visual search task (test phase). In Experiment 1, we showed reward-associated features in a task display requiring response selection and observed VDAC, consistent with most previous studies. In Experiment 2, features presented at a fixation display before a task display also induced VDAC. Moreover, in Experiment 3, we reduced the time interval between features and rewards so that features appeared after a task display and we obtained marginally significant VDAC. However, no VDAC was observed when features and rewards were simultaneously presented in a feedback display in Experiments 4 and 5, suggesting that a direct association between feature and reward is not sufficient for VDAC. These results are in favor of the idea that response selection does not mediate feature–reward association in VDAC. Moreover, the evidence suggests that the time interval of feature and reward is flexible with some restriction in the learning of feature–reward association. The present study supports the hypothesis that theories of Pavlovian conditioning can account for feature–reward association in VDAC.

Keywords

Attentional capture Associative learning Pavlovian conditioning Task irrelevance Reward 

Notes

Acknowledgments

We would like to thank Berno Bucker for valuable feedback on earlier draft of the manuscript. We also thank three anonymous reviewers for their helpful comments and suggestions. This research was supported by Grants 16H01727 and 16J04500 from the Grants-in-Aid for Scientific Research (KAKENHI) program of the Japan Society for the Promotion of Science.

References

  1. Anderson, B. A. (2013). A value-driven mechanism of attentional selection. Journal of Vision, 13(3), 1–16.CrossRefGoogle Scholar
  2. Anderson, B. A. (2016). The attention habit: How reward learning shapes attentional selection. Annals of the New York Academy of Sciences, 1369(1), 24–39. doi: https://doi.org/10.1111/nyas.12957 CrossRefPubMedGoogle Scholar
  3. Anderson, B. A., Laurent, P. A., & Yantis, S. (2011a). Learned value magnifies salience-based attentional capture. PLOS ONE, 6, e27926. doi: https://doi.org/10.1371/journal.pone.0027926 CrossRefPubMedPubMedCentralGoogle Scholar
  4. Anderson, B. A., Laurent, P. A., & Yantis, S. (2011b). Value-driven attentional capture. Proceedings of the National Academy of Sciences of the United States of America, 108, 10367–10371. doi: https://doi.org/10.1073/pnas.1104047108 CrossRefPubMedPubMedCentralGoogle Scholar
  5. Anderson, B. A., Laurent, P. A., & Yantis, S. (2012). Generalization of value-based attentional priority. Visual Cognition, 20, 647–658. doi: https://doi.org/10.1080/13506285.2012.679711 CrossRefGoogle Scholar
  6. Anderson, B. A., & Yantis, S. (2013). Persistence of value-driven attentional capture. Journal of Experimental Psychology: Human Perception and Performance, 39, 6–9. doi: https://doi.org/10.1037/a0030860 PubMedGoogle Scholar
  7. Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012). Top-down versus bottom-up attentional control: A failed theoretical dichotomy. Trends in Cognitive Sciences, 16, 437–443.CrossRefPubMedPubMedCentralGoogle Scholar
  8. Bucker, B., Belopolsky, A.V. & Theeuwes, J. (2015). Distractors that signal reward attract the eyes. Visual Cognition, 23, 1–24.CrossRefGoogle Scholar
  9. Bucker, B. & Theeuwes, J. (2017a). Pavlovian reward learning underlies value driven attentional capture. Attention, Perception, & Psychophysics. 79, 415–428. doi: https://doi.org/10.3758/s13414-016-1241-1 CrossRefGoogle Scholar
  10. Bucker, B., & Theeuwes, J. (2017b). Stimulus-driven and goal-driven effects on Pavlovian associative reward learning. Visual Cognition, 26, 131-148.  https://doi.org/10.1080/13506285.2017.1399948
  11. Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013). Rewards teach visual selective attention. Vision Research, 85, 58–72.CrossRefPubMedGoogle Scholar
  12. Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3, 201–215. doi: https://doi.org/10.1038/nrn755.CrossRefPubMedGoogle Scholar
  13. Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon identification of a target letter in a non-search task. Perception and Psychophysics, 16, 143–149.CrossRefGoogle Scholar
  14. Failing, M., Nissens, T., Pearson, D., Le Pelley, M., & Theeuwes, J. (2015). Oculomotor capture by stimuli that signal the availability of reward. Journal of Neurophysiology, 114, 2316−2327. doi: https://doi.org/10.1152/jn.00441.2015 CrossRefPubMedPubMedCentralGoogle Scholar
  15. Failing, M., & Theeuwes, J. (2017). Don’t let it distract you: How information about the availability of reward affects attentional selection. Attention, Perception, & Psychophysics, 79, 2275–2298. doi: https://doi.org/10.3758/s13414-017-1376-8.CrossRefGoogle Scholar
  16. Failing, M., & Theeuwes, J. (in press). Selection history: How reward modulates selectivity of visual attention. Psychonomic Bulletin & Review. doi: https://doi.org/10.3758/s13423-017-1380-y
  17. Hickey, C., Chelazzi, L., & Theeuwes, J. (2010a). Reward changes salience in human vision via the anterior cingulate. The Journal of Neuroscience, 30, 11096–11103. doi: https://doi.org/10.1523/JNEUROSCI.1026-10.2010 CrossRefPubMedGoogle Scholar
  18. Hickey, C., Chelazzi, L., & Theeuwes, J. (2010b). Reward guides vision when it’s your thing: Trait reward-seeking in reward-mediated visual priming. PLOS ONE, 5, e14087. doi: https://doi.org/10.1371/journal.pone.0014087 CrossRefPubMedPubMedCentralGoogle Scholar
  19. Hickey, C., Chelazzi, L., & Theeuwes, J. (2011). Reward has a residual impact on target selection in visual search, but not on the suppression of distractors. Visual Cognition, 19, 117–128.CrossRefGoogle Scholar
  20. Ishihara, S. (1917). Tests for color-blindness. Tokyo: Hongo Harukicho.Google Scholar
  21. JASP Team (2017). JASP (Version 0.8.4) [Computer software] Retrieved from https://jasp-stats.org/
  22. Kamin, L. J. (1969). Predictability, surprise, attention and conditioning. In B. A. Campbell & R. M. Church (Eds.), Punishment and aversive behavior (279–296). New York: Appleton-Century-Crofts.Google Scholar
  23. Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., & Wills, A. J. (2016). Attention and associative learning in humans: An integrative review. Psychonomic Bulletin & Review, 142(10), 1111–1140.CrossRefGoogle Scholar
  24. Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015). When goals conflict with values: Counterproductive attentional and oculomotor capture by reward-related stimuli. Journal of Experimental Psychology: General, 144, 158–171.CrossRefGoogle Scholar
  25. Lee, J., & Shomstein, S. (2014). Reward-based transfer from bottom-up to top-down search task. Psychological Science, 25, 466–475. doi: https://doi.org/10.1177/0956797613509284 CrossRefPubMedGoogle Scholar
  26. Mine, C., & Saiki, J. (2015). Task-irrelevant stimulus-reward association induces value-driven attentional capture. Attention, Perception, & Psychophysics, 77, 1896–1907. doi: https://doi.org/10.3758/s13414-015-0894-5 CrossRefGoogle Scholar
  27. Molet M., & Miller, R. R. (2014). Timing: An attribute of associative learning. Behavioural Processes, 101, 4–14. doi: https://doi.org/10.1016/j.beproc.2013.05.015 CrossRefPubMedGoogle Scholar
  28. Pavlov, I. P. (1927). Conditioned reflexes. London: Oxford University Press.Google Scholar
  29. Pearson, D., Donkin, C., Tran, S. C., Most, S. B., & Le Pelley, M. E. (2015). Cognitive control and counterproductive oculomotor capture by reward-related stimuli. Visual Cognition, 23, 41–66.CrossRefGoogle Scholar
  30. Rescorla, R. A. (1972). Informational variables in Pavlovian conditioning. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 6, pp. l–46). New York: Academic Press.Google Scholar
  31. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical Conditioning II (pp. 64–99). New York: Appleton-Century-Crofts.Google Scholar
  32. Sali, A. W., Anderson, B. A., & Yantis, S. (2014). The role of reward prediction in the control of attention. Journal of Experimental Psychology: Human Perception and Performance, 40, 1654–1664. doi: https://doi.org/10.1037/a0037267 PubMedGoogle Scholar
  33. Seitz, A., Kim, D., & Watanabe, T. (2009). Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron, 61, 700–707. doi: https://doi.org/10.1016/j.neuron.2009.01.016 CrossRefPubMedPubMedCentralGoogle Scholar
  34. Theeuwes, J. (1991). Cross-dimensional perceptual selectivity. Perception & Psychophysics, 50, 184–193.CrossRefGoogle Scholar
  35. Theeuwes, J. (1992). Perceptual selectivity for color and form. Perception & Psychophysics, 51, 599–606.CrossRefGoogle Scholar
  36. Turk-Browne, N. B., Jungé, J., & Scholl, B. J. (2005). The automaticity of visual statistical learning. Journal of Experimental Psychology: General, 134, 552–564.CrossRefGoogle Scholar
  37. Wang, L., Yu, H., & Zhou, X. (2013). Interaction between value and perceptual salience in value-driven attentional capture. Journal of Vision, 13, 1–13. doi: https://doi.org/10.1167/13.3.5 CrossRefGoogle Scholar
  38. Yokoyama, T., Padmala, S., & Pessoa, L. (2015). Reward learning and negative emotion during rapid attentional competition. Frontiers in Psychology, 6, 269. doi: https://doi.org/10.3389/fpsyg.2015.00269 CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© The Psychonomic Society, Inc. 2018

Authors and Affiliations

  1. 1.Graduate School of Human and Environmental StudiesKyoto UniversityKyotoJapan
  2. 2.Japan Society for the Promotion of ScienceTokyoJapan

Personalised recommendations