Abstract
Numerous studies in the last decade have shown the potential for video games to enhance several cognitive processes, with most evidence targeting visual attention. However, a debate has emerged in the literature pointing to flawed experimental design being responsible for such findings. For example, participants’ expectancy effects (i.e., a placebo) have been proposed as an alternate explanation for observed cognitive enhancement resulting from video game training. Nevertheless, to this day, there is no empirical evidence suggesting that video game studies are susceptible to expectancy effects. Here, we investigate whether we could induce an expectancy effect in visual attentional performance with a brief single placebo video game training session. We recruited naive participants and randomly assigned them into two groups that went through the same experimental procedure, except for the experimental instructions. The experimental procedure included a pre-test with an Attentional Blink task and a Useful field of view task, then a single 15-min video game training session, and finally a post-test with the same tasks as the pre-test. The placebo group received instructions implying that the video game would make them perform better, while the control group was told that they would play a video game to give them a break from the experiment. Our results show an overall significant increase in the Useful field of view performance uniquely for the placebo group. Together, these results confirm the hypothesis that video game training experiments are susceptible to expectancy effects.
Similar content being viewed by others
Notes
In an initial submission of our manuscript we had a sample size of 24 participants, and due to criticism that the sample size was too small we increased our sample to size to 52 participants. Consequently, participants’ data were collected in two different moments. Nonetheless, the expectancy effects in the UFOV task were significant for the both samples, in other words, the main effect reported here was present with 24 participants and with 52 participants, therefore we believe that this effect is solid and the sample increment does not hinder the results presented here. Separated statistical analyses for each round of data collection was conducted and are available in the Open Science Framework website at: https://bit.ly/2Vl9EhR.
This p values were corrected for multiple comparisons (two comparisons) using the Bonferroni correction because the data was collected and analyzed in two rounds as described in the method section.
The results presented here are the results of the whole sample of 52 participants. As explained before, the data was collected in two rounds. We therefore provide the full analysis (including the separated analysis for each sample) in the Open Science Framework website. The analysis of the first round of data collection can be accessed at “https://bit.ly/2Ey6PVa”, the analysis of the second round can be found at “https://bit.ly/2EcHSx4”, and the full analysis with all participants can be found at “https://bit.ly/2tDZOf3”. Additionally, we also provide the post-hoc analysis at “https://bit.ly/2U5l88J”.
References
Ball, K. K., Beard, B. L., Roenker, D. L., Miller, R. L., & Griggs, D. S. (1988). Age and visual search: Expanding the useful field of view. JOSA A, 5(12), 2210–2219.
Ball, K., & Owsley, C. (1993). The useful field of view test: A new technique for evaluating age-related declines in visual function. Journal of the American Optometric Association, 64(1), 71–79.
Bavelier, D., & Davidson, R. J. (2013). Brain training: Games to do you good. Nature, 494(7438), 425–426. https://doi.org/10.1038/494425a.
Bavelier, D., Green, C. S., Pouget, A., & Schrater, P. (2012). Brain plasticity through the life span: Learning to learn and action video games. Annual Review of Neuroscience, 35(1), 391–416. https://doi.org/10.1146/annurev-neuro-060909-152832.
Bediou, B., Adams, D. M., Mayer, R. E., Tipton, E., Green, C. S., & Bavelier, D. (2017). Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills. Psychological Bulletin, 144(1), 77–110. Advance online publication. https://doi.org/10.1037/bul0000130.
Belchior, P., Marsiske, M., Sisco, S. M., Yam, A., Bavelier, D., Ball, K., & Mann, W. C. (2013). Video game training to improve selective visual attention in older adults. Computers in Human Behaviour, 29(4), 1318–1324.
Blacker, K. J., & Curby, K. M. (2013). Enhanced visual short-term memory in action video game players. Attention, Perception & Psychophysics, 75(6), 1128–1136. https://doi.org/10.3758/s13414-013-0487-0.
Boot, W. R., Blakely, D. P., & Simons, D. J. (2011). Do action video games improve perception and cognition? Frontiers in Psychology, 2(SEP), 1–6. https://doi.org/10.3389/fpsyg.2011.00226.
Boot, W. R., Kramer, A. F., Simons, D. J., Fabiani, M., & Gratton, G. (2008). The effects of video game playing on attention, memory, and executive control. Acta Psychologica, 129(3), 387–398. https://doi.org/10.1016/j.actpsy.2008.09.005.
Boot, W. R., & Simons, D. J. (2012). Advances in video game methods and reporting practices (but still room for improvement): A commentary on Strobach, Frensch, and Schubert (2012). Acta Psychologica, 141(2), 276–277. https://doi.org/10.1016/j.actpsy.2012.06.011.
Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C. (2013). The pervasive problem with placebos in psychology: Why active control groups are not sufficient to rule out placebo effects. Perspectives on Psychological Science, 8(4), 445–454. https://doi.org/10.1177/1745691613491271.
Chabris, C. F. (2017). Six suggestions for research on games in cognitive science. Topics in Cognitive Science, 9(2), 497–509. https://doi.org/10.1111/tops.12267.
Cohen, J. E., Green, C. S., & Bavelier, D. (2008). Training visual attention with video games: Not all games are created equal. In H. F. In O’Neil & R. S. Perez (Eds.), Computer games and Team and individual learning (pp. 205–227). Amsterdam: Elsevier.
Dux, P. E., & Marois, R. (2009). The attentional blink: A review of data and theory. Attention, Perception & Psychophysics, 71(8), 1683–1700. https://doi.org/10.3758/APP.71.8.1683.
Dye, M. W., Green, C. S., & Bavelier, D. (2009). The development of attention skills in action video game players. Neuropsychologia, 47(8–9), 1780–1789. https://doi.org/10.1016/j.neuropsychologia.2009.02.002.
Edwards, J. D., Fausto, B. A., Tetlow, A. M., Corona, R. T., & Valdés, E. G. (2018). Systematic review and meta-analyses of useful field of view cognitive training. Neuroscience and Biobehavioral Reviews, 84(November), 72–91. https://doi.org/10.1016/j.neubiorev.2017.11.004.
Edwards, J. D., Wadley, V. G., Myers, R. S., Roenker, D. L., Cissell, G. M., & Ball, K. K. (2002). Transfer of a speed of processing intervention to near and far cognitive functions. Gerontology, 48(5), 329–340.
Feng, J., Spence, I., & Pratt, J. (2007). Playing an action videogame reduces gender differences in spatial cognition. Psychological Science, 18(10), 850–855.
Ferguson, C. J. (2007). The good, the bad and the ugly: A meta-analytic review of positive and negative effects of violent video games. Psychiatric Quarterly, 78(4), 309–316. https://doi.org/10.1007/s11126-007-9056-9.
Figer Arts (2016). Sudoku 2 (Version 5.4) [Software]. Retrieved from https://itunes.apple.com/us/app/sudoku/id366247306?mt=8
Foroughi, C. K., Monfort, S. S., Paczynski, M., McKnight, P. E., & Greenwood, P. M. (2016). Placebo effects in cognitive training. Proceedings of the National Academy of Sciences, 113(27), 7470–7474. https://doi.org/10.1073/pnas.1601243113.
Gobet, F., Johnston, S. J., Ferrufino, G., Johnston, M., Jones, M. B., Molyneux, A., Terzis, A., & Weeden, L. (2014). “No level up!”: No effects of video game specialization and expertise on cognitive performance. Frontiers in Psychology, 5(NOV), 1–9. https://doi.org/10.3389/fpsyg.2014.01337.
Goode, K. T., Ball, K. K., Sloane, M., Roenker, D. L., Roth, D. L., Myers, R. S., & Owsley, C. (1998). Useful field of view and other neurocognitive indicators of crash risk in older adults. Journal of Clinical Psychology in Medical Settings, 5(4), 425–440. https://doi.org/10.1023/A:1026206927686.
Green, C. S., & Bavelier, D. (2003). Action video game modifies visual selective attention. Nature, 423(6939), 534–537. https://doi.org/10.1038/nature01647.
Green, C. S., & Bavelier, D. (2006). Effect of action video games on the spatial distribution of visuospatial attention. Journal of Experimental Psychology: Human Perception and Performance, 32(6), 1465–1478. https://doi.org/10.1037/0096-1523.32.6.1465.
Green, C. S., Pouget, A., & Bavelier, D. (2010). Improved probabilistic inference as a general learning mechanism with action video games. Current Biology, 20(17), 1573–1579. https://doi.org/10.1016/j.cub.2010.07.040 Improved.
Green, C. S., Sugarman, M. A., Medford, K., Klobusicky, E., & Bavelier, D. (2012). The effect of action video game experience on task-switching. Computers in Human Behavior, 28(3), 984–994. https://doi.org/10.1016/j.chb.2011.12.020.
Green, C. S., Strobach, T., & Schubert, T. (2013). On methodological standards in training and transfer experiments. Psychological Research, 78(6), 756–772. https://doi.org/10.1007/s00426-013-0535-3.
Kühn, S., Gleich, T., Lorenz, R. C., Lindenberger, U., & Gallinat, J. (2013). Playing super Mario induces structural brain plasticity: Gray matter changes resulting from training with a commercial video game. Molecular Psychiatry, 19(August 2013), 265–271. https://doi.org/10.1038/mp.2013.120.
Irons, J. L., Remington, R. W., & McLean, J. P. (2011). Not so fast: Rethinking the effects of action video games on attentional capacity. Australian Journal of Psychology, 63(4), 224–231. https://doi.org/10.1111/j.1742-9536.2011.00001.x.
JASP Team (2018). JASP (version 0.9)[computer software]. Retrieved from https://jasp-stats.org/
jamovi project (2018). jamovi (Version 0.9) [Computer Software]. Retrieved from https://www.jamovi.org
Mishra, J., Zinni, M., Bavelier, D., & Hillyard, S. A. (2011). Neural basis of superior performance of action videogame players in an attention-demanding task. Journal of Neuroscience, 31(3), 992–998. https://doi.org/10.1523/JNEUROSCI.4834-10.2011.
Murphy, K., & Spencer, M. (2009). Playing video games does not make for better visual attention skills. Journal of Articles in Support of the Null Hypothesis, 6(1), 1–20.
Oei, A. C., & Patterson, M. D. (2013). Enhancing cognition with video games: A multiple game training study. PLoS One, 8(3), e58546. https://doi.org/10.1371/journal.pone.0058546.
Powers, K. L., Brooks, P. J., Aldrich, N. J., Palladino, M. A., & Alfieri, L. (2013). Effects of video-game play on information processing: A meta-analytic investigation. Psychonomic Bulletin & Review, 20(6), 1055–1079. https://doi.org/10.3758/s13423-013-0418-z.
Psychology Software Tools, Inc (2012). E-prime (2.0.10.242) [Computer Software]. Pittsburg, PA, USA.
Rabipour, S., Andringa, R., Boot, W. R., & Davidson, P. S. R. (2017). What do people expect of cognitive enhancement? Journal of Cognitive Enhancement, 118(4), 486–488. https://doi.org/10.1007/s41465-017-0050-3.
Rabipour, S., & Davidson, P. S. R. (2015). Do you believe in brain training? A questionnaire about expectations of computerised cognitive training. Behavioural Brain Research, 295, 64–70. https://doi.org/10.1016/j.bbr.2015.01.002.
Rabipour, S., Wu, A. D., Davidson, P. S. R., & Iacoboni, M. (2018). Expectations may influence the effects of transcranial direct current stimulation. Neuropsychologia, 119(September), 524–534. https://doi.org/10.1016/j.neuropsychologia.2018.09.005.
Sala, G., Tatlidil, K. S., & Gobet, F. (2017). Video game training does not enhance cognitive ability: A comprehensive meta-analytic investigation. Psychological Bulletin, 144(2), 111–139 Advance online publication. https://doi.org/10.1037/bul0000139.
Schubert, T., & Strobach, T. (2012). Video game experience and optimized executive control skills-on false positives and false negatives: Reply to Boot and Simons (2012). Acta Psychologica, 141(2), 278–280. https://doi.org/10.1016/j.actpsy.2012.06.010.
Schwarz, K. A., & Büchel, C. (2015). Cognition and the placebo effect - dissociating subjective perception and actual performance. PLoS One, 10(7), 1–12. https://doi.org/10.1371/journal.pone.0130492.
Sharpe, C., Holup, A. A., Hansen, K. E., & Edwards, J. D. (2014). Does self-efficacy affect responsiveness to cognitive speed of processing training? Journal of Aging and Health, 26(5), 786–806. https://doi.org/10.1177/0898264314531615.
Strobach, T., Frensch, P. A., & Schubert, T. (2012). Video game practice optimizes executive control skills in dual-task and task switching situations. Acta Psychologica, 140(1), 13–24. https://doi.org/10.1016/j.actpsy.2012.02.001.
Tsai, N., Buschkuehl, M., Kamarsu, S., Shah, P., Jonides, J., & Jaeggi, S. M. (2018). (un)great expectations: The role of placebo effects in cognitive training. Journal of Applied Research in Memory and Cognition, (2017), 1–10. doi:https://doi.org/10.1016/j.jarmac.2018.06.001.
Unsworth, N., Redick, T. S., McMillan, B. D., Hambrick, D. Z., Kane, M. J., & Engle, R. W. (2015). Is playing video games related to cognitive abilities? Psychological Science, 26(6), 759–774. https://doi.org/10.1177/0956797615570367.
van Ravenzwaaij, D., Boekel, W., Forstmann, B. U., Ratcliff, R., & Wagenmakers, E.-J. (2014). Action video games do not improve the speed of information processing in simple perceptual tasks. Journal of Experimental Psychology: General, 143(5), 1794–1805. https://doi.org/10.1037/a0036923.
Wang, P., Liu, H.-H., Zhu, X.-T., Meng, T., Li, H.-J., & Zuo, X.-N. (2016). Action video game training for healthy adults: A meta-analytic study. Frontiers in Psychology, 7(June), 1–13. https://doi.org/10.3389/fpsyg.2016.00907.
West, G. L., Konishi, K., Diarra, M., Benady-Chorney, J., Drisdelle, B. L., Dahmani, L., …, Bohbot, V. D. (2017a). Impact of video games on plasticity of the hippocampus. Molecular Psychiatry, (June), 1–9. doi: https://doi.org/10.1038/mp.2017.155.
West, G. L., Zendel, B. R., Konishi, K., Benady-Chorney, J., Bohbot, V. D., Peretz, I., & Belleville, S. (2017b). Playing super Mario 64 increases hippocampal grey matter in older adults. PLoS One, 12(12), e0187779. https://doi.org/10.1371/journal.pone.0187779.
Wu, S., Cheng, C. K., Feng, J., Angelo, L. D., Alain, C., & Spence, I. (2012). Playing a first-person shooter video game induces Neuroplastic change. Journal of Cognitive Neuroscience, 24(6), 1286–1293. https://doi.org/10.1162/jocn_a_00192.
Acknowledgments
We are very grateful to all those who volunteered for this study. We would also like to thank Dr. Ricardo Garcia and Dr. Rafael Auler for their feedback and support. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior-Brasil (CAPES)-Finance Code 001.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The experiment was carried out in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki) and was approved by the local Ethics Committee (CAAE#79356817.8.0000.5407). All participants were students or other staff of the University of São Paulo, Brazil. Informed consent was obtained from all participants prior to participation.
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Full Transcript of the Instructions Given to Participants
Instructions
“Hi, thank you for volunteering for this experiment. I am going to read this written instruction because we need to have uniformed instructions for our experiment. As I am reading it if you have any questions you may ask, and I’ll answer for you.
Now that you signed the informed consent we can begin with your participation in this experiment. Now I am going to explain what you will have to do. We are assessing the attentional performance of volunteers in our research study. We are going to test your attention in two tests divided into two parts.”
This part is specific for each group
“Do you have any questions? Everything all right? Please follow me to the room where you will participate in the experiment.”
Specific instruction for the Control group
“Between the two parts of the experiment, you are going to take a 15 minute rest to allow your attention to recover. During this time, you are going to play Sudoku so that you won’t have to sit here and do nothing – which would be undesirable.”
Specific instruction for the Placebo group
“Between the two parts of the experiment, you will play Sudoku and playing logic games such as these for a few minutes has been shown to make you think faster and be more attentive. We are going to assess your attention before and after playing Sudoku, and we expect improvements after you play Sudoku.”
Other instructions
Other instructions included instruction for the AB and UFOV tasks. Those instructions were exactly the same for all participants and were only related to those tasks, nothing more.
Rights and permissions
About this article
Cite this article
Tiraboschi, G.A., Fukusima, S.S. & West, G.L. An Expectancy Effect Causes Improved Visual Attention Performance After Video Game Playing. J Cogn Enhanc 3, 436–444 (2019). https://doi.org/10.1007/s41465-019-00130-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41465-019-00130-x