Abstract
Executive function (EF) is a collection of self-regulatory control processes that are compromised by poverty and powerfully predict academic outcomes in children. Despite this, there are few evidence-based interventions to improve EF. Given the importance of measurement of EF in the context of the classroom where children learn, we first report results showing the validity and reliability of over 60,000 web-based, classroom administrations of tests of EF that have previously only been widely used in laboratory research. Using these tests, we next show that 800 min of computer-presented cognitive training exercises can improve EF, after controlling for practice effects and developmental effects (working memory: partial η2 = .039, response inhibition: partial η2 = .132, interference control: partial η2 = .072). The abilities to measure and improve EF at low cost and large scale in classrooms can contribute to improved, evidence-based education and potentially help reduce achievement gaps associated with poverty.
Similar content being viewed by others
References
Allan, N. P., Hume, L. E., Allan, D. M., Farrington, A. L., & Lonigan, C. J. (2014). Relations between inhibitory control and the development of academic skills in preschool and kindergarten: A meta-analysis. Developmental Psychology, 50, 2368–2379.
Baum, K. T., Byars, A. W., dGrauw, T. J., Dunn, D. W., Bates, J. E., Howe, S. R., Chiu, C. Y., & Austin, J. K. (2010). The effect of temperament and neuropsychological functioning on behavior problems in children with new-onset seizures. Epilepsy & Behavior, 17, 467–473.
Berninger, V., Abbott, R., Cook, C. R., & Nagy, W. (2017). Relationships of attention and executive functions to oral language, reading, and writing skills and systems in middle childhood and early adolescence. Journal of Learning Disabilities, 50, 434–449.
Best, J. R., Miller, P. H., & Naglieri, J. A. (2011). Relations between executive function and academic achievement from ages 5 to 17 in a large, representative national sample. Learning and Individual Differences, 21, 327–336.
Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009). Assessing inattention and impulsivity in children during the go/nogo task. British Journal of Developmental Psychology, 27, 365–383.
Biederman, J., Monuteaux, M. C., Doyle, A. E., Seidman, L. J., Wilens, T. E., Ferrero, F., Morgan, C. L., & Faraone, S. V. (2004). Impact of executive function deficits and attention-deficit/hyperactivity disorder (ADHD) on academic outcomes in children. Journal of Consulting and Clinical Psychology, 72, 757–766.
Bohrnstedt, G., Kitmitto, S., Ogut, B., Sherman, D., & Chan, D. (2015). School composition and the black-white achievement gap. NCES 2015-018. National Center for education statistics. https://nces.ed.gov/pubsearch. Accessed on April 2018
Bollini, A. M., Arnold, M. C., & Keefe, R. S. (2000). Test-retest reliability of the dot test of visuospatial working memory in patients with schizophrenia and controls. Schizophrenia Research, 45, 169–173.
Cantin, R. H., Gnaedinger, E. K., Gallaway, K. C., Hesson-McInnis, M. S., & Hund, A. M. (2016). Executive functioning predicts reading, mathematics, and theory of mind during elementary years. Journal of Experimental Child Psychology, 146, 66–78.
Cohen, R. A., Malloy, P. F., & Jenkins, M. A. (1998). Disorders of attention. In P. J. Snyder & P. D. Nussbaum (Eds.), Clinical neuropsychology: A pocket handbook for assessment. Washington DC: American Psychological Association.
Cortese, S., Ferrin, M., Brandeis, D., Buitelaar, J., Daley, D., Dittmann, R. W., Holtmann, M., Santosh, P., Stevenson, J., Stringaris, A., Zuddas, A., & Sonuga-Barke, E. J. (2015). Cognitive training for attention-deficit/hyperactivity disorder: Meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 164–174.
Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168.
Diamond, A., & Lee, K. (2011). Interventions and programs demonstrated to aid executive function development in children 4-12 years of age. Science, 333, 959–964.
Diamond, A., & Ling, D. S. (2016). Conclusions about interventions, programs, and approaches for improving executive functions that appear justified and those that, despite much hype, do not. Developmental Cognitive Neuroscience, 18, 34–48.
Etkin, A., Gyurak, A., & O’Hara, R. (2013). A neurobiological approach to the cognitive deficits of psychiatric disorders. Dialogues in Clinical Neuroscience, 15, 419–429.
Evans, G. W., Schamberg, M. A., & McEwen, B. S. (2009). Childhood poverty, chronic stress, and adult working memory. Proceedings of the National Academy of Sciences of the United States of America, 106, 6545–6549.
Galinsky, E., Bezos, J., McClelland, M., Carlson, S. M., & Zelazo, P. D. (2017). Civic science for public use: Mind in the making and vroom. Child Development, 88, 1409–1418.
Georgiou, G. K., & Das, J. P. (2016). What component of executive functions contributes to normal and impaired reading comprehension in young adults? Research in Developmental Disabilities, 49-50, 118–128.
Gligorovic, M., & Durovic, N. B. (2014). Inhibitory control and adaptive behavior in children with mild intellectual disability. Journal of Intellectual Disability Research, 58, 233–242.
Blair, C., & Raver, C. C. (2016). Poverty, stress, and brain development: New directions for prevention and intervention. Academic Pediatrics, 16, s30–s36.
Graham, D. M., Glass, L., & Mattson, S. N. (2016). The influence of extrinsic reinforcement on children with heavy prenatal alcohol exposure. Alcoholism: Clinical and Experimental Research, 40, 348–358.
Hadwin, J. A., & Richards, H. J. (2016). Working memory training and CBT reduces anxiety symptoms and attentional biases to threat: A preliminary study. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.00047.
Hahn, E., Ta, T. M., Hahn, C., Kuehl, L. K., Ruehl, C., Neuhaus, A. H., & Dettling, M. (2011). Test-retest reliability of attention network test measures in schizophrenia. Schizophrenia Research, 133, 218–222.
Jacobson, L. A., Williford, A. P., & Pianta, R. C. (2011). The role of executive function in children’s competent adjustment to middle school. Child Neuropsychology, 17, 255–280.
Jacobson, L. A., Koriakin, T., Kipkin, P., Boada, R., Frijters, J. C., Lovett, M. W., Hill, D., Willcutt, E., Gottwald, S., Wolf, M., Bosson-Heenan, J., Gruen, J. R., & Mahone, E. M. (2017). Executive functions contribute uniquely to reading competence in minority youth. Journal of Learning Disabilities, 4, 1–12.
Keshavan, M. S., Vinogradov, S., Rumsey, J., Sherrill, J., & Wagner, A. (2014). Cognitive training in mental disorders: Update and future directions. American Journal of Psychiatry, 171, 510–522.
Langberg, J. M., Dvorsky, M. R., & Evans, S. W. (2013). What specific facets of executive function are associated with academic functioning in youth with attention-deficit/hyperactivity disorder? Journal of Abnormal Child Psychology, 41, 1145–1159.
Langenecker, S. A., Zubieta, J.-K., Young, E. A., Akil, H., & Nielson, K. A. (2007). A task to manipulate attentional load, set-shifting, and inhibitory control: Convergent validity and test-retest reliability of the parametric go/no-go test. Journal of Clinical and Experimental Neuropsychology, 29, 842–853.
Leark, R. A., Wallace, D. R., & Fitzgerald, R. (2004). Test-retest reliability and standard error of measurement for the test of variables of attention (TOVA) with healthy school-age children. Assessment, 11, 285–289.
Lee, R. S., Hermens, D. F., Redoblado-Hodge, M. A., Naismith, S. L., Porter, M. A., Kaur, M., White, D., Scott, E. M., & Hickie, I. B. (2013). Neuropsychological and socio-occupational functioning in young psychiatric outpatients: A longitudinal investigation. PLoS One, 8, e58176. https://doi.org/10.1371/journal.pone.0058176.
Latzman, R. D., Elkovitch, N., Young, J., & Clark, L. A. (2010). The contribution of executive functioning to academic achievement among male adolescents. Journal of Clinical and Experimental Neuropsychology, 32, 455–462.
Lipsey, M. W., Nesbitt, K. T., Farran, D. C., Dong, N., Fuhs, M. W., & Wilson, S. J. (2017). Learning-related cognitive self-regulation measures for prekindergarten children: A comparative evaluation of the educational relevance of selected measures. Journal of Educational Psychology. https://doi.org/10.1037/edu0000203.
Mirsky, A. (1996). Disorders of attention: A neuropsychological perspective. In L. G. Reid & A. Norman (Eds.), Attention, memory, and executive function (pp. 71–95). Baltimore: Paul H Brookes Publishing.
Mishra, J., Sagar, R., Joseph, A. A., Gazzaley, A., & Merzenich, M. M. (2016). Training sensory signal-to-noise resolution in children with ADHD in a global mental health setting. Translational Psychiatry, 6, e781.
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.
Niendam, T. A., Laird, A. R., Ray, K. I., Dean, Y. M., Glahn, D. C., & Carter, C. S. (2012). Meta-analytic evidence for a superordinate cognitive control network subserving diverse executive functions. Cognitive, Affective, & Behavioral Neuroscience, 12, 241–268.
Paap, K. R., & Sawi, O. (2016). The role of test-retest reliability in measuring individual and group differences in executive functioning. Journal of Neuroscience Methods, 274, 81–83.
Raver, C. C., McCoy, D. C., & Lowenstein, A. L. (2013). Predicting individual differences in low-income children’s executive control from early to middle childhood. Developmental Science, 16, 394–408.
Reardon, S. F. (2013). The widening income achievement gap. Educational Leadership, 70, 10–16.
Rinsky, J. R., & Hinshaw, S. P. (2011). Linkages between childhood executive functioning and adolescent social functioning and psychopathology in girls with ADHD. Child Neuropsychology, 17, 368–390.
Roberts, G., Quach, J., Spencer-Smith, M., Anderson, P. J., Gathercole, S., Gold, L., Sia, K.-L., Mensah, F., Rickards, F., Ainley, J., & Wake, M. (2016). Academic outcomes 2 years after working memory training for children with low working memory: A randomized clinical trial. JAMA Pediatrics, 170, e154568.
Rose, S. A., Feldman, J. F., & Jankowski, J. J. (2011). Modeling a cascade of effects: The role of speed and executive functioning in preterm/full-term differences in academic achievement. Developmental Science, 14, 1161–1175.
Senkowski, D., & Gallinat, J. (2015). Dsyfunctional prefrontal gamma-band oscillations reflect working memory and other cognitive deficits in schizophrenia. Biological Psychiatry, 77, 1010–1019.
Sheehan, W. A., & Iarocci, G. (2015). Executive functioning predicts academic but not social adjustment to university. Journal of Attention Disorders, 1–9. https://doi.org/10.1177/1087054715612258
Sirois, P. A., Chernoff, M. C., Malee, K. M., Garvie, P. A., Harris, L. L., Williams, P. L., Woods, S. P., Nozyce, M. L., Kammerer, B. L., Yildirim, C., & Nichols, S. L. (2016). Associations of memory and executive functioning with academic and adaptive functioning among youth with perinatal HIV exposure and/or infection. Journal of the Pediatric Infectious Diseases Society, 5, S2–S32.
Soreni, N., Crosbie, J., Ickowicz, A., & Schachar, R. (2009). Stop signal and conners’ continuous performance tasks: Test-retest reliability of two inhibition measures in ADHD children. Journal of Attention Disorders, 13, 137–143.
Tulsky, D. S., Carlozzi, N. E., Chevalier, N., Espy, K. A., Beaumont, J. L., & Mungas, D. (2013). NIH toolbox cognition battery (cb): Measuring working memory. Monographs of the Society for Research in Child Development, 78, 70–87.
Tarp, J., Domazet, S. L., Froberg, K., Hillman, C. H., Andersen, L. B., & Bugge, A. (2016). Effectiveness of a school-based physical activity intervention on cognitive performance in Danish adolescents: Locomotion-learning, cognition, and motion – A cluster randomized controlled trial. PLoS One, 11, e0158087. https://doi.org/10.1371/journal.pone.0158087.
Van der Donk, M. L., Hiemstra-Beernink, A., Tjeenk-Kalff, A. C., van der Leij, A., & Lindauer, R. J. (2016). Predictors and moderators of treatment outcome in cognitive training for children with ADHD. Journal of Attention Disorders. https://doi.org/10.1177/1087054716632876.
Wexler, B. E. (2013). Integrated brain and body exercises for ADHD and related problems with attention and executive function. International Journal of Gaming and Computer-Mediated Simulations, 5, 1–17.
Wexler, B. E., Iseli, M., Leon, S., Zaggle, W., Rush, C., Goodman, A., Esat Imal, A., & Bo, E. (2016). Cognitive priming and cognitive training: Immediate and far transfer to academic skills in children. Scientific Reports, 6, 32859. https://doi.org/10.1038/srep32859.
Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2012). The measurement of executive function at age5: Psychometric properties and relationship to academic achievement. Psychological Assessment, 24, 226–239.
Willoughby, M. T., Magnus, B., Vernon-Feagans, L., Blair, C. B., & the Family Life Project Investigators. (2017). Developmental delays in executive function from 3 to 5 years of age predict kindergarten academic readiness. Journal of Learning Disabilities, 50, 359–372.
Will, E., Fidler, D. J., Daunhauer, L., & Gerlach-McDonald, B. (2017). Executive function and academic achievement in primary grade students with down syndrome. Journal of Intellectual Disability Research, 61, 181–195.
Zabel, T. A., von Thomsen, C., Cole, C., Martin, R., & Mahone, E. M. (2009). Reliability concerns in the repeated computerized assessment of attention in children. The Clinical Neuropsychologist, 23, 1213–1231.
Zelazo, P. D., Anderson, J. E., Richler, J., Wallner-Allen, K., Beaumont, J. L., & Weintraub, S. (2013). NIH toolbox cognition battery (cb): Measuring executive function and attention. Monographs of the Society for Research in Child Development, 78, 16–33.
Zhao, X., Chen, L., & Maes, J. H. (2018). Training and transfer effects of response inhibition training in children and adults. Developmental Science, 1–12. https://doi.org/10.1111/desc.12511
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Bruce E. Wexler reports a financial interest in C8 Sciences, a Yale startup company that sells the Activate program to schools. The other authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed Consent
All procedures were approved by the Yale University School of Medicine Human Investigations Committee (consent/assent were not required per committee decision since the schools made the decision to use the programs and assessments as part of the school curriculum).
Rights and permissions
About this article
Cite this article
Kavanaugh, B.C., Tuncer, O.F. & Wexler, B.E. Measuring and Improving Executive Functioning in the Classroom. J Cogn Enhanc 3, 271–280 (2019). https://doi.org/10.1007/s41465-018-0095-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41465-018-0095-y