Advertisement

Measuring and Improving Executive Functioning in the Classroom

  • Brian C. KavanaughEmail author
  • Omer Faruk Tuncer
  • Bruce E. Wexler
Original Research

Abstract

Executive function (EF) is a collection of self-regulatory control processes that are compromised by poverty and powerfully predict academic outcomes in children. Despite this, there are few evidence-based interventions to improve EF. Given the importance of measurement of EF in the context of the classroom where children learn, we first report results showing the validity and reliability of over 60,000 web-based, classroom administrations of tests of EF that have previously only been widely used in laboratory research. Using these tests, we next show that 800 min of computer-presented cognitive training exercises can improve EF, after controlling for practice effects and developmental effects (working memory: partial η2 = .039, response inhibition: partial η2 = .132, interference control: partial η2 = .072). The abilities to measure and improve EF at low cost and large scale in classrooms can contribute to improved, evidence-based education and potentially help reduce achievement gaps associated with poverty.

Keywords

Executive functioning Cognitive training Classroom 

Notes

Compliance with Ethical Standards

Conflict of Interest

Bruce E. Wexler reports a financial interest in C8 Sciences, a Yale startup company that sells the Activate program to schools. The other authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed Consent

All procedures were approved by the Yale University School of Medicine Human Investigations Committee (consent/assent were not required per committee decision since the schools made the decision to use the programs and assessments as part of the school curriculum).

References

  1. Allan, N. P., Hume, L. E., Allan, D. M., Farrington, A. L., & Lonigan, C. J. (2014). Relations between inhibitory control and the development of academic skills in preschool and kindergarten: A meta-analysis. Developmental Psychology, 50, 2368–2379.CrossRefGoogle Scholar
  2. Baum, K. T., Byars, A. W., dGrauw, T. J., Dunn, D. W., Bates, J. E., Howe, S. R., Chiu, C. Y., & Austin, J. K. (2010). The effect of temperament and neuropsychological functioning on behavior problems in children with new-onset seizures. Epilepsy & Behavior, 17, 467–473.CrossRefGoogle Scholar
  3. Berninger, V., Abbott, R., Cook, C. R., & Nagy, W. (2017). Relationships of attention and executive functions to oral language, reading, and writing skills and systems in middle childhood and early adolescence. Journal of Learning Disabilities, 50, 434–449.CrossRefGoogle Scholar
  4. Best, J. R., Miller, P. H., & Naglieri, J. A. (2011). Relations between executive function and academic achievement from ages 5 to 17 in a large, representative national sample. Learning and Individual Differences, 21, 327–336.CrossRefGoogle Scholar
  5. Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009). Assessing inattention and impulsivity in children during the go/nogo task. British Journal of Developmental Psychology, 27, 365–383.CrossRefGoogle Scholar
  6. Biederman, J., Monuteaux, M. C., Doyle, A. E., Seidman, L. J., Wilens, T. E., Ferrero, F., Morgan, C. L., & Faraone, S. V. (2004). Impact of executive function deficits and attention-deficit/hyperactivity disorder (ADHD) on academic outcomes in children. Journal of Consulting and Clinical Psychology, 72, 757–766.CrossRefGoogle Scholar
  7. Bohrnstedt, G., Kitmitto, S., Ogut, B., Sherman, D., & Chan, D. (2015). School composition and the black-white achievement gap. NCES 2015-018. National Center for education statistics. https://nces.ed.gov/pubsearch. Accessed on April 2018
  8. Bollini, A. M., Arnold, M. C., & Keefe, R. S. (2000). Test-retest reliability of the dot test of visuospatial working memory in patients with schizophrenia and controls. Schizophrenia Research, 45, 169–173.CrossRefGoogle Scholar
  9. Cantin, R. H., Gnaedinger, E. K., Gallaway, K. C., Hesson-McInnis, M. S., & Hund, A. M. (2016). Executive functioning predicts reading, mathematics, and theory of mind during elementary years. Journal of Experimental Child Psychology, 146, 66–78.CrossRefGoogle Scholar
  10. Cohen, R. A., Malloy, P. F., & Jenkins, M. A. (1998). Disorders of attention. In P. J. Snyder & P. D. Nussbaum (Eds.), Clinical neuropsychology: A pocket handbook for assessment. Washington DC: American Psychological Association.Google Scholar
  11. Cortese, S., Ferrin, M., Brandeis, D., Buitelaar, J., Daley, D., Dittmann, R. W., Holtmann, M., Santosh, P., Stevenson, J., Stringaris, A., Zuddas, A., & Sonuga-Barke, E. J. (2015). Cognitive training for attention-deficit/hyperactivity disorder: Meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 164–174.CrossRefGoogle Scholar
  12. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168.CrossRefGoogle Scholar
  13. Diamond, A., & Lee, K. (2011). Interventions and programs demonstrated to aid executive function development in children 4-12 years of age. Science, 333, 959–964.CrossRefGoogle Scholar
  14. Diamond, A., & Ling, D. S. (2016). Conclusions about interventions, programs, and approaches for improving executive functions that appear justified and those that, despite much hype, do not. Developmental Cognitive Neuroscience, 18, 34–48.CrossRefGoogle Scholar
  15. Etkin, A., Gyurak, A., & O’Hara, R. (2013). A neurobiological approach to the cognitive deficits of psychiatric disorders. Dialogues in Clinical Neuroscience, 15, 419–429.PubMedPubMedCentralGoogle Scholar
  16. Evans, G. W., Schamberg, M. A., & McEwen, B. S. (2009). Childhood poverty, chronic stress, and adult working memory. Proceedings of the National Academy of Sciences of the United States of America, 106, 6545–6549.CrossRefGoogle Scholar
  17. Galinsky, E., Bezos, J., McClelland, M., Carlson, S. M., & Zelazo, P. D. (2017). Civic science for public use: Mind in the making and vroom. Child Development, 88, 1409–1418.CrossRefGoogle Scholar
  18. Georgiou, G. K., & Das, J. P. (2016). What component of executive functions contributes to normal and impaired reading comprehension in young adults? Research in Developmental Disabilities, 49-50, 118–128.CrossRefGoogle Scholar
  19. Gligorovic, M., & Durovic, N. B. (2014). Inhibitory control and adaptive behavior in children with mild intellectual disability. Journal of Intellectual Disability Research, 58, 233–242.CrossRefGoogle Scholar
  20. Blair, C., & Raver, C. C. (2016). Poverty, stress, and brain development: New directions for prevention and intervention. Academic Pediatrics, 16, s30–s36.CrossRefGoogle Scholar
  21. Graham, D. M., Glass, L., & Mattson, S. N. (2016). The influence of extrinsic reinforcement on children with heavy prenatal alcohol exposure. Alcoholism: Clinical and Experimental Research, 40, 348–358.CrossRefGoogle Scholar
  22. Hadwin, J. A., & Richards, H. J. (2016). Working memory training and CBT reduces anxiety symptoms and attentional biases to threat: A preliminary study. Frontiers in Psychology, 7.  https://doi.org/10.3389/fpsyg.2016.00047.
  23. Hahn, E., Ta, T. M., Hahn, C., Kuehl, L. K., Ruehl, C., Neuhaus, A. H., & Dettling, M. (2011). Test-retest reliability of attention network test measures in schizophrenia. Schizophrenia Research, 133, 218–222.CrossRefGoogle Scholar
  24. Jacobson, L. A., Williford, A. P., & Pianta, R. C. (2011). The role of executive function in children’s competent adjustment to middle school. Child Neuropsychology, 17, 255–280.CrossRefGoogle Scholar
  25. Jacobson, L. A., Koriakin, T., Kipkin, P., Boada, R., Frijters, J. C., Lovett, M. W., Hill, D., Willcutt, E., Gottwald, S., Wolf, M., Bosson-Heenan, J., Gruen, J. R., & Mahone, E. M. (2017). Executive functions contribute uniquely to reading competence in minority youth. Journal of Learning Disabilities, 4, 1–12.Google Scholar
  26. Keshavan, M. S., Vinogradov, S., Rumsey, J., Sherrill, J., & Wagner, A. (2014). Cognitive training in mental disorders: Update and future directions. American Journal of Psychiatry, 171, 510–522.CrossRefGoogle Scholar
  27. Langberg, J. M., Dvorsky, M. R., & Evans, S. W. (2013). What specific facets of executive function are associated with academic functioning in youth with attention-deficit/hyperactivity disorder? Journal of Abnormal Child Psychology, 41, 1145–1159.CrossRefGoogle Scholar
  28. Langenecker, S. A., Zubieta, J.-K., Young, E. A., Akil, H., & Nielson, K. A. (2007). A task to manipulate attentional load, set-shifting, and inhibitory control: Convergent validity and test-retest reliability of the parametric go/no-go test. Journal of Clinical and Experimental Neuropsychology, 29, 842–853.CrossRefGoogle Scholar
  29. Leark, R. A., Wallace, D. R., & Fitzgerald, R. (2004). Test-retest reliability and standard error of measurement for the test of variables of attention (TOVA) with healthy school-age children. Assessment, 11, 285–289.CrossRefGoogle Scholar
  30. Lee, R. S., Hermens, D. F., Redoblado-Hodge, M. A., Naismith, S. L., Porter, M. A., Kaur, M., White, D., Scott, E. M., & Hickie, I. B. (2013). Neuropsychological and socio-occupational functioning in young psychiatric outpatients: A longitudinal investigation. PLoS One, 8, e58176.  https://doi.org/10.1371/journal.pone.0058176.CrossRefPubMedPubMedCentralGoogle Scholar
  31. Latzman, R. D., Elkovitch, N., Young, J., & Clark, L. A. (2010). The contribution of executive functioning to academic achievement among male adolescents. Journal of Clinical and Experimental Neuropsychology, 32, 455–462.CrossRefGoogle Scholar
  32. Lipsey, M. W., Nesbitt, K. T., Farran, D. C., Dong, N., Fuhs, M. W., & Wilson, S. J. (2017). Learning-related cognitive self-regulation measures for prekindergarten children: A comparative evaluation of the educational relevance of selected measures. Journal of Educational Psychology.  https://doi.org/10.1037/edu0000203.CrossRefGoogle Scholar
  33. Mirsky, A. (1996). Disorders of attention: A neuropsychological perspective. In L. G. Reid & A. Norman (Eds.), Attention, memory, and executive function (pp. 71–95). Baltimore: Paul H Brookes Publishing.Google Scholar
  34. Mishra, J., Sagar, R., Joseph, A. A., Gazzaley, A., & Merzenich, M. M. (2016). Training sensory signal-to-noise resolution in children with ADHD in a global mental health setting. Translational Psychiatry, 6, e781.CrossRefGoogle Scholar
  35. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.CrossRefGoogle Scholar
  36. Niendam, T. A., Laird, A. R., Ray, K. I., Dean, Y. M., Glahn, D. C., & Carter, C. S. (2012). Meta-analytic evidence for a superordinate cognitive control network subserving diverse executive functions. Cognitive, Affective, & Behavioral Neuroscience, 12, 241–268.CrossRefGoogle Scholar
  37. Paap, K. R., & Sawi, O. (2016). The role of test-retest reliability in measuring individual and group differences in executive functioning. Journal of Neuroscience Methods, 274, 81–83.CrossRefGoogle Scholar
  38. Raver, C. C., McCoy, D. C., & Lowenstein, A. L. (2013). Predicting individual differences in low-income children’s executive control from early to middle childhood. Developmental Science, 16, 394–408.CrossRefGoogle Scholar
  39. Reardon, S. F. (2013). The widening income achievement gap. Educational Leadership, 70, 10–16.Google Scholar
  40. Rinsky, J. R., & Hinshaw, S. P. (2011). Linkages between childhood executive functioning and adolescent social functioning and psychopathology in girls with ADHD. Child Neuropsychology, 17, 368–390.CrossRefGoogle Scholar
  41. Roberts, G., Quach, J., Spencer-Smith, M., Anderson, P. J., Gathercole, S., Gold, L., Sia, K.-L., Mensah, F., Rickards, F., Ainley, J., & Wake, M. (2016). Academic outcomes 2 years after working memory training for children with low working memory: A randomized clinical trial. JAMA Pediatrics, 170, e154568.CrossRefGoogle Scholar
  42. Rose, S. A., Feldman, J. F., & Jankowski, J. J. (2011). Modeling a cascade of effects: The role of speed and executive functioning in preterm/full-term differences in academic achievement. Developmental Science, 14, 1161–1175.CrossRefGoogle Scholar
  43. Senkowski, D., & Gallinat, J. (2015). Dsyfunctional prefrontal gamma-band oscillations reflect working memory and other cognitive deficits in schizophrenia. Biological Psychiatry, 77, 1010–1019.CrossRefGoogle Scholar
  44. Sheehan, W. A., & Iarocci, G. (2015). Executive functioning predicts academic but not social adjustment to university. Journal of Attention Disorders, 1–9.  https://doi.org/10.1177/1087054715612258
  45. Sirois, P. A., Chernoff, M. C., Malee, K. M., Garvie, P. A., Harris, L. L., Williams, P. L., Woods, S. P., Nozyce, M. L., Kammerer, B. L., Yildirim, C., & Nichols, S. L. (2016). Associations of memory and executive functioning with academic and adaptive functioning among youth with perinatal HIV exposure and/or infection. Journal of the Pediatric Infectious Diseases Society, 5, S2–S32.CrossRefGoogle Scholar
  46. Soreni, N., Crosbie, J., Ickowicz, A., & Schachar, R. (2009). Stop signal and conners’ continuous performance tasks: Test-retest reliability of two inhibition measures in ADHD children. Journal of Attention Disorders, 13, 137–143.CrossRefGoogle Scholar
  47. Tulsky, D. S., Carlozzi, N. E., Chevalier, N., Espy, K. A., Beaumont, J. L., & Mungas, D. (2013). NIH toolbox cognition battery (cb): Measuring working memory. Monographs of the Society for Research in Child Development, 78, 70–87.CrossRefGoogle Scholar
  48. Tarp, J., Domazet, S. L., Froberg, K., Hillman, C. H., Andersen, L. B., & Bugge, A. (2016). Effectiveness of a school-based physical activity intervention on cognitive performance in Danish adolescents: Locomotion-learning, cognition, and motion – A cluster randomized controlled trial. PLoS One, 11, e0158087.  https://doi.org/10.1371/journal.pone.0158087.CrossRefPubMedPubMedCentralGoogle Scholar
  49. Van der Donk, M. L., Hiemstra-Beernink, A., Tjeenk-Kalff, A. C., van der Leij, A., & Lindauer, R. J. (2016). Predictors and moderators of treatment outcome in cognitive training for children with ADHD. Journal of Attention Disorders.  https://doi.org/10.1177/1087054716632876.
  50. Wexler, B. E. (2013). Integrated brain and body exercises for ADHD and related problems with attention and executive function. International Journal of Gaming and Computer-Mediated Simulations, 5, 1–17.CrossRefGoogle Scholar
  51. Wexler, B. E., Iseli, M., Leon, S., Zaggle, W., Rush, C., Goodman, A., Esat Imal, A., & Bo, E. (2016). Cognitive priming and cognitive training: Immediate and far transfer to academic skills in children. Scientific Reports, 6, 32859.  https://doi.org/10.1038/srep32859.CrossRefPubMedPubMedCentralGoogle Scholar
  52. Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2012). The measurement of executive function at age5: Psychometric properties and relationship to academic achievement. Psychological Assessment, 24, 226–239.CrossRefGoogle Scholar
  53. Willoughby, M. T., Magnus, B., Vernon-Feagans, L., Blair, C. B., & the Family Life Project Investigators. (2017). Developmental delays in executive function from 3 to 5 years of age predict kindergarten academic readiness. Journal of Learning Disabilities, 50, 359–372.Google Scholar
  54. Will, E., Fidler, D. J., Daunhauer, L., & Gerlach-McDonald, B. (2017). Executive function and academic achievement in primary grade students with down syndrome. Journal of Intellectual Disability Research, 61, 181–195.CrossRefGoogle Scholar
  55. Zabel, T. A., von Thomsen, C., Cole, C., Martin, R., & Mahone, E. M. (2009). Reliability concerns in the repeated computerized assessment of attention in children. The Clinical Neuropsychologist, 23, 1213–1231.CrossRefGoogle Scholar
  56. Zelazo, P. D., Anderson, J. E., Richler, J., Wallner-Allen, K., Beaumont, J. L., & Weintraub, S. (2013). NIH toolbox cognition battery (cb): Measuring executive function and attention. Monographs of the Society for Research in Child Development, 78, 16–33.CrossRefGoogle Scholar
  57. Zhao, X., Chen, L., & Maes, J. H. (2018). Training and transfer effects of response inhibition training in children and adults. Developmental Science, 1–12.  https://doi.org/10.1111/desc.12511 CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.E. P. Bradley Hospital/Alpert Medical School of Brown UniversityEast ProvidenceUSA
  2. 2.Ardahan State HospitalArdahanTurkey
  3. 3.Yale University School of MedicineNew HavenUSA

Personalised recommendations