Advertisement

Journal of Pediatric Neuropsychology

, Volume 5, Issue 4, pp 163–176 | Cite as

Relationships Between the BRIEF/BRIEF-SR and Performance-Based Neuropsychological Tests in Adolescents with Mild Traumatic Brain Injury

  • John W. LaceEmail author
  • Zachary C. Merz
  • Alex F. Grant
  • Carson L. Teague
  • Stephanie Aylward
  • Jill Dorflinger
  • Jeffrey D. Gfeller
Article
  • 15 Downloads

Abstract

Clinical neuropsychologists typically use both performance-based tests and behavioral rating scales as part of comprehensive assessment. However, literature has suggested that performance-based tests account for limited variance in behavioral rating scales in healthy and clinical populations. Importantly, little work has investigated the relationships between performance-based tests and behavioral rating scales in adolescent mild traumatic brain injury (mTBI). The present study was retrospective in nature and included 136 adolescents (M age = 14.97; 56% female) in the post-acute phase of recovery from mTBI (M days since injury = 33.4) referred for neuropsychological evaluation. Participants were administered a multi-domain neuropsychological test battery with measures of reaction time, processing speed, sustained attention, impulsivity, working memory, and verbal and visual memory, and the Behavior Rating Inventory of Executive Function (BRIEF) and BRIEF-Self Report (BRIEF-SR). Results revealed mean neuropsychological test performance and parent- and self-reported executive dysfunction within the average range. Hierarchical multiple regressions revealed that performance-based test scores accounted for between 13 and 18% variance in BRIEF scores and between 8 and 14% variance in BRIEF-SR scores after controlling for demographic factors (which accounted for 3% variance in BRIEF scores and 7–10% variance in BRIEF-SR scores). Processing speed emerged as the most consistent significant individual predictor of BRIEF/BRIEF-SR scores across regression analyses. These findings build on previous literature by suggesting relatively limited psychometric overlap between performance-based tests and behavioral rating scales, such that these approaches likely assess distinct and unique psychological constructs. Relationships to previous work, limitations of the current study, and directions for future research are discussed.

Keywords

Mild traumatic brain injury Neuropsychological testing Behavioral rating scales BRIEF BRIEF-SR 

Notes

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflicts of interest.

Ethical Approval

The present study was retrospective. For this type of study, formal consent is not required. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed Consent

The present study was retrospective, and data were de-identified prior to study’s conception. Approval by participating institutions’ Institutional Review Boards (#2016-0028-03 and #27348) waived the requirement for informed consent.

References

  1. Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., & Mikiewicz, O. (2002). Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychology, 8(4), 231–240.  https://doi.org/10.1076/chin.8.4.231.13509.CrossRefPubMedGoogle Scholar
  2. Babikian, T., & Asarnow, R. (2009). Neurocognitive outcomes and recovery after pediatric TBI: Meta-analytic review of the literature. Neuropsychology, 23(3), 283–296.  https://doi.org/10.1037/a0015268.CrossRefPubMedPubMedCentralGoogle Scholar
  3. Baker, J. G., Leddy, J. J., Darling, S. R., Shucard, J., Makdissi, M., & Willer, B. S. (2015). Gender differences in recovery from sports-related concussion in adolescents. Clinical Pediatrics, 55(8), 771–775.  https://doi.org/10.1177/0009922815606417.CrossRefPubMedGoogle Scholar
  4. Bar-Haim Erez, A., Rothschild, E., Katz, N., Tuchner, M., & Hartman-Maeir, A. (2009). Executive functioning, awareness, and participation in daily life after mild traumatic brain injury: a preliminary study. American Journal of Occupational Therapy, 63(5), 634–640.  https://doi.org/10.5014/ajot.63.5.634.CrossRefGoogle Scholar
  5. Barlow, K. M., Crawford, S., Brooks, B. L., Turley, B., & Mikrogianakis, A. (2015). The incidence of postconcussion syndrome remains stable following mild traumatic brain injury in children. Pediatric Neurology, 53(6), 491–497.  https://doi.org/10.1016/j.pediatrneurol.2015.04.011.CrossRefPubMedGoogle Scholar
  6. Barney, S. J., Allen, D. N., Thaler, N. S., Park, B. S., Strauss, G. P., & Mayfield, J. (2011). Neuropsychological and behavioral measures of attention assess different constructs in children with traumatic brain injury. The Clinical Neuropsychologist, 25(7), 1145–1157.  https://doi.org/10.1080/13854046.2011.595956.CrossRefPubMedGoogle Scholar
  7. Bechara, A. (2004). The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage. Brain and Cognition, 55(1), 30–40.CrossRefGoogle Scholar
  8. Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50(1-3), 7–15.CrossRefGoogle Scholar
  9. Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (2005). The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers. Trends in Cognitive Sciences, 9(4), 159–162.CrossRefGoogle Scholar
  10. Beer, J. S. (2006). Orbitofrontal cortex and social regulation. In J. T. Cacioppa, P. S. Visser, & C. L. Picket (Eds.), Social neuroscience: people thinking about thinking people (pp. 153–166). Cambridge: MIT Press.Google Scholar
  11. Benedict, R. H. B., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins verbal learning test—revised: normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55.  https://doi.org/10.1076/clin.12.1.43.1726.CrossRefGoogle Scholar
  12. Berz, K., Divine, J., Foss, K. B., Heyl, R., Ford, K. R., & Myer, G. D. (2013). Sex-specific differences in the severity of symptoms and recovery rate following sports-related concussion in young athletes. The Physician and Sportsmedicine, 41(2), 58–63.  https://doi.org/10.3810/psm.2013.05.2015.CrossRefPubMedGoogle Scholar
  13. Bodnar, L. E., Prahme, M. C., Cutting, L. E., Denckla, M. B., & Mahone, E. M. (2007). Construct validity of parent ratings of inhibitory control. Child Neuropsychology, 13(4), 345–362.  https://doi.org/10.1080/09297040600899867.CrossRefPubMedGoogle Scholar
  14. Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., & Grimm, K. J. (2009). The contributions of ‘hot’ and ‘cool’ executive function to children’s academic achievement, learning-related behaviors, and engagement in kindergarten. Early Childhood Research Quarterly, 24(3), 337–349.  https://doi.org/10.1016/j.ecresq.2009.06.001.CrossRefGoogle Scholar
  15. Burgess, P. W., Alderman, N., Evans, J. O. N., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4(6), 547–558.  https://doi.org/10.1017/S1355617798466037.CrossRefPubMedGoogle Scholar
  16. Chan, R. C. K., Shum, D., Toulopoulou, T., & Chen, E. Y. H. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201-216.  https://doi.org/10.1016/j.acn.2007.08.010.CrossRefGoogle Scholar
  17. Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197.  https://doi.org/10.1023/B:NERV.0000009483.91468.fb.CrossRefPubMedGoogle Scholar
  18. Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217–227.  https://doi.org/10.1016/j.acn.2005.12.002.CrossRefPubMedGoogle Scholar
  19. Chaytor, N., Temkin, N., Machamer, J., & Dikmen, S. (2007). The ecological validity of neuropsychological assessment and the role of depressive symptoms in moderate to severe traumatic brain injury. Journal of the International Neuropsychological Society, 13(3), 377–385.  https://doi.org/10.1017/S1355617707070592.CrossRefPubMedGoogle Scholar
  20. Chevignard, M. P., Servant, V., Mariller, A., Abada, G., Pradat-Diehl, P., & Laurent-Vannier, A. (2009). Assessment of executive functioning in children after TBI with a naturalistic open-ended task: a pilot study. Developmental Neurorehabilitation, 12(2), 76–91.  https://doi.org/10.1080/17518420902777019.CrossRefPubMedGoogle Scholar
  21. Chevignard, M. P., Soo, C., Galvin, J., Catroppa, C., & Eren, S. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: a systematic review. Brain Injury, 26(9), 1033–1057.  https://doi.org/10.3109/02699052.2012.666366.CrossRefPubMedGoogle Scholar
  22. Colvin, A. C., Mullen, J., Lovell, M. R., Vereeke West, R., Collins, M. W., & Groh, M. (2009). The role of concussion history and gender in recovery from soccer-related concussion. The American Journal of Sports Medicine, 37(9), 1699–1704.  https://doi.org/10.1177/0363546509332497.CrossRefPubMedGoogle Scholar
  23. Conners, C. K. (2014). Conners’ continuous performance test (Conners CPT 3). North Tonawanda: MHS AssessmentsGoogle Scholar
  24. Conners, K. C., & M. H. S. (2000). Conners’ Continuous Performance Test II. CPT II. North Tonawanda: Multi-Health Systems.Google Scholar
  25. Cormier, D. C., McGrew, K. S., Bulut, O., & Funamoto, A. (2016). Revisiting the relations between the WJ-IV measures of Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during the school-age years. Journal of Psychoeducational Assessment, 35(8), 731–754.  https://doi.org/10.1177/0734282916659208.CrossRefGoogle Scholar
  26. Covassin, T., Elbin, R. J., Harris, W., Parker, T., & Kontos, A. (2012). The role of age and sex in symptoms, neurocognitive performance, and postural stability in athletes after concussion. The American Journal of Sports Medicine, 40(6), 1303–1312.  https://doi.org/10.1177/0363546512444554.CrossRefPubMedGoogle Scholar
  27. Covassin, T., Elbin, R. J., Bleecker, A., Lipchik, A., & Kontos, A. P. (2013). Are there differences in neurocognitive function and symptoms between male and female soccer players after concussions? The American Journal of Sports Medicine, 41(12), 2890–2895.  https://doi.org/10.1177/0363546513509962.CrossRefPubMedGoogle Scholar
  28. Cusimano, M. D., Topolovec-Vranic, J., Zhang, S., Mullen, S. J., Wong, M., & Ilie, G. (2017). Factors influencing the underreporting of concussion in sports: a qualitative study of minor hockey participants. Clinical Journal of Sport Medicine, 27(4), 375–380.  https://doi.org/10.1097/jsm.0000000000000372.CrossRefPubMedGoogle Scholar
  29. Davis, A. S., Bernat, D. J., & Reynolds, C. R. (2018). Estimation of premorbid functioning in pediatric neuropsychology: review and recommendations. Journal of Pediatric Neuropsychology, 4(1-2), 49–62.  https://doi.org/10.1007/s40817-018-0051-x.CrossRefGoogle Scholar
  30. Delis, D. C. (1994). CVLT-C: California verbal learning test. Harcourt Brace Corporation: Psychological Corporation.Google Scholar
  31. Denckla, M. B. (2002). The Behavior Rating Inventory of Executive Function: commentary. Child Neuropsychology, 8(4), 304–306.  https://doi.org/10.1076/chin.8.4.304.13512.CrossRefPubMedGoogle Scholar
  32. Di Pinto, M. (2006). The ecological validity of the Behavior Rating Inventory of Executive Function (BRIEF) in attention deficit hyperactivity disorder: Predicting academic achievement and social adaptive behavior in the subtypes of ADHD (Doctoral Dissertation). Drexel University: Philadelphia, PA. Available from https://idea.library.drexel.edu/islandora/object/idea%3A845/datastream/OBJ/download/The_ecological_validity_of_the_behavior_rating_inventory_of_executive_function__BRIEF__in_attention_deficit_hyperactivity_disorder__predicting_academic_achievement_and_social_adaptive_behavior_in_the_subtypes_of_ADHD.pdf
  33. Donders, J., DenBraber, D., & Vos, L. (2010). Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury. Journal of Neuropsychology, 4(2), 197–209.  https://doi.org/10.1348/174866409X478970.CrossRefPubMedGoogle Scholar
  34. Donna, K. B., Tanya, K., Jason, R. F., David, E., Frank, W., & Jeffrey, T. B. (2005). Sex differences in outcome following sports-related concussion. J Neurosurg, 102(5), 856–863.  https://doi.org/10.3171/jns.2005.102.5.0856.CrossRefGoogle Scholar
  35. Duggan, E. C., Garcia-Barrera, M. A., & Muller, U. (2018). Derivation, replication, and validity analyses of a screener for the behavioral assessment of executive functions in young adults. Assessment, 25(7), 867–884.  https://doi.org/10.1177/1073191116670511.CrossRefPubMedGoogle Scholar
  36. Duncan, J., & Owen, A. M. (2000). Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends in Neurosciences, 23(10), 475–483.CrossRefGoogle Scholar
  37. Duvall, S. W., Erickson, S. J., MacLean, P., LaFavor, T., & Lowe, J. R. (2017). Multimodal executive function measurement in preschool children born very low birth weight and full term: relationships between formal lab-based measure performance, parent report, and naturalistic observational coding. Journal of Pediatric Neuropsychology, 3(3), 195–205.  https://doi.org/10.1007/s40817-017-0047-y.CrossRefGoogle Scholar
  38. Ellis, M. J., Ritchie, L. J., Koltek, M., Hosain, S., Cordingley, D., Chu, S., Russell, K. (2015). Psychiatric outcomes after pediatric sports-related concussion. Journal of Neurosurgery: Pediatrics PED, 16(6), 709.  https://doi.org/10.3171/2015.5.peds15220.PubMedGoogle Scholar
  39. Emery, C. A., Barlow, K. M., Brooks, B. L., Max, J. E., Villavicencio-Requis, A., Gnanakumar, V., Yeates, K. O. (2016). A Systematic Review of Psychiatric, Psychological, and Behavioural Outcomes following Mild Traumatic Brain Injury in Children and Adolescents. The Canadian Journal of Psychiatry, 61(5), 259–269.  https://doi.org/10.1177/0706743716643741 CrossRefGoogle Scholar
  40. Eslinger, P. J., Flaherty-Craig, C. V., & Benton, A. L. (2004). Developmental outcomes after early prefrontal cortex damage. Brain and Cognition, 55(1), 84–103.  https://doi.org/10.1016/S0278-2626(03)00281-1.CrossRefGoogle Scholar
  41. Esposito, G., Van Horn, J. D., Weinberger, D. R., & Berman, K. F. (1996). Gender differences in cerebral blood flow as a function of cognitive state with PET. Journal of Nuclear Medicine, 37(4), 559–564.PubMedGoogle Scholar
  42. Field, M., Collins, M. W., Lovell, M. R., & Maroon, J. (2003). Does age play a role in recovery from sports-related concussion? A comparison of high school and collegiate athletes. The Journal of Pediatrics, 142(5), 546–553.  https://doi.org/10.1067/mpd.2003.190.CrossRefGoogle Scholar
  43. Field, A. (2013). Discovering statistics using IBM SPSS Statistics, fourth edition: Thousand Oaks, CA: Sage.Google Scholar
  44. Frost, R. B., Farrer, T. J., Primosch, M., & Hedges, D. W. (2013). Prevalence of traumatic brain injury in the general adult population: a meta-analysis. Neuroepidemiology, 40(3), 154–159.  https://doi.org/10.1159/000343275.CrossRefPubMedGoogle Scholar
  45. Ganesalingam, K., Yeates, K. O., Taylor, H. G., Walz, N. C., Stancin, T., & Wade, S. (2011). Executive functions and social competence in young children 6 months following traumatic brain injury. Neuropsychology, 25(4), 466–476.  https://doi.org/10.1037/a0022768.CrossRefPubMedPubMedCentralGoogle Scholar
  46. Gillen, G. (2013). A fork in the road: an occupational hazard? The American Journal of Occupational Therapy, 67(6), 641–652.  https://doi.org/10.5014/ajot.2013.676002.CrossRefPubMedGoogle Scholar
  47. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). BRIEF: Behavior rating inventory of executive function. Lutz: Psychological assessment resources.Google Scholar
  48. Grace, J., & Malloy, P. (1992). Frontal lobe personality scale. Providence: Brown University.Google Scholar
  49. Greenwald, B. D., Ambrose, A. F., & Armstrong, G. P. (2012). Mild Brain Injury. Rehabilitation Research and Practice, 2012, 3.  https://doi.org/10.1155/2012/469475.CrossRefGoogle Scholar
  50. Guy, S. C., Gioia, G. A., & Isquith, P. K. (2004). BRIEF-SR: Behavior rating inventory of executive function--self-report version. Lutz: Psychological Assessment Resources.Google Scholar
  51. Herjanic, B., & Reich, W. (1982). Development of a structured psychiatric interview for children: Agreement between child and parent on individual symptoms. Journal of Abnormal Child Psychology, 10(3), 307–324.  https://doi.org/10.1007/BF00912324.CrossRefPubMedGoogle Scholar
  52. Hooper, C. J., Luciana, M., Conklin, H. M., & Yarger, R. S. (2004). Adolescents’ performance on the Iowa Gambling Task: implications for the development of decision making and ventromedial prefrontal cortex. Developmental Psychology, 40(6), 1148.CrossRefGoogle Scholar
  53. ImPACT Applications Inc. (2011). Immediate Post-Concussion Assessment and Cognitive Testing Technical Manual and Psychometric Data. Pittsburgh: ImPACT Applications Inc.Google Scholar
  54. Isquith, P. K., Roth, R. M., & Gioia, G. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child, 2(2), 125–132.  https://doi.org/10.1080/21622965.2013.748389.CrossRefGoogle Scholar
  55. Isquith, P. K., Roth, R. M., Kenworthy, L., & Gioia, G. (2014). Contribution of rating scales to intervention for executive dysfunction. Applied Neuropsychology: Child, 3(3), 197–204.  https://doi.org/10.1080/21622965.2013.870014.CrossRefGoogle Scholar
  56. Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467.  https://doi.org/10.1076/clin.17.4.460.27934.CrossRefPubMedGoogle Scholar
  57. Iverson, G. L., Lovell, M. R., & Collins, M. W. (2005). Validity of ImPACT for measuring processing speed following sports-related concussion. Journal of Clinical and Experimental Neuropsychology, 27(6), 683–689.  https://doi.org/10.1081/13803390490918435.CrossRefPubMedGoogle Scholar
  58. Iverson, G. L., Gardner, A. J., Terry, D. P., Ponsford, J. L., Sills, A. K., Broshek, D. K., & Solomon, G. S. (2017). Predictors of clinical recovery from concussion: a systematic review. British Journal of Sports Medicine, 51(12), 941.  https://doi.org/10.1136/bjsports-2017-097729.CrossRefPubMedPubMedCentralGoogle Scholar
  59. Josman, N., & Meyer, S. (2019). Conceptualisation and use of executive functions in paediatrics: A scoping review of occupational therapy literature. Australian Occupational Therapy Journal, 66(1), 77–90.  https://doi.org/10.1111/1440-1630.12525.CrossRefPubMedGoogle Scholar
  60. Kibby, M. Y., Schmitter-Edgecombe, M., & Long, C. J. (1998). Ecological validity of neuropsychological tests: focus on the California Verbal Learning Test and the Wisconsin Card Sorting Test. Archives of Clinical Neuropsychology, 13(6), 523–534.  https://doi.org/10.1093/arclin/13.6.523.CrossRefPubMedGoogle Scholar
  61. Koehl, L. M., Walls, B. D., Brothers, S. L., Morris, S. N., Glueck, A. C., Schmitt, F. A., Berry, D. T. R., & Han, D. Y. (2019). Convergent and discriminant validity of the Immediate Postconcussion Assessment and Cognitive Testing Battery (ImPACT) in young athletes. Applied Neuropsychology: Child, 8(3), 253–263.  https://doi.org/10.1080/21622965.2018/1436440.CrossRefGoogle Scholar
  62. Kurowski, B. G., Wade, S. L., Kirkwood, M. W., Brown, T. M., Stancin, T., & Taylor, H. G. (2013). Online problem-solving therapy for executive dysfunction after child traumatic brain injury. Pediatrics, 132(1), e158–e166.  https://doi.org/10.1542/peds.2012-4040.CrossRefPubMedPubMedCentralGoogle Scholar
  63. Lace, J. W., Emmert, N. A., Merz, Z. C., Zane, K. L., Grant, A. F., Aylward, S., Dorflinger, J., & Gfeller, J. D. (2019). Investigating the BRIEF and BRIEF-SR in adolescents with mild traumatic brain injury. Journal of Pediatric Neuropsychology, 5(1-2), 9–19.  https://doi.org/10.1007/s40817-018-00063-x.CrossRefGoogle Scholar
  64. Levick, W. R. (2010). Observer rating of memory in children: a review. Brain Impairment, 11(2), 144–151.  https://doi.org/10.1375/brim.11.2.144.CrossRefGoogle Scholar
  65. Lewinsohn, P. M., Gotlib, I. H., Lewinsohn, M., Seeley, J. R., & Allen, N. B. (1998). Gender differences in anxiety disorders and anxiety symptoms in adolescents. Journal of Abnormal Psychology, 107(1), 109–117.  https://doi.org/10.1037/0021-843X.107.1.109.CrossRefPubMedGoogle Scholar
  66. Lipton, M. L., Gulko, E., Zimmerman, M. E., Friedman, B. W., Kim, M., Gellella, E., et al. (2009). Diffusion-tensor imaging implicates prefrontal axonal injury in executive function impairment following very mild traumatic brain injury. Radiology, 252(3), 816–824.  https://doi.org/10.1148/radiol.2523081584.CrossRefPubMedGoogle Scholar
  67. Loe, I. M., Chatav, M., & Alduncin, N. (2015). Complementary assessments of executive function in preterm and full-term preschoolers. Child Neuropsychology, 21(3), 331–353.  https://doi.org/10.1080/09297049.2014.906568.CrossRefPubMedGoogle Scholar
  68. Lovell, M. R., & Getz, G. E. (2006). The ImPACT neuropsychological test battery. In R. J. Echemendia (Ed.), Sports neuropsychology: Assessment and management of traumatic brain injury (pp. 193–215).Google Scholar
  69. Lovell, M. R., Iverson, G. L., Collins, M. W., Podell, K., Johnston, K. M., Pardini, D., et al. (2006). Measurement of symptoms following sports-related concussion: reliability and normative data for the post-concussion scale. Applied Neuropsychology, 13(3), 166–174.  https://doi.org/10.1207/s15324826an1303_4.CrossRefPubMedGoogle Scholar
  70. Maerlender, A., Flashman, L., Kessler, A., Kumbhani, S., Greenwald, R., Tosteson, T., & McAllister, T. (2010). Examination of the construct validity of Impact™ Computerized Test, Traditional, and Experimental Neuropsychological Measures. The Clinical Neuropsychologist, 24(8), 1309–1325.  https://doi.org/10.1080/13854046.2010.516072.CrossRefPubMedPubMedCentralGoogle Scholar
  71. Maillard-Wermelinger, A., Yeates, K. O., Gerry Taylor, H., Rusin, J., Bangert, B., Dietrich, A., et al. (2009). Mild traumatic brain injury and executive functions in school-aged children. Developmental Neurorehabilitation, 12(5), 330–341.  https://doi.org/10.3109/17518420903087251.CrossRefPubMedPubMedCentralGoogle Scholar
  72. Mangeot, S., Armstrong, K., Colvin, A. N., Yeates, K. O., & Taylor, H. G. (2002). Long-term executive function deficits in children with traumatic brain injuries: assessment using the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychology, 8(4), 271–284.  https://doi.org/10.1076/chin.8.4.271.13503.CrossRefPubMedGoogle Scholar
  73. McAuley, T., Chen, S., Goos, L., Schachar, R., & Crosbie, J. (2010). Is the behavior rating inventory of executive function more strongly associated with measures of impairment or executive function? Journal of the International Neuropsychological Society, 16(3), 495–505.  https://doi.org/10.1017/S1355617710000093.CrossRefPubMedGoogle Scholar
  74. McConnell, B., Duffield, T., Hall, T., Piantino, J., Seitz, D., Soden, D., & Williams, C. (2019). Post-traumatic headache after pediatric traumatic brain injury: prevalence, risk factors, and association with neurocognitive outcomes. Journal of Child Neurology.  https://doi.org/10.1177/0883073819876473.
  75. McGrew, K. S., LaForte, E. M., & Schrank, F. A. (2014). Technical manual: Woodcock-Johnson IV. Rolling Meadows: Riverside.Google Scholar
  76. Menon, D. K., Schwab, K., Wright, D. W., & Maas, A. I. (2010). Position statement: definition of traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 91(11), 1637–1640.  https://doi.org/10.1016/j.apmr.2010.05.017.CrossRefPubMedGoogle Scholar
  77. Meythaler, J. M., Peduzzi, J. D., Eleftheriou, E., & Novack, T. A. (2001). Current concepts: diffuse axonal injury & associated traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 82(10), 1461–1471.  https://doi.org/10.1053/apmr.2001.25137.CrossRefPubMedGoogle Scholar
  78. Mitchell, M., & Miller, L. S. (2008). Prediction of functional status in older adults: the ecological validity of four Delis-Kaplan Executive Function System tests. Journal of Clinical and Experimental Neuropsychology, 30(6), 683–690.  https://doi.org/10.1080/13803390701679893.CrossRefPubMedGoogle Scholar
  79. Miyashita, T. L., Diakogeorgiou, E., & VanderVegt, C. (2016). Gender differences in concussion reporting among high school athletes. Sports Health, 8(4), 359–363.  https://doi.org/10.1177/1941738116651856.CrossRefPubMedPubMedCentralGoogle Scholar
  80. Norris, G., & Tate, R. L. (2000). The behavioural assessment of the dysexecutive syndrome (BADS): ecological, concurrent and construct validity. Neuropsychological Rehabilitation, 10(1), 33–45.  https://doi.org/10.1080/096020100389282.CrossRefGoogle Scholar
  81. Novack, T. A., Alderson, A. L., Bush, B. A., Meythaler, J. M., & Canupp, K. (2000). Cognitive and functional recovery at 6 and 12 months post-TBI. Brain Injury, 14(11), 987–996.  https://doi.org/10.1080/02699050050191922.CrossRefPubMedGoogle Scholar
  82. O’Reilly, R. C. (2010). The what and how of prefrontal cortical organization. Trends in Neurosciences, 33(8), 355–361.CrossRefGoogle Scholar
  83. Paniak, C., Miller, H. B., Murphy, D., Andrews, A., & Flynn, J. (1997). Consonant trigrams test for children: Development and norms. The Clinical Neuropsychologist, 11(2), 198–200.  https://doi.org/10.1080/13854049708407051.CrossRefGoogle Scholar
  84. Peterson, E., & Welsh, M. C. (2014). The development of hot and cool executive functions in childhood and adolescence: Are we getting warmer? In Handbook of Executive Functioning (pp. 45–65). New York: Springer.CrossRefGoogle Scholar
  85. Prince, C., & Bruhns, M. E. (2017). Evaluation and treatment of mild traumatic brain injury: the role of neuropsychology. Brain Sciences, 7(8).  https://doi.org/10.3390/brainsci7080105.CrossRefGoogle Scholar
  86. Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: a follow-up survey of INS and NAN Members. Archives of Clinical Neuropsychology, 31(3), 206–230.  https://doi.org/10.1093/arclin/acw007.CrossRefGoogle Scholar
  87. Ready, R. E., Stierman, L., & Paulsen, J. S. (2001). Ecological validity of neuropsychological and personality measures of executive functions. The Clinical Neuropsychologist, 15(3), 314–323.  https://doi.org/10.1076/clin.15.3.314.10269.CrossRefPubMedGoogle Scholar
  88. Roth, R. M., Erdodi, L. A., McCulloch, L. J., & Isquith, P. K. (2014a). Much ado about norming: the Behavior Rating Inventory of Executive Function. Child Neuropsychology, 21(2), 225–233.  https://doi.org/10.1080/09297049.2014.897318.CrossRefPubMedGoogle Scholar
  89. Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014b). Assessment of executive functioning using the Behavior Rating Inventory of Executive Function (BRIEF). In S. Goldstein & J. Naglieri (Eds.), Handbook of Executive Functioning. New York: Springer.Google Scholar
  90. Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017). Gender differences in depression in representative national samples: Meta-analyses of diagnoses and symptoms. Psychological Bulletin, 143(8), 783–822.  https://doi.org/10.1037/bul0000102.CrossRefPubMedPubMedCentralGoogle Scholar
  91. Sbordone, R. J. (2001). Limitations of neuropsychological testing to predict the cognitive and behavioral functioning of persons with brain injury in real-world settings. NeuroRehabilitation, 16(4), 199–201.PubMedGoogle Scholar
  92. Schatz, P., Pardini, J. E., Lovell, M. R., Collins, M. W., & Podell, K. (2006). Sensitivity and specificity of the ImPACT Test Battery for concussion in athletes. Archives of Clinical Neuropsychology, 21(1), 91–99.  https://doi.org/10.1016/j.acn.2005.08.001.CrossRefPubMedGoogle Scholar
  93. Schatz, P., Moser, R. S., Solomon, G. S., Ott, S. D., & Karpf, R. (2012). Prevalence of invalid computerized baseline neurocognitive test results in high school and collegiate athletes. Journal of Athletic Training, 47(3), 289–296.  https://doi.org/10.4085/1062-6050-47.3.14.CrossRefPubMedPubMedCentralGoogle Scholar
  94. Schrank, F. A., Mather, N., & McGrew, K. S. (2014). Woodcock-Johnson IV Tests of Achievement. Rolling Meadows: Riverside.Google Scholar
  95. Schretlen, D. J., & Shapiro, A. M. (2003). A quantitative review of the effects of traumatic brain injury on cognitive functioning. International Review of Psychiatry, 15(4), 341–349.  https://doi.org/10.1080/09540260310001606728.CrossRefPubMedGoogle Scholar
  96. Shaked, D., Faulkner, L. M. D., Tolle, K., Wendell, C. R., Waldstein, S. R., & Spencer, R. J. (2019). Reliability and validity of the Conners’ Continuous Performance Test (pp. 1–10). Adult: Applied Neuropsychology.  https://doi.org/10.1080/23279095.2019.1570199.CrossRefGoogle Scholar
  97. Silver, C. H. (2014). Sources of data about children's executive functioning: review and commentary. Child Neuropsychology, 20(1), 1–13.  https://doi.org/10.1080/09297049.2012.727793.CrossRefPubMedGoogle Scholar
  98. Solomon, G. (n.d.). Introduction to ImPACT: Immediate Post Concussion Assessment and Cognitive Testing. PowerPoint Presentation. Retrieved from https://perma.cc/9Y6G-RE7Z
  99. Strauss, E., Sherman, E. M., & Spreen, O. (2006). A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary. New York: Oxford University Press.Google Scholar
  100. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (sixth ed.). Boston: Pearson.Google Scholar
  101. Tierney, R. T., Sitler, M. R., Swanik, C. B., Swanik, K. A., Higgins, M., & Torg, J. (2005). Gender differences in head-neck segment dynamic stabilization during head acceleration. Medicine and Science in Sports and Exercise, 37(2), 272–279.CrossRefGoogle Scholar
  102. Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2008). Executive functions: performance-based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with attention deficit/hyperactivity disorder (ADHD). Child Neuropsychology, 15(1), 53–72.  https://doi.org/10.1080/09297040802070929.CrossRefGoogle Scholar
  103. Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54(2), 131–143.  https://doi.org/10.1111/jcpp.12001.CrossRefPubMedGoogle Scholar
  104. Van der Elst, W., Van Boxtel, M. P. J., Van Breukelen, G. J. P., & Jolles, J. (2008). A large-scale cross-sectional and longitudinal study into the ecological validity of neuropsychological test measures in neurologically intact people. Archives of Clinical Neuropsychology, 23(7-8), 787–800.  https://doi.org/10.1016/j.acn.2008.09.002.CrossRefPubMedGoogle Scholar
  105. Voller, B., Benke, T., Benedetto, K., Schnider, P., Auff, E., & Aichner, F. (1999). Neuropsychological, MRI and EEG findings after very mild traumatic brain injury. Brain Injury, 13(10), 821–827.  https://doi.org/10.1080/026990599121214.CrossRefPubMedGoogle Scholar
  106. Vriezen, E. R., & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology, 8(4), 296–303.  https://doi.org/10.1076/chin.8.4.296.13505.CrossRefPubMedGoogle Scholar
  107. Vriezen, E. R., Pigott, S. D., & Pelletier, P. M. (2001). Developmental implications of early frontal-lobe damage: a case study. Brain and Cognition, 47, 222–225.Google Scholar
  108. Wallisch, A., Little, L. M., Dean, E., & Dunn, W. (2018). Executive function measures for children: A scoping review of ecological validity. OTJR: Occupation, Participation and Health, 38(1), 6–14.  https://doi.org/10.1177/1539449217727118.CrossRefPubMedGoogle Scholar
  109. Wood, R. L., & Liossi, C. (2006). The ecological validity of executive tests in a severely brain injured sample. Archives of Clinical Neuropsychology, 21(5), 429–437.  https://doi.org/10.1016/j.acn.2005.06.014.CrossRefPubMedGoogle Scholar
  110. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III tests of achievement. Rolling Meadows: Riverside.Google Scholar
  111. Zane, K. L., Gfeller, J. D., Roskos, P. T., & Bucholz, R. D. (2016). The clinical utility of the Conners’ Continuous Performance Test-II in traumatic brain injury. Archives of Clinical Neuropsychology, 31(8), 996–1005.  https://doi.org/10.1093/arclin/acw078.CrossRefGoogle Scholar

Copyright information

© American Academy of Pediatric Neuropsychology 2019

Authors and Affiliations

  • John W. Lace
    • 1
    Email author
  • Zachary C. Merz
    • 2
  • Alex F. Grant
    • 1
  • Carson L. Teague
    • 1
  • Stephanie Aylward
    • 3
  • Jill Dorflinger
    • 4
  • Jeffrey D. Gfeller
    • 1
  1. 1.Department of PsychologySaint Louis UniversitySt. LouisUSA
  2. 2.Department of Physical Medicine and RehabilitationUniversity of North Carolina, Chapel HillChapel HillUSA
  3. 3.Department of PsychologyIllinois Institute of TechnologyChicagoUSA
  4. 4.Center for Pediatric BrainAMITA Health Neurosciences InstituteChicagoUSA

Personalised recommendations