Abstract
Clinical neuropsychologists typically use both performance-based tests and behavioral rating scales as part of comprehensive assessment. However, literature has suggested that performance-based tests account for limited variance in behavioral rating scales in healthy and clinical populations. Importantly, little work has investigated the relationships between performance-based tests and behavioral rating scales in adolescent mild traumatic brain injury (mTBI). The present study was retrospective in nature and included 136 adolescents (M age = 14.97; 56% female) in the post-acute phase of recovery from mTBI (M days since injury = 33.4) referred for neuropsychological evaluation. Participants were administered a multi-domain neuropsychological test battery with measures of reaction time, processing speed, sustained attention, impulsivity, working memory, and verbal and visual memory, and the Behavior Rating Inventory of Executive Function (BRIEF) and BRIEF-Self Report (BRIEF-SR). Results revealed mean neuropsychological test performance and parent- and self-reported executive dysfunction within the average range. Hierarchical multiple regressions revealed that performance-based test scores accounted for between 13 and 18% variance in BRIEF scores and between 8 and 14% variance in BRIEF-SR scores after controlling for demographic factors (which accounted for 3% variance in BRIEF scores and 7–10% variance in BRIEF-SR scores). Processing speed emerged as the most consistent significant individual predictor of BRIEF/BRIEF-SR scores across regression analyses. These findings build on previous literature by suggesting relatively limited psychometric overlap between performance-based tests and behavioral rating scales, such that these approaches likely assess distinct and unique psychological constructs. Relationships to previous work, limitations of the current study, and directions for future research are discussed.
Similar content being viewed by others
References
Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., & Mikiewicz, O. (2002). Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychology, 8(4), 231–240. https://doi.org/10.1076/chin.8.4.231.13509.
Babikian, T., & Asarnow, R. (2009). Neurocognitive outcomes and recovery after pediatric TBI: Meta-analytic review of the literature. Neuropsychology, 23(3), 283–296. https://doi.org/10.1037/a0015268.
Baker, J. G., Leddy, J. J., Darling, S. R., Shucard, J., Makdissi, M., & Willer, B. S. (2015). Gender differences in recovery from sports-related concussion in adolescents. Clinical Pediatrics, 55(8), 771–775. https://doi.org/10.1177/0009922815606417.
Bar-Haim Erez, A., Rothschild, E., Katz, N., Tuchner, M., & Hartman-Maeir, A. (2009). Executive functioning, awareness, and participation in daily life after mild traumatic brain injury: a preliminary study. American Journal of Occupational Therapy, 63(5), 634–640. https://doi.org/10.5014/ajot.63.5.634.
Barlow, K. M., Crawford, S., Brooks, B. L., Turley, B., & Mikrogianakis, A. (2015). The incidence of postconcussion syndrome remains stable following mild traumatic brain injury in children. Pediatric Neurology, 53(6), 491–497. https://doi.org/10.1016/j.pediatrneurol.2015.04.011.
Barney, S. J., Allen, D. N., Thaler, N. S., Park, B. S., Strauss, G. P., & Mayfield, J. (2011). Neuropsychological and behavioral measures of attention assess different constructs in children with traumatic brain injury. The Clinical Neuropsychologist, 25(7), 1145–1157. https://doi.org/10.1080/13854046.2011.595956.
Bechara, A. (2004). The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage. Brain and Cognition, 55(1), 30–40.
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50(1-3), 7–15.
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (2005). The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers. Trends in Cognitive Sciences, 9(4), 159–162.
Beer, J. S. (2006). Orbitofrontal cortex and social regulation. In J. T. Cacioppa, P. S. Visser, & C. L. Picket (Eds.), Social neuroscience: people thinking about thinking people (pp. 153–166). Cambridge: MIT Press.
Benedict, R. H. B., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins verbal learning test—revised: normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55. https://doi.org/10.1076/clin.12.1.43.1726.
Berz, K., Divine, J., Foss, K. B., Heyl, R., Ford, K. R., & Myer, G. D. (2013). Sex-specific differences in the severity of symptoms and recovery rate following sports-related concussion in young athletes. The Physician and Sportsmedicine, 41(2), 58–63. https://doi.org/10.3810/psm.2013.05.2015.
Bodnar, L. E., Prahme, M. C., Cutting, L. E., Denckla, M. B., & Mahone, E. M. (2007). Construct validity of parent ratings of inhibitory control. Child Neuropsychology, 13(4), 345–362. https://doi.org/10.1080/09297040600899867.
Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., & Grimm, K. J. (2009). The contributions of ‘hot’ and ‘cool’ executive function to children’s academic achievement, learning-related behaviors, and engagement in kindergarten. Early Childhood Research Quarterly, 24(3), 337–349. https://doi.org/10.1016/j.ecresq.2009.06.001.
Burgess, P. W., Alderman, N., Evans, J. O. N., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4(6), 547–558. https://doi.org/10.1017/S1355617798466037.
Chan, R. C. K., Shum, D., Toulopoulou, T., & Chen, E. Y. H. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201-216. https://doi.org/10.1016/j.acn.2007.08.010.
Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197. https://doi.org/10.1023/B:NERV.0000009483.91468.fb.
Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217–227. https://doi.org/10.1016/j.acn.2005.12.002.
Chaytor, N., Temkin, N., Machamer, J., & Dikmen, S. (2007). The ecological validity of neuropsychological assessment and the role of depressive symptoms in moderate to severe traumatic brain injury. Journal of the International Neuropsychological Society, 13(3), 377–385. https://doi.org/10.1017/S1355617707070592.
Chevignard, M. P., Servant, V., Mariller, A., Abada, G., Pradat-Diehl, P., & Laurent-Vannier, A. (2009). Assessment of executive functioning in children after TBI with a naturalistic open-ended task: a pilot study. Developmental Neurorehabilitation, 12(2), 76–91. https://doi.org/10.1080/17518420902777019.
Chevignard, M. P., Soo, C., Galvin, J., Catroppa, C., & Eren, S. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: a systematic review. Brain Injury, 26(9), 1033–1057. https://doi.org/10.3109/02699052.2012.666366.
Colvin, A. C., Mullen, J., Lovell, M. R., Vereeke West, R., Collins, M. W., & Groh, M. (2009). The role of concussion history and gender in recovery from soccer-related concussion. The American Journal of Sports Medicine, 37(9), 1699–1704. https://doi.org/10.1177/0363546509332497.
Conners, C. K. (2014). Conners’ continuous performance test (Conners CPT 3). North Tonawanda: MHS Assessments
Conners, K. C., & M. H. S. (2000). Conners’ Continuous Performance Test II. CPT II. North Tonawanda: Multi-Health Systems.
Cormier, D. C., McGrew, K. S., Bulut, O., & Funamoto, A. (2016). Revisiting the relations between the WJ-IV measures of Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during the school-age years. Journal of Psychoeducational Assessment, 35(8), 731–754. https://doi.org/10.1177/0734282916659208.
Covassin, T., Elbin, R. J., Harris, W., Parker, T., & Kontos, A. (2012). The role of age and sex in symptoms, neurocognitive performance, and postural stability in athletes after concussion. The American Journal of Sports Medicine, 40(6), 1303–1312. https://doi.org/10.1177/0363546512444554.
Covassin, T., Elbin, R. J., Bleecker, A., Lipchik, A., & Kontos, A. P. (2013). Are there differences in neurocognitive function and symptoms between male and female soccer players after concussions? The American Journal of Sports Medicine, 41(12), 2890–2895. https://doi.org/10.1177/0363546513509962.
Cusimano, M. D., Topolovec-Vranic, J., Zhang, S., Mullen, S. J., Wong, M., & Ilie, G. (2017). Factors influencing the underreporting of concussion in sports: a qualitative study of minor hockey participants. Clinical Journal of Sport Medicine, 27(4), 375–380. https://doi.org/10.1097/jsm.0000000000000372.
Davis, A. S., Bernat, D. J., & Reynolds, C. R. (2018). Estimation of premorbid functioning in pediatric neuropsychology: review and recommendations. Journal of Pediatric Neuropsychology, 4(1-2), 49–62. https://doi.org/10.1007/s40817-018-0051-x.
Delis, D. C. (1994). CVLT-C: California verbal learning test. Harcourt Brace Corporation: Psychological Corporation.
Denckla, M. B. (2002). The Behavior Rating Inventory of Executive Function: commentary. Child Neuropsychology, 8(4), 304–306. https://doi.org/10.1076/chin.8.4.304.13512.
Di Pinto, M. (2006). The ecological validity of the Behavior Rating Inventory of Executive Function (BRIEF) in attention deficit hyperactivity disorder: Predicting academic achievement and social adaptive behavior in the subtypes of ADHD (Doctoral Dissertation). Drexel University: Philadelphia, PA. Available from https://idea.library.drexel.edu/islandora/object/idea%3A845/datastream/OBJ/download/The_ecological_validity_of_the_behavior_rating_inventory_of_executive_function__BRIEF__in_attention_deficit_hyperactivity_disorder__predicting_academic_achievement_and_social_adaptive_behavior_in_the_subtypes_of_ADHD.pdf
Donders, J., DenBraber, D., & Vos, L. (2010). Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury. Journal of Neuropsychology, 4(2), 197–209. https://doi.org/10.1348/174866409X478970.
Donna, K. B., Tanya, K., Jason, R. F., David, E., Frank, W., & Jeffrey, T. B. (2005). Sex differences in outcome following sports-related concussion. J Neurosurg, 102(5), 856–863. https://doi.org/10.3171/jns.2005.102.5.0856.
Duggan, E. C., Garcia-Barrera, M. A., & Muller, U. (2018). Derivation, replication, and validity analyses of a screener for the behavioral assessment of executive functions in young adults. Assessment, 25(7), 867–884. https://doi.org/10.1177/1073191116670511.
Duncan, J., & Owen, A. M. (2000). Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends in Neurosciences, 23(10), 475–483.
Duvall, S. W., Erickson, S. J., MacLean, P., LaFavor, T., & Lowe, J. R. (2017). Multimodal executive function measurement in preschool children born very low birth weight and full term: relationships between formal lab-based measure performance, parent report, and naturalistic observational coding. Journal of Pediatric Neuropsychology, 3(3), 195–205. https://doi.org/10.1007/s40817-017-0047-y.
Ellis, M. J., Ritchie, L. J., Koltek, M., Hosain, S., Cordingley, D., Chu, S., Russell, K. (2015). Psychiatric outcomes after pediatric sports-related concussion. Journal of Neurosurgery: Pediatrics PED, 16(6), 709. https://doi.org/10.3171/2015.5.peds15220.
Emery, C. A., Barlow, K. M., Brooks, B. L., Max, J. E., Villavicencio-Requis, A., Gnanakumar, V., Yeates, K. O. (2016). A Systematic Review of Psychiatric, Psychological, and Behavioural Outcomes following Mild Traumatic Brain Injury in Children and Adolescents. The Canadian Journal of Psychiatry, 61(5), 259–269. https://doi.org/10.1177/0706743716643741
Eslinger, P. J., Flaherty-Craig, C. V., & Benton, A. L. (2004). Developmental outcomes after early prefrontal cortex damage. Brain and Cognition, 55(1), 84–103. https://doi.org/10.1016/S0278-2626(03)00281-1.
Esposito, G., Van Horn, J. D., Weinberger, D. R., & Berman, K. F. (1996). Gender differences in cerebral blood flow as a function of cognitive state with PET. Journal of Nuclear Medicine, 37(4), 559–564.
Field, M., Collins, M. W., Lovell, M. R., & Maroon, J. (2003). Does age play a role in recovery from sports-related concussion? A comparison of high school and collegiate athletes. The Journal of Pediatrics, 142(5), 546–553. https://doi.org/10.1067/mpd.2003.190.
Field, A. (2013). Discovering statistics using IBM SPSS Statistics, fourth edition: Thousand Oaks, CA: Sage.
Frost, R. B., Farrer, T. J., Primosch, M., & Hedges, D. W. (2013). Prevalence of traumatic brain injury in the general adult population: a meta-analysis. Neuroepidemiology, 40(3), 154–159. https://doi.org/10.1159/000343275.
Ganesalingam, K., Yeates, K. O., Taylor, H. G., Walz, N. C., Stancin, T., & Wade, S. (2011). Executive functions and social competence in young children 6 months following traumatic brain injury. Neuropsychology, 25(4), 466–476. https://doi.org/10.1037/a0022768.
Gillen, G. (2013). A fork in the road: an occupational hazard? The American Journal of Occupational Therapy, 67(6), 641–652. https://doi.org/10.5014/ajot.2013.676002.
Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). BRIEF: Behavior rating inventory of executive function. Lutz: Psychological assessment resources.
Grace, J., & Malloy, P. (1992). Frontal lobe personality scale. Providence: Brown University.
Greenwald, B. D., Ambrose, A. F., & Armstrong, G. P. (2012). Mild Brain Injury. Rehabilitation Research and Practice, 2012, 3. https://doi.org/10.1155/2012/469475.
Guy, S. C., Gioia, G. A., & Isquith, P. K. (2004). BRIEF-SR: Behavior rating inventory of executive function--self-report version. Lutz: Psychological Assessment Resources.
Herjanic, B., & Reich, W. (1982). Development of a structured psychiatric interview for children: Agreement between child and parent on individual symptoms. Journal of Abnormal Child Psychology, 10(3), 307–324. https://doi.org/10.1007/BF00912324.
Hooper, C. J., Luciana, M., Conklin, H. M., & Yarger, R. S. (2004). Adolescents’ performance on the Iowa Gambling Task: implications for the development of decision making and ventromedial prefrontal cortex. Developmental Psychology, 40(6), 1148.
ImPACT Applications Inc. (2011). Immediate Post-Concussion Assessment and Cognitive Testing Technical Manual and Psychometric Data. Pittsburgh: ImPACT Applications Inc.
Isquith, P. K., Roth, R. M., & Gioia, G. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child, 2(2), 125–132. https://doi.org/10.1080/21622965.2013.748389.
Isquith, P. K., Roth, R. M., Kenworthy, L., & Gioia, G. (2014). Contribution of rating scales to intervention for executive dysfunction. Applied Neuropsychology: Child, 3(3), 197–204. https://doi.org/10.1080/21622965.2013.870014.
Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467. https://doi.org/10.1076/clin.17.4.460.27934.
Iverson, G. L., Lovell, M. R., & Collins, M. W. (2005). Validity of ImPACT for measuring processing speed following sports-related concussion. Journal of Clinical and Experimental Neuropsychology, 27(6), 683–689. https://doi.org/10.1081/13803390490918435.
Iverson, G. L., Gardner, A. J., Terry, D. P., Ponsford, J. L., Sills, A. K., Broshek, D. K., & Solomon, G. S. (2017). Predictors of clinical recovery from concussion: a systematic review. British Journal of Sports Medicine, 51(12), 941. https://doi.org/10.1136/bjsports-2017-097729.
Josman, N., & Meyer, S. (2019). Conceptualisation and use of executive functions in paediatrics: A scoping review of occupational therapy literature. Australian Occupational Therapy Journal, 66(1), 77–90. https://doi.org/10.1111/1440-1630.12525.
Kibby, M. Y., Schmitter-Edgecombe, M., & Long, C. J. (1998). Ecological validity of neuropsychological tests: focus on the California Verbal Learning Test and the Wisconsin Card Sorting Test. Archives of Clinical Neuropsychology, 13(6), 523–534. https://doi.org/10.1093/arclin/13.6.523.
Koehl, L. M., Walls, B. D., Brothers, S. L., Morris, S. N., Glueck, A. C., Schmitt, F. A., Berry, D. T. R., & Han, D. Y. (2019). Convergent and discriminant validity of the Immediate Postconcussion Assessment and Cognitive Testing Battery (ImPACT) in young athletes. Applied Neuropsychology: Child, 8(3), 253–263. https://doi.org/10.1080/21622965.2018/1436440.
Kurowski, B. G., Wade, S. L., Kirkwood, M. W., Brown, T. M., Stancin, T., & Taylor, H. G. (2013). Online problem-solving therapy for executive dysfunction after child traumatic brain injury. Pediatrics, 132(1), e158–e166. https://doi.org/10.1542/peds.2012-4040.
Lace, J. W., Emmert, N. A., Merz, Z. C., Zane, K. L., Grant, A. F., Aylward, S., Dorflinger, J., & Gfeller, J. D. (2019). Investigating the BRIEF and BRIEF-SR in adolescents with mild traumatic brain injury. Journal of Pediatric Neuropsychology, 5(1-2), 9–19. https://doi.org/10.1007/s40817-018-00063-x.
Levick, W. R. (2010). Observer rating of memory in children: a review. Brain Impairment, 11(2), 144–151. https://doi.org/10.1375/brim.11.2.144.
Lewinsohn, P. M., Gotlib, I. H., Lewinsohn, M., Seeley, J. R., & Allen, N. B. (1998). Gender differences in anxiety disorders and anxiety symptoms in adolescents. Journal of Abnormal Psychology, 107(1), 109–117. https://doi.org/10.1037/0021-843X.107.1.109.
Lipton, M. L., Gulko, E., Zimmerman, M. E., Friedman, B. W., Kim, M., Gellella, E., et al. (2009). Diffusion-tensor imaging implicates prefrontal axonal injury in executive function impairment following very mild traumatic brain injury. Radiology, 252(3), 816–824. https://doi.org/10.1148/radiol.2523081584.
Loe, I. M., Chatav, M., & Alduncin, N. (2015). Complementary assessments of executive function in preterm and full-term preschoolers. Child Neuropsychology, 21(3), 331–353. https://doi.org/10.1080/09297049.2014.906568.
Lovell, M. R., & Getz, G. E. (2006). The ImPACT neuropsychological test battery. In R. J. Echemendia (Ed.), Sports neuropsychology: Assessment and management of traumatic brain injury (pp. 193–215).
Lovell, M. R., Iverson, G. L., Collins, M. W., Podell, K., Johnston, K. M., Pardini, D., et al. (2006). Measurement of symptoms following sports-related concussion: reliability and normative data for the post-concussion scale. Applied Neuropsychology, 13(3), 166–174. https://doi.org/10.1207/s15324826an1303_4.
Maerlender, A., Flashman, L., Kessler, A., Kumbhani, S., Greenwald, R., Tosteson, T., & McAllister, T. (2010). Examination of the construct validity of Impact™ Computerized Test, Traditional, and Experimental Neuropsychological Measures. The Clinical Neuropsychologist, 24(8), 1309–1325. https://doi.org/10.1080/13854046.2010.516072.
Maillard-Wermelinger, A., Yeates, K. O., Gerry Taylor, H., Rusin, J., Bangert, B., Dietrich, A., et al. (2009). Mild traumatic brain injury and executive functions in school-aged children. Developmental Neurorehabilitation, 12(5), 330–341. https://doi.org/10.3109/17518420903087251.
Mangeot, S., Armstrong, K., Colvin, A. N., Yeates, K. O., & Taylor, H. G. (2002). Long-term executive function deficits in children with traumatic brain injuries: assessment using the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychology, 8(4), 271–284. https://doi.org/10.1076/chin.8.4.271.13503.
McAuley, T., Chen, S., Goos, L., Schachar, R., & Crosbie, J. (2010). Is the behavior rating inventory of executive function more strongly associated with measures of impairment or executive function? Journal of the International Neuropsychological Society, 16(3), 495–505. https://doi.org/10.1017/S1355617710000093.
McConnell, B., Duffield, T., Hall, T., Piantino, J., Seitz, D., Soden, D., & Williams, C. (2019). Post-traumatic headache after pediatric traumatic brain injury: prevalence, risk factors, and association with neurocognitive outcomes. Journal of Child Neurology. https://doi.org/10.1177/0883073819876473.
McGrew, K. S., LaForte, E. M., & Schrank, F. A. (2014). Technical manual: Woodcock-Johnson IV. Rolling Meadows: Riverside.
Menon, D. K., Schwab, K., Wright, D. W., & Maas, A. I. (2010). Position statement: definition of traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 91(11), 1637–1640. https://doi.org/10.1016/j.apmr.2010.05.017.
Meythaler, J. M., Peduzzi, J. D., Eleftheriou, E., & Novack, T. A. (2001). Current concepts: diffuse axonal injury & associated traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 82(10), 1461–1471. https://doi.org/10.1053/apmr.2001.25137.
Mitchell, M., & Miller, L. S. (2008). Prediction of functional status in older adults: the ecological validity of four Delis-Kaplan Executive Function System tests. Journal of Clinical and Experimental Neuropsychology, 30(6), 683–690. https://doi.org/10.1080/13803390701679893.
Miyashita, T. L., Diakogeorgiou, E., & VanderVegt, C. (2016). Gender differences in concussion reporting among high school athletes. Sports Health, 8(4), 359–363. https://doi.org/10.1177/1941738116651856.
Norris, G., & Tate, R. L. (2000). The behavioural assessment of the dysexecutive syndrome (BADS): ecological, concurrent and construct validity. Neuropsychological Rehabilitation, 10(1), 33–45. https://doi.org/10.1080/096020100389282.
Novack, T. A., Alderson, A. L., Bush, B. A., Meythaler, J. M., & Canupp, K. (2000). Cognitive and functional recovery at 6 and 12 months post-TBI. Brain Injury, 14(11), 987–996. https://doi.org/10.1080/02699050050191922.
O’Reilly, R. C. (2010). The what and how of prefrontal cortical organization. Trends in Neurosciences, 33(8), 355–361.
Paniak, C., Miller, H. B., Murphy, D., Andrews, A., & Flynn, J. (1997). Consonant trigrams test for children: Development and norms. The Clinical Neuropsychologist, 11(2), 198–200. https://doi.org/10.1080/13854049708407051.
Peterson, E., & Welsh, M. C. (2014). The development of hot and cool executive functions in childhood and adolescence: Are we getting warmer? In Handbook of Executive Functioning (pp. 45–65). New York: Springer.
Prince, C., & Bruhns, M. E. (2017). Evaluation and treatment of mild traumatic brain injury: the role of neuropsychology. Brain Sciences, 7(8). https://doi.org/10.3390/brainsci7080105.
Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: a follow-up survey of INS and NAN Members. Archives of Clinical Neuropsychology, 31(3), 206–230. https://doi.org/10.1093/arclin/acw007.
Ready, R. E., Stierman, L., & Paulsen, J. S. (2001). Ecological validity of neuropsychological and personality measures of executive functions. The Clinical Neuropsychologist, 15(3), 314–323. https://doi.org/10.1076/clin.15.3.314.10269.
Roth, R. M., Erdodi, L. A., McCulloch, L. J., & Isquith, P. K. (2014a). Much ado about norming: the Behavior Rating Inventory of Executive Function. Child Neuropsychology, 21(2), 225–233. https://doi.org/10.1080/09297049.2014.897318.
Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014b). Assessment of executive functioning using the Behavior Rating Inventory of Executive Function (BRIEF). In S. Goldstein & J. Naglieri (Eds.), Handbook of Executive Functioning. New York: Springer.
Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017). Gender differences in depression in representative national samples: Meta-analyses of diagnoses and symptoms. Psychological Bulletin, 143(8), 783–822. https://doi.org/10.1037/bul0000102.
Sbordone, R. J. (2001). Limitations of neuropsychological testing to predict the cognitive and behavioral functioning of persons with brain injury in real-world settings. NeuroRehabilitation, 16(4), 199–201.
Schatz, P., Pardini, J. E., Lovell, M. R., Collins, M. W., & Podell, K. (2006). Sensitivity and specificity of the ImPACT Test Battery for concussion in athletes. Archives of Clinical Neuropsychology, 21(1), 91–99. https://doi.org/10.1016/j.acn.2005.08.001.
Schatz, P., Moser, R. S., Solomon, G. S., Ott, S. D., & Karpf, R. (2012). Prevalence of invalid computerized baseline neurocognitive test results in high school and collegiate athletes. Journal of Athletic Training, 47(3), 289–296. https://doi.org/10.4085/1062-6050-47.3.14.
Schrank, F. A., Mather, N., & McGrew, K. S. (2014). Woodcock-Johnson IV Tests of Achievement. Rolling Meadows: Riverside.
Schretlen, D. J., & Shapiro, A. M. (2003). A quantitative review of the effects of traumatic brain injury on cognitive functioning. International Review of Psychiatry, 15(4), 341–349. https://doi.org/10.1080/09540260310001606728.
Shaked, D., Faulkner, L. M. D., Tolle, K., Wendell, C. R., Waldstein, S. R., & Spencer, R. J. (2019). Reliability and validity of the Conners’ Continuous Performance Test (pp. 1–10). Adult: Applied Neuropsychology. https://doi.org/10.1080/23279095.2019.1570199.
Silver, C. H. (2014). Sources of data about children's executive functioning: review and commentary. Child Neuropsychology, 20(1), 1–13. https://doi.org/10.1080/09297049.2012.727793.
Solomon, G. (n.d.). Introduction to ImPACT: Immediate Post Concussion Assessment and Cognitive Testing. PowerPoint Presentation. Retrieved from https://perma.cc/9Y6G-RE7Z
Strauss, E., Sherman, E. M., & Spreen, O. (2006). A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary. New York: Oxford University Press.
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (sixth ed.). Boston: Pearson.
Tierney, R. T., Sitler, M. R., Swanik, C. B., Swanik, K. A., Higgins, M., & Torg, J. (2005). Gender differences in head-neck segment dynamic stabilization during head acceleration. Medicine and Science in Sports and Exercise, 37(2), 272–279.
Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2008). Executive functions: performance-based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with attention deficit/hyperactivity disorder (ADHD). Child Neuropsychology, 15(1), 53–72. https://doi.org/10.1080/09297040802070929.
Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54(2), 131–143. https://doi.org/10.1111/jcpp.12001.
Van der Elst, W., Van Boxtel, M. P. J., Van Breukelen, G. J. P., & Jolles, J. (2008). A large-scale cross-sectional and longitudinal study into the ecological validity of neuropsychological test measures in neurologically intact people. Archives of Clinical Neuropsychology, 23(7-8), 787–800. https://doi.org/10.1016/j.acn.2008.09.002.
Voller, B., Benke, T., Benedetto, K., Schnider, P., Auff, E., & Aichner, F. (1999). Neuropsychological, MRI and EEG findings after very mild traumatic brain injury. Brain Injury, 13(10), 821–827. https://doi.org/10.1080/026990599121214.
Vriezen, E. R., & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology, 8(4), 296–303. https://doi.org/10.1076/chin.8.4.296.13505.
Vriezen, E. R., Pigott, S. D., & Pelletier, P. M. (2001). Developmental implications of early frontal-lobe damage: a case study. Brain and Cognition, 47, 222–225.
Wallisch, A., Little, L. M., Dean, E., & Dunn, W. (2018). Executive function measures for children: A scoping review of ecological validity. OTJR: Occupation, Participation and Health, 38(1), 6–14. https://doi.org/10.1177/1539449217727118.
Wood, R. L., & Liossi, C. (2006). The ecological validity of executive tests in a severely brain injured sample. Archives of Clinical Neuropsychology, 21(5), 429–437. https://doi.org/10.1016/j.acn.2005.06.014.
Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III tests of achievement. Rolling Meadows: Riverside.
Zane, K. L., Gfeller, J. D., Roskos, P. T., & Bucholz, R. D. (2016). The clinical utility of the Conners’ Continuous Performance Test-II in traumatic brain injury. Archives of Clinical Neuropsychology, 31(8), 996–1005. https://doi.org/10.1093/arclin/acw078.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflicts of interest.
Ethical Approval
The present study was retrospective. For this type of study, formal consent is not required. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed Consent
The present study was retrospective, and data were de-identified prior to study’s conception. Approval by participating institutions’ Institutional Review Boards (#2016-0028-03 and #27348) waived the requirement for informed consent.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lace, J.W., Merz, Z.C., Grant, A.F. et al. Relationships Between the BRIEF/BRIEF-SR and Performance-Based Neuropsychological Tests in Adolescents with Mild Traumatic Brain Injury. J Pediatr Neuropsychol 5, 163–176 (2019). https://doi.org/10.1007/s40817-019-00074-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40817-019-00074-2