Abstract
A thorough understanding of the relationship between cognitive test performance and symptoms of depression, anxiety, or post-traumatic stress disorder (PTSD) in people with traumatic brain injury (TBI) is important given the high prevalence of these emotional symptoms following injury. It is also important to understand whether these relationships are affected by TBI severity, and the validity of test performance and symptom report. This meta-analysis was conducted to investigate whether these symptoms are associated with cognitive test performance alterations in adults with a TBI. This meta-analysis was prospectively registered on the PROSPERO International Prospective Register of Systematic Reviews website (registration number: CRD42018089194). The electronic databases Medline, PsycINFO, and CINAHL were searched for journal articles published up until May 2020. In total, 61 studies were included, which enabled calculation of pooled effect sizes for the cognitive domains of immediate memory (verbal and visual), recent memory (verbal and visual), attention, executive function, processing speed, and language. Depression had a small, negative relationship with most cognitive domains. These relationships remained, for the most part, when samples with mild TBI (mTBI)-only were analysed separately, but not for samples with more severe TBI (sTBI)-only. A similar pattern of results was found in the anxiety analysis. PTSD had a small, negative relationship with verbal memory, in samples with mTBI-only. No data were available for the PTSD analysis with sTBI samples. Moderator analyses indicated that the relationships between emotional symptoms and cognitive test performance may be impacted to some degree by exclusion of participants with atypical performance on performance validity tests (PVTs) or symptom validity tests (SVTs), however there were small study numbers and changes in effect size were not statistically significant. These findings are useful in synthesising what is currently known about the relationship between cognitive test performance and emotional symptoms in adults with TBI, demonstrating significant, albeit small, relationships between emotional symptoms and cognitive test performance in multiple domains, in non-military samples. Some of these relationships appeared to be mildly impacted by controlling for performance validity or symptom validity, however this was based on the relatively few studies using validity tests. More research including PVTs and SVTs whilst examining the relationship between emotional symptoms and cognitive outcomes is needed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abramovitch, A., Abramowitz, J. S., & Mittelman, A. (2013). The neuropsychology of adult obsessive–compulsive disorder: A meta-analysis. Clinical Psychology Review, 33(8), 1163–1171. https://doi.org/10.1016/j.cpr.2013.09.004
Airaksinen, E., Larsson, M., & Forsell, Y. (2005). Neuropsychological functions in anxiety disorders in population-based samples: Evidence of episodic memory dysfunction. Journal of Psychiatric Research, 39(2), 207–214. https://doi.org/10.1016/j.jpsychires.2004.06.001
Alfano, D. P. (2006). Emotional and pain-related factors in neuropsychological assessment following mild traumatic brain injury. Brain and Cognition, 60(2), 194–196. https://doi.org/10.1016/s0887-6177(99)80309-6
Alsalaheen, B., Stockdale, K., Pechumer, D., & Broglio, S. P. (2016). Validity of the immediate post concussion assessment and cognitive testing (ImPACT). Sports Medicine, 46(10), 1487–1501. https://doi.org/10.1007/s40279-016-0532-y
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Pub. https://doi.org/10.1176/appi.books.9780890425596
Andriessen, T. M., Jacobs, B., & Vos, P. E. (2010). Clinical characteristics and pathophysiological mechanisms of focal and diffuse traumatic brain injury. Journal of Cellular and Molecular Medicine, 14(10), 2381–2392. https://doi.org/10.1111/j.1582-4934.2010.01164.x
Anson, K., & Ponsford, J. (2006). Who benefits? Outcome following a coping skills group intervention for traumatically brain injured individuals. Brain Injury, 20(1), 1–13. https://doi.org/10.1080/02699050500309791
Arent, S. M., & Landers, D. M. (2003). Arousal, anxiety, and performance: A reexamination of the inverted-U hypothesis. Research Quarterly for Exercise and Sport, 74(4), 436–444. https://doi.org/10.1080/02701367.2003.10609113
Armistead-Jehle, P., Gervais, R. O., & Green, P. (2012). Memory complaints inventory and symptom validity test performance in a clinical sample. Archives of Clinical Neuropsychology, 27(7), 725–734. https://doi.org/10.1093/arclin/acs071
Armstrong, T., & Olatunji, B. O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clinical Psychology Review, 32(8), 704–723. https://doi.org/10.1016/j.cpr.2012.09.004
Arnould, A., Rochat, L., Azouvi, P., & Van der Linden, M. (2018). Self-appraisals and episodic memory: Different psychological factors related to patient versus informant reports of apathy in severe traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 40(7), 650–662. https://doi.org/10.1080/13803395.2017.1411468
Ashendorf, L., Constantinou, M., & McCaffrey, R. J. (2004). The effect of depression and anxiety on the TOMM in community-dwelling older adults. Archives of Clinical Neuropsychology, 19(1), 125–130. https://doi.org/10.1093/arclin/19.1.125
Atteberry-Bennett, J., Barth, J. T., Loyd, B. H., & Lawrence, E. C. (1986). The relationship between behavioral and cognitive deficits, demographics and depression in patients with minor head injuries. International Journal of Clinical Neuropsychology, 8(3), 114–117.
Baddeley, A. D., Emslie, H., & Nimmo-Smith, I. (2006). Doors and people: A test of visual and verbal recall and recognition: Harcourt Assessment.
Barker-Collo, S., Jones, K., Theadom, A., Starkey, N., Dowell, A., McPherson, K., & Feigin, V. (2015). Neuropsychological outcome and its correlates in the first year after adult mild traumatic brain injury: A population-based New Zealand study. Brain Injury, 29(13–14), 1604–1616. https://doi.org/10.3109/02699052.2015.1075143
Batchelor, J., Harvey, A. G., & Bryant, R. A. (1995). Stroop colour word test as a measure of attentional deficit following mild head injury. The Clinical Neuropsychologist, 9(2), 180–186. https://doi.org/10.1080/13854049508401600
Baune, B. T., Miller, R., McAfoose, J., Johnson, M., Quirk, F., & Mitchell, D. (2010). The role of cognitive impairment in general functioning in major depression. Psychiatry Research, 176(2–3), 183–189. https://doi.org/10.1016/j.psychres.2008.12.001
Bay, E., & Covassin, T. (2012). Chronic stress, somatic and depressive symptoms following mild to moderate traumatic brain injury. Archives of Psychiatric Nursing, 26(6), 477–486. https://doi.org/10.1016/j.apnu.2012.06.002
Bay, E. H. (2001). Chronic stress, cortisol regulation, interpersonal relatedness, cognitive burden, and depressive symptoms among community-dwelling survivors of brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 62(10-B), 4461.
Beck, A. T., Steer, R. A., & Brown, G. (1996). Beck depression inventory–II. Psychological Assessment. https://doi.org/10.1037/t00742-000
Belanger, H. G., Curtiss, G., Demery, J. A., Lebowitz, B. K., & Vanderploeg, R. D. (2005). Factors moderating neuropsychological outcomes following mild traumatic brain injury: A meta-analysis. Journal of the International Neuropsychological Society, 11(3), 215–227. https://doi.org/10.1017/s1355617705050277
Belanger, H. G., Proctor-Weber, Z., Kretzmer, T., Kim, M., French, L. M., & Vanderploeg, R. D. (2011). Symptom complaints following reports of blast versus non-blast mild TBI: Does mechanism of injury matter? The Clinical Neuropsychologist, 25(5), 702–715. https://doi.org/10.1080/13854046.2011.566892
Benedict, R. H. B., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins Verbal Learning Test–Revised: Normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55. https://doi.org/10.1076/clin.12.1.43.1726
Benedict, R. H. B., Schretlen, D., Groninger, L., Dobraski, M., & Shpritz, B. (1996). Revision of the Brief Visuospatial Memory Test: Studies of normal performance, reliability, and validity. Psychological Assessment, 8(2), 145.
Bierman, E. J. M., Comijs, H. C., Rijmen, F., Jonker, C., & Beekman, A. T. F. (2008). Anxiety symptoms and cognitive performance in later life: Results from the longitudinal aging study Amsterdam. Aging and Mental Health, 12(4), 517–523. https://doi.org/10.1080/13607860802224276
Biggan, S. L. (1996). Predictive validity of functional assessment and neuropsychological test scores in the vocational outcome of persons with traumatic brain injuries. Dissertation Abstracts International: Section B: The Sciences and Engineering, 58(5-B), 2664.
Bigler, E. D. (2007). Anterior and middle cranial fossa in traumatic brain injury: Relevant neuroanatomy and neuropathology in the study of neuropsychological outcome. Neuropsychology, 21(5), 515–531. https://doi.org/10.1037/0894-4105.21.5.515
Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638. https://doi.org/10.3109/02699052.2014.947627
Bivona, U., Costa, A., Contrada, M., Silvestro, D., Azicnuda, E., Aloisi, M., & Caltagirone, C. (2019). Depression, apathy and impaired self-awareness following severe traumatic brain injury: A preliminary investigation. Brain Injury, 33(9), 1245–1256. https://doi.org/10.1080/02699052.2019.1641225
Bolzenius, J. D., Roskos, P. T., Salminen, L. E., Paul, R. H., & Bucholz, R. D. (2015). Cognitive and self-reported psychological outcomes of blast-induced mild traumatic brain injury in veterans: A preliminary study. Applied Neuropsychology: Adult, 22(2), 79–87. https://doi.org/10.1080/23279095.2013.845823
Bombardier, C. H., Fann, J. R., Temkin, N. R., Esselman, P. C., Barber, J., & Dikmen, S. S. (2010). Rates of major depressive disorder and clinical outcomes following traumatic brain injury. JAMA, 303(19), 1938–1945. https://doi.org/10.1001/jama.2010.599
Bomyea, J., Flashman, L. A., Zafonte, R., Andaluz, N., Coimbra, R., George, M. S., & Shutter, L. (2019). Associations between neuropsychiatric and health status outcomes in individuals with probable mTBI. Psychiatry Research, 272, 531–539. https://doi.org/10.1016/j.psychres.2018.12.021
Boone, K. B., Pontón, M. O., Gorsuch, R. L., González, J. J., & Miller, B. L. (1998). Factor analysis of four measures of prefrontal lobe functioning. Archives of Clinical Neuropsychology, 13(7), 585–595. https://doi.org/10.1016/s0887-6177(97)00074-7
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. https://doi.org/10.1002/jrsm.12
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2011). Introduction to meta-analysis. Wiley. https://doi.org/10.1002/9781119558378
Bouma, A., Mulder, J., Lindeboom, J., & Schmand, B. (2012). Handboek neuropsychologische diagnostiek.
Bowen, A., Neumann, V., Conner, M., Tennant, A., & Chamberlain, M. A. (1998). Mood disorders following traumatic brain injury: Identifying the extent of the problem and the people at risk. Brain Injury, 12(3), 177–190. https://doi.org/10.1080/026990598122656
Bryant, R. A., O’Donnell, M. L., Creamer, M., McFarlane, A. C., Clark, C. R., & Silove, D. (2010). The psychiatric sequelae of traumatic injury. American Journal of Psychiatry, 167(3), 312–320. https://doi.org/10.1176/appi.ajp.2009.09050617
Bush, S. S., Ruff, R. M., Tröster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., & Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20(4), 419–426. https://doi.org/10.1016/j.acn.2005.02.002
Butters, M. A., Bhalla, R. K., Andreescu, C., Wetherell, J. L., Mantella, R., Begley, A. E., & Lenze, E. J. (2011). Changes in neuropsychological functioning following treatment for late-life generalised anxiety disorder. The British Journal of Psychiatry, 199(3), 211–218. https://doi.org/10.1192/bjp.bp.110.090217
Calamia, M., Markon, K., & Tranel, D. (2013). The robust reliability of neuropsychological measures: Meta-analyses of test–retest correlations. The Clinical Neuropsychologist, 27(7), 1077–1105. https://doi.org/10.1080/13854046.2013.809795
Carvajal, M. (2015). An investigation for the role of cognitive reserve on subsequent development of PTSD and memory dysfunction following mild traumatic brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering,.76(11-B), no pagination specified.
Chalton, L. D., & McMillan, T. M. (2009). Can ‘partial’PTSD explain differences in diagnosis of PTSD by questionnaire self-report and interview after head injury? Brain Injury, 23(2), 77–82. https://doi.org/10.1080/02699050802635273
Chaytor, N., Temkin, N., Machamer, J., & Dikmen, S. (2007). The ecological validity of neuropsychological assessment and the role of depressive symptoms in moderate to severe traumatic brain injury. Journal of the International Neuropsychological Society: JINS, 13(3), 377. https://doi.org/10.1017/s1355617707070592
Clark, A. L., Amick, M. M., Fortier, C., Milberg, W. P., & McGlinchey, R. E. (2014). Poor performance validity predicts clinical characteristics and cognitive test performance of OEF/OIF/OND veterans in a research setting. The Clinical Neuropsychologist, 28(5), 802–825. https://doi.org/10.1080/13854046.2014.904928
Clark, L., Chamberlain, S. R., & Sahakian, B. J. (2009). Neurocognitive mechanisms in depression: Implications for treatment. Annual Review of Neuroscience, 32, 57–74. https://doi.org/10.1146/annurev.neuro.31.060407.125618
Clarke, L. A., Genat, R. C., & Anderson, J. F. I. (2012). Long-term cognitive complaint and post-concussive symptoms following mild traumatic brain injury: The role of cognitive and affective factors. Brain Injury, 26(3), 298–307. https://doi.org/10.3109/02699052.2012.654588
Cohen, J. (1988). Statistical power analysis for the behavioral sciences, 2nd edn. Á/L. In: Erbaum Press, Hillsdale, NJ, USA. https://doi.org/10.4324/9780203771587
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155. https://doi.org/10.1037/0033-2909.112.1.155
Cohen, R. M., Weingartner, H., Smallberg, S. A., Pickar, D., & Murphy, D. L. (1982). Effort and cognition in depression. Archives of General Psychiatry, 39(5), 593–597. https://doi.org/10.1001/archpsyc.1982.04290050061012
Considine, C. M., Weisenbach, S. L., Walker, S. J., McFadden, E. M., Franti, L. M., Bieliauskas, L. A., & Langenecker, S. A. (2011). Auditory memory decrements, without dissimulation, among patients with major depressive disorder. Archives of Clinical Neuropsychology, 26(5), 445–453. https://doi.org/10.1093/arclin/acr041
Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). The handbook of research synthesis and meta-analysis: Russell Sage Foundation. https://doi.org/10.7758/9781610448864
Coughlan, A. K., Oddy, M., & Crawford, J. R. (2007). BIRT memory and information processing battery (BMIPB). Brain Injury Rehabilitation Trust.
Crawford, J. R., Obonsawin, M. C., & Allan, K. M. (1998). PASAT and components of WAIS-R performance: Convergent and discriminant validity. Neuropsychological Rehabilitation, 8(3), 255–272. https://doi.org/10.1080/713755575
Critchfield, E., Soble, J. R., Marceaux, J. C., Bain, K. M., Chase Bailey, K., Webber, T. A., & O’Rourke, J. J. (2019). Cognitive impairment does not cause invalid performance: Analyzing performance patterns among cognitively unimpaired, impaired, and noncredible participants across six performance validity tests. The Clinical Neuropsychologist, 33(6), 1083–1101. https://doi.org/10.1080/13854046.2018.1508615
Cross, M. E. (2004). Use of the Personality Assessment Inventory with mild traumatic brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 66(3-B), 1712.
Crowe, S. F. (1998). The differential contribution of mental tracking, cognitive flexibility, visual search, and motor speed to performance on parts A and B of the Trail Making Test. Journal of Clinical Psychology, 54(5), 585–591. https://doi.org/10.1002/(sici)1097-4679(199808)54:5%3C585::aid-jclp4%3E3.0.co;2-k
Curtis, K. L. (2012). A multigroup analysis of the psychological factors that contribute to persisting working attention problems in mild traumatic brain injury and chronic pain. Dissertation Abstracts International: Section B: The Sciences and Engineering, 73(12-B).
Daffner, K. R., Gale, S. A., Barrett, A. M., Boeve, B. F., Chatterjee, A., Coslett, H. B., & Hart, J. J. (2015). Improving clinical cognitive testing: Report of the AAN Behavioral Neurology Section Workgroup. Neurology, 85(10), 910–918. https://doi.org/10.1212/wnl.0000000000001763
Dandachi-FitzGerald, B., Ponds, R. W. H. M., Peters, M. J. V., & Merckelbach, H. (2011). Cognitive underperformance and symptom over-reporting in a mixed psychiatric sample. The Clinical Neuropsychologist, 25(5), 812–828. https://doi.org/10.1080/13854046.2011.583280
Dandachi-FitzGerald, B., van Twillert, B., van de Sande, P., van Os, Y., & Ponds, R. W. H. M. (2016). Poor symptom and performance validity in regularly referred Hospital outpatients: Link with standard clinical measures, and role of incentives. Psychiatry Research, 239, 47–53. https://doi.org/10.1016/j.psychres.2016.02.061
Dean, P. J. A., & Sterr, A. (2013). Long-term effects of mild traumatic brain injury on cognitive performance. Frontiers in Human Neuroscience, 7, 30. https://doi.org/10.3389/fnhum.2013.00030
Delis, D. C., Kramer, J. H., Kaplan, E., & Holdnack, J. (2004). Reliability and validity of the Delis-Kaplan Executive Function System: An update. Journal of the International Neuropsychological Society: JINS, 10(2), 301–303. https://doi.org/10.1017/s1355617704102191
Denning, J. H., & Shura, R. D. (2019). Cost of malingering mild traumatic brain injury-related cognitive deficits during compensation and pension evaluations in the veterans benefits administration. Applied Neuropsychology: Adult, 26(1), 1–16. https://doi.org/10.1080/23279095.2017.1350684
Dennis, E. L., Disner, S. G., Fani, N., Salminen, L. E., Logue, M., Clarke, E. K., . . . Bomyea, J. (2019). Altered white matter microstructural organization in posttraumatic stress disorder across 3047 adults: results from the PGC-ENIGMA PTSD consortium. Molecular psychiatry, 1–16.
Dikmen, S. S., Corrigan, J. D., Levin, H. S., Machamer, J., Stiers, W., & Weisskopf, M. G. (2009). Cognitive outcome following traumatic brain injury. The Journal of Head Trauma Rehabilitation, 24(6), 430–438. https://doi.org/10.1097/htr.0b013e3181c133e9
Dikmen, S. S., Heaton, R. K., Grant, I., & Temkin, N. R. (1999). Test–retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery. Journal of the International Neuropsychological Society, 5(4), 346–356. https://doi.org/10.1017/s1355617799544056
Draper, K., & Ponsford, J. (2008). Cognitive functioning ten years following traumatic brain injury and rehabilitation. Neuropsychology, 22(5), 618–625. https://doi.org/10.1037/0894-4105.22.5.618
Drucker, A. M., Fleming, P., & Chan, A.-W. (2016). Research techniques made simple: Assessing risk of bias in systematic reviews. Journal of Investigative Dermatology, 136(11), e109–e114. https://doi.org/10.1016/j.jid.2016.08.021
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341x.2000.00455.x
Ehrenberg, A. J., Suemoto, C. K., Franca Resende, E. D. P., Petersen, C., Leite, R. E. P., Rodriguez, R. D., & Nitrini, R. (2018). Neuropathologic correlates of psychiatric symptoms in Alzheimer’s disease. Journal of Alzheimer’s Disease, 66(1), 115–126. https://doi.org/10.3233/jad-180688
Elbaum-David, J. (1997). Self-awareness of memory impairment, depression and short-term memory in adults with traumatic brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 58(9-B), 4748.
Elefante, C., Brancati, G. E., Bacciardi, S., Mazzucchi, S., Del Prete, E., Palermo, G., & Lattanzi, L. (2021). Prevalence and Clinical Correlates of Comorbid Anxiety and Panic Disorders in Patients with Parkinson’s Disease. Journal of Clinical Medicine, 10(11), 2302. https://doi.org/10.3390/jcm10112302
Erez, A.B.-H., Rothschild, E., Katz, N., Tuchner, M., & Hartman-Maeir, A. (2009). Executive functioning, awareness, and participation in daily life after mild traumatic brain injury: A preliminary study. American Journal of Occupational Therapy, 63(5), 634–640. https://doi.org/10.5014/ajot.63.5.634
Etkin, A., Gyurak, A., & O'Hara, R. (2013). A neurobiological approach to the cognitive deficits of psychiatric disorders. Dialogues in Clinical Neuroscience, 15(4), 419–429. https://doi.org/10.31887/dcns.2013.15.4/aetkin
Failla, M. D., Juengst, S. B., Graham, K. M., Arenth, P. M., & Wagner, A. K. (2016). Effects of depression and antidepressant use on cognitive deficits and functional cognition following severe traumatic brain injury. The Journal of Head Trauma Rehabilitation, 31(6), E62–E73. https://doi.org/10.1097/htr.0000000000000214
Fann, J. R., Bombardier, C. H., Dikmen, S., Esselman, P., Warms, C. A., Pelzer, E., & Temkin, N. (2005). Validity of the Patient Health Questionnaire-9 in assessing depression following traumatic brain injury. The Journal of Head Trauma Rehabilitation, 20(6), 501–511. https://doi.org/10.1097/00001199-200511000-00003
Ferreri, F., Lapp, L. K., & Peretti, C.-S. (2011). Current research on cognitive aspects of anxiety disorders. Current Opinion in Psychiatry, 24(1), 49–54. https://doi.org/10.1097/yco.0b013e32833f5585
Fox, D. D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. The Clinical Neuropsychologist, 25(3), 488–495. https://doi.org/10.1080/13854046.2011.554443
Freece, K. (2011). Cognitive sequelae of trauma: memory and attention deficits in individuals diagnosed with posttraumatic stress disorder, mild traumatic brain injury, and comorbid posttraumatic stress disorder/mild traumatic brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 72(5-B), 3094.
Gardizi, E. (2015). Predictors of Depression after Traumatic Brain Injury during Early and Late Recovery. Dissertation Abstracts International: Section B: The Sciences and Engineering, 77(3-B), no pagination specified.
Geary, E. K., Kraus, M. F., Pliskin, N. H., & Little, D. M. (2010). Verbal learning differences in chronic mild traumatic brain injury. Journal of the International Neuropsychological Society, 16(3), 506–516. https://doi.org/10.1017/s135561771000010x
Ghaffar, O., McCullagh, S., Ouchterlony, D., & Feinstein, A. (2006). Randomized treatment trial in mild traumatic brain injury. Journal of Psychosomatic Research, 61(2), 153–160. https://doi.org/10.1016/j.jpsychores.2005.07.018
Gould, K. R., Ponsford, J. L., Johnston, L., & Schönberger, M. (2011). Relationship between psychiatric disorders and 1-year psychosocial outcome following traumatic brain injury. The Journal of Head Trauma Rehabilitation, 26(1), 79–89. https://doi.org/10.1097/htr.0b013e3182036799
Gould, K. R., Ponsford, J. L., & Spitz, G. (2014). Association between cognitive impairments and anxiety disorders following traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 36(1), 1–14. https://doi.org/10.1080/13803395.2013.863832
Grauwmeijer, E., Heijenbrok-Kal, M. H., Peppel, L. D., Hartjes, C. J., Haitsma, I. K., de Koning, I., & Ribbers, G. M. (2018). Cognition, health-related quality of life, and depression ten years after moderate to severe traumatic brain injury: A prospective cohort study. Journal of Neurotrauma, 35(13), 1543–1551. https://doi.org/10.1089/neu.2017.5404
Greene, E. J., Peduzzi, P., Dziura, J., Meng, C., Miller, M. E., Travison, T. G., & Esserman, D. (2021). Estimation of ascertainment bias and its effect on power in clinical trials with time-to-event outcomes. Statistics in Medicine, 40(5), 1306–1320. https://doi.org/10.1002/sim.8842
Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060. https://doi.org/10.1080/02699050110088254
Gualtieri, C. T., & Johnson, L. G. (2006). Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21(7), 623–643. https://doi.org/10.1016/j.acn.2006.05.007
Haggerty, K. A., Frazier, T. W., Busch, R. M., & Naugle, R. I. (2007). Relationships among Victoria Symptom Validity Test indices and Personality Assessment Inventory validity scales in a large clinical sample. The Clinical Neuropsychologist, 21(6), 917–928. https://doi.org/10.1080/13854040600899724
Hampson, N. E., Kemp, S., Coughlan, A. K., Moulin, C. J., & Bhakta, B. B. (2014). Effort test performance in clinical acute brain injury, community brain injury, and epilepsy populations. Applied Neuropsychology: Adult, 21(3), 183–194. https://doi.org/10.1080/09084282.2013.787425
Hantke, N., Adamson, M. M., Noda, A., Lazzeroni, L. C., Beaudreau, S. A., Yutsis, M., ... & Yesavage, J. A. (2021). Posttraumatic stress disorder-associated cognitive deficits on the repeatable battery for the assessment of neuropsychological status in a veteran population. Federal practitioner, 38(1), 28. https://doi.org/10.12788/fp.0083
Hart, T., Fann, J. R., Chervoneva, I., Juengst, S. B., Rosenthal, J. A., Krellman, J. W., & Kroenke, K. (2016). Prevalence, risk factors, and correlates of anxiety at 1 year after moderate to severe traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 97(5), 701–707. https://doi.org/10.1016/j.apmr.2015.08.436
Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129. https://doi.org/10.1080/13854040903155063
Henry, G. K., Heilbronner, R. L., Suhr, J., Gornbein, J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society, 24(7), 735–745. https://doi.org/10.1017/s1355617718000218
Hesdorffer, D. C., Rauch, S. L., & Tamminga, C. A. (2009). Long-term psychiatric outcomes following traumatic brain injury: A review of the literature. The Journal of Head Trauma Rehabilitation, 24(6), 452–459. https://doi.org/10.1037/e717682011-015
Hickling, E. J., Gillen, R., Blanchard, E. B., Buckley, T., & Taylor, A. (1998). Traumatic brain injury and posttraumatic stress disorder: A preliminary investigation of neuropsychological test results in PTSD secondary to motor vehicle accidents. Brain Injury, 12(4), 265–274. https://doi.org/10.1080/026990598122566
Higgin, J., Thompson, S., Deeks, J., & Altman, D. (2003). Measuring inconsistency in meta-analysis. British Medical Journal, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
Himanen, L., Portin, R., Tenovuo, O., Taiminen, T., Koponen, S., Hiekkanen, H., & Helenius, H. (2009). Attention and depressive symptoms in chronic phase after traumatic brain injury. Brain Injury, 23(3), 220–227. https://doi.org/10.1080/02699050902748323
Hoffman, L. M. (1999). Neurobehavioral sequelae and brain compromise in mild head injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 61(5-B), 2763.
Holdnack, J. A., Zhou, X., Larrabee, G. J., Millis, S. R., & Salthouse, T. A. (2011). Confirmatory factor analysis of the WAIS-IV/WMS-IV. Assessment, 18(2), 178–191. https://doi.org/10.1177/1073191110393106
Iverson, G. L., Brooks, B. L., Langenecker, S. A., & Young, A. H. (2011). Identifying a cognitive impairment subgroup in adults with mood disorders. Journal of Affective Disorders, 132(3), 360–367. https://doi.org/10.1016/j.jad.2011.03.001
Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B. (2010). The concurrent validity of the N-back task as a working memory measure. Memory, 18(4), 394–412. https://doi.org/10.1080/09658211003702171
Jamora, C. W., Young, A., & Ruff, R. M. (2012). Comparison of subjective cognitive complaints with neuropsychological tests in individuals with mild vs more severe traumatic brain injuries. Brain Injury, 26(1), 36–47. https://doi.org/10.3109/02699052.2011.635352
Jewsbury, P. A., & Bowden, S. C. (2017). Construct validity of fluency and implications for the factorial structure of memory. Journal of Psychoeducational Assessment, 35, 460–481. https://doi.org/10.1177/0734282916648041
Jewsbury, P. A., Bowden, S. C., & Duff, K. (2016a). The Cattell–Horn–Carroll Model of cognition for clinical assessment. Journal of Psychoeducational Assessment, 35(6), 547–567. https://doi.org/10.1177/0734282916651360
Jewsbury, P. A., Bowden, S. C., & Strauss, M. E. (2016b). Integrating the switching, inhibition, and updating model of executive function with the Cattell-Horn-Carroll model. Journal of Experimental Psychology: General, 145, 220–245. https://doi.org/10.1037/xge0000119
Johnson-Greene, D., Brooks, L., & Ference, T. (2013). Relationship between performance validity testing, disability status, and somatic complaints in patients with fibromyalgia. The Clinical Neuropsychologist, 27(1), 148–158. https://doi.org/10.1080/13854046.2012.733732
Joosub, N., Cassimjee, N., & Cramer, A. (2017). The relationship between neuropsychological performance and depression in patients with traumatic brain injury. South African Journal of Psychology, 47(2), 171–183. https://doi.org/10.1177/0081246316654327
Jorge, R. E., Robinson, R. G., Moser, D., Tateno, A., Crespo-Facorro, B., & Arndt, S. (2004). Major depression following traumatic brain injury. Archives of General Psychiatry, 61(1), 42–50. https://doi.org/10.1001/archpsyc.61.1.42
Joy, S., Kaplan, E., & Fein, D. (2004). Speed and memory in the WAIS-III Digit Symbol—Coding subtest across the adult lifespan. Archives of Clinical Neuropsychology, 19(6), 759–767. https://doi.org/10.1016/j.acn.2003.09.009
Jurick, S. M., Crocker, L. D., Merritt, V. C., Sanderson-Cimino, M. E., Keller, A. V., Glassman, L. H., & Jak, A. J. (2021). Independent and Synergistic Associations Between TBI Characteristics and PTSD Symptom Clusters on Cognitive Performance and Postconcussive Symptoms in Iraq and Afghanistan Veterans. The Journal of Neuropsychiatry and Clinical Neurosciences, 33(2), 98–108. https://doi.org/10.1176/appi.neuropsych.20050128
Keilp, J. G., Madden, S. P., Gorlyn, M., Burke, A. K., Oquendo, M. A., & Mann, J. J. (2018). The lack of meaningful association between depression severity measures and neurocognitive performance. Journal of Affective Disorders, 241, 164–172. https://doi.org/10.1016/j.jad.2018.08.034
Keiski, M. A., Shore, D. L., & Hamilton, J. M. (2007). The role of depression in verbal memory following traumatic brain injury. The Clinical Neuropsychologist, 21(5), 744–761. https://doi.org/10.1080/13854040600775346
Kongs, S. K., Thompson, L. L., Iverson, G. L., & Heaton, R. K. (2000). Wisconsin Card Sorting Test-, 64 Card Version: WCST-64: PAR Lutz, FL.
Kontos, A. P., Kotwal, R. S., Elbin, R. J., Lutz, R. H., Forsten, R. D., Benson, P. J., & Guskiewicz, K. M. (2013). Residual effects of combat-related mild traumatic brain injury. Journal of Neurotrauma, 30(8), 680–686. https://doi.org/10.1089/neu.2012.2506
Lamberty, G. J., Nelson, N. W., & Yamada, T. (2013). Effects and outcomes in civilian and military traumatic brain injury: Similarities, differences, and forensic implications. Behavioral Sciences & the Law, 31(6), 814–832. https://doi.org/10.1002/bsl.2091
Lange, R. T., Iverson, G. L., Brooks, B. L., & Ashton Rennison, V. L. (2010). Influence of poor effort on self-reported symptoms and neurocognitive test performance following mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 32(9), 961–972. https://doi.org/10.1080/13803391003645657
Lapshin, H., Lanctôt, K. L., O’Connor, P., & Feinstein, A. (2013). Assessing the validity of a computer-generated cognitive screening instrument for patients with multiple sclerosis. Multiple Sclerosis Journal, 19(14), 1905–1912. https://doi.org/10.1177/1352458513488841
Larrabee, G. J. (2003a). Detection of Malingering Using Atypical Performance Patterns on Standard Neuropsychological Tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089
Larrabee, G. J. (2003b). Detection of symptom exaggeration with the MMPI-2 in litigants with malingered neurocognitive dysfunction. The Clinical Neuropsychologist, 17(1), 54–68. https://doi.org/10.1076/clin.17.1.54.15627
Larrabee, G. J. (2012). Performance validity and symptom validity in neuropsychological assessment. Journal of the International Neuropsychological Society: JINS, 18(4), 625–630. https://doi.org/10.1017/s1355617712000240
Larrabee, G. J., & Curtiss, G. (1995). Construct validity of various verbal and visual memory tests. Journal of Clinical and Experimental Neuropsychology, 17(4), 536–547. https://doi.org/10.1080/01688639508405144
Larrabee, G. J., & Rohling, M. L. (2013). Neuropsychological differential diagnosis of mild traumatic brain injury. Behavioral Sciences and the Law, 31(6), 686–701. https://doi.org/10.1002/bsl.2087
Leary, J. B., Kim, G. Y., Bradley, C. L., Hussain, U. Z., Sacco, M., Bernad, M., & Chan, L. (2018). The association of cognitive reserve in chronic-phase functional and neuropsychological outcomes following traumatic brain injury. The Journal of Head Trauma Rehabilitation, 33(1), E28–E35. https://doi.org/10.1097/htr.0000000000000329
Lee, R. S. C., Hermens, D. F., Porter, M. A., & Redoblado-Hodge, M. A. (2012). A meta-analysis of cognitive deficits in first-episode major depressive disorder. Journal of Affective Disorders, 140(2), 113–124. https://doi.org/10.1016/j.jad.2011.10.023
Leitner, D., Miller, H., & Libben, M. (2019). Comparison of the Buschke Selective Reminding Test and the California Verbal Learning Test-Second Edition in a heterogeneous sample of people with traumatic brain injury. Applied Neuropsychology: Adult, 26(2), 124–138. https://doi.org/10.1080/23279095.2017.1362561
Lepage, C., de Pierrefeu, A., Koerte, I. K., Coleman, M. J., Pasternak, O., Grant, G., & George, M. S. (2018). White matter abnormalities in mild traumatic brain injury with and without post-traumatic stress disorder: A subject-specific diffusion tensor imaging study. Brain Imaging and Behavior, 12(3), 870–881. https://doi.org/10.1007/s11682-017-9744-5
Levaux, M.-N., Van der Linden, M., Larøi, F., & Danion, J. -M. (2012). Caractérisation des difficultés dans la vie quotidienne de personnes souffrant de schizophrénie en rapport avec les facteurs cognitifs et cliniques. Alter, 6(4), 267–278. https://doi.org/10.1016/j.alter.2012.08.003
Lezak, M., Howieson, D. B., Bigler, E. B., & Tranel, D. (2012). Neuropsychological assessment (Fifth ed.): New York: Oxford University Press.
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., & Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Journal of Clinical Epidemiology, 62(10), 1–34. https://doi.org/10.1016/j.jclinepi.2009.06.006
Loignon, A., Ouellet, M. C., & Belleville, G. (2020). A systematic review and meta-analysis on PTSD following TBI among military/veteran and civilian populations. The Journal of Head Trauma Rehabilitation, 35(1), E21–E35. https://doi.org/10.1097/htr.0000000000000514
Lopez, K. C., Leary, J. B., Pham, D. L., Chou, Y. -Y., Dsurney, J., & Chan, L. (2017). Brain volume, connectivity, and neuropsychological performance in mild traumatic brain injury: The impact of post-traumatic stress disorder symptoms. Journal of Neurotrauma, 34(1), 16–22. https://doi.org/10.1089/neu.2015.4323
Lovibond, S. H., & Lovibond, P. F. (1993). Manual for the depression anxiety stress scales (DASS). Psychology Foundation Monograph. Sydney, Australia: University of New South Wales. https://doi.org/10.1037/t39835-000
Macciocchi, S. N., Seel, R. T., & Thompson, N. (2013). The impact of mild traumatic brain injury on cognitive functioning following co-occurring spinal cord injury. Archives of Clinical Neuropsychology, 28(7), 684–691. https://doi.org/10.1093/arclin/act049
Mac Donald, C. L., Johnson, A. M., Wierzechowski, L., Kassner, E., Stewart, T., Nelson, E. C., & Brody, D. L. (2014). Prospectively assessed clinical outcomes in concussive blast vs nonblast traumatic brain injury among evacuated US military personnel. JAMA Neurology, 71(8), 994–1002. https://doi.org/10.1001/jamaneurol.2014.1114
Madonna, D., Delvecchio, G., Soares, J. C., & Brambilla, P. (2019). Structural and functional neuroimaging studies in generalized anxiety disorder: A systematic review. Brazilian Journal of Psychiatry, 41, 336–362. https://doi.org/10.1590/1516-4446-2018-0108
Maguen, S., Madden, E., Lau, K. M., & Seal, K. (2012). The impact of head injury mechanism on mental health symptoms in veterans: Do number and type of exposures matter? Journal of Traumatic Stress, 25(1), 3–9. https://doi.org/10.1002/jts.21669
Mahan, M. Y., Rafter, D. J., Truwit, C. L., Oswood, M., & Samadani, U. (2021). Evaluation of diffusion measurements reveals radial diffusivity indicative of microstructural damage following acute, mild traumatic brain injury. Magnetic Resonance Imaging, 77, 137–147. https://doi.org/10.1016/j.mri.2020.12.012
Marion, B. E., Sellbom, M., & Bagby, R. M. (2011). The detection of feigned psychiatric disorders using the MMPI-2-RF overreporting validity scales: An analog investigation. Psychological Injury and Law, 4(1), 1–12. https://doi.org/10.1007/s12207-011-9097-0
Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017
Massey, J. S., Meares, S., Batchelor, J., & Bryant, R. A. (2015). An exploratory study of the association of acute posttraumatic stress, depression, and pain to cognitive functioning in mild traumatic brain injury. Neuropsychology, 29(4), 530–542. https://doi.org/10.1037/neu0000192
Mauri, M. C., Paletta, S., Colasanti, A., Miserocchi, G., & Altamura, A. C. (2014). Clinical and neuropsychological correlates of major depression following post-traumatic brain injury, a prospective study. Asian Journal of Psychiatry, 12, 118–124. https://doi.org/10.1016/j.ajp.2014.07.003
May, M., Milders, M., Downey, B., Whyte, M., Higgins, V., Wojcik, Z., & O’Rourke, S. (2017). Social behavior and impairments in social cognition following traumatic brain injury. Journal of the International Neuropsychological Society, 23(5), 400–411. https://doi.org/10.1017/s1355617717000182
McClintock, S. M., Husain, M. M., Greer, T. L., & Cullum, C. M. (2010). Association between depression severity and neurocognitive function in major depressive disorder: A review and synthesis. Neuropsychology, 24(1), 9–34. https://doi.org/10.1037/a0017336
McDonald, S. D., & Calhoun, P. S. (2010). The diagnostic accuracy of the PTSD checklist: A critical review. Clinical Psychology Review, 30(8), 976–987. https://doi.org/10.1016/j.cpr.2010.06.012
McIntire, K. L., Crawford, K. M., Perrin, P. B., Sestak, J. L., Aman, K., Walter, L. A., & Niemeier, J. P. (2021). Factors Increasing Risk of Suicide after Traumatic Brain Injury: A State-of-the-Science Review of Military and Civilian Studies. Brain Injury, 35(2), 151–163. https://doi.org/10.1080/02699052.2020.1861656
Merz, Z. C., Roskos, P. T., Gfeller, J. D., & Bucholz, R. D. (2017). Impact of psychiatric symptomatology on neuropsychological assessment performance in persons with TBI: A comparison of OEF/OIF veteran and civilian samples. Brain Injury, 31(11), 1422–1428. https://doi.org/10.1080/02699052.2017.1339124
Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26(1), 8–15. https://doi.org/10.1093/arclin/acq083
Miller, W. R. (1975). Psychological deficit in depression. Psychological Bulletin, 82(2), 238–260. https://doi.org/10.1037/h0076367
Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102. https://doi.org/10.1076/jcen.24.8.1094.8379
Mogge, N. L., Lepage, J. S., Bell, T., & Ragatz, L. (2010). The negative distortion scale: A new PAI validity scale. The Journal of Forensic Psychiatry & Psychology, 21(1), 77–90. https://doi.org/10.1080/14789940903174253
Moldover, J. E. (2003). Depression and Anxiety After Traumatic Brain Injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 66(9-B), 5099.
Mollayeva, T., Mollayeva, S., Pacheco, N., D’Souza, A., & Colantonio, A. (2019). The course and prognostic factors of cognitive outcomes after traumatic brain injury: A systematic review and meta-analysis. Neuroscience & Biobehavioral Reviews, 99, 198–250. https://doi.org/10.1016/j.neubiorev.2019.01.011
Morey, L. C., & Boggs, C. (1991). Personality assessment inventory (PAI): PAR Lutz, FL.
Mowla, A., Ashkani, H., Ghanizadeh, A., Dehbozorgi, G. R., Sabayan, B., & Chohedri, A. H. (2008). Do memory complaints represent impaired memory performance in patients with major depressive disorder? Depression and Anxiety, 25(10), E92–E96. https://doi.org/10.1002/da.20343
Munn, Z., Moola, S., Riitano, D., & Lisy, K. (2014). The development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence. International Journal of Health Policy and Management, 3(3), 123–128. https://doi.org/10.15171/ijhpm.2014.71
Na, K. -S., Jung, H. -Y., Lee, S. I., & Kim, S.-G. (2014). Mediating effects of cognitive effort and depression on intelligence, memory, and executive functions in individuals with mild traumatic brain injury. Psychiatry Investigation, 11(2), 112. https://doi.org/10.4306/pi.2014.11.2.112
Na, S., Waldron-Perrine, B., Tree, H., Spencer, R., Pangilinan, P., & Bieliauskas, L. (2011). The influence of PTSD symptoms on effort test performance in a VA polytrauma/TBI clinic. Archives of Clinical Neuropsychology, 26(6), 470–567.
National Health and Medical Research Council. (2019). Assessing Risk of Bias. Retrieved January 6, 2020, from. https://nhmrc.gov.au/guidelinesforguidelines/develop/assessing-risk-bias
Nelson, N. W., Sweet, J. J., Berry, D. T., Bryant, F. B., & Granacher, R. P. (2007). Response validity in forensic neuropsychology: Exploratory factor analytic evidence of distinct cognitive and psychological constructs. Journal of the International Neuropsychological Society, 13(3), 440–449. https://doi.org/10.1017/s1355617707070373
Newman, M. G., Zuellig, A. R., Kachin, K. E., Constantino, M. J., Przeworski, A., Erickson, T., & Cashman-McGrath, L. (2002). Preliminary reliability and validity of the Generalized Anxiety Disorder Questionnaire-IV: A revised self-report diagnostic measure of generalized anxiety disorder. Behavior Therapy, 33(2), 215–233. https://doi.org/10.1016/s0005-7894(02)80026-0
Ngwenya, L. B., Gardner, R. C., Yue, J. K., Burke, J. F., Ferguson, A. R., Huang, M. C., & Yuh, E. L. (2018). Concordance of common data elements for assessment of subjective cognitive complaints after mild-traumatic brain injury: A TRACK-TBI Pilot Study. Brain Injury, 32(9), 1071–1078. https://doi.org/10.1080/02699052.2018.1481527
Novelli, G., Papagno, C., Capitani, E., & Laiacona, M. (1986). Tre test clinici di memoria verbale a lungo termine: taratura su soggetti normali. Archivio di psicologia, neurologia e psichiatria.
Nuechterlein, K. H., Green, M. F., Kern, R. S., Baade, L. E., Barch, D. M., Cohen, J. D., & Gold, J. M. (2008). The MATRICS Consensus Cognitive Battery, part 1: Test selection, reliability, and validity. American Journal of Psychiatry, 165(2), 203–213. https://doi.org/10.1176/appi.ajp.2007.07010042
Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8(1), 46–63. https://doi.org/10.1007/s12207-015-9216-4
O’Bryant, S. E., Finlay, C. G., & O’Jile, J. R. (2007). TOMM performances and self-reported symptoms of depression and anxiety. Journal of Psychopathology and Behavioral Assessment, 29(2), 111–114. https://doi.org/10.1007/s10862-006-9034-9
O’Toole, M. S., & Pedersen, A. D. (2011). A systematic review of neuropsychological performance in social anxiety disorder. Nordic Journal of Psychiatry, 65(3), 147–161. https://doi.org/10.3109/08039488.2011.565801
Ord, J. S., Greve, K. W., Bianchini, K. J., & Aguerrevere, L. E. (2010). Executive dysfunction in traumatic brain injury: The effects of injury severity and effort on the Wisconsin Card Sorting Test. Journal of Clinical and Experimental Neuropsychology, 32(2), 132–140. https://doi.org/10.1080/13803390902858874
Osborn, A. J., Mathias, J. L., & Fairweather-Schmidt, A. K. (2014). Depression following adult, non-penetrating traumatic brain injury: A meta-analysis examining methodological variables and sample characteristics. Neuroscience & Biobehavioral Reviews, 47, 1–15. https://doi.org/10.1016/j.neubiorev.2014.07.007
Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25(1), 46–59. https://doi.org/10.1002/hbm.20131
Ownsworth, T., Gooding, K., & Beadle, E. (2019). Self-focused processing after severe traumatic brain injury: Relationship to neurocognitive functioning and mood symptoms. British Journal of Clinical Psychology, 58(1), 35–50. https://doi.org/10.1111/bjc.12185
Panayiotou, A., Jackson, M., & Crowe, S. F. (2010). A meta-analytic review of the emotional symptoms associated with mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 32(5), 463–473. https://doi.org/10.1080/13803390903164371
Parish, R. V. (2004). Posttraumatic stress, mild traumatic brain injury, and memory function. Dissertation Abstracts International: Section B: The Sciences and Engineering, 64(6-B), 2934.
Patry, B. N. (2007). Event-based prospective memory following adult traumatic brain injury. Dissertation Abstracts International: Section B: The Sciences and Engineering, 68(6-B), 4138.
Perry, D. C., Sturm, V. E., Peterson, M. J., Pieper, C. F., Bullock, T., Boeve, B. F., & Kramer, J. H. (2016). Association of traumatic brain injury with subsequent neurological and psychiatric disease: A meta-analysis. Journal of Neurosurgery, 124(2), 511–526. https://doi.org/10.3171/2015.2.jns14503
Pessoa, L. (2009). How do emotion and motivation direct executive control? Trends in Cognitive Sciences, 13(4), 160–166. https://doi.org/10.1016/j.tics.2009.01.006
Pineau, H., Marchand, A., & Guay, S. (2014). Objective neuropsychological deficits in post-traumatic stress disorder and mild traumatic brain injury: What remains beyond symptom similarity? Behavioral Sciences, 4(4), 471–486. https://doi.org/10.3390/bs4040471
Ponsford, J., Draper, K., & Schönberger, M. (2008). Functional outcome 10 years after traumatic brain injury: Its relationship with demographic, injury severity, and cognitive and emotional status. Journal of the International Neuropsychological Society, 14(2), 233–242. https://doi.org/10.1017/s1355617708080272
Prado, C. E., Watt, S., & Crowe, S. F. (2018). A meta-analysis of the effects of antidepressants on cognitive functioning in depressed and non-depressed samples. Neuropsychology Review, 28(1), 32–72. https://doi.org/10.1007/s11065-018-9369-5
Preece, M. H. W., & Geffen, G. M. (2007). The contribution of pre-existing depression to the acute cognitive sequelae of mild traumatic brain injury. Brain Injury, 21(9), 951–961. https://doi.org/10.1080/02699050701481647
Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. https://doi.org/10.1093/arclin/acw007
Rabinowitz, A. R., & Levin, H. S. (2014). Cognitive sequelae of traumatic brain injury. The Psychiatric Clinics of North America, 37(1), 1–11. https://doi.org/10.1016/j.psc.2013.11.004
Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306
Rao, V., Munro, C. A., Rosenberg, P., Ward, J., Bertrand, M., Degoankar, M., & Barker, P. B. (2010). Neuroanatomical correlates of depression in post traumatic brain injury: Preliminary results of a pilot study. The Journal of Neuropsychiatry and Clinical Neurosciences, 22(2), 231–235. https://doi.org/10.1176/jnp.2010.22.2.231
Rapoport, M. J., McCullagh, S., Shammi, P., & Feinstein, A. (2005). Cognitive impairment associated with major depression following mild and moderate traumatic brain injury. The Journal of Neuropsychiatry and Clinical Neurosciences, 17(1), 61–65. https://doi.org/10.1176/jnp.17.1.61
Rees, L. M., Tombaugh, T. N., & Boulay, L. (2001). Depression and the test of memory malingering. Archives of Clinical Neuropsychology, 16(5), 501–506. https://doi.org/10.1093/arclin/16.5.501
Rees, L. M., Tombaugh, T. N., Gansler, D. A., & Moczynski, N. P. (1998). Five validation experiments of the Test of Memory Malingering (TOMM). Psychological Assessment, 10(1), 10–20. https://doi.org/10.1037/1040-3590.10.1.10
Revonsuo, A., & Portin, R. (1995). CogniSpeed: The computer based measurement of cognitive processing. Turku, Finland: AboaTech.
Riley, E., Mitko, A., Stumps, A., Robinson, M., Milberg, W., McGlinchey, R., & DeGutis, J. (2019). Clinically significant cognitive dysfunction in OEF/OIF/OND veterans: Prevalence and clinical associations. Neuropsychology, 33(4), 534–546. https://doi.org/10.1037/neu0000529
Robertson, I. H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1994). The test of everyday attention (TEA). Bury St. Edmunds, UK: Thames Valley Test Company, 197–221.
Rock, P., Roiser, J., Riedel, W., & Blackwell, A. (2014). Cognitive impairment in depression: A systematic review and meta-analysis. Psychological Medicine, 44(10), 2029–2040. https://doi.org/10.1017/s0033291713002535
Rogers, R., Sewell, K. W., Martin, M. A., & Vitacco, M. J. (2003). Detection of feigned mental disorders: A meta-analysis of the MMPI-2 and malingering. Assessment, 10(2), 160–177. https://doi.org/10.1177/1073191103010002007
Rogers, R., Sewell, K. W., Morey, L. C., & Ulstad, K. L. (1996). Detection of feigned mental disorders on the Personality Assessment Inventory: A discriminant analysis. Journal of Personality Assessment, 67(3), 629–640. https://doi.org/10.1207/s15327752jpa6703_15
Rohling, M. L., Green, P., Allen, L. M., III., & Iverson, G. L. (2002). Depressive symptoms and neurocognitive test scores in patients passing symptom validity tests. Archives of Clinical Neuropsychology, 17(3), 205–222. https://doi.org/10.1016/s0887-6177(01)00109-3
Romero, K., Black, S. E., & Feinstein, A. (2014). Differences in cerebral perfusion deficits in mild traumatic brain injury and depression using single-photon emission computed tomography. Frontiers in Neurology, 5, 158. https://doi.org/10.3389/fneur.2014.00158
Rosenfeld, J. V., McFarlane, A. C., Bragge, P., Armonda, R. A., Grimes, J. B., & Ling, G. S. (2013). Blast-related traumatic brain injury. The Lancet Neurology, 12(9), 882–893. https://doi.org/10.1016/s1474-4422(13)70161-3
Ruff, R. M., & Allen, C. C. (1996). Ruff 2 & 7 selective attention test: professional manual: Psychological Assessment Resources.
Ruocco, A. C., Swirsky-Sacchetti, T., Chute, D. L., Mandel, S., Platek, S. M., & Zillmer, E. A. (2008). Distinguishing between neuropsychological malingering and exaggerated psychiatric symptoms in a neuropsychological setting. The Clinical Neuropsychologist, 22(3), 547–564. https://doi.org/10.1080/13854040701336444
Ruttan, L. A., & Heinrichs, R. W. (2003). Depression and neurocognitive functioning in mild traumatic brain injury patients referred for assessment. Journal of Clinical and Experimental Neuropsychology, 25(3), 407–419. https://doi.org/10.1076/jcen.25.3.407.13812
Satz, P., Forney, D. L., Zaucha, K., Asarnow, R. R., Light, R., McCleary, C., & Becker, D. (1998). Depression, cognition, and functional correlates of recovery outcome after traumatic brain injury. Brain Injury, 12(7), 537–553. https://doi.org/10.1080/026990598122313
Schiehser, D. M., Delis, D. C., Filoteo, J. V., Delano-Wood, L., Han, S. D., Jak, A. J., & Bondi, M. W. (2011). Are self-reported symptoms of executive dysfunction associated with objective executive function performance following mild to moderate traumatic brain injury? Journal of Clinical and Experimental Neuropsychology, 33(6), 704–714. https://doi.org/10.1080/13803395.2011.553587
Schmaal, L., Hibar, D. P., Sämann, P. G., Hall, G. B., Baune, B. T., Jahanshad, N., & Ikram, M. A. (2017). Cortical abnormalities in adults and adolescents with major depression based on brain scans from 20 cohorts worldwide in the ENIGMA Major Depressive Disorder Working Group. Molecular Psychiatry, 22(6), 900–909. https://doi.org/10.1038/mp.2016.60
Scholten, A. C., Haagsma, J. A., Cnossen, M. C., Olff, M., Van Beeck, E. F., & Polinder, S. (2016). Prevalence of and risk factors for anxiety and depressive disorders after traumatic brain injury: A systematic review. Journal of Neurotrauma, 33(22), 1969–1994. https://doi.org/10.1089/neu.2015.4252
Schretlen, D., Bobholz, J. H., & Brandt, J. (1996). Development and psychometric properties of the Brief Test of Attention. The Clinical Neuropsychologist, 10(1), 80–89. https://doi.org/10.1080/13854049608406666
Schroeder, R. W., Baade, L. E., Peck, C. P., VonDran, E. J., Brockman, C. J., Webster, B. K., & Heinrichs, R. J. (2012). Validation of MMPI-2-RF validity scales in criterion group neuropsychological samples. The Clinical Neuropsychologist, 26(1), 129–146. https://doi.org/10.1080/13854046.2011.639314
Schroeder, R. W., & Marshall, P. S. (2011). Evaluation of the appropriateness of multiple symptom validity indices in psychotic and non-psychotic psychiatric populations. The Clinical Neuropsychologist, 25(3), 437–453. https://doi.org/10.1080/13854046.2011.556668
Schultz, I. Z., Sepehry, A. A., & Greer, S. C. (2018). Impact of common mental health disorders on cognition: Depression and posttraumatic stress disorder in forensic neuropsychology context. Psychological Injury and Law, 11(2), 139–152. https://doi.org/10.1007/s12207-018-9322-1
Scott, J. C., Matt, G. E., Wrocklage, K. M., Crnich, C., Jordan, J., Southwick, S. M., & Schweinsburg, B. C. (2015). A quantitative meta-analysis of neurocognitive functioning in posttraumatic stress disorder. Psychological Bulletin, 141(1), 105–140. https://doi.org/10.1037/a0038039
Sedgwick, P., & Marston, L. (2015). How to read a funnel plot in a meta-analysis. BMJ, 351, h4718. https://doi.org/10.1136/bmj.h4718
Sherer, M., Davis, L. C., Sander, A. M., Nick, T. G., Luo, C., Pastorek, N., & Hanks, R. (2015). Factors associated with word memory test performance in persons with medically documented traumatic brain injury. The Clinical Neuropsychologist, 29(4), 522–541. https://doi.org/10.1080/13854046.2015.1052763
Sherman, E. M. S., Strauss, E., Slick, D. J., & Spellacy, F. (2000). Effect of depression on neuropsychological functioning in head injury: Measurable but minimal. Brain Injury, 14(7), 621–632. https://doi.org/10.1080/02699050050043980
Snyder, H. R. (2013). Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review. Psychological Bulletin, 139(1), 81–132. https://doi.org/10.1037/a0028727
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Patient Health Questionnaire Primary Care Study Group. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. JAMA, 282(18), 1737–1744. https://doi.org/10.1001/jama.282.18.1737
Sriganesh, K., Shanthanna, H., & Busse, J. W. (2016). A brief overview of systematic reviews and meta-analyses. Indian Journal of Anaesthesia, 60(9), 689. https://doi.org/10.4103/0019-5049.190628
Stenberg, J., Eikenes, L., Moen, K. G., Vik, A., Håberg, A. K., & Skandsen, T. (2021). Acute Diffusion Tensor and Kurtosis Imaging and Outcome Following Mild Traumatic Brain Injury. Journal of Neurotrauma. https://doi.org/10.1089/neu.2021.0074
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001). Investigating and dealing with publication and other biases in meta-analysis. BMJ, 323(7304), 101–105. https://doi.org/10.1136/bmj.323.7304.101
Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary: American Chemical Society.
Stuart, A. L., Pasco, J. A., Jacka, F. N., Brennan, S. L., Berk, M., & Williams, L. J. (2014). Comparison of self-report and structured clinical interview in the identification of depression. Comprehensive Psychiatry, 55(4), 866–869. https://doi.org/10.1016/j.comppsych.2013.12.019
Stubbs, J. L., Green, K. E., Silverberg, N. D., Howard, A., Dhariwal, A. K., Brubacher, J. R., & Aquino, A. (2020). Atypical somatic symptoms in adults with prolonged recovery from mild traumatic brain injury. Frontiers in Neurology, 11, 43. https://doi.org/10.3389/fneur.2020.00043
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., & Participants, C. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
Tate, R. L., Perdices, M., & Maggiotto, S. (1998). Stability of the Wisconsin Card Sorting Test and the determination of reliability of change in scores. The Clinical Neuropsychologist, 12(3), 348–357. https://doi.org/10.1076/clin.12.3.348.1988
Tendal, B., Higgins, J. P. T., Jüni, P., Hróbjartsson, A., Trelle, S., Nüesch, E., & Ilsøe-Kristensen, S. (2009). Disagreements in meta-analyses using outcomes measured on continuous or rating scales: Observer agreement study. BMJ, 339, b3128. https://doi.org/10.1136/bmj.b3128
Terry, D. P., Brassil, M., Iverson, G. L., Panenka, W. J., & Silverberg, N. D. (2019). Effect of depression on cognition after mild traumatic brain injury in adults. The Clinical Neuropsychologist, 33(1), 124–136. https://doi.org/10.1080/13854046.2018.1459853
Udala, M., Clark, J., Miller, H., Leitner, D., & Libben, M. (2019). Psychological disturbance and cognitive functioning in TBI patients. Applied Neuropsychology: Adult, 26(6), 581–590. https://doi.org/10.1080/23279095.2018.1460370
Valera, E. M. (1999). Brain injury in battered women: Prevalence and relationship to cognitive functioning and psychopathology. Dissertation Abstracts International: Section B: The Sciences and Engineering, 60(12-B), 6387.
van der Horn, H. J., Spikman, J. M., Jacobs, B., & van der Naalt, J. (2013). Postconcussive complaints, anxiety, and depression related to vocational outcome in minor to severe traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 94(5), 867–874. https://doi.org/10.1016/j.apmr.2012.11.039
Van Dyke, S. A., Millis, S. R., Axelrod, B. N., & Hanks, R. A. (2013). Assessing effort: Differentiating performance and symptom validity. The Clinical Neuropsychologist, 27(8), 1234–1246. https://doi.org/10.1080/13854046.2013.835447
Van Praag, D. L., Cnossen, M. C., Polinder, S., Wilson, L., & Maas, A. I. (2019). Post-traumatic stress disorder after civilian traumatic brain injury: A systematic review and meta-analysis of prevalence rates. Journal of Neurotrauma, 36(23), 3220–3232. https://doi.org/10.1089/neu.2018.5759
van Wingen, G. A., van Eijndhoven, P., Cremers, H. R., Tendolkar, I., Verkes, R. J., Buitelaar, J. K., & Fernández, G. (2010). Neural state and trait bases of mood-incongruent memory formation and retrieval in first-episode major depression. Journal of Psychiatric Research, 44(8), 527–534. https://doi.org/10.1016/j.jpsychires.2009.11.009
Volle, E., Gonen-Yaacovi, G., de Lacy Costello, A., Gilbert, S. J., & Burgess, P. W. (2011). The role of rostral prefrontal cortex in prospective memory: A voxel-based lesion study. Neuropsychologia, 49(8), 2185–2198. https://doi.org/10.1016/j.neuropsychologia.2011.02.045
Wang, M. -L., Wei, X. -E., Yu, M. -M., & Li, W. -B. (2021). Cognitive impairment in mild traumatic brain injury: A diffusion kurtosis imaging and volumetric study. Acta Radiologica. https://doi.org/10.1177/0284185121998317
Wardlaw, C., Hicks, A. J., Sherer, M., & Ponsford, J. L. (2018). Psychological resilience is associated with participation outcomes following mild to severe traumatic brain injury. Frontiers in Neurology, 9, 563. https://doi.org/10.3389/fneur.2018.00563
Watt, S., Prado, C. E., & Crowe, S. F. (2018). Immediate and delayed neuropsychological effects of carbon monoxide poisoning: A meta-analysis. Journal of the International Neuropsychological Society, 24(4), 405–415. https://doi.org/10.1017/s1355617717001035
Webb, J. W., Batchelor, J., Meares, S., Taylor, A., & Marsh, N. V. (2012). Effort test failure: Toward a predictive model. The Clinical Neuropsychologist, 26(8), 1377–1396. https://doi.org/10.1080/13854046.2012.728248
Wechsler, D. (1981). Wechsler adult intelligence scale-revised (WAIS-R): Psychological Corporation.
Wechsler, D. (1997). Wechsler memory scale (WMS-III) (Vol. 14): Psychological corporation San Antonio, TX.
Wechsler, D. (2008). Wechsler adult intelligence scale–Fourth Edition (WAIS–IV). San Antonio, TX: NCS Pearson, 22(498), 1.
Wechsler, D. (2009). WMS-IV: Wechsler memory scale (4th ed.). The Psychological Corporation.
Weddell, R. A. (2010). Relatives’ criticism influences adjustment and outcome after traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 91(6), 897–904. https://doi.org/10.1016/j.apmr.2010.01.020
Weddell, R. A., & Leggett, J. A. (2006). Factors triggering relatives’ judgements of personality change after traumatic brain injury. Brain Injury, 20(12), 1221–1234. https://doi.org/10.1080/02699050601049783
Weddell, R. A., & Wood, R. L. (2016). Exploration of correlates of self-reported personality change after moderate–severe traumatic brain injury. Brain Injury, 30(11), 1362–1371. https://doi.org/10.1080/02699052.2016.1195921
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., & Wallner-Allen, K. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11), S54–S64.
West, L. K., Curtis, K. L., Greve, K. W., & Bianchini, K. J. (2011). Memory in traumatic brain injury: The effects of injury severity and effort on the Wechsler Memory Scale-III. Journal of Neuropsychology, 5(1), 114–125. https://doi.org/10.1348/174866410x521434
Whelan-Goodinson, R., Ponsford, J., Johnston, L., & Grant, F. (2009a). Psychiatric disorders following traumatic brain injury: Their nature and frequency. Journal of Head Trauma Rehabilitation, 24(5), 324–332. https://doi.org/10.1097/htr.0b013e3181a712aa
Whelan-Goodinson, R., Ponsford, J., & Schönberger, M. (2009b). Validity of the Hospital Anxiety and Depression Scale to assess depression and anxiety following traumatic brain injury as compared with the Structured Clinical Interview for DSM-IV. Journal of Affective Disorders, 114(1–3), 94–102. https://doi.org/10.1016/j.jad.2008.06.007
Whiteside, D. M., Dunbar-Mayer, P., & Waters, D. P. (2009). Relationship between Tomm performance and PAI validity scales in a mixed clinical sample. The Clinical Neuropsychologist, 23(3), 523–533. https://doi.org/10.1080/13854040802389169
Williams, R. A., Hagerty, B. M., Cimprich, B., Therrien, B., Bay, E., & Oe, H. (2000). Changes in directed attention and short-term memory in depression. Journal of Psychiatric Research, 34(3), 227–238. https://doi.org/10.1016/s0022-3956(00)00012-1
Wisdom, N. M., Pastorek, N. J., Miller, B. I., Booth, J. E., Romesser, J. M., Linck, J. F., & Sim, A. H. (2014). PTSD and Cognitive Functioning: Importance of Including Performance Validity Testing. The Clinical Neuropsychologist, 28(1), 128–145. https://doi.org/10.1080/13854046.2013.863977
Wooley, C. N., & Rogers, R. (2015). The effectiveness of the personality assessment inventory with feigned PTSD: An initial investigation of Resnick’s model of malingering. Assessment, 22(4), 449–458. https://doi.org/10.1177/1073191114552076
Yanez, Y. T., Fremouw, W., Tennant, J., Strunk, J., & Coker, K. (2006). Effects of severe depression on TOMM performance among disability-seeking outpatients. Archives of Clinical Neuropsychology, 21(2), 161–165. https://doi.org/10.1016/j.acn.2005.07.009
Zigmond, A. S., & Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361–370.
Ziino, C., & Ponsford, J. (2006). Selective attention deficits and subjective fatigue following traumatic brain injury. Neuropsychology, 20(3), 383–390. https://doi.org/10.1037/0894-4105.20.3.383
Zimmermann, P., & Fimm, B. (2009). TAP: Tests d’évaluation de l’attention, version 2.2. Adaptation Française M. Leclercq. In: Herzogenrath, Germany: Vera Fimm, Psychologische Testsysteme.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Uiterwijk, D., Stargatt, R., Humphrey, S. et al. The Relationship Between Cognitive Functioning and Symptoms of Depression, Anxiety, and Post-Traumatic Stress Disorder in Adults with a Traumatic Brain Injury: a Meta-Analysis. Neuropsychol Rev 32, 758–806 (2022). https://doi.org/10.1007/s11065-021-09524-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11065-021-09524-1