Abstract
The purpose of this study was to evaluate relationships among the Word Memory Test (WMT), symptom validity test (SVT) indices of the Personality Assessment Inventory (PAI), history of mild traumatic brain injury (mTBI), and posttraumatic stress disorder (PTSD) symptom burden. Participants were postdeployment, predominantly male (88.5%) veterans (N = 417) who completed a neurocognition study that included the WMT and PAI. Correlations, chi-square analyses, and ANOVAs were used for analyses. Results of aim 1 examining relations among the two tests found that 20.4% produced invalid scores on the WMT (regardless of PAI scores), 13.8% produced an invalid PAI (regardless of WMT scores), and 4.6% were invalid on both tests. Of the 4 original PAI validity scales, only Negative Impression Management was related to WMT failure; the supplementary Malingering Index was also significant at a smaller effect size. The second aim evaluated mTBI and PTSD symptoms in relation to validity scores. History of mTBI was associated with invalid WMT scores but not PAI scores; follow-up analyses indicated that injuries sustained during deployment were significantly more likely to produce invalid WMT scores than non-deployment injuries. Contrary to hypotheses, PTSD symptom burden was related to WMT failure but not overreporting on the PAI. After dividing the sample into four groups based on valid versus invalid WMT and PAI scores, the invalid PVT valid SVT group had the highest proportion of mTBI, whereas PTSD symptom burden was highest in the groups that invalidated both measures or only the WMT. Service-connected disability status was unrelated to either type of validity. Given invalidating both types of validity measures is uncommon, the importance of sampling both types of validity is highlighted.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data and material
Please contact the corresponding author for more information.
References
Aase, D. M., Soble, J. R., Shepard, P., Akagi, K., Schroth, C., Greenstein, J. E., Proescher, E., & Phan, K. L. (2020). Concordance of embedded performance and symptom validity tests and associations with mild traumatic brain injury and posttraumatic stress disorder among post-9/11 veterans. Archives of Clinical Neuropsychology: 36(3), 424–429. https://doi.org/10.1093/arclin/acaa053
Aikman, G. G., & Souheaver, G. T. (2008). Use of the Personality Assessment Inventory (PAI) in neuropsychological testing of psychiatric outpatients. Applied Neuropsychology, 15(3), 176–183. https://doi.org/10.1080/09084280802324283
Armistead-Jehle, P., & Buican, B. (2012). Evaluation context and symptom validity test performances in a U.S. military sample. Archives of Clinical Neuropsychology, 27(8), 828–839.https://doi.org/10.1093/arclin/acs086
Belanger, H. G., Curtiss, G., Demery, J. A., Lebowitz, B. K., & Vanderploeg, R. D. (2005). Factors moderating neuropsychological outcomes following mild traumatic brain injury: A meta-analysis. Journal of the International Neuropsychological Society, 11(3), 215–227. https://doi.org/10.1017/s1355617705050277
Berry, D. T. R., Wetter, M. W., Baer, R. A., Youngjohn, J. R., Gass, C. S., Lamb, D. G., Franzen, M. D., MacInnes, W. D., & Buchholz, D. (1995). Overreporting of closed-head injury symptoms on the MMPI-2. Psychological Assessment, 7(4), 517–523. https://doi.org/10.1037/1040-3590.7.4.517
Bowden, S. C., Shores, E. A., & Mathias, J. L. (2006). Does effort suppress cognition after traumatic brain injury? A re-examination of the evidence for the Word Memory Test. The Clinical Neuropsychologist, 20(4), 858–872. https://doi.org/10.1080/13854040500246935
Brancu, M., Wagner, H. R., Morey, R. A., Beckham, J. C., Calhoun, P. S., Tupler, L. A., Marx, C. E., Taber, K. H., Hurley, R. A., Rowland, J., McDonald, S. D., Hoerle, J. M., Moore, S. D., Kudler, H. S., Weiner, R. D., VA Mid-Atlantic MIRREC Workgroup, & Fairbank, J. A. (2017). The Post-Deployment Mental Health (PDMH) study and repository: A multi-site study of US Afghanistan and Iraq era veterans. International Journal of Methods in Psychiatric Research, 26(3), e1570. https://doi.org/10.1002/mpr.1570
Bush, S. S., Ruff, R. M., Tröster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., Reynolds, C. R., & Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity: NAN Policy & Planning Committee. Archives of Clinical Neuropsychology, 20(4), 419–426. https://doi.org/10.1016/j.acn.2005.02.002
Calhoun, P. S., Earnst, K. S., Tucker, D. D., Kirby, A. C., & Beckham, J. C. (2000). Feigning combat-related posttraumatic stress disorder on the Personality Assessment Inventory. Journal of Personality Assessment, 75(2), 338–350. https://doi.org/10.1207/S15327752JPA7502_11
Carone, D. A. (2014). Young child with severe brain volume loss easily passes the Word Memory Test and Medical Symptom Validity Test: Implications for mild TBI. The Clinical Neuropsychologist, 28(1), 146–162. https://doi.org/10.1080/13854046.2013.861019
Carroll, L. J., Cassidy, J. D., Peloso, P. M., Borg, J., von Holst, H., Holm, L., Paniak, C., & Pépin, M. (2004). Prognosis for mild traumatic brain injury: Results of the WHO collaborating centre task force on mild traumatic brain injury. Journal of Rehabilitation Medicine, 36, 84–105. https://doi.org/10.1080/16501960410023859
Copeland, C. T., Mahoney, J. J., Block, C. K., Linck, J. F., Pastorek, N. J., Miller, B. I., Romesser, J. M., & Sim, A. H. (2016). Relative utility of performance and symptom validity tests. Archives of Clinical Neuropsychology, 31(1), 18–22. https://doi.org/10.1093/arclin/acv065
Critchfield, E., Soble, J. R., Marceaux, J. C., Bain, K. M., Chase Bailey, K., Webber, T. A., et al. (2019). Cognitive impairment does not cause invalid performance: Analyzing performance patterns among cognitively unimpaired, impaired, and noncredible participants across six performance validity tests. The Clinical Neuropsychologist, 33(6), 1083–1101. https://doi.org/10.1080/13854046.2018.1508615.
Defense and Veterans Brain Injury Center (DVBIC). (2019). Total DoD TBI Worldwide Numbers. Retrieved from https://dvbic.dcoe.mil/dod-worldwide-numbers-tbi.
Denning, J. H., & Shura, R. D. (2019). Cost of malingering mild traumatic brain injury-related cognitive deficits during compensation and pension evaluations in the Veterans Benefits Administration. Applied Neuropsychology: Adult, 26(1), 1–16. https://doi.org/10.1080/23279095.2017.1350684
Dismuke-Greer, C. E., Gebregziabher, M., Byers, A. L., Taber, D., Axon, N., Yaffe, K., & Egede, L. E. (2019). Comorbid TBI-depression costs in veterans: A Chronic Effect of Neurotrauma Consortium (CENC) study. Brain Injury, 33(2), 198–204. https://doi.org/10.1080/02699052.2018.1542508
Erdodi, L. A., Green, P., Sirianni, C. D., & Abeare, C. A. (2019). The myth of high false-positive rates on the Word Memory Test in mild TBI. Psychological Injury and Law. https://doi.org/10.1007/s12207-019-09356-8
Fulton, J. J., Calhoun, P. S., Wagner, H. R., Schry, A. R., Hair, L. P., Feeling, N., Elbogen, E., & Beckham, J. C. (2015). The prevalence of posttraumatic stress disorder in Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) veterans: A meta-analysis. Journal of Anxiety Disorders, 31, 98–107. https://doi.org/10.1016/j.janxdis.2015.02.003
Gaasedelen, O. J., Whiteside, D. M., Altmaier, E., Welch, C. & Basso, M. R. (2019). The construction and the initial validation of the Cognitive Bias Scale for the Personality Assessment Inventory. The Clinical Neuropsychologist. https://doi.org/1080/13854046.2019.1612947
Gervais, R. O., Ben-Porath, Y. S., Wygant, D. B., & Green, P. (2007). Development and validation of a Response Bias Scale (RBS) for the MMPI-2. Assessment, 14(2), 196–208. https://doi.org/10.1177/1073191106295861
Green, P. (2005). Green’s Word Memory Test for Windows user’s manual. Green’s Publishing Inc.
Green, P., & Flaro, L. (2015). Results from three performance validity tests (PVTs) in adults with intellectual deficits. Applied Neuropsychology: Adult, 22(4), 293–303. https://doi.org/10.1080/23279095.2014.925903
Green, P., Flaro, L., & Courtney, J. (2009). Examining false positives on the Word Memory Test in adults with mild traumatic brain injury. Brain Injury, 23(9), 741–750. https://doi.org/10.1080/02699050903133962
Green, P., Lees-Haley, P. R., & Allen III, L. M. (2002). The Word Memory Test and the validity of neuropsychological test scores. Journal of Forensic Neuropsychology, 2(3–4), 97–124. https://doi.org/10.1300/J151v02n03_05
Green, P., Montijo, J., & Brockhaus, R. (2011). High specificity of the Word Memory Test and Medical Symptom Validity Test in groups with severe verbal memory impairment. Applied Neuropsychology, 18(2), 86–94. https://doi.org/10.1080/09084282.2010.523389
Greve, K. W., Ord, J., Curtis, K. L., Bianchini, K. J., & Brennan, A. (2008). Detecting malingering in traumatic brain injury and chronic pain: A comparison of three forced-choice symptom validity tests. The Clinical Neuropsychologist, 22(5), 896–918. https://doi.org/10.1080/13854040701565208
Haggerty, K. A., Frazier, T. W., Busch, R. M., & Naugle, R. I. (2007). Relationships among Victoria Symptom Validity Test indices and Personality Assessment Inventory validity scales in a large clinical sample. The Clinical Neuropsychologist, 21(6), 917. https://doi.org/10.1080/13854040600899724
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129. https://doi.org/10.1080/13854040903155063
Hoge, C. W., McGurk, D., Thomas, J. L., Cox, A. L., Engel, C. C., & Castro, C. A. (2008). Mild traumatic brain injury in U.S. Soldiers returning from Iraq. The New England Journal of Medicine, 358(5), 453–463. https://doi.org/10.1056/NEJMoa072972
Hopwood, C. J., Morey, L. C., Rogers, R., & Sewell, K. (2007). Malingering on the Personality Assessment Inventory: Identification of specific feigned disorders. Journal of Personality Assessment, 88(1), 43–48. https://doi.org/10.1207/s15327752jpa8801_06
Ingram, P. B., Tarescavage, A. M., Ben-Porath, Y. S., & Oehlert, M. E. (2019). Patterns of MMPI-2-Restructured Form (MMPI-2-RF) validity scale scores observed across Veteran Affairs settings. Psychological Services, 17(3), 355–362. https://doi.org/10.1037/ser0000339
Ivins, B. J., Schwab, K. A., Warden, D., Harvey, S., Hoilien, M., Powell, J., Johnson, E. W., & Salazar, A. M. (2003). Traumatic brain injury in U.S. Army paratroopers: Prevalence and character. The Journal of Trauma, 55(4), 617–621. https://doi.org/10.1097/01.TA.0000052368.97573.D4
Jurick, S. M., Crocker, L. D., Keller, A. V., Hoffman, S. N., Bomyea, J., Jacobson, M. W., & Jak, A. J. (2019). The Minnesota Multiphasic Personality Inventory-2-RF in treatment-seeking veterans with history of mild traumatic brain injury. Archives of Clinical Neuropsychology, 34(3), 366–380. https://doi.org/10.1093/arclin/acy048
Kessler, R. C., Heeringa, S. G., Stein, M. B., Colpe, L. J., Fullerton, C. S., Hwang, I., Naifeh, J. A., Nock, M. K., Petukhova, M., Sampson, N. A., Schoenbaum, M., Zaslavsky, A. M., Ursano, R. J., & Army STARRS Collaborators. (2014). Thirty-day prevalence of DSM-IV mental disorders among nondeployed soldiers in the US Army: Results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry, 71(5), 504–513. https://doi.org/10.1001/jamapsychiatry.2014.28
Kucharski, L. T., Toomey, J. P., Fila, K., & Duncan, S. (2007). Detection of malingering of psychiatric disorder with the Personality Assessment Inventory: An investigation of criminal defendants. Journal of Personality Assessment, 88(1), 25–32. https://doi.org/10.1207/s15327752jpa8801_04
Lange, R. T., Pancholi, S., Bhagwat, A., Anderson-Barnes, V., & French, L. M. (2012). Influence of poor effort on neuropsychological test performance in U.S. military personnel following mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 34(5), 453–466.https://doi.org/10.1080/13803395.2011.648175
Larrabee, G. J. (2003a). Detection of symptom exaggeration with the MMPI-2 in litigants with malingered neurocognitive dysfunction. The Clinical Neuropsychologist, 17(1), 54–68. https://doi.org/10.1076/clin.17.1.54.15627
Larrabee, G. J. (2003b). Exaggerated MMPI-2 symptom report in personal injury litigants with malingered neurocognitive deficit. Archives of Clinical Neuropsychology, 18(6), 673–686. https://doi.org/10.1016/S0887-6177(02)00157-9
Lew, H. L., Otis, J. D., Tun, C., Kerns, R. D., Clark, M. E., & Cifu, D. X. (2009). Prevalence of chronic pain, posttraumatic stress disorder, and persistent postconcussive symptoms in OIF/OEF veterans: Polytrauma clinical triad. Journal of Rehabilitation Research and Development, 46(6), 697–702. https://doi.org/10.1682/jrrd.2009.01.0006
Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776. https://doi.org/10.1080/13854046.2015.1087597
Martindale, S. L., Epstein, E. L., Taber, K. H., VA Mid-Atlantic MIRECC Workgroup, & Rowland, J. A. (2018). Behavioral and health outcomes associated with deployment and nondeployment acquisition of traumatic brain injury in Iraq and Afghanistan veterans. Archives of Physical Medicine and Rehabilitation, 99(12), 2485–2495. https://doi.org/10.1016/j.apmr.2018.04.029
Martindale, S. L., Ord, A. S., Lad, S. S., Miskey, H. M., Taber, K. H., & Rowland, J. A. (2020). Differential effects of deployment and non-deployment mild TBI on neuropsychological outcomes. Rehabilitation Psychology, in Press. https://doi.org/10.1037/rep0000374
McCaffrey, R. J., O’Bryant, S. E., Ashendorf, L., & Fisher, J. M. (2003). Correlations among the TOMM, Rey-15, and MMPI-2 validity scales in a sample of TBI litigants. Journal of Forensic Neuropsychology, 3(3), 45–53. https://doi.org/10.1300/J151v03n03_03
McCormick, C. L., Yoash-Gantz, R. E., McDonald, S. D., Campbell, T. C., & Tupler, L. A. (2013). Performance on the Green Word Memory Test following Operation Enduring Freedom/Operation Iraqi Freedom-era military service: Test failure is related to evaluation context. Archives of Clinical Neuropsychology, 28(8), 808–823. https://doi.org/10.1093/arclin/act050
Miskey, H. M., Martindale, S. L., Shura, R. D., & Taber, K. H. (2020). Distress tolerance and symptom severity mediate failure on a symptom validity test in Iraq and Afghanistan veterans with posttraumatic stress disorder. Journal of Neuropsychiatry and Clinical Neuroscience, 32, 161-167. https://doi.org/10.1176/appi.neuropsych.17110340
Mooney, S. R., Stafford, J., & Seats, E. (2018). Medical evaluation board involvement, non-credible cognitive testing, and emotional response bias in concussed service members. Military Medicine, 183(11–12), e546–e554. https://doi.org/10.1093/milmed/usy038
Morey, L. C. (2007). The Personality Assessment Inventory professional manual. Psychological Assessment Resources.
Nelson, N. W., Boone, K., Dueck, A., Wagener, L., Lu, P., & Grills, C. (2003). Relationships between eight measures of suspect effort. The Clinical Neuropsychologist, 17(2), 263–272. https://doi.org/10.1076/clin.17.2.263.16511
Nelson, N. W., Sweet, J. J., Berry, D. T. R., Bryant, F. B., & Granacher, R. P. (2007). Response validity in forensic neuropsychology: Exploratory factor analytic evidence of distinct cognitive and psychological constructs. Journal of the International Neuropsychological Society, 13(3), 440–449. https://doi.org/10.1017/S1355617707070373
Panayiotou, A., Jackson, M., & Crowe, S. F. (2010). A meta-analytic review of the emotional symptoms associated with mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 32(5), 463–473. https://doi.org/10.1080/13803390903164371
Pugh, M. J., Finley, E. P., Copeland, L. A., Wang, C. P., Noel, P. H., Amuan, M. E., & Pugh, J. A. (2014). Complex comorbidity clusters in OEF/OIF veterans: The polytrauma clinical triad and beyond. Medical Care, 52(2), 172–181. https://doi.org/10.1097/mlr.0000000000000059
Sharland, M. J., & Gfeller, J. D. (2007). A survey of neuropsychologists’ beliefs and practices with respect to the assessment of effort. Archives of Clinical Neuropsychology, 22(2), 213–223. https://doi.org/10.1016/j.acn.2006.12.004
Sollman, M. J., & Berry, D. T. (2011). Detection of inadequate effort on neuropsychological testing: A meta-analytic update and extension. Archives of Clinical Neuropsychology, 26(8), 774–789. https://doi.org/10.1093/arclin/acr066
Sumanti, M., Boone, K. B., Savodnik, I., & Gorsuch, R. (2006). Noncredible psychiatric and cognitive symptoms in a workers’ compensation “stress” claim sample. The Clinical Neuropsychologist, 20(4), 754–765. https://doi.org/10.1080/13854040500428467
Thomas, K. M., Hopwood, C. J., Orlando, M. J., Weathers, F. W., & McDevitt-Murphy, M. E. (2012). Detecting feigned PTSD using the Personality Assessment Inventory. Psychological Injury and Law, 5(3–4), 192–201. https://doi.org/10.1007/s12207-011-9111-6
Van Dyke, S. A., Millis, S. R., Axelrod, B. N., & Hanks, R. A. (2013). Assessing effort: Differentiating performance and symptom validity. The Clinical Neuropsychologist, 27(8), 1234–1246. https://doi.org/10.1080/13854046.2013.835447
Veterans Benefits Administration. (2019). Annual Benefits Report: Fiscal Year 2018. Retrieved from https://www.benefits.va.gov/REPORTS/abr/docs/2018-abr.pdf
Wang, E. W., Rogers, R., Giles, C. L., Diamond, P. M., Herrington-Wang, L. E., & Taylor, E. R. (1997). A pilot study of the Personality Assessment Inventory (PAI) in corrections: Assessment of malingering, suicide risk, and aggression in male inmates. Behavioral Sciences and the Law, 15(4), 469–482. https://doi.org/10.1002/(SICI)1099-0798(199723/09)15:4%3c469::AID-BSL279%3e3.0.CO;2-A
Whiteside, D. M., Dunbar-Mayer, P., & Waters, D. P. (2009). Relationship between TOMM performance and PAI validity scales in a mixed clinical sample. The Clinical Neuropsychologist, 23(3), 523–533. https://doi.org/10.1080/13854040802389169
Whiteside, D. M., Galbreath, J., Brown, M., & Turnbull, J. (2012). Differential response patterns on the Personality Assessment Inventory (PAI) in compensation-seeking and non-compensation-seeking mild traumatic brain injury patients. Journal of Clinical and Experimental Neuropsychology, 34(2), 172–182. https://doi.org/10.1080/13803395.2011.630648
Youngjohn, J. R., Davis, D., & Wolf, I. (1997). Head injury and the MMPI-2: Paradoxical severity effects and the influence of litigation. Psychological Assessment, 9(3), 177–184. https://doi.org/10.1037/1040-3590.9.3.177
Funding
This work was supported by resources of the Durham Veterans Affairs Medical Center (VAMC); Salisbury VAMC; Richmond VAMC; the Mid-Atlantic Mental Illness Research, Education, and Clinical Center; and the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment. Treven C. Pickett is now at National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest/Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shura, R.D., Yoash-Gantz, R.E., Pickett, T.C. et al. Relations Among Performance and Symptom Validity, Mild Traumatic Brain Injury, and Posttraumatic Stress Disorder Symptom Burden in Postdeployment Veterans. Psychol. Inj. and Law 14, 257–268 (2021). https://doi.org/10.1007/s12207-021-09415-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12207-021-09415-z