Skip to main content
Log in

The Myth of High False-Positive Rates on the Word Memory Test in Mild TBI

  • Published:
Psychological Injury and Law Aims and scope Submit manuscript

Abstract

This study was designed to replicate previous reports of elevated false-positive rates (FPR) on the Word Memory Test (WMT) in patients with mild traumatic brain injury (TBI) and to evaluate previous claims that genuine memory deficits and non-credible responding are conflated on the WMT. Data from a consecutive case sequence of 170 patients with mild TBI referred for neuropsychological assessment were collected. Failure rate on the WMT was compared to that on other performance validity tests (PVTs). The clinical characteristics and neuropsychological profiles of patients who passed and those who failed the WMT and other PVTs were compared. Base rate of failure was the highest on the WMT (44.7%), but comparable to that on other established PVTs (39.4–41.8%). The vast majority of patients (94.7%) who failed the WMT had independent evidence of invalid performance, refuting previous estimates of 20–30% FPR. Failing the WMT was associated with globally lower scores on tests measuring various cognitive domains. The neurocognitive profile of individuals with invalid performance was remarkably consistent across various PVTs. Previously reported FPR of the WMT were not replicated. Failing the WMT typically occurred in the context of failing other PVTs too. Results suggest a common factor behind non-credible responding that is invariant of the psychometric definition of invalid performance. Failure on the WMT should not be discounted based on rational arguments unsubstantiated by objective data. Inferring elevated FPR from high failure rate alone is a fundamental epistemological error.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J. & Erdodi, L. (2018). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation.

  • Abeare, C. A., Messa, I., Zuccato, B. G., Merker, B., & Erdodi, L. A. (2018). Prevalence of invalid performance on baseline testing for sport-related concussion by age and validity indicator. Advanced online publication. JAMA Neurology, 75, 697–703. https://doi.org/10.1001/jamaneurol.2018.0031.

    Article  PubMed  PubMed Central  Google Scholar 

  • Abeare, C., Sabelli, A., Taylor, B., Holcomb, M., Dumitrescu, C., Kirsch, N., & Erdodi, L. (2019). The importance of demographically adjusted cutoffs: age and education bias in raw score cutoffs within the Trail Making Test. Advance online publication. Psychological Injury and Law. https://doi.org/10.1007/s12207-019-09353.

  • Allen, L. M., & Green, P. (1999). Severe TBI sample performance on CARB and the WMT; supplement to the CARB ’97 and Word Memory Test Manuals. North Carolina: Cognisyst.

    Google Scholar 

  • Alverson, W. A., O'Rourke, J. J. F., & Soble, J. R. (2019). The Word Memory Test genuine memory impairment profile discriminates genuine memory impairment from invalid performance in a mixed clinical sample with cognitive impairment. The Clinical Neuropsychologist, 21(2), 209–231. https://doi.org/10.1080/13825580601025932

  • An, K. Y., Kaploun, K., Erdodi, L. A., & Abeare, C. A. (2017). Performance validity in undergraduate research participants: a comparison of failure rates across tests and cutoffs. The Clinical Neuropsychologist, 31(1), 193–206. https://doi.org/10.1080/13854046.2016.1217046

    Article  PubMed  Google Scholar 

  • Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist., 31(5), 857–866. https://doi.org/10.1080/13854046.2017.1285961.

  • Blaskewitz, N., Merten, T., & Brockhaus, R. (2009). Detection of suboptimal effort with the Rey Complex Figure Test and Recognition Trial. Applied Neuropsychology, 16, 54-61.

  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York: Guilford.

    Google Scholar 

  • Bowden, S. C., Shores, E. A., & Mathias, J. L. (2006). Does effort suppress cognition after brain injury? A re-examination of the evidence for the Word Memory Test. The Clinical Neuropsychologist, 20, 858–872.

    Article  PubMed  Google Scholar 

  • Brockhaus, R., & Merten, T. (2004). Neuropsychologische diagnostik suboptimalen leistungsverhaltens mit dem Word Memory Test (Neuropsychological assessment of supotimal performance: the Word Memory Test). Nervenarzt, 75, 882–887.

  • Brockhaus, R., & Peker, O. (2003). Testing effort in Turkish-speaking subjects: validation of a translation of the Word Memory Test (WMT). Journal of the International Neuropsychological Society, 9, 503–590.

    Google Scholar 

  • Carone, D. A. (2008). Children with moderate/severe brain damage/dysfunction outperform adults with mild-to-no brain damage on the Medical Symptom Validity Test. Brain Injury, 22(12), 960–971.

    Article  PubMed  Google Scholar 

  • Carone, D. A. (2014). Young child with severe brain volume loss easily passes the Word Memory Test and Medical Symptom Validity Test: implication for mild TBI. The Clinical Neuropsychologist, 28, 146–162.

    Article  PubMed  Google Scholar 

  • Carone, D. A., Green, P., & Drane, D. L. (2013). Word Memory Test profiles in two cases with surgical removal of the left anterior hippocampus and parahippocampal gyrus. Applied Neuropsychology: Adult, 21(2), 155–160.

    Article  Google Scholar 

  • Clark, A. L., Amick, M. M., Fortier, C., Millberg, W. P., & McGlinchey, R. E. (2014). Poor performance validity predicts clinical characteristics and cognitive test performance of OEF/OIF/OND veterans in a research setting. The Clinical Neuropsychologist, 28(5), 802–825.

  • Conder, R., Allen, L., & Cox, D. (1992). Computerized assessment of response bias test manual. Durham: Cognisyst.

    Google Scholar 

  • Coleman, R. D., Rapport, L. J., Millis, S. R., Ricker, J. H., & Farchine, T. J. (1998). Effects of coaching on detection of malingering on the California Verbal Learning test. Journal of Clinical and Experimental Neuropsychology, 20(2), 201–210.

  • Cottingham, M. E., Victor, T. L., Boone, K. B., Ziegler, E. A., & Zeller, M. (2018). Apparent effect of type of compensation seeking (disability vs. litigation) on performance validity test scores may be due to other factors. The Clinical Neuropsychologist, 28(6), 1030–1047. https://doi.org/10.1080/13854046.2014.951397.

  • Curtis, K. L., Greve, K. W., Bianchini, K. J., & Brennan, A. (2006). California Verbal Learning Test indicators of malingered neurocognitive dysfunction: Sensitivity and specificity in traumatic brain injury. Assessment, 13(1), 46–61.

  • DeFlippis, N. A., & McCampbell, E. (1979, 1991, 1997). Manual for the Booklet Category Test. Odessa: Psychological Assessment Resources.

  • Delis, D. C., & Wetter, S. R. (2007). Cogniform disorder and cogniform condition: Proposed diagnoses for excessive cognitive symptoms. Archives of Clinical Neuropsychology, 22, 589–604.

  • Demakis, G. J., Gervais, R. O., & Rohling, M. L. (2008). The effect of failure on cognitive and psychological symptom validity tests in litigants with symptoms of post-traumatic stress disorder. The Clinical Neuropsychologist, 22(5), 879–895.

    Article  PubMed  Google Scholar 

  • DiCarlo, M. A., Gfeller, J. D., & Oliveri, M. V. (2000). Effects of coaching on detecting feigned cognitive impairment with the Category Test. Archives of Clinical Neuropsychology, 15(5), 399–413.

  • Donders, J., & Strong, C. H. (2011). Embedded effort indicators on the California Verbal Learning Test – second edition (CVLT-II): an attempted cross-validation. The Clinical Neuropsychologist, 25, 173–184.

    Article  PubMed  Google Scholar 

  • Elbaum, T. Golan, L, Lupu, T., Wagner, M, & Braw, Y. (2019) Establishing supplementary response time validity indicators in the Word Memory Test (WMT) and directions for future research. Advanced online publication. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2018.1555161.

  • Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017). WAIS-IV processing speed scores as measures of non-credible responding – the third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157. https://doi.org/10.1037/pas0000319.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2018). A single error is one too many: The Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology, 33(7), 845–860. https://doi.org/10.1093/arclin/acx110.

  • Erdodi, L. A., Dunn, A. G., Seke, K. R., Charron, C., McDermott, A., Enache, A., Maytham, C., & Hurtubise, J. (2018). The Boston Naming Test as a measure of performance validity. Psychological Injury and Law, 11, 1-8. https://doi.org/10.1007/s12207-017-9309-3

  • Erdodi, L. A., Hurtubise, J. L., Charron, C., Dunn, A., Enache, A., McDermott, A.,& Hirst, R. (2018). The D-KEFS Trails as performance validitytests. Psychological Assessment, 30(8), 1081-1095.

  • Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014). Comparing the Recognition Memory Test and the Word Choice Test in a mixed clinical sample: Are they equivalent? Psychological Injury and Law, 7(3), 255–263. https://doi.org/10.1007/s12207-014-9197-8.

  • Erdodi, L. A., Kirsch, N. L., Sabelli, A. G., & Abeare, C. A. (2018). The grooved pegboard test as a validity indicator – a study on psychogenic interference as a confound in performance validity research. Psychological Injury and Law, 11(4), 307–324. https://doi.org/10.1007/s12207-018-9337-7.

    Article  Google Scholar 

  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: an emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., & Lichtenstein, J. D. (2019). Information processing speed tests as PVTs. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective. New York: Guilford.

    Google Scholar 

  • Erdodi, L. A., Lichtenstein, J. D., Rai, J. K., & Flaro, L. (2017). Embedded validity indicators in Conners’ CPT-II: do adult cutoffs work the same way in children? Applied Neuropsychology: Child, 6(4), 335–363. https://doi.org/10.1080/21622965.2016.1198908.

    Article  Google Scholar 

  • Erdodi, L. A., Nussbaum, S., Sagar, S., Abeare, C. A., & Schwartz, E. S. (2017). Limited English proficiency increases failure rates on performance validity tests with high verbal mediation. Psychological Injury and Law, 10(1), 96–103.

    Article  Google Scholar 

  • Erdodi, L. A., Pelletier, C. L., & Roth, R. M. (2018). Elevations on select Conners’ CPT-II scales indicate noncredible responding in adults with traumatic brain injury. Applied Neuropsychology: Adult, 25(1), 19-28. https://doi.org/10.1080/23279095.2016.1232262

  • Erdodi, L. A., & Rai, J. K. (2017). A single error is one too many: examining alternative cutoffs on trial 2 on the TOMM. Brain Injury, 31(10), 1362–1368. https://doi.org/10.1080/02699052.2017.1332386.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., & Roth, R. M. (2017). Low scores on BDAE Complex Ideational Material are associated with invalid performance in adults without aphasia. Applied Neuropsychology: Adult, 24(3), 264–274. https://doi.org/10.1080/23279095.2017.1298600.

    Article  Google Scholar 

  • Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology and Neuroscience, 10(3), 325–344. https://doi.org/10.1037/pne0000103.

  • Erdodi, L. A., Sagar, S., Seke, K., Zuccato, B. G., Schwartz, E. S., & Roth, R. M. (2018a). The Stroop Test as a measure of performance validity in adults clinically referred for neuropsychological assessment. Psychological Assessment, 30(6), 755–766. https://doi.org/10.1037/pas0000525.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Tyson, B. T., Abeare, C. A., Zuccato, B. G., Rai, J. K., Seke, K. R., Sagar, S., & Roth, R. M. (2018b). Utility of critical items within the Recognition Memory Test and Word Choice Test. Applied Neuropsychology: Adult, 25(4), 327–339. https://doi.org/10.1080/23279095.2017.1298600.

    Article  Google Scholar 

  • Erdodi, L. A., Tyson, B. T., Shahein, A., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Zuccato, B. G., Kucharski, B., & Roth, R. M. (2017b). The power of timing: adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383. https://doi.org/10.1080/13803395.2016.1230181.

    Article  PubMed  Google Scholar 

  • Etherton, J. L., Bianchini, K. J., Heinly, M. T., & Greve, K. W. (2006). Pain, malingering, and performance on the WAIS-III Processing Speed Index. Journal of Clinical and Experimental Neuropsychology, 28(7), 1218-1237.

  • Fritze, E. (2003). Validierung des Word Memory Test in Turkische sprache (Validation of the WMT in Turkish speakers). External examiner, Brockhaus, R., Diplomarbeit (Thesis), Ruhr-Universitat Bochum, Dortmund, Germany.

  • Gervais, R. O., Russell, A. S., Green, P., Allen, L. M., Ferrari, R., & Pieschl, S. D. (2001). Effort testing in patients with fibromyalgia and disability incentives. Journal of Rheumatology, 28, 1892–1899.

    PubMed  Google Scholar 

  • Gligorović, M., & Buha, N. (2013). Conceptual abilities of children with mild intellectual disability: analysis of Wisconsin Card Sorting Test performance. Journal of Intellectual and Developmental Disabilities, 38(2), 134–140. https://doi.org/10.3109/13668250.2013.772956.

  • Goodrich-Hunsaker, N. J., & Hopkins, R. O. (2009). Word Memory Test performance in amnesic patients with hippocampal damage. Neuropsychology, 23(4), 529–534.

    Article  PubMed  Google Scholar 

  • Green, P. (2003). Green’s Word Memory Test. Edmonton, Canada: Green’s Publishing

  • Green, P. (2004). Green’s medical symptom validity test (MSVT) for Microsoft windows user’s manual. Kelowna: Green’s Publishing.

    Google Scholar 

  • Green, P. (2007). Spoiled for choice: Making comparisons between forced-choice effort tests. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment (pp. 50–77). New York: Guilford Press.

  • Green, P., & Allen, L. (1999). Performance of neurological patients on the Word Memory Test (WMT) and computerized assessment of response bias (CARB); supplement to the Word Memory Test and CARB ’97 Manuals. North Carolina: Cognisyst.

    Google Scholar 

  • Green, P., & Astner, K. (1995). Manual for the oral word memory test. North Carolina: Cognisyst.

    Google Scholar 

  • Green, P., & Flaro, F. (2015). Results from three performance validity tests (PVTs) in adults with intellectual deficits. Applied Neuropsychology: Adult, 22(4), 293–303.

    Article  Google Scholar 

  • Green, P., & Flaro, L. (2016). Results from three performance validity tests in children with intellectual disability. Applied Neuropsychology: Child, 5, 25–34.

    Article  Google Scholar 

  • Green, P., Flaro, L., Brockhaus, R., & Montijo, J. (2012). Performance on the WMT, MSVT, and NV-MSVT in children with developmental disabilities and in adults with mild traumatic brain injury. In A. Horton, & Reynolds, C. (Eds). New York, USA: Springer.

  • Green, P., Flaro, L., & Courtney, J. (2009). Examining false positives on the Word Memory Test in adults with mild traumatic brain injury. Brain Injury, 23(9), 741–750.

    Article  PubMed  Google Scholar 

  • Green, P., Lees-Haley, P., & Allen, L. M. (2003). The Word Memory Test and the validity of neuropsychological test scores. Journal of Forensic Neuropsychology, 2, 97–124.

    Article  Google Scholar 

  • Green, P., & Merten, T. (2013). Noncredible explanations of noncredible symptom validity test failure). In D. Carone & S. Bush (Eds.), Mild traumatic brain injury: symptom validity assessment and malingering. New York: Springer Publishing.

    Google Scholar 

  • Green, P., Montijo, J., & Brockhaus, R. (2011). High specificity of the Word Memory Test and Medical Symptom Validity Test in groups with severe verbal memory impairment. Applied Neuropsychology, 18(2), 86–94.

    Article  PubMed  Google Scholar 

  • Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060.

    Article  PubMed  Google Scholar 

  • Greiffenstein, M. F., & Baker, W. J. (2008). Validity testing in dually diagnosed posttraumatic stress disorder and mild closed head injury. The Clinical Neuropsychologist, 22, 565–582.

  • Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224.

  • Greve, K., Ord, J., Curtis, K., Bianchini, K., & Brennan, B. (2008). Detecting malingering in traumatic brain injury and chronic pain: a comparison of three forced choice symptom validity tests. The Clinical Neuropsychologist, 22, 896–918.

    Article  PubMed  Google Scholar 

  • Greve, K. W., Heinly, M. T., Bianchini, K. J., & Love, J. M. (2009). Malingering detection with the Wisconsin Card Sorting Test in mild traumatic brain injury. The Clinical Neuropsychologist, 23, 343–362.

  • Grimes, D. A., & Schulz, K. F. (2005). Refining clinical diagnosis with likelihood ratios. The Lancet, 365(9469), 1500–1505.

  • Hall, V., Worthington, A., & Venables, K. (2014). A UK pilot study: the specificity of the Word Memory Test effort sub-tests in acute minimal to mild head injury. Journal of Neuropsychology, 8(2), 216–230.

    Article  PubMed  Google Scholar 

  • Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz: Psychological Assessment Resources.

  • Henry, G. K., Helbronner, R. L., Suhr, J., Gornbein, J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society, 24, 1–11.

  • Hill, A. B. (1965). The environment and disease: association or causation. Proceedings of the Royal Society of Medicine, 58, 295–300.

    Article  Google Scholar 

  • Hurtubise, J. L., Scavone, A., Sagar, S., & Erdodi, L. A. (2017). Psychometric markers of genuine and feigned neurodevelopmental disorders in the context of applying for academic accommodations. Psychological Injury and Law, 10, 121–137.

    Article  Google Scholar 

  • Jones, A. (2013). Test of memory malingering: cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059.

  • King, J. H., Sweet, J. J., Sherer, M., Curtiss, G., & Vanderploeg, R. D. (2002). Validity indicators within the Wisconsin Card Sorting Test: Application of new and previously researched multivariate procedures in multiple traumatic brain injury samples. The Clinical Neuropsychologist, 16(4), 506–523.

  • Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental Test of Memory Malingering Scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244.

  • Larochette, A. C., & Harrison, A. G. (2012). Word Memory Test performance in Canadian adolescents with learning disabilities: a preliminary study. Applied Neuropsychology: Child, 1(1), 38–47.

    Article  Google Scholar 

  • Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089.

    Article  PubMed  Google Scholar 

  • Larrabee, G. J. (2012). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: a scientific approach (Second ed., pp. 116–159). New York: Oxford University Press.

    Google Scholar 

  • Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29, 364–373.

    Article  PubMed  Google Scholar 

  • Larrabee, G. J., Millis, S. R., & Meyers, J. E. (2009). 40 plus or minus 10, a new magical number: reply to Russell. Clinical Neuropsychology, 23(5), 841–849.

  • Lichtenstein, J. D., Flaro, L., Baldwin, F. S., Rai, J., & Erdodi, L. A. (2019). Further evidence for embedded performance validity tests in children within the Conners’ Continuous Performance Test - second edition. Developmental Neuropsychology, 44(2), 159–171. https://doi.org/10.1080/87565641.2019.1565535.

    Article  PubMed  Google Scholar 

  • Lichtenstein, J. D., Holcomb, M., & Erdodi, L. A. (2018). One-minute PVT: further evidence for the utility of the California Verbal Learning Test—Children’s Version Forced Choice Recognition Trial. Journal of Pediatric Neuropsychology, 4, 94–104.

    Article  Google Scholar 

  • Lupu, T., Elbaum, T., Wagner, M., & Braw, Y. (2018). Enhanced detection of feigned cognitive impairment using per item response time measurements in the Word Memory Test. Applied Neuropsychology: Adult, 25(6), 532–542. https://doi.org/10.1080/23279095.2017.1341410.

  • Macciocchi, S. N., Seel, R. T., Yi, A., & Small, S. (2017). Medical symptom validity test performance following moderate-severe traumatic brain injury: expectations based on orientation log classification. Archives of Clinical Neuropsychology, 32(3), 339–348.

    Article  PubMed  Google Scholar 

  • Mathias, C. W., Greve, K. W., Bianchini, K. J., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction using the reliable digit span in traumatic brain injury. Assessment, 9(3), 301–308.

  • McCrea, M. A. (2008). Mild traumatic brain injury and post-concussion syndrome: the new evidence. Oxford University Press.

  • Meyers, J., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26(1), 8–15.

    Article  PubMed  Google Scholar 

  • Millis, S. R., Putnam, S. H., Adams, K. M., & Ricker, J. H. (1995). The California Verbal Learning Test in the detection of incomplete effort in neuropsychological evaluation. Psychological Assessment, 7(4), 463–471.

  • Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology., 24(8), 1094–1102.

    Article  PubMed  Google Scholar 

  • Pearson. (2009). Advanced Clinical Solutions for the WAIS-IV and WMS-IV – Technical Manual. San Antonio: Author.

  • Persinger, V. C., Whiteside, D. M., Bobova, L., Saigal, S. D., Vannucci, M. J., & Basso, M. R. (2018). Using the California Verbal Learning Test, Second Edition as an embedded performance validity measure among individuals with TBI and individuals with psychiatric disorders. The Clinical Neuropsychologist, 32(6), 1039–1053. https://doi.org/10.1080/13854046.2017.1419507.

  • Rapport, L. J., Farchione, T. J., Coleman, R. D., & Axelrod, B. N. (1998). Effects of coaching on malingered motor function profiles. Journal of Clinical and Experimental Neuropsychology, 20(1), 89–97.

  • Rabin, L. A., Spadaccini, A. T., Brodale, D. L., Grant, K. S., Elbulok, M. M., & Barr, W. B. (2014). Utilization rates of tests & test batteries among clinical psychologists in the United States & Canada. Professional Psychology Research & Practice, 45(5), 368–377.

    Article  Google Scholar 

  • Rai, J., An, K. Y., Charles, J., Ali, S., & Erdodi, L. A. (2019). Introducing a forced choicerecognition trial to the Rey Complex Figure Test. Advance online publication. Psychologyand Neuroscience. https://doi.org/10.1037/pne0000175.

  • Rai, J., & Erdodi, L. (2019). The impact of criterion measures on the classificationaccuracy of TOMM-1. Advance online publication. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2019.161.1613994.

  • Reese, C. S., Suhr, J. A., & Riddle, T. L. (2012). Exploration of malingering indices in the Wechsler Adult Intelligence Scale – Fourth Edition Digit Span subtest. Archives of Clinical Neuropsychology, 27, 176–181.

  • Richman, J., Green, P., Gervais, R., Flaro, L., Merten, T., Brockhaus, R., & Ranks, D. (2006). Objective tests of symptom exaggeration in independent medical evaluations. Journal of Occupational and Environmental Medicine, 48(3), 303–311.

  • Rogers, R., Sewell, K. W., Martin, M. A., & Vitacco, M. J. (2003). Detection of feigned mental disorders: A meta-analysis of the MMPI-2 and malingering. Assessment, 10,160-177.

  • Rohling, M., Binder, L., Demakis, G., Larrabee, G., Ploetz, L., & Langhinrichsen-Rohling, J. (2011). A meta-analysis of neuropsychological outcome after mild traumatic brain injury: re- analyses and reconsiderations of Binder et al., Frencham et al., and Pertab et al. The Clinical Neuropsychologist, 25(4), 608–623.

    Article  PubMed  Google Scholar 

  • Rohling, M. L., & Demakis, G. J. (2010). Bowden, Shores, & Mathias (2006): failure to replicate or just failure to notice. Does effort still account for more variance in neuropsychological test scores than TBI severity? The Clinical Neuropsychologist, 24(1), 119–136.

  • Rohling, M. L., Green, P., Allen, L., & Iverson, G. L. (2002). Depressive symptoms and neurocognitive test scores in patients passing symptom validity tests. Archives of Clinical Neuropsychology, 17(3), 205–222.

    Article  PubMed  Google Scholar 

  • Shelley-Tremblay, J. F., Eyer, J. C., & Hill, B. D. (2019). A laboratory Word Memory Test analogue differentiates intentional feigning from true responding using the P300 event-related potential. Brain Science, 9(5), 109. https://doi.org/10.3390/brainsci9050109.

  • Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gatz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Crossvalidation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23, 94–104. https://doi.org/10.1080/23279095.2015.1014556

  • Slick, D. J., Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561.

  • Slick, D. J., Iverson, G. L., & Green, P. (2000). California Verbal Learning Test indicators of suboptimal performance in a sample of head-injury litigants. Journal of Clinical and Experimental Neuropsychology, 22(4), 569–579.

  • Suhr, J. A. (2003). Neuropsychological impairment in fibromyalgia. Relation to depression, fatigue, and pain. Journal of Psychosomatic Research, 55, 321–329.

  • Suhr, J. A., & Boyer, D. (1999). Use of the Wisconsin Card Sorting Test in the detection of malingering in student simulator and patient samples. Journal of Clinical and Experimental Psychology, 21(5), 701–708. https://doi.org/10.1076/jcen.21.5.701.868

  • Sweet, J. J., Wolfe, P., Sattlberger, E., Numan, B., Rosenfeld, J. P., Clingerman, S., & Nies, K. J. (2000). Further investigation of traumatic brain injury versus insufficient effort with the California Verbal Learning Test. Archives of Clinical Neuropsychology, 15(2), 105–113.

  • Tenhula, W. N., & Sweet, J. J. (1996). Double cross-validation of the Booklet Category Test in detecting malingered traumatic brain injury. The Clinical Neuropsychologist, 10(1), 104–116.

  • Tombaugh, T. N. (1996). Test of Memory Malingering. New York: Multi-Health Systems.

  • Tomer, E., Lupu, T., Golan, L., Wagner, M., & Braw, Y. (2018). Eye tracking as a mean to detect feigned cognitive impairment in the Word Memory Test. Advance online publication. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2018.1480483.

  • Trueblood, W. (1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 14(4), 697–607. https://doi.org/10.1080/01688639408402671.

  • Tydecks, S., Merten, T., & Gubbay, J. (2006). The Word Memory Test and the One-in-Five-Test in an analogue study with Russian speaking participants. International Journal of Forensic Psychology, 1(3), 29–37.

    Google Scholar 

  • Tyson, B. T., Baker, S., Greenacre, M., Kent, K. J., Lichtenstein, J. D., Sabelli, A., & Erdodi, L. A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45.

    Article  Google Scholar 

  • Warrington, E. K. (1984). Recognition Memory Test: RMT (Words) [Test Booklet]. NFER-Nelson Publishing Company.

  • Whiteside, D., Wald, D., & Busse, M. (2011). Classification accuracy of multiple visual spatial measures in the detection of suspect effort. The Clinical Neuropsychologist, 25, 287–301.

  • Williamson, D. J., Holsman, M., Chaytor, N., Miller, J. W., & Drane, D. L. (2012). Abuse, not financial incentive, predicts non-credible cognitive performance in patients with psychogenic non-epileptic seizures. The Clinical Neuropsychologist, 26(4), 588–598.

  • Wolfe, P. L., Millis, S. R., Hanks, R., Fichtenberg, N., Larrabee, G. J., & Sweet, J. J. (2010). Effort indicators within the California Verbal Learning Test-II (CVLT-II). The Clinical Neuropsychologist, 24(1), 153–168.

Download references

Funding

This research was supported by a Collaborative Research Grant from the Faculty of Arts, Humanities, and Social Sciences at the University of Windsor.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laszlo A. Erdodi.

Ethics declarations

Relevant ethical guidelines regulating research involving human participants were followed throughout the project. All data collection, storage, and processing were done in compliance with the Helsinki Declaration.

Conflict of Interest

The first and last authors are employed by the University of Windsor. In addition to that, they provide forensic consultation and medicolegal assessments, for which they receive financial compensation. Dr. Green is the author of the WMT, MSVT, and NV-MSVT and the owner of Green’s Publishing. However, the data analysis was performed and interpreted by the other authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Erdodi, L.A., Green, P., Sirianni, C.D. et al. The Myth of High False-Positive Rates on the Word Memory Test in Mild TBI. Psychol. Inj. and Law 12, 155–169 (2019). https://doi.org/10.1007/s12207-019-09356-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12207-019-09356-8

Keywords

Navigation