Abstract
Assessment of the validity of neuropsychological test data has become an ensconced aspect of the assessment process. Among the more popular free-standing performance validity measures (PVMs) is the Test of Memory Malingering (Tombaugh 1996). Given the popularity of this measure, a number of researchers (i.e., Trial 1 (Denning, 2012); TOMMe10 (Denning, 2012); Albany Consistency Index (Gunner, Miele, Lynch, & McCaffrey, 2012)) have sought to expand its utility by increasing the number of scoring approaches associated with its administration. This paper aimed to cross-validate prior work by examining the performance of these measures in a mixed clinical sample of veterans referred for neuropsychological evaluation. All five examined measures provided good to excellent discrimination of patients determined to be putting forth poor effort based on failure of two or three alternate measures of performance validity. Traditional scoring approaches revealed high rates of specificity, with lower rates of sensitivity. The newer measures performed well for both sensitivity and specificity at higher base rates. However, predicted performance in low base rate populations (i.e., 0.10) using the newly derived scoring failed to reach predetermined cutoffs for specificity (0.90). Further examination of the cumulative performance of the scoring approaches indicated that administration of only two initial scoring indices was necessary to obtain a high rate of classification.
Similar content being viewed by others
References
Axelrod, B. N., Fichtenberg, N. L., Millis, S. R., & Wertheimer, J. C. (2006). Detecting incomplete effort with Digit Span from the Wechsler Adult Intelligence Scale-Third Edition. The Clinical Neuropsychologist, 20(3), 513–523.
Boone, K. B. (2007). Assessment of feigned cognitive impairment: a neuropsychological perspective. New York: Guilford Press.
Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (2000). California verbal learning test (2nd ed.). San Antonio: The Psychological Corporation.
Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering trial 1, errors on the first 10 items of the test of memory malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432.
Flaro, L., Green, P., & Robertson, E. (2007). Word Memory Test failure 23 times higher in mild brain injury than in parents seeking custody: the power of external incentives. Brain Injury, 21(4), 373–383.
Gervais, R. O., Rohling, M. L., Green, P., & Ford, W. (2004). A comparison of WMT, CARB, and TOMM failure rates in non-head injury disability claimants. Archives of Clinical Neuropsychology, 19(4), 475–487.
Green, P. (2004). Green’s Medical Symptom Validity Test (MSVT) for Microsoft Windows. User’s manual. Edmonton: Green’s Publishing.
Green, P. (2005). Word Memory Test for Windows: user’s manual and program. Edmonton: Green’s Publishing.
Green, P. (2011). Comparison between the Test of Memory Malingering (TOMM) and the Nonverbal Medical Symptom Validity Test (NV-MSVT) in adults with disability claims. Applied Neuropsychology, 18(1), 18–26.
Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M., 3rd. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060.
Greiffenstein, M. F., Baker, R., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224.
Greiffenstein, M. F., Greve, K. W., Bianchini, K. J., & Baker, W. J. (2008). Test of memory malingering and word memory test: a new comparison of failure concordance rates. Archives of Clinical Neuropsychology, 23(7–8), 801–807.
Greve, K. W., Ord, J., Curtis, K. L., Bianchini, K. J., & Saburina, I. N. (2008). Detecting malingering in traumatic brain injury and chronic pain: a comparison of three forced-choice symptom validity tests. The Clinical Neuropsychologist, 22(5), 896–918.
Gunner, J. H., Miele, A. S., Lynch, J. K., & McCaffrey, R. J. (2012). The Albany Consistency Index for the test of memory malingering. Archives of Clinical Neuropsychology, 27(1), 1–9.
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129.
Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York: Wiley.
Larrabee, G. J. (2007). Assessment of malingered neuropsychological deficits. Oxford: Oxford University Press.
Schutte, C., & Axelrod, B. N. (2013). Use of embedded cognitive symptom validity measures in mild traumatic brain injury cases. Mild traumatic brain injury: symptom validity assessment and malingering (pp. 159–181). New York: Springer Publishing Co.
Spencer, R. J., Axelrod, B. N., Drag, L. L., Waldron-Perrine, B., Pangilinan, P. H., & Bieliauskas, L. A. (2013). WAIS-IV reliable digit span is no more accurate than age corrected scaled score as an indicator of invalid performance in a veteran sample undergoing evaluation for mTBI. The Clinical Neuropsychologist, 27(8), 1362–1372.
Tombaugh, T. N. (1996). Test of Memory Malingering: TOMM. Tonawanda: Multi-Health Systems, Inc.
Wechsler, D. (1997). Wechsler adult intelligence scale (3rd ed.). San Antonio: The Psychological Corporation.
Wechsler, D. (2008). Wechsler adult intelligence scale (4th ed.). San Antonio: The Psychological Corporation.
Young, J. C., Sawyer, R. J., Roper, B. L., & Baughman, B. C. (2012). Expansion and re-examination of Digit Span Effort Indices on the WAIS-IV. The Clinical Neuropsychologist, 26(1), 147–159.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kulas, J.F., Axelrod, B.N. & Rinaldi, A.R. Cross-Validation of Supplemental Test of Memory Malingering Scores as Performance Validity Measures. Psychol. Inj. and Law 7, 236–244 (2014). https://doi.org/10.1007/s12207-014-9200-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12207-014-9200-4