Skip to main content

Advertisement

SpringerLink
Log in

Cross-validation of the Utility of Test of Memory Malingering (TOMM) Cut-offs in a Large Colombian Sample

  • Published:
Psychological Injury and Law Aims and scope Submit manuscript

Abstract

This study sought to cross-validate the utility of Test of Memory Malingering (TOMM) cut-offs derived in a large Colombian sample with further exploration of the impact of age, education, and Mini-Mental Status Examination (MMSE) scores on TOMM trials. To address these aims, the study examines concordance rates of the TOMM scores by demographics and Hopkins Verbal Learning Test-Revised (HVLT-R) test performance. Additionally, item response theory analysis (IRT) focused on the interaction between demographic variables and the psychometric properties of the TOMM items. Data were collected from 1416 healthy controls (58.6% female; M age = 58.19; M education = 9 years) who completed the TOMM, MMSE, and HVLT-R as part of a comprehensive battery conducted in Spanish. Frequency analysis was used to assess for concordance rates of passing TOMMe10, Trial 1, and Trial 2 scores, further broken down by median split for MMSE, education, and age. Additionally, IRT is used to examine, in detail, the psychometric properties of the TOMM items and relationships to demographic variables. Validity classification differed across the TOMM trials, with 82.8% passing e10, 88.6% Trial 1, and 92.5% Trial 2. When dichotomized by a median split, passing rates across all TOMM trials were significantly different (p ≤ .001) for MMSE scores, education, and age with the largest discrepancy (~ 21%) observed on TOMMe10. IRT confirmed that all TOMM items are easy to answer correctly with Trial 2 items being appreciably easier (difficulty range =  − 4.90 to − 1.52) than Trial 1 items (difficulty range =  − 6.22 to − 3.50). Age, education, MMSE, and HVLT-R scores all were significantly related to latent trait scores on the TOMM (p < .001). Utilization of the TOMM in Spanish-speaking individuals is warranted, but with caution. The TOMMe10 yielded higher rates of invalid classification when compared to Trial 1 or Trial 2. IRT methods allow examination of whether traditional TOMM trial cut-offs may be appropriate when individuals present with advanced age or low educational attainment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • American Psychological Association. (2010). Ethical principles of psychologists and code of conduct (2002, Amended June 1, 2010). Retrieved from http://www.apa.org/ethics/code/index.aspx

  • Arango-Lasprilla, J., & Rivera, D. (2015). Neuropsicología en Colombia: Datos normativos, estado actual y retos a futuro. Editorial Universidad Autónoma de Manizales.

  • Bailey, K. C., Soble, J. R., Bain, K. M., & Fullen, C. (2018). Embedded performance validity tests in the Hopkins Verbal Learning Test-Revised and the Brief Visuospatial Memory Test-Revised: A replication study. Archives of Clinical Neuropsychology : The Official Journal of the National Academy of Neuropsychologists, 33(7). https://doi.org/10.1093/arclin/acx111

  • Benedict, R. H., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins Verbal Learning Test–Revised: Normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55

    Article  Google Scholar 

  • Brandt, J., & Benedict, R. H. B. (1991). Hopkins Verbal Learning Test-Revised (HVLT-R). Psychological Assessment Resources.

    Google Scholar 

  • Brandt, J., & Benedict, R. H. B. (2001). Hopkins Verbal Learning Test—Revised. Psychological Assessment Resources.

    Google Scholar 

  • Burton, V., Vilar-López, R., & Puente, A. E. (2012). Measuring effort in neuropsychological evaluations of forensic cases of Spanish speakers. Archives of Clinical Neuropsychology, 27(3), 262–267

    Article  Google Scholar 

  • Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

    Article  Google Scholar 

  • Chalmers, R. P. (2015). Extended mixed-effects item response models with the MH-RM algorithm. Journal of Educational Measurement, 52(2), 200–222. https://doi.org/10.1111/jedm.12072

    Article  Google Scholar 

  • DenBoer, J. W., & Hall, S. (2007). Neuropsychological test performance of successful brain injury simulators. The Clinical Neuropsychologist, 21(6), 943–955

    Article  Google Scholar 

  • Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432

    Article  PubMed  Google Scholar 

  • Denning, J. H. (2019). When 10 is enough: Errors on the first 10 items of the Test of Memory Malingering (TOMMe10) and administration time predict freestanding performance validity tests (PVTs) and underperformance on memory measures. Applied Neuropsychology: Adult, 1–13.

  • Erdodi, L. A., & Rai, J. K. (2017). A single error is one too many: Examining alternative cutoffs on Trial 2 of the TOMM. Brain Injury, 31(10), 1362–1368

    Article  Google Scholar 

  • Fazio, R. L., Denning, J. H., & Denney, R. L. (2017). TOMM Trial 1 as a performance validity indicator in a criminal forensic sample. The Clinical Neuropsychologist, 31(1), 251–267

    Article  Google Scholar 

  • Folstein, M., Folstein, S., & McHugh, P. (1975). Mini-mental state: a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189–198. https://doi.org/10.1016/0022-3956(75)90026-6

    Article  Google Scholar 

  • Fuji, D. E. M. (2018). Developing a cultural context for conducting a neuropsychological evaluation with a culturally diverse client: The ECLECTIC framework. The Clinical Neuropsychologist, 32(8), 1356–1392. https://doi.org/10.1080/13854046.2018.1435826

    Article  Google Scholar 

  • Grabyan, J. M., Collins, R. L., Alverson, W. A., & Chen, D. K. (2018). Performance on the Test of Memory Malingering is predicted by the number of errors on its first 10 items on an inpatient epilepsy monitoring unit. The Clinical Neuropsychologist, 32(3), 468–478

    Article  Google Scholar 

  • Guàrdia-Olmos, J., Peró-Cebollero, M., Rivera, D., & Arango-Lasprilla, J. C. (2015). Methodology for the development of normative data for ten Spanish-language neuropsychological tests in eleven Latin American countries. NeuroRehabilitation, 37(4), 493–499. https://doi.org/10.3233/NRE-151277

    Article  Google Scholar 

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Conference Participants 1. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129

    Article  Google Scholar 

  • Hilsabeck, R. C., Gordon, S. N., Hietpas-Wilson, T., & Zartman, A. L. (2011). Use of Trial 1 of  the Test of Memory Malingering (TOMM) as a screening measure of effort: Suggested discontinuation rules. The Clinical Neuropsychologist, 25(7), 1228–1238.

  • Jelicic, M., Ceunen, E., Peters, M. J., & Merckelbach, H. (2011). Detecting coached feigning using the Test of Memory Malingering (TOMM) and the Structured Inventory of Malingered Symptomatology (SIMS). Journal of Clinical Psychology, 67(9), 850–855

    Article  Google Scholar 

  • Kirkwood, M. W. (2015). Review of pediatric performance and symptoms validity tests. In M. W. Kirkwood (Ed.), Validity testing in child and adolescent assessment: Evaluating exaggeration, feigning, and noncredible effort (pp. 79–106). Guilford Publications.

  • Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine, 16(9), 606–613

    Article  PubMed  Google Scholar 

  • Llorente, A. M. (2008). American population estimates, trends in American immigration, and neuropsychology: Influences on assessment and inferential processes with Hispanic populations. In A. M. Llorente (Ed.), Principles of neuropsychological assessment with Hispanics: Theoretical foundations and clinical practice (pp. 29–46). Springer.

  • Llorente, A. M., Pontόn, M. O., Taussig, I. M., & Satz, P. (1999). Patterns of American immigration and their influence on the acquisition of neuropsychological norms for Hispanics. Archives of Clinical Neuropsychology, 14(7), 603–614

    Google Scholar 

  • Mahoney, F. I., & Barthel, D. W. (1965). Functional evaluation: the Barthel Index: a simple index of independence useful in scoring improvement in the rehabilitation of the chronically ill. Maryland state medical journal.

  • Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists validity testing beliefs and practices: A survey of north American professionals. Clinical Neuropsychologist, 29(6), 741–776. https://doi.org/10.1080/13854046.2015.1087597

    Article  Google Scholar 

  • Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119

    Article  Google Scholar 

  • Mindt, M. R., Byrd, D., Saez, P., & Manly, J. (2010). Increasing culturally competent neuropsychological services for ethnic minority populations: A call to action. The Clinical Neuropsychologist, 24(3), 429–453

    Article  PubMed  Google Scholar 

  • Nijdam-Jones, A., Rivera, D., Rosenfeld, B., & Arango-Lasprilla, J. C. (2017). A cross-cultural analysis of the Test of Memory Malingering among Latin American Spanish-speaking adults. Law and Human Behavior, 41(5), 422

    Article  Google Scholar 

  • Nijdam-Jones, A., Rivera, D., Rosenfeld, B., & Arango-Lasprilla, J. C. (2019). The effect of literacy and culture on cognitive effort test performance: An examination of the test of memory Malingering in Colombia. Journal of clinical and experimental neuropsychology, 41(10), 1015–1023

    Article  Google Scholar 

  • Pontόn, M. O., & Ardila, A. (1999). The future of neuropsychology with Hispanic populations in the United States. Archives of Clinical Neuropsychology, 14(7), 565–580

    Google Scholar 

  • Rai, J. K., & Erdodi, L. A. (2019). Impact of criterion measures on the classification accuracy of TOMM-1. Applied Neuropsychology: Adult, 1–12.

  • Relevance 2050 Initiative. American Academy of Clinical Neuropsychology (AACN). https://theaacn.org/relevance-2050-initiative/

  • Ramírez, R. M., Chirivella-Garrido, J., Caballero, M. C., Ferri-Campos, J., & Noé-Sebastián, E. (2004). Inteligencia, memoria y simulación: correlaciones entre instrumentos de medida. Revista de Neurología, España, 38(1), 28-33.

  • Revelle, W. (2020). psych: Procedures for personality and psychological research, Northwestern University, Evanston, Illinois, USA. https://CRAN.R-project.org/package=psychVersion=2.0.7

  • Sawyer, R. J., Testa, S. M., & Dux, M. (2017). Embedded performance validity tests within the Hopkins Verbal Learning Test-Revised and the Brief Visuospatial Memory Test-Revised. The Clinical Neuropsychologist, 31(1), 207–218. https://doi.org/10.1080/13854046.2016.1245787

    Article  Google Scholar 

  • Schroeder, R. W., Olsen, D. H., & Martin, P. K. (2019). Classification accuracy rates of four TOMM validity indices when examined independently and jointly. The Clinical Neuropsychologist, 33(8), 1373–1387

    Article  Google Scholar 

  • Strutt, A. M., Scott, B. M., Lozano, V. J., Tieu, P. G., & Peery, S. (2012). Assessing sub-optimal performance with the Test of Memory Malingering in Spanish speaking patients with TBI. Brain Injury, 26(6), 853–863

    Article  Google Scholar 

  • Tombaugh, T. N. (1996). Test of memory malingering: TOMM. Multy-Health Systems.

  • Tombaugh, T. N., López, R. V., García, M. P., & Puente, A. E. (2011). TOMM: Test de simulación de problemas de memoria. Tea.

    Google Scholar 

  • United States Census Bureau. (2019). Quick Facts United States. Census.gov. https://www.census.gov/quickfacts/fact/table/US/RHI725218

  • Vilar-López, R., Gómez-Río, M., Santiago-Ramajo, S., Rodríguez-Fernández, A., Puente, A. E., & Pérez-García, M. (2008). Malingering detection in a Spanish population with a known-groups design. Archives of Clinical Neuropsychology, 23(4), 365–377

    Article  Google Scholar 

  • Vilar-López, R., Santiago-Ramajo, S., Gómez-Río, M., Verdejo-García, A., Llamas, J. M., & Pérez-García, M. (2007). Detection of malingering in a Spanish population using three specific malingering tests. Archives of Clinical Neuropsychology, 22(3), 379–388

    Article  Google Scholar 

  • Villaseñor-Cabrera, T., Guàrdia-Olmos, J., Jiménez-Maldonado, M., Rizo-Curiel, G., & Peró-Cebollero, M. (2010). Sensitivity and specificity of the Mini-Mental State Examination in the Mexican population. Quality & Quantity, 44(6), 1105-1112.

Download references

Author information

Authors and Affiliations

  1. Division of Psychiatry, UT Southwestern Medical Center, Dallas, TX, USA

    K. Chase Bailey & William Goatte

  2. Biomedical Research Doctorate Program, University of the Basque Country (UPV/EHU), Leioa, Spain

    Daniela Ramos-Usuga

  3. Biocruces Bizkaia Health Research Institute, Barakaldo, Spain

    Daniela Ramos-Usuga & Juan Carlos Arango-Lasprilla

  4. Departamento de Ciencias de La Salud, Universidad Pública de Navarra, Pamplona, España

    Diego Rivera

  5. IKERBASQUE Basque Foundation for Science, Bilbao, Spain

    Juan Carlos Arango-Lasprilla

  6. Department of Cell Biology and Histology, University of the Basque Country UPV/EHU, Leioa, Spain

    Juan Carlos Arango-Lasprilla

Authors
  1. K. Chase Bailey
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. William Goatte
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniela Ramos-Usuga
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Diego Rivera
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Juan Carlos Arango-Lasprilla
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Juan Carlos Arango-Lasprilla.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bailey, K.C., Goatte, W., Ramos-Usuga, D. et al. Cross-validation of the Utility of Test of Memory Malingering (TOMM) Cut-offs in a Large Colombian Sample. Psychol. Inj. and Law 14, 114–126 (2021). https://doi.org/10.1007/s12207-021-09407-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12207-021-09407-z

Keywords

Search

Navigation