Skip to main content
SpringerLink
Log in

One-Minute PVT: Further Evidence for the Utility of the California Verbal Learning Test—Children’s Version Forced Choice Recognition Trial

  • Published:
Journal of Pediatric Neuropsychology Aims and scope Submit manuscript

Abstract

Objective

To replicate previous research on the forced choice recognition trial for the California Verbal Learning Test—Children’s Version (FCR-C).

Method

Classification accuracy of the FCR-C was computed in 178 children referred for neuropsychological assessment to a tertiary care hospital.

Results

FCR-C ≤ 14 produced the best combination of sensitivity (.12–.42) and specificity (.88–.96). Unlike some of the criterion performance validity tests (PVTs), base rate of failure on the FCR-C was evenly distributed across age ranges.

Conclusion

The FCR-C is a quick and inexpensive PVT, unaffected by cognitive maturation, and highly specific to psychometrically defined invalid performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Abeare, C. A., Messa, I., Zuccato, B. G., Merker, B., & Erdodi, L. (2018). Prevalence of invalid performance on baseline testing for sport-related concussion by age and validity indicator. Advanced online publication. JAMA Neurology. https://doi.org/10.1001/jamaneurol.2018.0031.

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

    Book  Google Scholar 

  • Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various Digit Span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159.

    Article  PubMed  Google Scholar 

  • Baker, D. A., Connery, A. K., Kirk, J. W., & Kirkwood, M. W. (2014). Embedded performance validity indicators within the California Verbal Learning Test, Children’s Version. The Clinical Neuropsychologist, 28(1), 116–127.

    Article  PubMed  Google Scholar 

  • Baldessarini, R. J., Finklestein, S., & Arana, G. W. (1983). The predictive power of diagnostic tests and the effect of prevalence of illness. Archives of General Psychiatry, 40(5), 569–573.

    Article  PubMed  Google Scholar 

  • Bauer, L., O’Bryant, S. E., Lynch, J. K., McCaffrey, R. J., & Fisher, J. M. (2007). Examining the Test of Memory Malingering Trial 1 and Word Memory Test Immediate Recognition as screening tools for insufficient effort. Assessment, 14(3), 215–222.

    Article  PubMed  Google Scholar 

  • Bernstein, J. H., & Waber, D. P. (1991). Developmental neuropsychological assessment: the systemic approach. In A. A. Boulton, G. B. Baker, & M. Hissock (Eds.), Neuromethods. New York: Humana Press.

    Google Scholar 

  • Blaskewitz, N., Merten, T., & Kathmann, N. (2008). Performance of children on symptom validity tests: TOMM, MSVT, and FIT. Archives of Clinical Neuropsychology, 23(4), 379–391.

    Article  PubMed  Google Scholar 

  • Boone, K. B. (2007). Assessment of feigned cognitive impairment. A neuropsychological perspective. New York: Guilford.

    Google Scholar 

  • Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examination. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803.

    Article  PubMed  Google Scholar 

  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York: Guilford.

    Google Scholar 

  • Boone, K. B., Salazar, X., Lu, P., Warner-Chacon, K., & Razani, J. (2002). The Rey 15-item recognition trial: a technique to enhance sensitivity of the Rey 15-item memorization test. Journal of Clinical and Experimental Neuropsychology, 24(5), 561–573. https://doi.org/10.1076/jcen.24.5.561.1004.

    Article  PubMed  Google Scholar 

  • Brooks, B. L., & Ploetz, D. M. (2015). Embedded performance validity on the CVLT-C for youth with neurological disorders. Archives of Clinical Neuropsychology, 30, 200–206.

    Article  PubMed  Google Scholar 

  • Brooks, B., Ploetz, D., & Kirkwood, M. (2016). A survey of neuropsychologists’ use of validity tests with children and adolescents. Child Neuropsychology, 22(8), 1001–1020.

    Article  PubMed  Google Scholar 

  • Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., et al. (2005). Symptom validity assessment: practice issues and medical necessity (NAN Policy and Planning Committees). Archives of Clinical Neuropsychology, 20, 419–426.

    Article  PubMed  Google Scholar 

  • Constantinou, M., & McCaffrey, R. J. (2003). Using the TOMM for evaluating children’s effort to perform optimally on neuropsychological measures. Child Neuropsychology, 9(2), 81–90.

    Article  PubMed  Google Scholar 

  • Crone, E.A., Wedelken, C., Donohue, S., van Leijenhorst, L., & Bunge, S.A. (2006). Neurocognitive development of the ability to manipulate information in working memory. Proceedings of the National Academy of Sciences of the United States of America, 103(24), 9315–9320.

  • Davis, J. J. (2014). Further consideration of Advanced Clinical Solutions Word Choice: comparison to the Recognition Memory Test—words and classification accuracy on a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294. https://doi.org/10.1080/13854046.2014.975844.

    Article  PubMed  Google Scholar 

  • Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. (1987). The California Verbal Learning Test: Adult Version Manual. San Antonio: The Psychological Corporation.

    Google Scholar 

  • Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (1994). California Verbal Learning Test, Children’s Version. San Antonio: Psychological Corporation.

    Google Scholar 

  • Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. (2000). The California Verbal Learning Test—second edition. San Antonio: The Psychological Corporation.

    Google Scholar 

  • Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432.

    Article  PubMed  Google Scholar 

  • DeRight, J., & Carone, D. A. (2015). Assessment of effort in children: a systematic review. Child Neuropsychology, 21(1), 1–24.

    Article  PubMed  Google Scholar 

  • Donders, J. (2005). Performance on the Test of Memory Malingering in a mixed pediatric sample. Child Neuropsychology, 11(2), 221–227.

    Article  PubMed  Google Scholar 

  • Donders, J., & Strong, C. H. (2011). Embedded effort indicators on the California Verbal Learning Test – second edition (CVLT-II): an attempted cross-validation. The Clinical Neuropsychologist, 25, 173–184.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A. (2017). Aggregating validity indicators: the salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment. Advance online publication. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2017.1384925.

  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: an emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31:(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119

  • Erdodi, L. A., & Rai, J. K. (2017). A single error is one too many: examining alternative cutoffs on Trial 2 on the TOMM. Brain Injury, 31(10), 1362–1368. https://doi.org/10.1080/02699052.2017.1332386.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Kirsch, N. L., Lajiness-O'Neill, R., Vingilis, E., & Medoff, B. (2014). Comparing the recognition memory test and the word choice test in a mixed clinical sample: Are they equivalent? Psychological Injury and Law, 7(3), 255–263. https://doi.org/10.1007/s12207-014-9197-8

  • Erdodi, L. A., Tyson, B. T., Abeare, C. A., Lichtenstein, J. D., Pelletier, C. L., Rai, J. K., & Roth, R. M. (2016). The BDAE Complex Ideational Material—a measure of receptive language or performance validity? Psychological Injury and Law, 9, 112–120. https://doi.org/10.1007/s12207-016-9254-6.

    Article  Google Scholar 

  • Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2017a). A single error is one too many: the Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Advanced online publication. Archives of Clinical Neuropsychology. https://doi.org/10.1093/arclin/acx110.

  • Erdodi, L. A., Lichtenstein, J. D., Rai, J. K., & Flaro, L. (2017b). Embedded validity indicators in Conners’ CPT-II: do adult cutoffs work the same way in children? Applied Neuropsychology: Child, 6(4), 335–363. https://doi.org/10.1080/21622965.2016.1198908.

    Article  Google Scholar 

  • Erdodi, L. A., Nussbaum, S., Sagar, S., Abeare, C. A., & Schwartz, E. S. (2017c). Limited English proficiency increases failure rates on performance validity tests with high verbal mediation. Psychological Injury and Law, 10(1), 96–103.

    Article  Google Scholar 

  • Fletcher, J. M., & Taylor, H. G. (1984). Neuropsychological approaches to children: towards a developmental neuropsychology. Journal of Clinical Neuropsychology, 6(1), 39–56.

    Article  PubMed  Google Scholar 

  • Gathercole, S. E., Pickering, S. J., Ambridge, B., & Wearing, H. (2004). The structure of working memory from 4 to 15 years of age. Developmental Psychology, 40(2), 177–190.

    Article  PubMed  Google Scholar 

  • Green, P. (2003). Green’s Word Memory Test. Edmonton: Green’s Publishing.

    Google Scholar 

  • Green, P. (2004). Green’s Medical Symptom Validity Test. Edmonton, Green’s Publishing.

    Google Scholar 

  • Green, P., & Flaro, L. (2003). Word Memory Test performance in children. Child Neuropsychology, 9, 189–207.

    Article  PubMed  Google Scholar 

  • Green, P., Flaro, L., Brockhaus, R., & Montijo, J. (2012). Performance on the WMT, MSVT, & NV-MSVT in children with developmental disabilities and in adults with mild traumatic brain injury. In C. R. Reynolds & A. Horton (Eds.), Detection of malingering during head injury litigation (2nd ed., pp. 201–219). New York: Plenum Press.

    Chapter  Google Scholar 

  • Greve, K. W., Bianchini, K. J., & Doane, B. M. (2006). Classification accuracy of the Test of Memory Malingering in traumatic brain injury: results of a known-group analysis. Journal of Clinical and Experimental Neuropsychology, 28(7), 1176–1190.

    Article  PubMed  Google Scholar 

  • Greve, K. W., Etherton, J. L., Ord, J., Bianchini, K. J., & Curtis, K. L. (2009). Detecting malingered pain-related disability: classification accuracy of the Test of Memory Malingering. The Clinical Neuropsychologist, 16(2), 179–191.

    Article  Google Scholar 

  • Grimes, D. A., & Schulz, K. F. (2005). Refining clinical diagnosis with likelihood ratios. The Lancet, 365(9469), 1500–1505.

    Article  Google Scholar 

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Participants, C. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129. https://doi.org/10.1080/13854040903155063.

    Article  PubMed  Google Scholar 

  • Heinly, M. T., Greve, K. W., Bianchini, K., Love, J. M., & Brennan, A. (2005). WAIS Digit-Span-based indicators of malingered neurocognitive dysfunction: classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444.

    Article  PubMed  Google Scholar 

  • Hilsabeck, R. C., Gordon, S. N., Hietpas-Wilson, T., & Zartman, A. L. (2011). Use of Trial 1 of the Test of Memory Malingering (TOMM) as a screening measure of effort: suggested discontinuation rules. The Clinical Neuropsychologist, 25(7), 1228–1238.

    Article  PubMed  Google Scholar 

  • Jones, A. (2013). Test of memory malingering: cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059.

    Article  PubMed  Google Scholar 

  • Kirk, J. W., Harris, B., Hutaff-Lee, C. F., Koelemay, S. W., Dinkins, J. P., & Kirkwood, M. W. (2011). Performance on the Test of Memory Malingering (TOMM) among a large clinic-referred pediatric sample. Child Neuropsychology, 17(3), 242–254.

    Article  PubMed  Google Scholar 

  • Kirkwood, M. W. (2015). Validity testing in child and adolescent assessment. New York: Guilford.

    Google Scholar 

  • Kirkwood, M. W., & Kirk, J. W. (2010). The base rate of suboptimal effort in a pediatric mild TBI sample: performance on the Medical Symptom Validity Test. The Clinical Neuropsychologist, 24, 860–872.

    Article  PubMed  Google Scholar 

  • Kirkwood, M. W., Hargrave, D. D., & Kirk, J. W. (2011). The value of the WISC-IV digit span subtest in detecting noncredible effort performance during pediatric neuropsychological examinations. Archives of Clinical Neuropsychology, 26, 377–384.

    Article  PubMed  Google Scholar 

  • Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental Test of Memory Malingering Scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244.

    Article  Google Scholar 

  • Lange, R. T., & Lippa, S. M. (2017). Sensitivity and specificity should never be interpreted in isolation without consideration of other clinical utility metrics. The Clinical Neuropsychologist, 31, 1015–1028.

    Article  PubMed  Google Scholar 

  • Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089.

    Article  PubMed  Google Scholar 

  • Larrabee, G. J. (2007). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: a scientific approach. New York: Oxford University Press.

    Google Scholar 

  • Lichtenstein, J. D., Erdodi, L. A., & Linnea, K. S. (2017). Introducing a forced-choice recognition task to the California Verbal Learning Test – Children’s Version. Child Neuropsychology, 23(3), 284–299. https://doi.org/10.1080/09297049.2015.1135422.

    Article  PubMed  Google Scholar 

  • Lichtenstein, J. D., Erdodi, L. A., Rai, J. K., Mazur-Mosiewicz, A., & Flaro, L. (2018). Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children. Child Neuropsychology, 24(2), 247–260. https://doi.org/10.1080/09297049.2016.1259402.

    Article  PubMed  Google Scholar 

  • Loring, D. W., Lee, G. P., & Meador, K. J. (2005). Victoria Symptom Validity Test performance in non-litigating epilepsy surgery candidates. Journal of Clinical and Experimental Neuropsychology, 27(5), 610–617.

    Article  PubMed  Google Scholar 

  • Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102.

    Article  PubMed  Google Scholar 

  • Nelson, N. W., Boone, K., Dueck, A., Wagener, L., Lu, P., & Grills, C. (2003). The relationship between eight measures of suspect effort. The Clinical Neuropsychologist, 17(2), 263–272.

    Article  PubMed  Google Scholar 

  • O’Bryant, S. E., Hilsabeck, R. C., Fisher, J. D., & McCaffrey, R. J. (2003). Utility of the Trail Making Test in the assessment of malingering in a sample of mild traumatic brain injury litigants. The Clinical Neuropsychologist, 17(1), 69–74. https://doi.org/10.1076/clin.17.1.69.15624.

    Article  PubMed  Google Scholar 

  • O’Bryant, S. E., Gavett, B. E., McCaffrey, R. J., O’Jile, J. R., Huerkamp, J. K., Smitherman, T. A., & Humpreys, J. D. (2008). Clinical utility of Trial 1 of the Test of Memory Malingering (TOMM). Applied Neuropsychology, 15, 113–116.

    Article  PubMed  Google Scholar 

  • Pearson (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV—technical manual. San Antonio, TX: Author.

  • Ploetz, D. M., Mosiewicz, A. M., Kirkwood, M. W., Sherman, E. S., & Brooks, B. L. (2014). Performance on the Test of Memory Malingering in children with neurological conditions. Child Neuropsychology, 22(2), 133–142.

    Article  PubMed  Google Scholar 

  • Reese, C. S., Suhr, J. A., & Riddle, T. L. (2012). Exploration of malingering indices in the Wechsler Adult Intelligence Scale – Fourth Edition Digit Span subtest. Archives of Clinical Neuropsychology, 27, 176–181.

    Article  PubMed  Google Scholar 

  • Rey, A. (1964). L’examen clinique en psychologie. Paris: Presses Universitaires de France.

    Google Scholar 

  • Reznek, L. (2005). The Rey 15-item memory test for malingering: a meta-analysis. Brain Injury, 19(7), 539–543. https://doi.org/10.1080/02699050400005242.

    Article  PubMed  Google Scholar 

  • Robles, L., López, E., Salazar, X., Boone, K. B., & Glaser, D. F. (2015). Specificity data for the b Test, Dot Counting Test, Rey-15 Item Plus Recognition, and Rey Word Recognition Test in monolingual Spanish-speakers. Journal of Clinical and Experimental Neuropsychology, 37(6), 614–621. https://doi.org/10.1080/13803395.2015.1039961.

    Article  PubMed  Google Scholar 

  • Schwartz, E. S., Erdodi, L., Rodriguez, N., Jyotsna, J. G., Curtain, J. R., Flashman, L. A., & Roth, R. M. (2016). CVLT-II forced choice recognition trial as an embedded validity indicator: a systematic review of the evidence. Journal of the International Neuropsychological Society, 22(8), 851–858. https://doi.org/10.1017/S1355617716000746.

    Article  PubMed  Google Scholar 

  • Sherman, E.M.S., & Brooks, B.L. (2015). Children and Adolescent Memory Profile (ChAMP) professional manual. Lutz, FL: PAR.

  • Slick, D. J., Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561.

    Article  PubMed  Google Scholar 

  • Statistics Canada. (2011). 2011 census handbook. Ottawa, ON: Statistics Canada. Available at: http://www12.statcan.gc.ca/census-recensement/2011/dp-pd/index-eng.cfm; accessed March 13, 2016.

  • Stenclik, J. H., Miele, A. S., Silk-Eglit, G., Lynch, J. K., & McCaffrey, R. J. (2013). Can the sensitivity and specificity of the TOMM be increased with different cut-off scores? Applied Neuropsychology: Adult, 20(4), 243–248.

    Article  Google Scholar 

  • Sussman, Z. W., Peterson, R. L., Connery, A., K., Baker, D. A., & Kirkwood, M. W. (2017). Utility of Matrix Reasoning as an embedded performance validity indicator in pediatric mild traumatic brain injury. Advanced online publication. Applied Neuropsychology: Child.

  • Tombaugh, T. N. (1996). Test of memory malingering. New York: Multi-Health Systems.

    Google Scholar 

  • U.S. Census Bureau. (2013). 2009–2013 American community survey. Washington, D.C.: Bureau of the Census. Available at: http://www.census.gov/data/tables/2013/demo/2009-2013-lang-tables.html; accessed March 13, 2016.

  • Vanbinst, K., Ceulemans, E., Peters, L., Ghesquiere, P., & De Smedt, B. (2018). Developmental trajectories of children’s symbolic numerical magnitude processing skills and associated cognitive competences. Journal of Experimental Child Psychology, 166, 232–250.

    Article  PubMed  Google Scholar 

  • Welsh, A.J., Bender, H.A., Whitman, L.A., Vasserman, M., & W.S. (2012). Clinical utility of reliable digit span in assessing effort in children and adolescents with epilepsy. Archives of Clinical Neuropsychology, 27(7), 735–741.

Download references

Author information

Authors and Affiliations

  1. Pediatric Neuropsychological Services, Dartmouth-Hitchcock Medical Center, Dartmouth’s Geisel School of Medicine, Lebanon, NH, USA

    Jonathan D. Lichtenstein

  2. Jefferson Neurobehavioral Group, Clinical Psychology, TCSPP at Xavier University of Louisiana, New Orleans, LA, USA

    Matthew Holcomb

  3. Department of Psychology, Neuropsychology Track, University of Windsor, 401 Sunset Aveue, Windsor, Ontario, N9B 3P4, Canada

    Laszlo A. Erdodi

Authors
  1. Jonathan D. Lichtenstein
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthew Holcomb
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Laszlo A. Erdodi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jonathan D. Lichtenstein.

Ethics declarations

For this type of study, formal consent is not required. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Conflict of Interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lichtenstein, J.D., Holcomb, M. & Erdodi, L.A. One-Minute PVT: Further Evidence for the Utility of the California Verbal Learning Test—Children’s Version Forced Choice Recognition Trial. J Pediatr Neuropsychol 4, 94–104 (2018). https://doi.org/10.1007/s40817-018-0057-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40817-018-0057-4

Keywords

Search

Navigation