Abstract
Neuropsychologists’ conclusions and courtroom testimony on malingering can have profound impact. Intensive and ingenious research has advanced our capacities to identify both insufficient and sufficient effort and thus make worthy contributions to just conflict resolution. Nevertheless, given multiple converging factors, such as misleadingly high accuracy rates in many studies, practitioners may well develop inflated confidence in methods for evaluating effort/malingering. Considerable research shows that overconfidence often increases diagnostic and predictive error and may lead to fixed conclusions when caution is better advised. Leonhard’s work thus performs an important service by alerting us to methodological considerations and shortcomings that can generate misimpressions about the efficacy of effort/malingering assessment. The present commentary covers various additional complicating factors in malingering assessment, including other factors that also inflate confidence; subtle and perhaps underappreciated methodological flaws that are inversely related to positive study outcomes (i.e., the worse the flaws the better methods appear to be); oversimplified classifications schemes for studying and evaluating effort that overlook, for example, common mixed presentations (e.g., malingering and genuinely injured); and the need to expand research across a greater range and severity of neuropsychological conditions and diverse groups. More generally, although endorsing various points that Leonhard raises, a number of questions and concerns are presented, such as methods for calculating the impact of case exclusions in studies. Ultimately, although Leonhard’s conclusions may be more negative than is justified, it seems fair to categorize methods for assessing malingering/effort as advancing, but not yet advanced, with much more needed to be done to approach that latter status.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of Data and Materials
Not applicable.
References
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., ... & Rush, J. D. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34(3), 341–382. https://doi.org/10.1177/0011000005285875
Bhowmick, C., Hirst, R., & Green, P. (2021). Comparison of the Word Memory Test and the Test of Memory Malingering in detecting invalid performance in neuropsychological testing. Applied Neuropsychology: Adult, 28(4), 486–496. https://doi.org/10.1080/23279095.2019.1658585
Clark, A. L., Amick, M. M., Fortier, C., Milberg, W. P., & McGlinchey, R. E. (2014). Poor performance validity predicts clinical characteristics and cognitive test performance of OEF/OIF/OND veterans in a research setting. The Clinical Neuropsychologist, 28(5), 802–825. https://doi.org/10.1080/13854046.2014.904928
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgement. Science, 243(4899), 1668–1674. https://doi.org/10.1126/science.2648573
Faust, D., & Ahern, D. C. (2012). Clinical judgment and prediction. In D. Faust (Ed.), Coping with psychiatric and psychological testimony (6th ed.) (pp. 147–208). Oxford University Press. https://doi.org/10.1093/med:psych/9780195174113.003.0009
Faust, D., Arkes, H. R., & Gaudet, C. E. (in press). Applying decision research to improve clinical outcomes, psychological assessment, and clinical prediction. Oxford University Press.
Faust, D., & Furman, A. (2022). When clinical judgment and science conflict, how does one decide? The epistemological status of learning from experience vs. science. In C.L. Cobb, S.J. Lynn, & W. O’Donohue (Eds.), Toward a Science of Clinical Psychology: A Tribute to the Life and Works of Scott O. Lilienfeld (pp. 71–104). Springer, Cham. https://doi.org/10.1007/978-3-031-14332-8_5
Faust, D., Gaudet, C. E., Ahern, D. C., & Bridges, A. J. (2021). Assessment of malingering and falsification: Continuing to push the boundaries of knowledge in research and clinical practice. In A.M. Horton & C.R. Reynolds (Eds.), Detection of malingering during head injury litigation (Volume 1, pp. 1–156.) Springer, Cham. https://doi.org/10.1007/978-3-030-54656-4_1
Faust, D., Hart, K., & Guilmette, T. J. (1988). Pediatric malingering: The capacity of children to fake believable deficits on neuropsychological testing. Journal of Consulting and Clinical Psychology, 56(4), 578. https://doi.org/10.1037//0022-006x.56.4.578
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19–30. https://doi.org/10.1037/1040-3590.12.1.19
Guay, J. P., & Parent, G. (2018). Broken legs, clinical overrides, and recidivism risk: An analysis of decisions to adjust risk levels with the LS/CMI. Criminal Justice and Behavior, 45(1), 82–100. https://doi.org/10.1177/0093854817719482
Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (2004). Adapting educational and psychological tests for cross-cultural assessment. Psychology Press. https://doi.org/10.4324/9781410611758
Heaton, R. K., Ryan, L., & Grant, I. (2009). Demographic influences and use of demographically corrected norms in neuropsychological assessment. In I. Grant & K. M. Adams (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (pp. 127–155). Oxford University Press.
Jewsbury, P. A. (2023). Invited commentary: Bayesian inference with multiple tests.
Jewsbury, P. A., & Bowden, S. C. (2014). A description of mixed group validation. Assessment, 21(2), 170–180. https://doi.org/10.1177/1073191112473176
Kovach, S. (2017). The effect of coaching on the ability to identify and pass a measure of insufficient effort. (Unpublished master’s thesis). University of Rhode Island.
Krauss, D. A. (2004). Adjusting risk of recidivism: Do judicial departures worsen or improve recidivism prediction under the Federal Sentencing Guidelines? Behavioral Sciences & the Law, 22(6), 731–750. https://doi.org/10.1002/bsl.609
Leonhard, C. (2023). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part I: Statistical issues. Neuropsychology Review.
Miller, D. J., Spengler, E. S., & Spengler, P. M. (2015). A meta-analysis of confidence and judgment accuracy in clinical decision making. Journal of Counseling Psychology, 62(4), 553–567. https://doi.org/10.1037/cou0000105
Mulenga, K., Ahonen, T., & Aro, M. (2001). Performance of Zambian children on the NEPSY: A pilot study. Developmental Neuropsychology, 20(1), 375–383. https://doi.org/10.1207/S15326942DN2001_4
Schmidt, F., Sinclair, S. M., & Thomasdóttir, S. (2016). Predictive validity of the youth level of service/case management inventory with youth who have committed sexual and non-sexual offenses: The utility of professional override. Criminal Justice and Behavior, 43(3), 413–430. https://doi.org/10.1177/0093854815603389
Sherry, N., Ernst, N., French, J. E., Eagle, S., Collins, M., & Kontos, A. (2022). Performance validity testing in patients presenting to a specialty clinic with a mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 37(3), E135–E143. https://doi.org/10.1097/HTR.0000000000000692
Sieck, W. R., & Arkes, H. R. (2005). The recalcitrance of overconfidence and its contribution to decision aid neglect. Journal of Behavioral Decision Making, 18(1), 29–53. https://doi.org/10.1002/bdm.486
Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17(4), 396–408. https://doi.org/10.1037/1040-3590.17.4.396
Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1–25. https://doi.org/10.1146/annurev.clinpsy.032408.153639
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., ... & Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
Tombaugh, T. N. (1996). Test of memory malingering. Multi-Health Systems.
Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644. https://doi.org/10.2466/02.07.17.PR0.110.2.639-644
Weschler, D. (2008). WAIS-IV technical and interpretive manual. Pearson.
Wormith, J. S., Hogg, S., & Guzzo, L. (2012). The predictive validity of a general risk/needs assessment inventory on sexual offender recidivism and an exploration of the professional override. Criminal Justice and Behavior, 39(12), 1511–1538. https://doi.org/10.1177/0093854812455741
Acknowledgements
I wish to express my thanks to Kathleen Monahan for her invaluable help in the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
Not applicable.
Corresponding author
Ethics declarations
Ethical Approval
Not applicable.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Faust, D. Invited Commentary: Advancing but not yet Advanced: Assessment of Effort/Malingering in Forensic and Clinical Settings. Neuropsychol Rev 33, 628–642 (2023). https://doi.org/10.1007/s11065-023-09605-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11065-023-09605-3