Skip to main content

Advertisement

Log in

Invited Commentary: Advancing but not yet Advanced: Assessment of Effort/Malingering in Forensic and Clinical Settings

  • Review
  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

Neuropsychologists’ conclusions and courtroom testimony on malingering can have profound impact. Intensive and ingenious research has advanced our capacities to identify both insufficient and sufficient effort and thus make worthy contributions to just conflict resolution. Nevertheless, given multiple converging factors, such as misleadingly high accuracy rates in many studies, practitioners may well develop inflated confidence in methods for evaluating effort/malingering. Considerable research shows that overconfidence often increases diagnostic and predictive error and may lead to fixed conclusions when caution is better advised. Leonhard’s work thus performs an important service by alerting us to methodological considerations and shortcomings that can generate misimpressions about the efficacy of effort/malingering assessment. The present commentary covers various additional complicating factors in malingering assessment, including other factors that also inflate confidence; subtle and perhaps underappreciated methodological flaws that are inversely related to positive study outcomes (i.e., the worse the flaws the better methods appear to be); oversimplified classifications schemes for studying and evaluating effort that overlook, for example, common mixed presentations (e.g., malingering and genuinely injured); and the need to expand research across a greater range and severity of neuropsychological conditions and diverse groups. More generally, although endorsing various points that Leonhard raises, a number of questions and concerns are presented, such as methods for calculating the impact of case exclusions in studies. Ultimately, although Leonhard’s conclusions may be more negative than is justified, it seems fair to categorize methods for assessing malingering/effort as advancing, but not yet advanced, with much more needed to be done to approach that latter status.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Availability of Data and Materials

Not applicable.

References

  • Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., ... & Rush, J. D. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist34(3), 341–382. https://doi.org/10.1177/0011000005285875

  • Bhowmick, C., Hirst, R., & Green, P. (2021). Comparison of the Word Memory Test and the Test of Memory Malingering in detecting invalid performance in neuropsychological testing. Applied Neuropsychology: Adult, 28(4), 486–496. https://doi.org/10.1080/23279095.2019.1658585

    Article  PubMed  Google Scholar 

  • Clark, A. L., Amick, M. M., Fortier, C., Milberg, W. P., & McGlinchey, R. E. (2014). Poor performance validity predicts clinical characteristics and cognitive test performance of OEF/OIF/OND veterans in a research setting. The Clinical Neuropsychologist, 28(5), 802–825. https://doi.org/10.1080/13854046.2014.904928

    Article  PubMed  Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957

    Article  CAS  PubMed  Google Scholar 

  • Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgement. Science, 243(4899), 1668–1674. https://doi.org/10.1126/science.2648573

    Article  CAS  PubMed  Google Scholar 

  • Faust, D., & Ahern, D. C. (2012). Clinical judgment and prediction. In D. Faust (Ed.), Coping with psychiatric and psychological testimony (6th ed.) (pp. 147–208). Oxford University Press. https://doi.org/10.1093/med:psych/9780195174113.003.0009

  • Faust, D., Arkes, H. R., & Gaudet, C. E. (in press). Applying decision research to improve clinical outcomes, psychological assessment, and clinical prediction. Oxford University Press.

  • Faust, D., & Furman, A. (2022). When clinical judgment and science conflict, how does one decide? The epistemological status of learning from experience vs. science. In C.L. Cobb, S.J. Lynn, & W. O’Donohue (Eds.), Toward a Science of Clinical Psychology: A Tribute to the Life and Works of Scott O. Lilienfeld (pp. 71–104). Springer, Cham. https://doi.org/10.1007/978-3-031-14332-8_5

  • Faust, D., Gaudet, C. E., Ahern, D. C., & Bridges, A. J. (2021). Assessment of malingering and falsification: Continuing to push the boundaries of knowledge in research and clinical practice. In A.M. Horton & C.R. Reynolds (Eds.), Detection of malingering during head injury litigation (Volume 1, pp. 1–156.) Springer, Cham. https://doi.org/10.1007/978-3-030-54656-4_1

  • Faust, D., Hart, K., & Guilmette, T. J. (1988). Pediatric malingering: The capacity of children to fake believable deficits on neuropsychological testing. Journal of Consulting and Clinical Psychology, 56(4), 578. https://doi.org/10.1037//0022-006x.56.4.578

    Article  CAS  PubMed  Google Scholar 

  • Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19–30. https://doi.org/10.1037/1040-3590.12.1.19

    Article  CAS  PubMed  Google Scholar 

  • Guay, J. P., & Parent, G. (2018). Broken legs, clinical overrides, and recidivism risk: An analysis of decisions to adjust risk levels with the LS/CMI. Criminal Justice and Behavior, 45(1), 82–100. https://doi.org/10.1177/0093854817719482

    Article  Google Scholar 

  • Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (2004). Adapting educational and psychological tests for cross-cultural assessment. Psychology Press. https://doi.org/10.4324/9781410611758

    Article  Google Scholar 

  • Heaton, R. K., Ryan, L., & Grant, I. (2009). Demographic influences and use of demographically corrected norms in neuropsychological assessment. In I. Grant & K. M. Adams (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (pp. 127–155). Oxford University Press.

    Google Scholar 

  • Jewsbury, P. A. (2023). Invited commentary: Bayesian inference with multiple tests.

  • Jewsbury, P. A., & Bowden, S. C. (2014). A description of mixed group validation. Assessment, 21(2), 170–180. https://doi.org/10.1177/1073191112473176

    Article  PubMed  Google Scholar 

  • Kovach, S. (2017). The effect of coaching on the ability to identify and pass a measure of insufficient effort. (Unpublished master’s thesis). University of Rhode Island.

  • Krauss, D. A. (2004). Adjusting risk of recidivism: Do judicial departures worsen or improve recidivism prediction under the Federal Sentencing Guidelines? Behavioral Sciences & the Law, 22(6), 731–750. https://doi.org/10.1002/bsl.609

    Article  Google Scholar 

  • Leonhard, C. (2023). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part I: Statistical issues. Neuropsychology Review.

  • Miller, D. J., Spengler, E. S., & Spengler, P. M. (2015). A meta-analysis of confidence and judgment accuracy in clinical decision making. Journal of Counseling Psychology, 62(4), 553–567. https://doi.org/10.1037/cou0000105

    Article  PubMed  Google Scholar 

  • Mulenga, K., Ahonen, T., & Aro, M. (2001). Performance of Zambian children on the NEPSY: A pilot study. Developmental Neuropsychology, 20(1), 375–383. https://doi.org/10.1207/S15326942DN2001_4

    Article  CAS  PubMed  Google Scholar 

  • Schmidt, F., Sinclair, S. M., & Thomasdóttir, S. (2016). Predictive validity of the youth level of service/case management inventory with youth who have committed sexual and non-sexual offenses: The utility of professional override. Criminal Justice and Behavior, 43(3), 413–430. https://doi.org/10.1177/0093854815603389

    Article  Google Scholar 

  • Sherry, N., Ernst, N., French, J. E., Eagle, S., Collins, M., & Kontos, A. (2022). Performance validity testing in patients presenting to a specialty clinic with a mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 37(3), E135–E143. https://doi.org/10.1097/HTR.0000000000000692

    Article  PubMed  Google Scholar 

  • Sieck, W. R., & Arkes, H. R. (2005). The recalcitrance of overconfidence and its contribution to decision aid neglect. Journal of Behavioral Decision Making, 18(1), 29–53. https://doi.org/10.1002/bdm.486

    Article  Google Scholar 

  • Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17(4), 396–408. https://doi.org/10.1037/1040-3590.17.4.396

    Article  PubMed  Google Scholar 

  • Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1–25. https://doi.org/10.1146/annurev.clinpsy.032408.153639

    Article  PubMed  PubMed Central  Google Scholar 

  • Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., ... & Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036

  • Tombaugh, T. N. (1996). Test of memory malingering. Multi-Health Systems.

  • Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644. https://doi.org/10.2466/02.07.17.PR0.110.2.639-644

    Article  PubMed  Google Scholar 

  • Weschler, D. (2008). WAIS-IV technical and interpretive manual. Pearson.

  • Wormith, J. S., Hogg, S., & Guzzo, L. (2012). The predictive validity of a general risk/needs assessment inventory on sexual offender recidivism and an exploration of the professional override. Criminal Justice and Behavior, 39(12), 1511–1538. https://doi.org/10.1177/0093854812455741

    Article  Google Scholar 

Download references

Acknowledgements

I wish to express my thanks to Kathleen Monahan for her invaluable help in the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Not applicable.

Corresponding author

Correspondence to David Faust.

Ethics declarations

Ethical Approval

Not applicable.

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Faust, D. Invited Commentary: Advancing but not yet Advanced: Assessment of Effort/Malingering in Forensic and Clinical Settings. Neuropsychol Rev 33, 628–642 (2023). https://doi.org/10.1007/s11065-023-09605-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11065-023-09605-3

Keywords

Navigation