Skip to main content
Log in

Quo Vadis Forensic Neuropsychological Malingering Determinations? Reply to Drs. Bush, Faust, and Jewsbury

  • Review
  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

The thoughtful commentaries in this volume of Drs. Bush, Jewsbury, and Faust add to the impact of the two reviews in this volume of statistical and methodological issues in the forensic neuropsychological determination of malingering based on performance and symptom validity tests (PVTs and SVTs). In his commentary, Dr. Bush raises, among others, the important question of whether such malingering determinations can still be considered as meeting the legal Daubert standard which is the basis for neuropsychological expert testimony. Dr. Jewsbury focuses mostly on statistical issues and agrees with two key points of the statistical review: Positive likelihood chaining is not a mathematically tenable method to combine findings of multiple PVTs and SVTs, and the Simple Bayes method is not applicable to malingering determinations. Dr. Faust adds important narrative texture to the implications for forensic neuropsychological practice and points to a need for research into factors other than malingering that may explain PVT and SVT failures. These commentaries put into even sharper focus the serious questions raised in the reviews about the scientific basis of present practices in the forensic neuropsychological determination of malingering.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Data Availability

Not applicable.

References

  • Al-Khairullah, N. A., & Al-Baldawi, T. H. K. (2021). Bayesian computational methods of the logistic regression model. Journal of Physics: Conference Series, 1804(1), 012073. https://doi.org/10.1088/1742-6596/1804/1/012073

  • Batt, K., Shores, E. A., & Chekaluk, E. (2008). The effect of distraction on the Word Memory Test and Test of Memory Malingering performance in patients with a severe brain injury. Journal of the International Neuropsychological Society : JINS, 14(6), 1074–1080. https://doi.org/10.1017/S135561770808137X

    Article  PubMed  Google Scholar 

  • Bayman, E. O., & Dexter, F. (2021). Multicollinearity in logistic regression models. Anesthesia and Analgesia, 133(2), 362–365. https://doi.org/10.1213/ANE.0000000000005593

    Article  PubMed  Google Scholar 

  • Bender, S. D., & Frederick, R. (2018). Neuropsychological models of feigned cognitive deficits. In S. D. Bender & R. Rogers (Eds.), Clinical assessment of malingering and deception (Fourth edition., pp. 42–60). The Guilford Press.

  • Bevilacqua, D., Davidesco, I., Wan, L., Chaloner, K., Rowland, J., Ding, M., Poeppel, D., & Dikker, S. (2019). Brain-to-brain synchrony and learning outcomes vary by student–teacher dynamics: Evidence from a real-world classroom electroencephalography study. Journal of Cognitive Neuroscience, 31(3), 401–411. https://doi.org/10.1162/jocn_a_01274

    Article  PubMed  Google Scholar 

  • Bolstad, W. M., & Curran, J. M. (2016). Introduction to Bayesian statistics (Third edition.). Wiley Blackwell.

  • Bush, S. S. (2023). Questioning what we thought we knew: Commentary on Leonhard’s performance validity assessment articles. Neuropsychology Review.

  • Chafetz, M. D. (2020). Deception is different: Negative validity test findings do not provide “evidence” for “good effort.” The Clinical Neuropsychologist, 1–37. https://doi.org/10.1080/13854046.2020.1840633

  • Chatterjee, S., & Simonoff, J. S. (2012). Handbook of regression analysis. John Wiley & Sons.

    Book  Google Scholar 

  • Chen, E. H., & Bailey, D. H. (2020). Dual-task studies of working memory and arithmetic performance: A meta-analysis. Journal of Experimental Psychology. Learning, Memory, and Cognition. https://doi.org/10.1037/xlm0000822

    Article  PubMed  Google Scholar 

  • COPE Council. (2019). COPE retraction guidelines—English. Committee on Publication Ethics. https://doi.org/10.24318/cope.2019.1.4

  • Domingos, P., & Pazzani, M. (1997). On the optimality of the Simple Bayesian Classifier under zero-one loss. Machine Learning, 29, 103–130.

    Article  Google Scholar 

  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119

    Article  PubMed  Google Scholar 

  • Faust, D. (2023). Invited Commentary: Advancing but not yet advanced: Assessment of effort/malingering in forensic and clinical settings. Neuropsychology Review.

  • Fox, J. (1991). Regression Diagnostics. SAGE Publications, Inc. https://doi.org/10.4135/9781412985604

  • Hand, D. J., & Yu, K. (2001). Idiot’s Bayes: Not so stupid after all? International Statistical Review / Revue Internationale De Statistique, 69(3), 385–398. https://doi.org/10.2307/1403452

    Article  Google Scholar 

  • Henry, G. K., Heilbronner, R. L., Suhr, G., & J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society: JINS, 24(7), 735–745. https://doi.org/10.1017/S1355617718000218

    Article  PubMed  Google Scholar 

  • Heyselaar, E., & Segaert, K. (2019). Memory encoding of syntactic information involves domain-general attentional resources: Evidence from dual-task studies. Quarterly Journal of Experimental Psychology, 72(6), 1285–1296. https://doi.org/10.1177/1747021818801249

    Article  Google Scholar 

  • Hidalgo, V., Pulopulos, M. M., & Salvador, A. (2019). Acute psychosocial stress effects on memory performance: Relevance of age and sex. Neurobiology of Learning and Memory, 157, 48–60. https://doi.org/10.1016/j.nlm.2018.11.013

    Article  PubMed  Google Scholar 

  • Hocking, R. R. (2013). Methods and applications of linear models: Regression and the analysis of variance. John Wiley & Sons.

    Google Scholar 

  • Jewsbury, P. (2023). Inference with multiple tests: Commentary to Leonhard. Neuropsychology Review.

  • Kazdin, A. E. (2017). Research Design in Clinical Psychology (5th ed.). Pearson.

  • Larrabee, G. J., Greiffenstein, M. F., Greve, K. W., & Bianchini, K. J. (2007). Redefining diagnostic criteria for malingering. In G. J. Larrabee (Ed.), Assessment of malingered neuropsychological deficits. Oxford University Press.

  • Larrabee, G. J., Rohling, M. L., & Meyers, J. E. (2019). Use of multiple performance and symptom validity measures: Determining the optimal per test cutoff for determination of invalidity, analysis of skew, and inter-test correlations in valid and invalid performance groups. The Clinical Neuropsychologist, 33(8), 1354–1372. https://doi.org/10.1080/13854046.2019.1614227

    Article  PubMed  Google Scholar 

  • Leonhard, C. (2023a). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part I: Statistical issues. Neuropsychology Review.

  • Leonhard, C. (2023b). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part II: Methodological issues. Neuropsychology Review.

  • Leonhard, C., & Leonhard, C. (2023). Neuropsychological malingering determinations: Science or fiction of lie detection? Georgia Law Review, 58(2).

  • Risk Assessment Workgroup. (2013). Assessing Cardiovascular Risk (p. 139). National Heart, Lung, and Blood Institute. Retrieved May 5, 2023, from https://www.nhlbi.nih.gov/sites/default/files/media/docs/risk-assessment.pdf

  • Roor, J. J., Peters, M. J. V., Dandachi-FitzGerald, B., & Ponds, R. W. H. M. (2023). Performance validity test failure in the clinical population: A systematic review and meta-analysis of prevalence rates. Neuropsychology Review. https://doi.org/10.1007/s11065-023-09582-7

    Article  PubMed  Google Scholar 

  • Samaras, T. T., & Storms, L. H. (1992). Impact of height and weight on life span. Bulletin of the World Health Organization, 70(2), 259–267.

    CAS  PubMed  PubMed Central  Google Scholar 

  • Schroeder, R. W., Martin, P. K., & Odland, A. P. (2016). Expert beliefs and practices regarding neuropsychological validity testing. Clinical Neuropsychologist, 30(4), 515–535. https://doi.org/10.1080/13854046.2016.1177118

    Article  PubMed  Google Scholar 

  • Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, acaa019. https://doi.org/10.1093/arclin/acaa019

  • Stuldreher, I. V., Thammasan, N., Erp, J. B. F. van, & Brouwer, A.-M. (2020). Physiological synchrony in EEG, electrodermal activity and heart rate reflects shared selective auditory attention. Journal of Neural Engineering, 17(4), 046028. https://doi.org/10.1088/1741-2552/aba87d

  • Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwood, M. W., Schroeder, R. W., & Suhr, J. A. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036

    Article  PubMed  Google Scholar 

  • Wirth, R., Janczyk, M., & Kunde, W. (2018). Effect monitoring in dual-task performance. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(4), 553–571. https://doi.org/10.1037/xlm0000474

    Article  PubMed  Google Scholar 

  • Witteveen, A., Nane, G. F., Vliegen, I. M. H., Siesling, S., & IJzerman, M. J. (2018). Comparison of logistic regression and Bayesian networks for risk prediction of breast cancer recurrence. Medical Decision Making, 38(7), 822–833. https://doi.org/10.1177/0272989X18790963

    Article  PubMed  Google Scholar 

  • Yerkes, R. M., & Dodson, J. D. (1908). The relation of strength of stimulus to rapidity of habit formation. Journal of Comparative Neurology and Psychology, 18, 459–482. https://doi.org/10.1002/cne.920180503

    Article  Google Scholar 

  • Zadora, G., Martyna, A., Ramos, D., & Aitken, C. (2014). Statistical analysis in forensic science: Evidential value of multivariate physicochemical data. John Wiley & Sons Inc.

Download references

Author information

Authors and Affiliations

Authors

Contributions

Not applicable because this manuscript has only a single author.

Corresponding author

Correspondence to Christoph Leonhard.

Ethics declarations

Ethics Approval

Not applicable because this is a reply to commentaries and not a study where human or animal data were collected.

Competing Interests

The author declares no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leonhard, C. Quo Vadis Forensic Neuropsychological Malingering Determinations? Reply to Drs. Bush, Faust, and Jewsbury. Neuropsychol Rev 33, 653–657 (2023). https://doi.org/10.1007/s11065-023-09606-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11065-023-09606-2

Keywords

Navigation