Abstract
The thoughtful commentaries in this volume of Drs. Bush, Jewsbury, and Faust add to the impact of the two reviews in this volume of statistical and methodological issues in the forensic neuropsychological determination of malingering based on performance and symptom validity tests (PVTs and SVTs). In his commentary, Dr. Bush raises, among others, the important question of whether such malingering determinations can still be considered as meeting the legal Daubert standard which is the basis for neuropsychological expert testimony. Dr. Jewsbury focuses mostly on statistical issues and agrees with two key points of the statistical review: Positive likelihood chaining is not a mathematically tenable method to combine findings of multiple PVTs and SVTs, and the Simple Bayes method is not applicable to malingering determinations. Dr. Faust adds important narrative texture to the implications for forensic neuropsychological practice and points to a need for research into factors other than malingering that may explain PVT and SVT failures. These commentaries put into even sharper focus the serious questions raised in the reviews about the scientific basis of present practices in the forensic neuropsychological determination of malingering.
Similar content being viewed by others
Data Availability
Not applicable.
References
Al-Khairullah, N. A., & Al-Baldawi, T. H. K. (2021). Bayesian computational methods of the logistic regression model. Journal of Physics: Conference Series, 1804(1), 012073. https://doi.org/10.1088/1742-6596/1804/1/012073
Batt, K., Shores, E. A., & Chekaluk, E. (2008). The effect of distraction on the Word Memory Test and Test of Memory Malingering performance in patients with a severe brain injury. Journal of the International Neuropsychological Society : JINS, 14(6), 1074–1080. https://doi.org/10.1017/S135561770808137X
Bayman, E. O., & Dexter, F. (2021). Multicollinearity in logistic regression models. Anesthesia and Analgesia, 133(2), 362–365. https://doi.org/10.1213/ANE.0000000000005593
Bender, S. D., & Frederick, R. (2018). Neuropsychological models of feigned cognitive deficits. In S. D. Bender & R. Rogers (Eds.), Clinical assessment of malingering and deception (Fourth edition., pp. 42–60). The Guilford Press.
Bevilacqua, D., Davidesco, I., Wan, L., Chaloner, K., Rowland, J., Ding, M., Poeppel, D., & Dikker, S. (2019). Brain-to-brain synchrony and learning outcomes vary by student–teacher dynamics: Evidence from a real-world classroom electroencephalography study. Journal of Cognitive Neuroscience, 31(3), 401–411. https://doi.org/10.1162/jocn_a_01274
Bolstad, W. M., & Curran, J. M. (2016). Introduction to Bayesian statistics (Third edition.). Wiley Blackwell.
Bush, S. S. (2023). Questioning what we thought we knew: Commentary on Leonhard’s performance validity assessment articles. Neuropsychology Review.
Chafetz, M. D. (2020). Deception is different: Negative validity test findings do not provide “evidence” for “good effort.” The Clinical Neuropsychologist, 1–37. https://doi.org/10.1080/13854046.2020.1840633
Chatterjee, S., & Simonoff, J. S. (2012). Handbook of regression analysis. John Wiley & Sons.
Chen, E. H., & Bailey, D. H. (2020). Dual-task studies of working memory and arithmetic performance: A meta-analysis. Journal of Experimental Psychology. Learning, Memory, and Cognition. https://doi.org/10.1037/xlm0000822
COPE Council. (2019). COPE retraction guidelines—English. Committee on Publication Ethics. https://doi.org/10.24318/cope.2019.1.4
Domingos, P., & Pazzani, M. (1997). On the optimality of the Simple Bayesian Classifier under zero-one loss. Machine Learning, 29, 103–130.
Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119
Faust, D. (2023). Invited Commentary: Advancing but not yet advanced: Assessment of effort/malingering in forensic and clinical settings. Neuropsychology Review.
Fox, J. (1991). Regression Diagnostics. SAGE Publications, Inc. https://doi.org/10.4135/9781412985604
Hand, D. J., & Yu, K. (2001). Idiot’s Bayes: Not so stupid after all? International Statistical Review / Revue Internationale De Statistique, 69(3), 385–398. https://doi.org/10.2307/1403452
Henry, G. K., Heilbronner, R. L., Suhr, G., & J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society: JINS, 24(7), 735–745. https://doi.org/10.1017/S1355617718000218
Heyselaar, E., & Segaert, K. (2019). Memory encoding of syntactic information involves domain-general attentional resources: Evidence from dual-task studies. Quarterly Journal of Experimental Psychology, 72(6), 1285–1296. https://doi.org/10.1177/1747021818801249
Hidalgo, V., Pulopulos, M. M., & Salvador, A. (2019). Acute psychosocial stress effects on memory performance: Relevance of age and sex. Neurobiology of Learning and Memory, 157, 48–60. https://doi.org/10.1016/j.nlm.2018.11.013
Hocking, R. R. (2013). Methods and applications of linear models: Regression and the analysis of variance. John Wiley & Sons.
Jewsbury, P. (2023). Inference with multiple tests: Commentary to Leonhard. Neuropsychology Review.
Kazdin, A. E. (2017). Research Design in Clinical Psychology (5th ed.). Pearson.
Larrabee, G. J., Greiffenstein, M. F., Greve, K. W., & Bianchini, K. J. (2007). Redefining diagnostic criteria for malingering. In G. J. Larrabee (Ed.), Assessment of malingered neuropsychological deficits. Oxford University Press.
Larrabee, G. J., Rohling, M. L., & Meyers, J. E. (2019). Use of multiple performance and symptom validity measures: Determining the optimal per test cutoff for determination of invalidity, analysis of skew, and inter-test correlations in valid and invalid performance groups. The Clinical Neuropsychologist, 33(8), 1354–1372. https://doi.org/10.1080/13854046.2019.1614227
Leonhard, C. (2023a). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part I: Statistical issues. Neuropsychology Review.
Leonhard, C. (2023b). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part II: Methodological issues. Neuropsychology Review.
Leonhard, C., & Leonhard, C. (2023). Neuropsychological malingering determinations: Science or fiction of lie detection? Georgia Law Review, 58(2).
Risk Assessment Workgroup. (2013). Assessing Cardiovascular Risk (p. 139). National Heart, Lung, and Blood Institute. Retrieved May 5, 2023, from https://www.nhlbi.nih.gov/sites/default/files/media/docs/risk-assessment.pdf
Roor, J. J., Peters, M. J. V., Dandachi-FitzGerald, B., & Ponds, R. W. H. M. (2023). Performance validity test failure in the clinical population: A systematic review and meta-analysis of prevalence rates. Neuropsychology Review. https://doi.org/10.1007/s11065-023-09582-7
Samaras, T. T., & Storms, L. H. (1992). Impact of height and weight on life span. Bulletin of the World Health Organization, 70(2), 259–267.
Schroeder, R. W., Martin, P. K., & Odland, A. P. (2016). Expert beliefs and practices regarding neuropsychological validity testing. Clinical Neuropsychologist, 30(4), 515–535. https://doi.org/10.1080/13854046.2016.1177118
Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, acaa019. https://doi.org/10.1093/arclin/acaa019
Stuldreher, I. V., Thammasan, N., Erp, J. B. F. van, & Brouwer, A.-M. (2020). Physiological synchrony in EEG, electrodermal activity and heart rate reflects shared selective auditory attention. Journal of Neural Engineering, 17(4), 046028. https://doi.org/10.1088/1741-2552/aba87d
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwood, M. W., Schroeder, R. W., & Suhr, J. A. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
Wirth, R., Janczyk, M., & Kunde, W. (2018). Effect monitoring in dual-task performance. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(4), 553–571. https://doi.org/10.1037/xlm0000474
Witteveen, A., Nane, G. F., Vliegen, I. M. H., Siesling, S., & IJzerman, M. J. (2018). Comparison of logistic regression and Bayesian networks for risk prediction of breast cancer recurrence. Medical Decision Making, 38(7), 822–833. https://doi.org/10.1177/0272989X18790963
Yerkes, R. M., & Dodson, J. D. (1908). The relation of strength of stimulus to rapidity of habit formation. Journal of Comparative Neurology and Psychology, 18, 459–482. https://doi.org/10.1002/cne.920180503
Zadora, G., Martyna, A., Ramos, D., & Aitken, C. (2014). Statistical analysis in forensic science: Evidential value of multivariate physicochemical data. John Wiley & Sons Inc.
Author information
Authors and Affiliations
Contributions
Not applicable because this manuscript has only a single author.
Corresponding author
Ethics declarations
Ethics Approval
Not applicable because this is a reply to commentaries and not a study where human or animal data were collected.
Competing Interests
The author declares no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Leonhard, C. Quo Vadis Forensic Neuropsychological Malingering Determinations? Reply to Drs. Bush, Faust, and Jewsbury. Neuropsychol Rev 33, 653–657 (2023). https://doi.org/10.1007/s11065-023-09606-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11065-023-09606-2