Abstract
Psychotic disorders are characterized by a generalized neurocognitive deficit (i.e., performance 1.5 SD below controls across neuropsychological domains with no specific profile of differential deficits). A motivational account of the generalized neurocognitive deficit has been proposed, which attributes poor neuropsychological testing performance to low effort. However, findings are inconsistent regarding effort test failure rate in individuals with psychotic disorders across studies (0–72%), and moderators are unclear, making it difficult to know whether the motivational explanation is viable. To address these issues, a meta-analysis was performed on data from 2205 individuals with psychotic disorders across 19 studies with 24 independent effects. Effort failure rate was examined along with moderators of effort test type, forensic status, IQ, positive symptoms, negative symptoms, diagnosis, age, gender, education, and antipsychotic use. The pooled weighted effort test failure rate was 18% across studies and there was a moderate pooled association between effort failure rate and global neurocognitive performance (r = .57). IQ and education significantly moderated failure rate. Collectively, these findings suggest that a nontrivial proportion of individuals with a psychotic disorder fail effort testing, and failure rate is associated with global neuropsychological impairment. However, given that effort tests are not immune to the effects of IQ in psychotic disorders, these results cannot attest to the viability of the motivational account of the generalized neurocognitive deficit. Furthermore, the significant moderating effect of IQ and education on effort test performance suggests that effort tests have questionable validity in this population and should be interpreted with caution.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andreasen, N. (1982). The scale for the assessment of negative symptoms (SANS). Iowa City, Iowa: The University of Iowa.
Andreasen, N. (1984). Scale for the assessment of positive symptoms (SAPS). Iowa City, University of Iowa:
Armistead-Jehle, P. (2010). Symptom validity test performance in U.S. veterans referred for evaluation of mild TBI. Applied Neuropsychology, 17(1), 52–59. https://doi.org/10.1080/09084280903526182
Armistead-Jehle, P., & Buican, B. (2012). Evaluation context and symptom validity test performance in a U.S. military sample. Archive of Clinical Neuropsychology, 27(8), 828–839. https://doi.org/10.1093/arclin/acs086
Avery, R., Startup, M., & Calabria, K. (2009). The role of effort, cognitive expectancy appraisals and coping style in the maintenance of the negative symptoms of schizophrenia (comparative study). Psychiatry Research, 167(1–2), 36–46. https://doi.org/10.1016/j.psychres.2008.04.016
Back, C., Boone, K. B., Edwards, C., Parks, C., Burgoyne, K., & Silver, B. (1996). The performance of schizophrenics on three cognitive tests of malingering, Rey 15-item memory test, Rey dot counting, and Hiscock forced-choice method. Assessment, 3(4), 449–457. https://doi.org/10.1177/107319119600300411
Bayan, S. M., Nitch, S., Kinney, D., & Kaminetskaya, M. (2018). Exploratory analysis of CVLT- II forced-choice recognition and RBANS EI base rates for forensically-committed, psychotic-disordered inpatients: Implications on clinical decision-making. Applied Neuropsychology: Adult, 25(1), 71–81. https://doi.org/10.1080/23279095.2016.1247092
Belanger, H. G., Curtiss, G., Demery, J. A., Lebowitz, B. K., & Vanderploeg, R. D. (2005). Factors moderating neuropsychological outcomes following mild traumatic brain injury: A meta-analysis. Journal of the International Neuropsychological Society, 11(3), 215–227. https://doi.org/10.1017/S1355617705050277
Bianchini, K. J., Mathias, C. W., & Greve, K. W. (2001). Symptom validity testing: A critical review. The Clinical Neuropsychologist, 15(1), 19–45. https://doi.org/10.1076/clin.15.1.19.1907
Bismark, A. W., Thomas, M. L., Tarasenko, M., Shiluk, A. L., Rackelmann, S. Y., Young, J. W., & Light, G. A. (2018). Relationship between effortful motivation and neurocognition in schizophrenia. Schizophrenia Research, 193, 69–76. https://doi.org/10.1016/j.schres.2017.06.042
Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2011). Introduction to meta- analysis. John Wiley & Sons.
Bortnik, K. E., Homer, M. D., & Bachman, D. L. (2013). Performance on standard indexes of effort among patients with dementia. Applied Neuropsychology: Adult, 20(4), 233–242. https://doi.org/10.1080/09084282.2012.695757
Bowie, C. R., Leung, W. W., Reichenberg, A., McClure, M. M., Patterson, T. L., Heaton, R. K., & Harvey, P. D. (2008). Predicting schizophrenia patients' real-world behavior with specific neuropsychological and functional capacity measures. Biological Psychiatry, 63(5), 505–511. https://doi.org/10.1016/J.Biopsych.2007.05.022
Burton, R. L., Enright, J., O’Connell, M. E., Lanting, S., & Morgan, D. (2015). RBANS embedded measures of suboptimal effort in dementia: Effort scale has a lower failure rate than the effort index. Archives of Clinical Neuropsychology, 30(1), 1–6. https://doi.org/10.1093/arclin/acu070
Carter, K. R., Scott, J. G., Adams, R. L., & Linck, J. (2016). Base rate comparison of suboptimal scores on the RBANS effort scale and effort index in parkinson’s disease. The Clinical Neuropsychologist, 30(7), 1118–1125. https://doi.org/10.1080/13854046.2016.1206145
Chafetz, M., & Dufrene, M. (2014). Malingering-by-proxy: Need for child protection and guidance for reporting. Child Abuse & Neglect, 38(11), 1755–1765. https://doi.org/10.1016/j.chiabu.2014.08.015
Davis, J. J. (2018). Performance validity in older adults: Observed versus predicted false positive rates in relation to number of tests administered. Journal of Clinical and Experimental Neuropsychology, 40(10), 1013–1021. https://doi.org/10.1080/13803395.2018.1472221
Dean, A. C., Victor, T. L., Boone, K. B., & Arnold, G. (2008). The relationship of IQ to effort test performance. The Clinical Neuropsychologist, 22(4), 705–722. https://doi.org/10.1080/13854040701440493
Dickinson, D. (2008). Digit symbol coding and general cognitive ability in schizophrenia: Worth another look? The British Journal of Psychiatry, 193(5), 354–356. https://doi.org/10.1192/bjp.bp.108.049387
Dickinson, D., & Harvey, P. D. (2009). Systemic hypotheses for generalized cognitive bDeficits in schizophrenia: A new take on an old problem. Schizophrenia Bulletin, 35(2), 403–414. https://doi.org/10.1093/Schbul/Sbn097
Dickinson, D., Iannone, V. N., Wilk, C. M., & Gold, J. M. (2004). General and specific cognitive deficits in schizophrenia. Biological Psychiatry, 55(8), 826–833. https://doi.org/10.1016/j.biopsych.2003.12.010
Dickinson, D., Ragland, J. D., Gold, J. M., & Gur, R. C. (2008). General and specific cognitive deficits in schizophrenia: Goliath defeats David? Biological Psychiatry, 64(9), 823–827. https://doi.org/10.1016/j.biopsych.2008.04.005
Dickinson, D., Ramsey, M. E., & Gold, J. M. (2007). Overlooking the obvious - A meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia. Archives of General Psychiatry, 64(5), 532–542. https://doi.org/10.1001/Archpsyc.64.5.532
Duff, K., Spering, C. C., O’Bryant, S. E., Beglinger, L. J., Moser, D. J., Bayless, J. D., … Scott, J. G. (2011). The RBANS effort index: Base rates in geriatric samples. Applied Neuropsychology, 18(1), 11–17. https://doi.org/10.1080/09084282.2010.523354
Duncan, A. (2005). The impact of cognitive and psychiatric impairment of psychotic disorders on the test of memory malingering (TOMM). Assessment, 12(2), 123–129. https://doi.org/10.1177/1073191105275512
Egeland, J., Sundet, K., Rund, B. R. R., Asbjrnsen, A., Hugdahl, K., Landr, N. I., … Stordal, K. I. (2003). Sensitivity and specificity of memorydysfunction in schizophrenia: A comparison with major depression. Journal of Clinical and Experimental Neuropsychology, 25(1), 79–93. https://doi.org/10.1076/jcen.25.1.79.13630
Fioravanti, M., Carlone, O., Vitale, B., Cinti, M. E., & Clare, L. (2005). A meta-analysis of cognitive deficits in adults with a diagnosis of schizophrenia. Neuropsychology Review, 15(2), 73–95. https://doi.org/10.1007/S11065-005-6254-9
Fisher, R. A. (1921). 014: On the “Probable Error” of a coefficient of correlation deduced from a small sample. Metron, 1, 3–32.
Foussias, G., Siddiqui, I., Fervaha, G., Mann, S., McDonald, K., Agid, O., … Remington, G. (2015). Motivated to do well: An examination of the relationships between motivation, effort, and cognitive performance in schizophrenia. Schizophrenia Research, 166(1–3), 276–282. https://doi.org/10.1016/j.schres.2015.05.019
Frederick, R. I., Crosby, R. D., & Wynkoop, T. F. (2000). Performance curve classification of invalid responding on the validity Indicator profile. Archives of Clinical Neuropsychology, 15(4), 281–300. https://doi.org/10.1016/S0887-6177(99)00002-5
Fusar-Poli, P., Smieskova, R., Kempton, M., Ho, B., Andreasen, N., & Borgwardt, S. (2013). Progressive brain changes in schizophrenia related to antipsychotic treatment? A meta-analysis of longitudinal MRI studies. Neuroscience & Biobehavioral Reviews, 37(8), 1680–1691. https://doi.org/10.1016/j.neubiorev.2013.06.001
Gierok, S. D., Dickson, A. L., & Cole, J. A. (2005). Performance of forensic and non-forensic adult psychiatric inpatients on the test of memory malingering. Archives of Clinical Neuropsychology, 20(6), 755–760. https://doi.org/10.1016/j.acn.2005.04.008
Glassmire, D. M., Toofanian Ross, P., Kinney, D. I., & Nitch, S. R. (2016). Derivation and cross-validation of cutoff scores for patients with schizophrenia spectrum disorders on WAIS-IV digit span–based performance validity measures. Assessment, 23(3), 292–306. https://doi.org/10.1177/1073191115587551
Gold, J. M., Strauss, G. P., Waltz, J. A., Robinson, B. M., Brown, J. K., & Frank, M. J. (2013). Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biological Psychiatry, 74(2), 130–136. https://doi.org/10.1016/j.biopsych.2012.12.022
Gorissen, M., Sanz, J. C., & Schmand, B. (2005). Effort and cognition in schizophrenia patients (research support, non-U.S. Gov't). Schizophrenia Research, 78(2–3), 199–208. https://doi.org/10.1016/j.schres.2005.02.016
Green, M. F., Nuechterlein, K. H., Kern, R. S., Baade, L. E., Fenton, W. S., Gold, J. M., … Marder, S. R. (2008). Functional co-primary measures for clinical trials in schizophrenia: Results from the MATRICS psychometric and standardization study. American Journal of Psychiatry, 165(2), 221–228. https://doi.org/10.1176/Appi.Ajp.2007.07010089
Green, P., Iverson, G. L., & Allen, L. (1999). Detecting malingering in head injury litigation with the word memory test. Brain Injury, 13(10), 813–819. https://doi.org/10.1080/026990599121205
Green, P., Montijo, J., & Brockhaus, R. (2011). High specificity of the word memory test and medical symptom validity test in groups with severe verbal memory impairment. Applied Neuropsychology, 18(2), 86–94. https://doi.org/10.1080/09084282.2010.523389
Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060. https://doi.org/10.1080/02699050110088254
Gur, R. E., Turetsky, B. I., Bilker, W. B., & Gur, R. C. (1999). Reduced gray matter volume in schizophrenia. Archives of General Psychiatry, 56(10), 905–911. https://doi.org/10.1001/archpsyc.56.10.905
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.
Heinrichs, R. W., & Zakzanis, K. K. (1998). Neurocognitive deficit in schizophrenia: A quantitative review of the evidence. Neuropsychology, 12(3), 426–445. https://doi.org/10.1037//0894-4105.12.3.426
Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
Howe, L. L., Anderson, A. M., Kaufman, D. A., Sachs, B. C., & Loring, D. W. (2007). Characterization of the medical symptom validity test in evaluation of clinically referred memory disorders clinic patients. Archives of Clinical Neuropsychology, 22(6), 753–761. https://doi.org/10.1016/j.acn.2007.06.003
Hunt, S., Root, J. C., & Bascetta, B. L. (2014). Effort testing in schizophrenia and schizoaffective disorder: Validity indicator profile and test of memory malingering performance characteristics. Archives of Clinical Neuropsychology, 29(2), 164–172. https://doi.org/10.1093/arclin/act069
Iverson, G. L., & Tulsky, D. S. (2003). Detecting malingering on the WAIS-III unusual digit span performance patterns in the normal population and in clinical groups. Archives of Clinical Neuropsychology, 18(1), 1–9. https://www.sciencedirect.com/science/article/pii/S0887617701001767?via%3Dihub
Kay, S., Fiszbein, A., & Opler, L. (1987). The positive and negative Syndrom scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13(2), 261–276. https://doi.org/10.1093/schbul/13.2.261
Keefe, R. S., Eesley, C. E., & Poe, M. P. (2005). Defining a cognitive function decrement in schizophrenia. Biological Psychiatry, 57(6), 688–691. https://doi.org/10.1016/j.biopsych.2005.01.003
Keefe, R. S. E., Poe, M., Walker, T. M., Kang, J. W., & Harvey, P. D. (2006). The schizophrenia cognition rating scale: An interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. American Journal of Psychiatry, 163(3), 426–432. https://doi.org/10.1176/Appi.Ajp.163.3.426
Kirkpatrick, B., Buchanan, R. W., McKenney, P. D., Alphs, L. D., & Carpenter Jr., W. T. (1989). The schedule for the deficit syndrome: An instrument for research in schizophrenia (research support, non-U.S. Gov't research support, U.S. Gov't, P.H.S.). Psychiatry Research, 30(2), 119–123. https://doi.org/10.1016/0165-1781(89)90153-4
Kirkpatrick, B., Messias, E., Harvey, P. D., Fernandez-Egea, E., & Bowie, C. R. (2008). Is schizophrenia a syndrome of accelerated aging? Schizophrenia Bulletin, 34(6), 1024–1032. https://doi.org/10.1093/schbul/sbm140
Kirkpatrick, B., Saoud, J. B., Strauss, G. P., Ahmed, A. O., Tatsumi, K., Opler, M., … Davidson, M. (2018). The brief negative symptom scale (BNSS): Sensitivity to treatment effects. Schizophrenia Research, 197, 269–273. https://doi.org/10.1016/j.schres.2017.11.031
Kirkpatrick, B., Strauss, G. P., Nguyen, L., Fischer, B. A., Daniel, D. G., Cienfuegos, A., & Marder, S. R. (2011). The brief negative symptom scale: Psychometric properties. Schizophrenia Bulletin, 37(2), 300–305. https://doi.org/10.1093/schbul/sbq059
Konstantakopoulos, G., Ploumpidis, D., Oulis, P., Patrikelis, P., Soumani, A., Papadimitriou, G. N., & Politis, A. M. (2011). Apathy, cognitive deficits and functional impairment in schizophrenia. Schizophrenia Research, 133(1–3), 193–198. https://doi.org/10.1093/schbul/sbq059
Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010). Decision making and the avoidance of cognitive demand. Journal of Experimental Psychology: General, 139(4), 665–682. https://doi.org/10.1037/a0020198
Kring, A. M., Gur, R. C., Blanchard, J. J., Horan, W. P., & Reise, S. P. (2013). The clinical assessment interview for negative symptoms (CAINS): Final development and validation. American Journal of Psychiatry, 170(2), 165–172. https://doi.org/10.1176/appi.ajp.2012.12010109
Lange, R. T., Sonal, P., Bhagwat, A., Anderson-Barnes, V., & French, L. M. (2012). Influence of poor effort on neuropsychological test performance in U.S. military personnel following mild traumatic brain injury. Journal of Clinical and Experimental Neurpsychology, 34(5), 453–466. https://doi.org/10.1080/13803395.2011.648175
Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373. https://doi.org/10.1093/arclin/acu019
Lezack, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment. New York, NY: Oxford University Press.
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P., … Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Medicine, 6(7), e1000100. https://doi.org/10.1371/journal.pmed.1000100
Lippa, S. M., Agbayani, K. A., Hawes, S., Jokic, E., & Caroselli, J. S. (2015). Effort in acute traumatic brain injury: Considering more than pass/fail. Rehabilitation Psychology, 59(3), 306–312. https://doi.org/10.1037/a0037217
Lippa, S. M., Lange, R. T., French, L. M., & Iverson, G. L. (2018). Performance validity, neurocognitive disorder, and post-concussion symptom reporting in service members with a history of mild traumatic brain injury. Archives of Clinical Neuropsychology, 33(5), 606–618. https://doi.org/10.1093/arclin/acx098
Llerena, K., Strauss, G. P., & Cohen, A. S. (2012). Looking at the other side of the coin: A meta-analysis of self-reported emotional arousal in people with schizophrenia. Schizophrenia Research, 142(1–3), 65–70. https://doi.org/10.1016/j.schres.2012.09.005
Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the test of memory malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. https://doi.org/10.1080/13854046.2019.1637027
McGuire, C., Crawford, S., & Evans, J. J. (2019). Effort testing in dementia assessment: A systematic review. Archives of Clinical Neuropsychology, 34(1), 114–131. https://doi.org/10.1093/arclin/acy012
Merten, T., Bossink, L., & Schmand, B. (2007). On the limits of effort testing: Symptom validity tests and severity of neurocognitive symptoms in nonlitigant patients. Journal of Clinical and Experimental Neuropsychology, 29(3), 308–318. https://doi.org/10.1080/13803390600693607
Miele, A. S., Gunner, J. H., Lynch, J. K., & McCaffrey, R. J. (2012). Are embedded validity indices equivalent to free-standing symptom validity tests? Archives of Clinical Neuropsychology, 27(1), 10–22. https://doi.org/10.1093/arclin/acr084
Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exeggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102. https://doi.org/10.1076/jcen.24.8.1094.8379
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
Moore, R. C., Davine, T., Harmell, A. L., Cardenas, V., Palmer, B. W., & Mausbach, B. T. (2013). Using the repeatable battery for the assessment of neuropsychological status (RBANS) effort index to predict treatment group attendance in patients with schizophrenia. Journal of the International Neuropsychological Society, 19(2), 198–205. https://doi.org/10.1017/s1355617712001221
Morra, L. F., Gold, J. M., Sullivan, S. K., & Strauss, G. P. (2015). Predictors of neuropsychological effort test performance in schizophrenia. Schizophrenia R esearch, 162(1–3), 205–210. https://doi.org/10.1016/j.schres.2014.12.033
National Heart, Lung, & Blood Institute. (2014). Quality assessment tool for observational cohort and cross-sectional studies. Bethesda: National Institutes of Health, Department of Health and Human Services. https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools
Nelson, N. W., Hoelze, J. B., McGuire, K. A., Ferrier-Auerbach, A. G., Charlesworth, M. J., & Sponheim, S. R. (2010). Evaluation context impacts neuropsychological performance of OEF/OIF veterans with reported combat-related concussion. Archives of Clinical Neuropsychology, 25(8), 713–723. https://doi.org/10.1093/arclin/acq075
Overall, J. E., & Gorham, D. R. (1962). The brief psychiatric rating scale. Psychological Reports, 10(3), 799–812. https://doi.org/10.2466/pr0.1962.10.3.799
Paradis, C. M., Solomon, L. Z., Owen, E., & Brooker, M. (2013). Detection of cognitive malingering or suboptimal effort in defendants undergoing competency to stand trial evaluations. Journal of Forensic Psychology Practice, 13(3), 245–265. https://doi.org/10.1080/15228932.2013.803374
Pivovarova, E., Rosenfeld, B., Dole, T., Green, D., & Zapf, P. (2009). Are measures of cognitive effort and motivation useful in differentiating feigned from genuine psychiatric symptoms? International Journal of Forensic Mental Health, 8(4), 271–278. https://doi.org/10.1080/14999011003635514
Raffard, S., Capdevielle, D., Boulenger, J.-P., Gely-Nargeot, M.-C., & Bayard, S. (2014). Can individuals with schizophrenia be instructed to deliberately feign memory deficits? Cognitive Neuropsychiatry, 19(5), 414–426. https://doi.org/10.1080/13546805.2014.896251
Rees, L. M., Tombaugh, T. N., Gansler, D. A., & Moczynski, N. P. (1998). Five validation experiments of the test of memory malingering (TOMM). Psychological Assessment, 10(1), 10–20. https://doi.org/10.1037/1040-3590.10.1.10
Reichenberg, A., & Harvey, P. D. (2007). Neuropsychological impairments in schizophrenia: Integration of performance-based and brain imaging findings. Psychological Bulletin, 133(5), 833–858. https://doi.org/10.1037/0033-2909.133.5.833
Rickards, T. A., Cranston, C. C., Touradji, P., & Bechtold, K. T. (2018). Embedded performance validity testing in neuropsychological assessment: Potential clinical tools. Applied Neuropsychology, 25(3), 219–230. https://doi.org/10.1080/23279095.2017.1278602
Rohling, M. L., Binder, L. M., & Langhinrichsen-Rohling, J. (1995). Money matters: A meta- analytic review of the association between financial compensation and the experience and treatment of chronic pain. Health Psychology, 14(6), 537–547. https://doi.org/10.1037//0278-6133.14.6.537
Rosenberg, M. (2005). The file-drawer problem revisited: A general weighted method for calculating fail-safe numbers in meta-analysis. Evolution, 59(2), 464–468. https://doi.org/10.1111/j.0014-3820.2005.tb01004.x
Schroeder, R. W., & Marshall, P. S. (2011). Evaluation of the appropriateness of multiple symptom validity indices in psychotic and non-psychotic psychiatric populations. The Clinical Neuropsychologist, 25(3), 437–453. https://doi.org/10.1080/13854046.2011.556668
Sieck, B. C., Smith, M. M., Duff, K., Paulsen, J. S., & Beglinger, L. J. (2013). Symptom validity test performance in the Huntington disease clinic. Archives of Clinical Neuropsychology, 28(2), 135–143. https://doi.org/10.1093/arclin/acs109
Singhal, A., Green, P., Ashaye, K., Shankar, K., & Gill, D. (2009). High specificity of the medical symptom validity test in patients with very severe memory impairment. Archives of Clinical Neuropsychology, 24(8), 721–728. https://doi.org/10.1093/arclin/acp074
Slick, D., Hopp, G., Strauss, E., & Thompson, G. (1997). The Victoria symptom validity test. Odessa: Psychological Assessment Resources. https://doi.org/10.1080/01688639608408313
Slick, D. J., Sherman, E. M., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561. https://doi.org/10.1076/1385-4046(199911)13:04;1-y;ft545
Smith, K., Boone, K., Victor, T., Miora, D., Cottingham, M., Ziegler, E., … Wright, M. (2014). Comparison of credible patients of very low intelligence and non-credible patients on neurocognitive performance validity indicators. The Clinical Neuropsychologist, 28(6), 1048–1070. https://doi.org/10.1080/13854046.2014.931465
Sterne, J. A., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Eepidemiology, 53(11), 1119–1129. https://doi.org/10.1016/s0895-4356(00)00242-0
Stevens, A., Schneider, K., Liske, B., Hermle, L., Huber, H., & Hetzel, G. (2014). Is subnormal cognitive performance in schizophrenia due to lack of effort or to cognitive impairment? German Journal of Psychiatry, 17(1), 1–9. https://www.semanticscholar.org/paper/Is-Subnormal-Cognitive-Performance-in-Schizophrenia-Stevens-Schneider/0d4c8f0ab3c3dc88aa52d7e8718f9fa4e29d8d68
Strauss, G. P., & Chapman, H. C. (2018). Preliminary psychometric properties of the brief negative symptom scale in youth at clinical high-risk for psychosis. Schizophrenia Research, 193, 435–437. https://doi.org/10.1016/j.schres.2017.07.051
Strauss, G. P., & Gold, J. M. (2016). A psychometric comparison of the clinical assessment interview for negative symptoms and the brief negative symptom scale. Schizophrenia Bulletin, 42(6), 1384–1394. https://doi.org/10.1093/schbul/sbw046
Strauss, G. P., Esfahlani, F. Z., Galderisi, S., Mucci, A., Rossi, A., Bucci, P., … Sayama, H. (2018a). Network analysis reveals the latent structure of negative symptoms in schizophrenia. Schizophrenia Bulletin, 45(5), 1033–1041. https://doi.org/10.1093/schbul/sby133
Strauss, G. P., Hong, L. E., Gold, J. M., Buchanan, R. W., McMahon, R. P., Keller, W. R., … Kirkpatrick, B. (2012a). Factor structure of the brief negative symptom scale. Schizophrenia Research, 142(1–3), 96–98. https://doi.org/10.1016/j.schres.2012.09.007
Strauss, G. P., Keller, W. R., Buchanan, R. W., Gold, J. M., Fischer, B. A., McMahon, R. P., … Kirkpatrick, B. (2012b). Next-generation negative symptom assessment for clinical trials: Validation of the brief negative symptom scale. Schizophrenia Research, 142(1–3), 88–92. https://doi.org/10.1016/j.schres.2012.10.012
Strauss, G. P., Morra, L. F., Sullivan, S. K., & Gold, J. M. (2015). The role of low cognitive effort and negative symptoms in neuropsychological impairment in schizophrenia. Neuropsychology, 29(2), 282–291. https://doi.org/10.1037/neu0000113
Strauss, G. P., Nuñez, A., Ahmed, A. O., Barchard, K. A., Granholm, E., Kirkpatrick, B., … Allen, D. N. (2018b). The latent structure of negative symptoms in schizophrenia. JAMA Psychiatry, 75(12), 1271–1279. https://doi.org/10.1001/jamapsychiatry.2018.2475
Strauss, G. P., Vertinski, M., Vogel, S. J., Ringdahl, E. N., & Allen, D. N. (2016). Negative symptoms in bipolar disorder and schizophrenia: A psychometric evaluation of the brief negative symptom scale across diagnostic categories. Schizophrenia Research, 170(2–3), 285–289. https://doi.org/10.1016/j.schres.2015.12.014
Sugawara, N., Maruo, K., Sugai, T., Suzuki, Y., Ozeki, Y., Shimoda, K., … Yasui-Furukori, N. (2018). Prevalence of underweight in patients with schizophrenia: A meta-analysis. Schizophrenia Research, 195, 67–73. https://doi.org/10.1016/j.schres.2017.10.017
Sullivan, E. V., Shear, P. K., Lim, K. O., Zipursky, R. B., & Pfefferbaum, A. (1996). Cognitive and motor impairments are related to gray matter volume deficits in schizophrenia. Biological Psychiatry, 39(4), 234–240. https://doi.org/10.1016/0006-3223(95)00135-2
Teichner, G., & Wagner, M. T. (2004). The test of memory malingering (TOMM): Normative data from cognitively intact, cognitively impaired, and elderly patients with dementia. Archives of Clinical Neuropsychology, 19(3), 455–464. https://doi.org/10.1016/S0887-6177(03)00078-7
Tombaugh, T. N. (1996). Test of memory malingering (TOMM). New York: Multi-Health Systems, Inc..
Tombaugh, T. N. (1997). The test of memory malingering (TOMM): Normative data from cognitively intact and cognitively impaired individuals. Psychological Assessment, 9(3), 260–268. https://doi.org/10.1037/1040-3590.9.3.260
Velligan, D. I., Kern, R. S., & Gold, J. M. (2006). Cognitive rehabilitation for schizophrenia and the putative role of motivation and expectancies. Schizophrenia Bulletin, 32(3), 474–485. https://doi.org/10.1093/schbul/sbj071
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1-48. https://doi.org/10.18637/jss.v036.i03
Victor, T. L., & Boone, K. B. (2007). Identification of feigned mental retardation. Assessment of feigned cognitive impairment: A neuropsychological perspective, 310–345. https://doi.org/10.1076/jcen.25.7.979.16481
Westbrook, A., Kester, D., & Braver, T. S. (2013). What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. PLoS One, 8(7), e68210. https://doi.org/10.1371/journal.pone.0068210
Whearty, K. M., Allen, D. N., Lee, B. G., & Strauss, G. P. (2015). The evaluation of insufficient cognitive effort in schizophrenia in light of low IQ scores. Journal of Psychiatry Research, 68, 397–404. https://doi.org/10.1016/j.jpsychires.2015.04.018
Whitney, K. A., Shepard, P. H., Mariner, J., Mossbarger, B., & Herman, S. M. (2010). Validity of the Wechsler test of adult Reading (WTAR): Effort considered in a clinical sample of U.S. military veterans. Applied Neuropsychology, 17(3), 196–204. https://doi.org/10.1080/09084282.2010.499787
Whiteney, K. A., Shepard, P. H., Williams, A. L., Davis, J. J., & Adams, K. M. (2009). The medical symptoms validity test in the evaluation of operation Iraqi freedom/operation enduring freedom soldiers: A preliminary study. Archives of Clinical Neuropsychology, 24(2), 145–152. https://doi.org/10.1093/arclin/acp020
Wykes, T., Huddy, V., Cellard, C., McGurk, S. R., & Czobor, P. (2011). A meta-analysis of cognitive remediation for schizophrenia: Methodology and effect sizes. American Journal of Psychiatry, 168(5), 472–485. https://doi.org/10.1176/appi.ajp.2010.10060855
Zipursky, R. B., Lambe, E. K., Kapur, S., & Mikulis, D. J. (1998). Cerebral gray matter volume deficits in first episode psychosis. Archives of General Psychiatry, 55(6), 540–546. https://doi.org/10.1001/archpsyc.55.6.540
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(DOCX 89 kb)
Rights and permissions
About this article
Cite this article
Ruiz, I., Raugh, I.M., Bartolomeo, L.A. et al. A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders. Neuropsychol Rev 30, 407–424 (2020). https://doi.org/10.1007/s11065-020-09448-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11065-020-09448-2