Skip to main content
Log in

The Grooved Pegboard Test as a Validity Indicator—a Study on Psychogenic Interference as a Confound in Performance Validity Research

  • Published:
Psychological Injury and Law Aims and scope Submit manuscript

Abstract

This study was designed to replicate an earlier report on the link between low scores on the Grooved Pegboard test (GPB), invalid responding, and elevated self-reported psychiatric symptoms. A fixed battery of neuropsychological tests was administered to 100 consecutively referred outpatients (MAge = 38.3, MEducation = 13.6 years) following traumatic brain injury at a Midwestern academic medical center. Classification accuracy of GPB validity cutoffs was computed against a free-standing PVT and three composite measures of embedded validity indicators. Previously suggested GPB validity cutoffs (T ≤ 29 in either hand) produced good combinations of sensitivity (0.25–0.55) and specificity (0.89–0.98) to psychometrically defined invalid performance. Raising the cutoff to T ≤ 31 resulted in a reasonable trade-off between increased sensitivity (0.36–0.55) and decreased specificity (0.84–0.94). T ≤ 31 in both hands was highly specific (0.93–0.98) to noncredible responding. GPB validity cutoffs were unrelated to psychiatric symptoms or injury severity. Failing PVTs based on forced choice recognition was associated with elevated self-reported depression, somatic concerns, and overall symptomatology. Low scores on the GPB are reliable indicators of noncredible responding. Self-reported emotional distress has a complex relationship with performance validity. Psychogenic interference is a potential mechanism behind PVT failures, and its expression is likely mediated by instrumentation and sampling artifacts. Further research on the topic is clearly needed to advance current understanding of psychogenic interference as a confound in cognitive testing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • An, K. Y., Charles, J., Ali, S., Enache, A., Dhuga, J., & Erdodi, L. A. (2018). Re-examining performance validity cutoffs within the Complex Ideational Material and the Boston Naming Test-Short Form using an experimental malingering paradigm. Journal of Clinical and Experimental Neuropsychology, 1–11. https://doi.org/10.1080/13803395.2018.1483488.

  • Arnold, G., & Boone, K. B. (2007). Use of motor and sensory tests as measures of effort. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. New York, NY: Guilford.

    Google Scholar 

  • Arnold, G., Boone, K. B., Lu, P., Dean, A., Wen, J., Nitch, S., & McPhearson, S. (2005). Sensitivity and specificity of finger tapping test scores for the detection of suspect effort. The Clinical Neuropsychologist, 19(1), 105–120.

    PubMed  Google Scholar 

  • Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866.

    PubMed  Google Scholar 

  • Ashendorf, L., O’Bryant, S. E., & McCaffrey, R. J. (2003). Specificity of malingering detection strategies in older adults using the CVLT and WCST. Clinical Neuropsychology, 17(2), 255–262.

    Google Scholar 

  • Axelrod, B. N., Meyers, J. E., & Davis, J. J. (2014). Finger tapping test performance as a measure of performance validity. The Clinical Neuropsychologist, 28(5), 876–888.

    PubMed  Google Scholar 

  • Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159.

    PubMed  Google Scholar 

  • Bearden, C. E., Glahn, D. C., Monkul, E. S., Barrett, J., Najt, P., Villareal, V., & Soares, J. C. (2006). Patterns of memory impairment in bipolar disorder and unipolar major depression. Psychiatry Research, 142, 139–150.

    PubMed  Google Scholar 

  • Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-II. San Antonio, TX: Psychological Corporation.

    Google Scholar 

  • Bell-Sprinkle, T. L., Boone, K. B., Miora, D., Cottingham, M., Victor, T., Ziegler, E., Zeller, M., & Wright, M. (2013). Re-examination of the Rey Word Recognition Test. The Clinical Neuropsychologist, 27(3), 516–527.

    Google Scholar 

  • Berry, D. T. R., Adams, J. J., Clark, C. D., Thacker, S. R., Burger, T. L., Wetter, M. W., Baer, R. A., & Borden, J. W. (1996). Detection of a cry for help on the MMPI-2: An analog investigation. Journal of Personality Assessment, 67(1), 26–36.

    PubMed  Google Scholar 

  • Bigler, E. D. (2012). Symptom validity testing, effort and neuropsychological assessment. Journal of the International Neuropsychological Society, 18, 632–642.

    PubMed  Google Scholar 

  • Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638.

    PubMed  PubMed Central  Google Scholar 

  • Bigler, E. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444.

    PubMed  Google Scholar 

  • Binder, L. M., & Willis, S. C. (1991). Assessment of motivation after financially compensable minor head trauma. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 3, 175–181.

    Google Scholar 

  • Boone, D. (1998). Internal consistency reliability of the Personality Assessment Inventory with psychiatric inpatients. Journal of Clinical Psychology, 54(6), 839–843.

    PubMed  Google Scholar 

  • Boone, K. B. (2007a). Assessment of feigned cognitive impairment. A neuropsychological perspective. New York, NY: Guilford.

    Google Scholar 

  • Boone, K. B. (2007b). Commentary on “Cogniform disorder and cogniform condition: Proposed diagnoses for excessive cognitive symptoms” by Dean C. Delis and Spencer R. Wetter. Archives of Clinical Neuropsychology, 22, 675–679.

    PubMed  Google Scholar 

  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York, NY: Guilford.

    Google Scholar 

  • Bortnik, K. E., Boone, K. B., Marion, S. D., Amano, S., Ziegler, E., Victor, T. L., & Zeller, M. A. (2010). Examination of various WMS-III logical memory scores in the assessment of response bias. The Clinical Neuropsychologist, 24(2), 344–357.

    PubMed  Google Scholar 

  • Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the Association for Scientific Advancement in Psychological Injury and Law. Psychological Injury and Law, 7(3), 197–205.

    Google Scholar 

  • Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., … Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity (NAN Policy and Planning Committees). Archives of Clinical Neuropsychology, 20, 419–426.

    PubMed  Google Scholar 

  • Carone, D. A. (2008). Children with moderate/severe brain damage/dysfunction outperform adults with mild-to-no brain damage on the Medical Symptom Validity Test. Brain Injury, 22(12), 960–971.

    PubMed  Google Scholar 

  • Chafetz, M. D., Williams, M. A., Ben-Porath, Y. S., Bianchini, K. J., Boone, K. B., Kirkwood, M. W., Larrabee, G. J., & Ord, J. S. (2015). Official position of the American Academy of Clinical Neuropsychology Social Security Administration policy on validity testing: Guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740.

    PubMed  Google Scholar 

  • Christensen, H., Griffiths, K., MacKinnon, A., & Jacomb, P. (1997). A quantitative review of cognitive deficits in depression and Alzheimer-type dementia. Journal of the International Neuropsychological Society, 3, 631–651.

    PubMed  Google Scholar 

  • Conners, K. C. (2004). Conner’s continuous performance test (CPT II).Version 5 for Windows. Technical guide and software manual. North Tonawada, NY: Multi-Health Systems.

    Google Scholar 

  • Considine, C., Weisenbach, S. L., Walker, S. J., McFadden, E. M., Franti, L. M., Bieliauskas, L. A., Maixner, D. F., Giordani, B., Berent, S., & Langenecker, S. A. (2011). Auditory memory decrements, without dissimulation, among patients with major depressive disorder. Archives of Clinical Neuropsychology, 26, 445–453.

    PubMed  PubMed Central  Google Scholar 

  • Costabile, T., Bilo, L., DeRosa, A., Pane, C., & Sacca, F. (2018). Dissociative identity disorder: Restoration of executive functions after switch from alter to host personality. Psychiatry and Clinical Neurosciences, 72, 189–190.

    PubMed  Google Scholar 

  • Cottingham, M. E., Victor, T. L., Boone, K. B., Ziegler, E. A., & Zeller, M. (2014). Apparent effect of type of compensation seeking (disability vs. litigation) on performance validity test scores may be due to other factors. The Clinical Neuropsychologist, 28(6), 1030–1047.

    PubMed  Google Scholar 

  • Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23, 133–152.

    PubMed  Google Scholar 

  • DeFilippis, N. A., & McCampbell, E. (1997). Manual for the booklet category test. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. (2000). The California Verbal Learning Test (2nd ed.). San Antonio, TX: The Psychological Corporation.

    Google Scholar 

  • Delis, D. C., & Wetter, S. R. (2007). Cogniform disorder and cogniform condition: Proposed diagnoses for excessive cognitive symptoms. Archives of Clinical Neuropsychology, 22, 589–604.

    PubMed  Google Scholar 

  • Derogatis, L. R. (1994). SCL-90-R: Administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems.

    Google Scholar 

  • Donders, J. (2005). Performance on the Test of Memory Malingering in a mixed pediatric sample. Child Neuropsychology, 11(2), 221–227.

    PubMed  Google Scholar 

  • Donders, J., & Strong, C. H. (2011). Embedded effort indicators on the California Verbal Learning Test—Second edition (CVLT-II): An attempted cross-validation. The Clinical Neuropsychologist, 25, 173–184.

    PubMed  Google Scholar 

  • Davis, J. J. (2014). Further consideration of Advanced Clinical Solutions Word Choice: Comparison to the Recognition Memory Test – Words and classification accuracy on a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294. https://doi.org/10.1080/13854046.2014.975844.

    PubMed  Google Scholar 

  • Dunn, L. M., & Dunn, D. M. (2007). Peabody Picture Vocabulary Test (4th ed.). San Antonio, TX, Pearson.

  • Egeland, J., Lund, A., Landro, N. I., Rund, B. R., Sudet, K., Asbjornsen, A., Mjellem, N., Roness, A., & Stordal, K. I. (2005). Cortisol level predicts executive and memory function in depression, symptom level predicts psychomotor speed. Acta Psychiatrica Scandinavica, 112, 434–441.

    PubMed  Google Scholar 

  • Erdodi, L. A. (2017). Aggregating validity indicators: The salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment. Applied Neuropsychology: Adult, 1–18. https://doi.org/10.1080/23279095.2017.1384925.

  • Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017a). WAIS-IV processing speed scores as measures of non-credible responding—The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157.

    PubMed  Google Scholar 

  • Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2017b). A single error is one too many: The Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology. https://doi.org/10.1093/arclin/acx110.

  • Erdodi, L. A., Dunn, A. G., Seke, K. R., Charron, C., McDermott, A., Enache, A., Maytham, C., & Hurtubise, J. (2018d). The Boston Naming Test as a measure of performance validity. Psychological Injury and Law, 11, 1–8. https://doi.org/10.1007/s12207-017-9309-3.

    Article  Google Scholar 

  • Erdodi, L. A., Hurtubise, J. L., Charron, C., Dunn, A., Enache, A., McDermott, A., & Hirst, R. B. (2018a). The D-KEFS Trails as performance validity tests. Psychological Assessment, 30(8), 1082–1095.

    PubMed  Google Scholar 

  • Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014a). Comparing the Recognition Memory Test and the Word Choice Test in a mixed clinical sample: Are they equivalent? Psychological Injury and Law, 7(3), 255–263. https://doi.org/10.1007/s12207-014-9197-8.

    Article  Google Scholar 

  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046.

    PubMed  Google Scholar 

  • Erdodi, L. A., Pelletier, C. L., & Roth, R. M. (2018b). Elevations on select Conners’ CPT-II scales indicate noncredible responding in adults with traumatic brain injury. Applied Neuropsychology: Adult, 25(1), 19–28. https://doi.org/10.1080/23279095.2016.1232262.

    Article  Google Scholar 

  • Erdodi, L. A., & Roth, R. M. (2017). Low scores on BDAE Complex Ideational Material are associated with invalid performance in adults without aphasia. Applied Neuropsychology: Adult, 24(3), 264–274. https://doi.org/10.1080/23279095.2017.1298600.

    Google Scholar 

  • Erdodi, L. A., & Rai, J. K. (2017). A single error is one too many: Examining alternative cutoffs on trial 2 on the TOMM. Brain Injury, 31(10), 1362–1368. https://doi.org/10.1080/02699052.2017.1332386.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Roth, R. M., Kirsch, N. L., Lajiness-O’Neill, R., & Medoff, B. (2014b). Aggregating validity indicators embedded in Conners’ CPT-II outperforms individual cutoffs at separating valid from invalid performance in adults with traumatic brain injury. Archives of Clinical Neuropsychology, 29(5), 456–466.

    PubMed  Google Scholar 

  • Erdodi, L. A., Sagar, S., Seke, K., Zuccato, B. G., Schwartz, E. S., & Roth, R. M. (2018c). The Stroop Test as a measure of performance validity in adults clinically referred for neuropsychological assessment. Psychological Assessment, 30(6), 755–766. https://doi.org/10.1037/pas0000525.

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017d). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology & Neuroscience, 10(3), 325–344.

    Google Scholar 

  • Erdodi, L. A., Tyson, B. T., Abeare, C. A., Lichtenstein, J. D., Pelletier, C. L., Rai, J. K., & Roth, R. M. (2016). The BDAE Complex Ideational Material—A measure of receptive language or performance validity? Psychological Injury and Law, 9, 112–120.

    Google Scholar 

  • Erdodi, L. A., Tyson, B. T., Abeare, C. A., Zuccato, B. G., Rai, J. K., Seke, K. R., …, & Roth, R. M. (2017e). Utility of critical items within the Recognition Memory Test and Word Choice Test. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2017.1298600

    Google Scholar 

  • Erdodi, L. A., Tyson, B. T., Shahein, A., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Zuccato, B. G., Kucharski, B., & Roth, R. M. (2017c). The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383. https://doi.org/10.1080/13803395.2016.1230181.

    Article  PubMed  Google Scholar 

  • Etherton, J. L., Bianchini, K. J., Heinly, M. T., & Greve, K. W. (2006). Pain, malingering, and performance on the WAIS-III Processing Speed Index. Journal of Clinical and Experimental Neuropsychology, 28(7), 1218–1237.

    PubMed  Google Scholar 

  • Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2018). A clinical comparison, simulation study testing the validity and IOP-29 with an Italian sample. Psychological Injury and Law. https://doi.org/10.1007/s12207-018-9314-1.

  • Green, P. (2003). Green’s word memory test. Edmonton, Canada: Green’s Publishing.

    Google Scholar 

  • Green, P. (2008). Green’s non-verbal medical symptom validity test. Edmonton: Green’s Publishing.

    Google Scholar 

  • Green, P., Iverson, G., & Allen, L. (1999). Detecting malingering in head injury litigation with the Word Memory Test. Brain Injury, 13, 813–819.

    PubMed  Google Scholar 

  • Greiffenstein, M. F., & Baker, W. J. (2008). Validity testing in dually diagnosed post-traumatic stress disorder and mild closed head injury. The Clinical Neuropsychologist, 22, 565–582.

    PubMed  Google Scholar 

  • Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224.

    Google Scholar 

  • Greiffenstein, M. F., Baker, W. J., & Gola, T. (1996). Motor dysfunction profiles in traumatic brain injury and postconcussion syndrome. Journal of the International Neuropsychological Society, 2(06), 477.

    PubMed  Google Scholar 

  • Greve, K. W., & Bianchini, K. J. (2004). Setting empirical cutoffs on psychometric indicators of negative response bias: A methodological commentary with recommendation. Archives of Clinical Neuropsychology, 19, 533–541.

    PubMed  Google Scholar 

  • Greve, K. W., Bianchini, K. J., Mathias, C. W., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction with the Wisconsin Card Sorting Test: A preliminary investigation in traumatic brain injury. The Clinical Neuropsychologist, 16(2), 179–191.

    PubMed  Google Scholar 

  • Grote, C., Kooker, E. K., Garron, D. C., Nyenhuis, D. L., Smith, C. A., & Mattingly, M. L. (2000). Performance of compensation seeking and non-compensation seeking samples on the Victoria Symptom Validity Tests: Cross-validation and extension of a standardization study. Journal of Clinical and Experimental Neuropsychology, 22, 709–791.

    PubMed  Google Scholar 

  • Halstead, W. (1947). Brain and intelligence. A quantitative study of the frontal lobes. Chicago: University of Chicago Press.

    Google Scholar 

  • Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtis, G. (1993). Wisconsin Card Sorting Test (WCST) manual revised and expanded. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.

    Google Scholar 

  • Heaton, R. K., Smith, H. H., Lehman, R. A. W., & Vogt, A. T. (1978). Prospects for faking believable deficits on neuropsychological testing. Journal of Consulting and Clinical Psychology, 46(5), 892–900.

    PubMed  Google Scholar 

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Conference Participants. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129.

    PubMed  Google Scholar 

  • Heinly, M. T., Greve, K. W., Bianchini, K., Love, J. M., & Brennan, A. (2005). WAIS digit-span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444.

    PubMed  Google Scholar 

  • Henry, G. K., Helbronner, R. L., Suhr, J., Gornbein, J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society, 24, 1–11.

    Google Scholar 

  • Hopwood, C. J., Morey, L. C., Shea, M. T., McGlashan, T. H., Sanislow, C. A., Grilo, C. M., … Skodol, A. E. (2007). Personality traits predict current and future functioning comparably for individuals with major depressive and personality disorders. Journal of Nervous and Mental Disorders, 195(3), 266–269.

    PubMed  Google Scholar 

  • Inman, T. H., & Berry, D. T. R. (2002). Cross-validation of indicators of malingering: A comparison of nine neuropsychological tests, four tests of malingering, and behavioral observations. Archives of Clinical Neuropsychology, 17, 1–23.

    PubMed  Google Scholar 

  • Jasinski, L. J., Berry, D. T., Shandera, A. L., & Clark, J. A. (2011). Use of the Wechsler Adult Intelligence Scale Digit Span subtest for malingering detection: A meta-analytic review. Journal of Clinical and Experimental Neuropsychology, 33(3), 300–314.

    PubMed  Google Scholar 

  • Johnson, R.W., Ellison, R.A., & Heikkinen, C.A. (1989). Psychological symptoms of counseling center clients. Journal of Counseling Psychology, 36(1), 110-114.

    Google Scholar 

  • Johnson, J. L., & Lesniak-Karpiak, K. (1997). The effect of warning on malingering on memory and motor tasks in college samples. Archives of Clinical Neuropsychology, 12, 231–238.

    PubMed  Google Scholar 

  • Jones, A. (2013). Test of memory malingering: Cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059.

    PubMed  Google Scholar 

  • Kalfon, T. B., Gal, G., Shorer, R., & Ablin, J. N. (2016). Cognitive functioning in fibromyalgia: The central role of effort. Journal of Psychosomatic Research, 87, 30–36.

    Google Scholar 

  • Karlin, B. E., Creech, S. K., Grimes, J. S., Clark, T. S., Meagher, M. W., & Morey, L. C. (2005). The Personality Assessment Inventory with chronic pain patients: Psychometric properties and clinical utility. Journal of Clinical Psychology, 61(12), 1571–1585.

    PubMed  Google Scholar 

  • Kemp, S., Coughlan, A. K., Rowbottom, C., Wilkinson, K., Teggart, V., & Baker, G. (2008). The base rate of effort test failure in patients with medically unexplained symptoms. Journal of Psychosomatic Research, 65(4), 319–325.

    PubMed  Google Scholar 

  • Kiewel, N. A., Wisdom, N. M., Bradshaw, M. R., Pastorek, N. J., & Strutt, A. M. (2012). Retrospective review of digit span-related effort indicators in probable Alzheimer’s disease patients. The Clinical Neuropsychologist, 26(6), 965–974.

    PubMed  Google Scholar 

  • Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., Ziegler, E. A., & Zeller, M. A. (2010a). The Warrington Recognition Memory Test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25, 60–70.

    PubMed  Google Scholar 

  • Kim, N., Boone, K. B., Victor, T., Lu, P., Keatinge, C., & Mitchell, C. (2010b). Sensitivity and specificity of a digit symbol recognition trial in the identification of response bias. Archives of Clinical Neuropsychology, 25(5), 420–428.

    PubMed  Google Scholar 

  • Kirkwood, M. W., & Kirk, J. W. (2010). The base rate of suboptimal effort in a pediatric mild TBI sample: Performance on the Medical Symptom Validity Test. The Clinical Neuropsychologist, 24(5), 860–872.

    PubMed  Google Scholar 

  • Kjærgaard, M., Arfwedson Wang, C. E., Waterloo, K., & Jorde, R. (2014). A study of the psychometric properties of the Beck Depression Inventory-II, the Montgomery and Åsberg Depression Rating Scale, and the Hospital Anxiety and Depression Scale in a sample from a healthy population. Scandinavian Journal of Psychology, 55(1), 83–89.

    PubMed  Google Scholar 

  • Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental Test of Memory Malingering Scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244.

    Google Scholar 

  • Lafayette Instrument. (2015). Grooved Pergboard user’s manual. Lafayette, IN.

  • Lange, R. T., Iverson, G. L., Brickell, T. A., Staver, T., Pancholi, S., Bhagwat, A., & French, L. M. (2013). Clinical utility of the Conners’ Continuous Performance Test-II to detect poor effort in U.S. military personnel following traumatic brain injury. Psychological Assessment, 25(2), 339–352.

    PubMed  Google Scholar 

  • Lange, R. T., & Lippa, S. M. (2017). Sensitivity and specificity should never be interpreted in isolation without consideration of other clinical utility metrics. The Clinical Neuropsychologist, 31, 1015–1028.

    PubMed  Google Scholar 

  • Langenecker, S. A., Bieliauskas, L. A., Rapport, L. J., Zubieta, J. K., Wilde, E. A., & Berent, S. (2005). Face emotion perception and executive functioning deficits in depression. Journal of Clinical and Experimental Psychology, 27, 320–333.

    Google Scholar 

  • Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425.

    PubMed  Google Scholar 

  • Larrabee, G. J. (2012). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: A scientific approach (2nd ed., pp. 116–159). New York: Oxford University Press.

    Google Scholar 

  • Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29, 364–373.

    PubMed  Google Scholar 

  • Larrabee, G. J., Millis, S. R., & Meyers, J. E. (2008). Sensitivity to brain dysfunction of the Halstead-Reitan vs and ability-focused neuropsychological battery. The Clinical Neuropsychologist, 22, 813–825.

    PubMed  Google Scholar 

  • Leighton, A., Weinborn, M., & Maybery, M. (2014). Bridging the gap between neurocognitive processing theory and performance validity assessment among the cognitively impaired: A review and methodological approach. Journal of the International Neuropsychological Society, 20, 873–886.

    PubMed  Google Scholar 

  • Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment. New York: Oxford University Press.

    Google Scholar 

  • Lichtenstein, J. D., Erdodi, L. A., & Linnea, K. S. (2017). Introducing a forced-choice recognition task to the California Verbal Learning Test—Children’s version. Child Neuropsychology, 23(3), 284–299. https://doi.org/10.1080/09297049.2015.1135422.

    Article  PubMed  Google Scholar 

  • Lichtenstein, J. D., Erdodi, L. A., Rai, J. K., Mazur-Mosiewicz, A., & Flaro, L. (2018). Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children. Child Neuropsychology, 24(2), 247–260. https://doi.org/10.1080/09297049.2016.1259402.

    Article  PubMed  Google Scholar 

  • Linn, R. T., Allen, K., & Willer, B. S. (1994). Affective symptoms in the chronic stage of traumatic brain injury: A study of married couples. Brain Injury, 8(2), 135–147.

    PubMed  Google Scholar 

  • Lu, P. H., Boone, K. B., Cozolino, L., & Mitchell, C. (2003). Effectiveness of the Rey-Osterrieth Complex Figure Test and the Meyers and Meyers recognition trial in the detection of suspect effort. The Clinical Neuropsychologist, 17(3), 426–440.

    PubMed  Google Scholar 

  • MacAllister, W. S., Nakhutina, L., Bender, H. A., Karantzoulis, S., & Carlson, C. (2009). Assessing effort during neuropsychological evaluation with the TOMM in children and adolescents with epilepsy. Child Neuropsychology, 15(6), 521–531.

    PubMed  Google Scholar 

  • Mathias, C. W., Greve, K. W., Bianchini, K. J., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction using the reliable digit span in traumatic brain injury. Assessment, 9(3), 301–308.

    PubMed  Google Scholar 

  • McGuire, B. E., & Shores, E. A. (2001). Simulated pain on the Symptom Checklist-90-Revised. Journal of Clinical Psychology, 57(12), 1589–1596.

    PubMed  Google Scholar 

  • Moore, B. A., & Donders, J. (2004). Predictors of invalid neuropsychological performance after traumatic brain injury. Brain Injury, 18(10), 975–984.

    PubMed  Google Scholar 

  • Morey, L. C. (1991). Personality Assessment Inventory. Odessa, FL: Routledge.

    Google Scholar 

  • Nelson, N. W., Boone, K., Dueck, A., Wagener, L., Lu, P., & Grills, C. (2003). The relationship between eight measures of suspect effort. The Clinical Neuropsychologist, 17(2), 263–272.

    PubMed  Google Scholar 

  • Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8, 46–63.

    Google Scholar 

  • Ord, J. S., Boettcher, A. C., Greve, K. J., & Bianchini, K. J. (2010). Detection of malingering in mild traumatic brain injury with the Conners’ Continuous Performance Test-II. Journal of Clinical and Experimental Neuropsychology, 32(4), 380–387.

    PubMed  Google Scholar 

  • Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV—Technical manual. San Antonio, TX: Author.

    Google Scholar 

  • Persinger, V. C., Whiteside, D. M., Bobova, L., Saigal, S. D., Vannucci, M. J., & Basso, M. R. (2018). Using the California Verbal Learning Test, second edition as an embedded performance validity measure among individuals with TBI and individuals with psychiatric disorders. The Clinical Neuropsychologist, 32(6), 1039–1053. https://doi.org/10.1080/13854046.2017.1419507.

    Article  PubMed  Google Scholar 

  • Rapport, L. J., Farchione, T. J., Coleman, R. D., & Axelrod, B. N. (1998). Effects of coaching on malingered motor function profiles. Journal of Clinical and Experimental Neuropsychology, 20(1), 89–97.

    PubMed  Google Scholar 

  • Raskin, S. A., Mateer, C. A., & Tweeten, R. (1998). Neuropsychological assessment of individuals with mild traumatic brain injury. The Clinical Neuropsychologist, 12(1), 21–30.

    Google Scholar 

  • Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., Ziegler, E. A., Zeller, M. A., & Wright, M. J. (2013). Cross-validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28, 30–37.

    PubMed  Google Scholar 

  • Rees, L. M., Tombaugh, T. N., & Boulay, L. (2001). Depression and the Test of Memory Malingering. Archives of Clinical Neuropsychology, 16, 501–506.

    PubMed  Google Scholar 

  • Reese, C. S., Suhr, J. A., & Riddle, T. L. (2012). Exploration of malingering indices in the Wechsler Adult Intelligence Scale – Fourth Edition Digit Span subtest. Archives of Clinical Neuropsychology, 27, 176–181.

    PubMed  Google Scholar 

  • Reitan, R. M. (1958). The validity of the Trail Making Test as an indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.

    Google Scholar 

  • Retain, R. M. (1955). The relation of the Trail Making Test to organic brain damage. Journal of Consulting Psychology, 19, 393–394.

    Google Scholar 

  • Rogers, R., Sewell, K. W., Martin, M. A., & Vitacco, M. J. (2003). Detection of feigned mental disorders: A meta-analysis of the MMPI-2 and malingering. Assessment, 10, 160–177.

    PubMed  Google Scholar 

  • Rohling, M. L., Green, P., Allen, L. M., & Iverson, G. L. (2002). Depressive symptoms and neurocognitive test scores in patients passing symptom validity tests. Archives of Clinical Neuropsychology, 17, 205–222.

    PubMed  Google Scholar 

  • Root, J. C., Robbins, R. N., Chang, L., & Van Gorp, W. G. (2006). Detection of inadequate effort on the California Verbal Learning Test—Second Edition: Forced choice recognition and critical item analysis. Journal of the International Neuropsychological Society, 12, 688–696.

    PubMed  Google Scholar 

  • Schwartz, E. S., Erdodi, L., Rodriguez, N., Jyotsna, J. G., Curtain, J. R., Flashman, L. A., & Roth, R. M. (2016). CVLT-II forced choice recognition trial as an embedded validity indicator: A systematic review of the evidence. Journal of the International Neuropsychological Society, 22(8), 851–858.

    PubMed  Google Scholar 

  • Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gatz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23, 94–104.

    Google Scholar 

  • Siefert, C. J., Sinclair, S. J., Kehl-Fie, K. A., & Blais, M. A. (2009). An item-level psychometric analysis of the Personality Assessment Inventory clinical scales in a psychiatric inpatient unit. Assessment, 16(4), 373–383.

    PubMed  Google Scholar 

  • Sims, J. A., Thomas, K. M., Hopwood, C. J., Chen, S. H., & Pascale, C. (2013). Psychometric properties and norms for the Personality Assessment Inventory in egg donors and gestational carriers. Journal of Personality Assessment, 95(5), 495–499.

    PubMed  Google Scholar 

  • Sinclair, S. J., Walsh-Messinger, J., Siefert, C. J., Antonius, D., Baity, M. R., Haggerty, G., Stein, M. B., & Blais, M. A. (2015). Neuropsychological functioning and profile validity on the Personality Assessment Inventory (PAI): An investigation in multiple psychiatric settings. Bulletin of the Menninger Clinic, 79(4), 305–334.

    PubMed  Google Scholar 

  • Slick, D. J., Sherman, E. M. S., Grant, L., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561.

    PubMed  Google Scholar 

  • Sprinkle, S. D., Lurie, D., Insko, S. L., Atkinson, G., Jones, G. L., Logan, A. R., & Bissada, N. N. (2002). Criterion validity, severity cut scores, and test-retest reliability of the Beck Depression Inventory-II in a university counseling center sample. Journal of Counseling Psychology, 49(3), 381–385.

    Google Scholar 

  • Storch, E. A., Roberti, J. W., & Roth, D. A. (2004). Factor structure, concurrent validity, and internal consistency of the Beck Depression Inventory—Second Edition in a sample of college students. Depression and Anxiety, 19(3), 187–189.

    PubMed  Google Scholar 

  • Sugarman, M. A., & Axelrod, B. N. (2015). Embedded measures of performance validity using verbal fluency tests in a clinical sample. Applied Neuropsychology: Adult, 22(2), 141–146.

    Google Scholar 

  • Suhr, J., & Spickard, B. (2012). Pain-related fear is associated with cognitive task avoidance: Exploration of the cogniphobia construct in a recurrent headache sample. The Clinical Neuropsychologist, 26(7), 1128–1141. https://doi.org/10.1080/13854046.2012.713121.

    Article  PubMed  Google Scholar 

  • Suhr, J., Tranel, D., Wefel, J., & Barrash, J. (1997). Memory performance after head injury: Contributions of malingering, litigation status, psychological factors, and medication use. Journal of Clinical and Experimental Psychology, 19(4), 500–514.

    Google Scholar 

  • Suhr, J. A. (2003). Neuropsychological impairment in fibromyalgia. Relation to depression, fatigue, and pain. Journal of Psychosomatic Research, 55, 321–329.

    PubMed  Google Scholar 

  • Suhr, J. A., & Boyer, D. (1999). Use of the Wisconsin Card Sorting Test in the detection of malingering in student simulator and patient samples. Journal of Clinical and Experimental Psychology, 21(5), 701–708.

    Google Scholar 

  • Sullivan, K., & King, J. (2008). Detecting faked psychopathology: A comparison of two tests to detect malingered psychopathology using a simulation design. Psychiatry Research, 176, 75–81.

    Google Scholar 

  • Sussman, Z. W., Peterson, R. L., Connery, A. K., Baker, D. A., & Kirkwood, M. W. (2017). Utility of Matrix Reasoning as an embedded performance validity indicator in pediatric mild traumatic brain injury. Applied Neuropsychology: Child.

  • Trueblood, W. (1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 14(4), 697–607.

    Google Scholar 

  • Tyson, B. T., Baker, S., Greenacre, M., Kent, K., J., Lichtenstein, J. D., Sabelli, A., & Erdodi, L.A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45.

    Google Scholar 

  • van Gorp, E. G., Humphrey, L. A., Kalechstein, A. L., Brumm, V. L., McMullen, W. J., Stoddard, M., & McPachana, N. A. (1999). How well do standard clinical neuropsychological tests identify malingering? A preliminary analysis. Journal of Clinical and Experimental Neuropsychology, 21, 245–250.

    PubMed  Google Scholar 

  • Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the Inventory of Problems–29: A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99, 534–544.

    PubMed  Google Scholar 

  • Wechsler, D. (2008). Wechsler Adult Intelligence Test—Fourth edition (WAIS-IV). San Antonio, TX: Pearson.

    Google Scholar 

  • Westcott, M. C., & Alfrano, D. P. (2005). The symptoms checklist-90-revised and mild traumatic brain injury. Brain Injury, 19(14), 1261–1267.

    PubMed  Google Scholar 

  • Whiteside, D. M., Kogan, J., Wardin, L., Philips, D., Franzwa, M. G., Rice, L., Basso, M., & Roper, B. (2015). Language-based embedded performance validity measures in traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 37(2), 220–227.

    PubMed  Google Scholar 

  • Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test 4. Lutz, FL: Psychological Assessment Resources, Inc.

    Google Scholar 

  • Williamson, D. J., Holsman, M., Chaytor, N., Miller, J. W., & Drane, D. L. (2012). Abuse, not financial incentive, predicts non-credible cognitive performance in patients with psychogenic non-epileptic seizures. The Clinical Neuropsychologist, 26(4), 588–598.

    PubMed  Google Scholar 

  • Zenisek, R., Millis, S. R., Banks, S. J., & Miller, J. B. (2016). Prevalence of below-criterion Reliable Digit Span scores in a clinical sample of older adults. Archives of Clinical Neuropsychology, 31(5), 426–433.

    PubMed  PubMed Central  Google Scholar 

  • Zuccato, B. G., Tyson, T. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment. https://doi.org/10.1037/pas0000596.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laszlo A. Erdodi.

Ethics declarations

Relevant ethical guidelines regulating research involving human participants were followed throughout the project. All data collection, storage, and processing was done in compliance with the Helsinki Declaration.

Conflict of Interest

The authors declare that they have no conflicts of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Erdodi, L.A., Kirsch, N.L., Sabelli, A.G. et al. The Grooved Pegboard Test as a Validity Indicator—a Study on Psychogenic Interference as a Confound in Performance Validity Research. Psychol. Inj. and Law 11, 307–324 (2018). https://doi.org/10.1007/s12207-018-9337-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12207-018-9337-7

Keywords

Navigation