Advertisement

The Grooved Pegboard Test as a Validity Indicator—a Study on Psychogenic Interference as a Confound in Performance Validity Research

  • Laszlo A. Erdodi
  • Ned L. Kirsch
  • Alana G. Sabelli
  • Christopher A. Abeare
Article

Abstract

This study was designed to replicate an earlier report on the link between low scores on the Grooved Pegboard test (GPB), invalid responding, and elevated self-reported psychiatric symptoms. A fixed battery of neuropsychological tests was administered to 100 consecutively referred outpatients (MAge = 38.3, MEducation = 13.6 years) following traumatic brain injury at a Midwestern academic medical center. Classification accuracy of GPB validity cutoffs was computed against a free-standing PVT and three composite measures of embedded validity indicators. Previously suggested GPB validity cutoffs (T ≤ 29 in either hand) produced good combinations of sensitivity (0.25–0.55) and specificity (0.89–0.98) to psychometrically defined invalid performance. Raising the cutoff to T ≤ 31 resulted in a reasonable trade-off between increased sensitivity (0.36–0.55) and decreased specificity (0.84–0.94). T ≤ 31 in both hands was highly specific (0.93–0.98) to noncredible responding. GPB validity cutoffs were unrelated to psychiatric symptoms or injury severity. Failing PVTs based on forced choice recognition was associated with elevated self-reported depression, somatic concerns, and overall symptomatology. Low scores on the GPB are reliable indicators of noncredible responding. Self-reported emotional distress has a complex relationship with performance validity. Psychogenic interference is a potential mechanism behind PVT failures, and its expression is likely mediated by instrumentation and sampling artifacts. Further research on the topic is clearly needed to advance current understanding of psychogenic interference as a confound in cognitive testing.

Keywords

Grooved Pegboard Test Performance validity Psychogenic interference Manual dexterity BDI-II SCL-90-R 

Notes

Compliance with Ethical Standards

Relevant ethical guidelines regulating research involving human participants were followed throughout the project. All data collection, storage, and processing was done in compliance with the Helsinki Declaration.

Conflict of Interest

The authors declare that they have no conflicts of interest.

References

  1. An, K. Y., Charles, J., Ali, S., Enache, A., Dhuga, J., & Erdodi, L. A. (2018). Re-examining performance validity cutoffs within the Complex Ideational Material and the Boston Naming Test-Short Form using an experimental malingering paradigm. Journal of Clinical and Experimental Neuropsychology, 1–11.  https://doi.org/10.1080/13803395.2018.1483488.
  2. Arnold, G., & Boone, K. B. (2007). Use of motor and sensory tests as measures of effort. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. New York, NY: Guilford.Google Scholar
  3. Arnold, G., Boone, K. B., Lu, P., Dean, A., Wen, J., Nitch, S., & McPhearson, S. (2005). Sensitivity and specificity of finger tapping test scores for the detection of suspect effort. The Clinical Neuropsychologist, 19(1), 105–120.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866.CrossRefGoogle Scholar
  5. Ashendorf, L., O’Bryant, S. E., & McCaffrey, R. J. (2003). Specificity of malingering detection strategies in older adults using the CVLT and WCST. Clinical Neuropsychology, 17(2), 255–262.CrossRefGoogle Scholar
  6. Axelrod, B. N., Meyers, J. E., & Davis, J. J. (2014). Finger tapping test performance as a measure of performance validity. The Clinical Neuropsychologist, 28(5), 876–888.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159.CrossRefGoogle Scholar
  8. Bearden, C. E., Glahn, D. C., Monkul, E. S., Barrett, J., Najt, P., Villareal, V., & Soares, J. C. (2006). Patterns of memory impairment in bipolar disorder and unipolar major depression. Psychiatry Research, 142, 139–150.CrossRefPubMedPubMedCentralGoogle Scholar
  9. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-II. San Antonio, TX: Psychological Corporation.Google Scholar
  10. Bell-Sprinkle, T. L., Boone, K. B., Miora, D., Cottingham, M., Victor, T., Ziegler, E., Zeller, M., & Wright, M. (2013). Re-examination of the Rey Word Recognition Test. The Clinical Neuropsychologist, 27(3), 516–527.CrossRefGoogle Scholar
  11. Berry, D. T. R., Adams, J. J., Clark, C. D., Thacker, S. R., Burger, T. L., Wetter, M. W., Baer, R. A., & Borden, J. W. (1996). Detection of a cry for help on the MMPI-2: An analog investigation. Journal of Personality Assessment, 67(1), 26–36.CrossRefGoogle Scholar
  12. Bigler, E. D. (2012). Symptom validity testing, effort and neuropsychological assessment. Journal of the International Neuropsychological Society, 18, 632–642.CrossRefGoogle Scholar
  13. Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638.CrossRefPubMedPubMedCentralGoogle Scholar
  14. Bigler, E. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444.CrossRefGoogle Scholar
  15. Binder, L. M., & Willis, S. C. (1991). Assessment of motivation after financially compensable minor head trauma. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 3, 175–181.CrossRefGoogle Scholar
  16. Boone, D. (1998). Internal consistency reliability of the Personality Assessment Inventory with psychiatric inpatients. Journal of Clinical Psychology, 54(6), 839–843.CrossRefGoogle Scholar
  17. Boone, K. B. (2007a). Assessment of feigned cognitive impairment. A neuropsychological perspective. New York, NY: Guilford.Google Scholar
  18. Boone, K. B. (2007b). Commentary on “Cogniform disorder and cogniform condition: Proposed diagnoses for excessive cognitive symptoms” by Dean C. Delis and Spencer R. Wetter. Archives of Clinical Neuropsychology, 22, 675–679.CrossRefGoogle Scholar
  19. Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York, NY: Guilford.Google Scholar
  20. Bortnik, K. E., Boone, K. B., Marion, S. D., Amano, S., Ziegler, E., Victor, T. L., & Zeller, M. A. (2010). Examination of various WMS-III logical memory scores in the assessment of response bias. The Clinical Neuropsychologist, 24(2), 344–357.CrossRefPubMedGoogle Scholar
  21. Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the Association for Scientific Advancement in Psychological Injury and Law. Psychological Injury and Law, 7(3), 197–205.CrossRefGoogle Scholar
  22. Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., … Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity (NAN Policy and Planning Committees). Archives of Clinical Neuropsychology, 20, 419–426.CrossRefPubMedGoogle Scholar
  23. Carone, D. A. (2008). Children with moderate/severe brain damage/dysfunction outperform adults with mild-to-no brain damage on the Medical Symptom Validity Test. Brain Injury, 22(12), 960–971.CrossRefPubMedGoogle Scholar
  24. Chafetz, M. D., Williams, M. A., Ben-Porath, Y. S., Bianchini, K. J., Boone, K. B., Kirkwood, M. W., Larrabee, G. J., & Ord, J. S. (2015). Official position of the American Academy of Clinical Neuropsychology Social Security Administration policy on validity testing: Guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740.CrossRefPubMedGoogle Scholar
  25. Christensen, H., Griffiths, K., MacKinnon, A., & Jacomb, P. (1997). A quantitative review of cognitive deficits in depression and Alzheimer-type dementia. Journal of the International Neuropsychological Society, 3, 631–651.PubMedGoogle Scholar
  26. Conners, K. C. (2004). Conner’s continuous performance test (CPT II).Version 5 for Windows. Technical guide and software manual. North Tonawada, NY: Multi-Health Systems.Google Scholar
  27. Considine, C., Weisenbach, S. L., Walker, S. J., McFadden, E. M., Franti, L. M., Bieliauskas, L. A., Maixner, D. F., Giordani, B., Berent, S., & Langenecker, S. A. (2011). Auditory memory decrements, without dissimulation, among patients with major depressive disorder. Archives of Clinical Neuropsychology, 26, 445–453.CrossRefPubMedPubMedCentralGoogle Scholar
  28. Costabile, T., Bilo, L., DeRosa, A., Pane, C., & Sacca, F. (2018). Dissociative identity disorder: Restoration of executive functions after switch from alter to host personality. Psychiatry and Clinical Neurosciences, 72, 189–190.CrossRefPubMedGoogle Scholar
  29. Cottingham, M. E., Victor, T. L., Boone, K. B., Ziegler, E. A., & Zeller, M. (2014). Apparent effect of type of compensation seeking (disability vs. litigation) on performance validity test scores may be due to other factors. The Clinical Neuropsychologist, 28(6), 1030–1047.CrossRefPubMedGoogle Scholar
  30. Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23, 133–152.CrossRefPubMedPubMedCentralGoogle Scholar
  31. DeFilippis, N. A., & McCampbell, E. (1997). Manual for the booklet category test. Odessa, FL: Psychological Assessment Resources.Google Scholar
  32. Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. (2000). The California Verbal Learning Test (2nd ed.). San Antonio, TX: The Psychological Corporation.Google Scholar
  33. Delis, D. C., & Wetter, S. R. (2007). Cogniform disorder and cogniform condition: Proposed diagnoses for excessive cognitive symptoms. Archives of Clinical Neuropsychology, 22, 589–604.CrossRefPubMedPubMedCentralGoogle Scholar
  34. Derogatis, L. R. (1994). SCL-90-R: Administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems.Google Scholar
  35. Donders, J. (2005). Performance on the Test of Memory Malingering in a mixed pediatric sample. Child Neuropsychology, 11(2), 221–227.CrossRefPubMedPubMedCentralGoogle Scholar
  36. Donders, J., & Strong, C. H. (2011). Embedded effort indicators on the California Verbal Learning Test—Second edition (CVLT-II): An attempted cross-validation. The Clinical Neuropsychologist, 25, 173–184.CrossRefPubMedPubMedCentralGoogle Scholar
  37. Davis, J. J. (2014). Further consideration of Advanced Clinical Solutions Word Choice: Comparison to the Recognition Memory Test – Words and classification accuracy on a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294.  https://doi.org/10.1080/13854046.2014.975844.CrossRefPubMedPubMedCentralGoogle Scholar
  38. Dunn, L. M., & Dunn, D. M. (2007). Peabody Picture Vocabulary Test (4th ed.). San Antonio, TX, Pearson.Google Scholar
  39. Egeland, J., Lund, A., Landro, N. I., Rund, B. R., Sudet, K., Asbjornsen, A., Mjellem, N., Roness, A., & Stordal, K. I. (2005). Cortisol level predicts executive and memory function in depression, symptom level predicts psychomotor speed. Acta Psychiatrica Scandinavica, 112, 434–441.CrossRefGoogle Scholar
  40. Erdodi, L. A. (2017). Aggregating validity indicators: The salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment. Applied Neuropsychology: Adult, 1–18.  https://doi.org/10.1080/23279095.2017.1384925.
  41. Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017a). WAIS-IV processing speed scores as measures of non-credible responding—The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2017b). A single error is one too many: The Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology.  https://doi.org/10.1093/arclin/acx110.
  43. Erdodi, L. A., Dunn, A. G., Seke, K. R., Charron, C., McDermott, A., Enache, A., Maytham, C., & Hurtubise, J. (2018d). The Boston Naming Test as a measure of performance validity. Psychological Injury and Law, 11, 1–8.  https://doi.org/10.1007/s12207-017-9309-3.CrossRefGoogle Scholar
  44. Erdodi, L. A., Hurtubise, J. L., Charron, C., Dunn, A., Enache, A., McDermott, A., & Hirst, R. B. (2018a). The D-KEFS Trails as performance validity tests. Psychological Assessment, 30(8), 1082–1095.CrossRefPubMedPubMedCentralGoogle Scholar
  45. Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014a). Comparing the Recognition Memory Test and the Word Choice Test in a mixed clinical sample: Are they equivalent? Psychological Injury and Law, 7(3), 255–263.  https://doi.org/10.1007/s12207-014-9197-8.CrossRefGoogle Scholar
  46. Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046.CrossRefPubMedPubMedCentralGoogle Scholar
  47. Erdodi, L. A., Pelletier, C. L., & Roth, R. M. (2018b). Elevations on select Conners’ CPT-II scales indicate noncredible responding in adults with traumatic brain injury. Applied Neuropsychology: Adult, 25(1), 19–28.  https://doi.org/10.1080/23279095.2016.1232262.CrossRefGoogle Scholar
  48. Erdodi, L. A., & Roth, R. M. (2017). Low scores on BDAE Complex Ideational Material are associated with invalid performance in adults without aphasia. Applied Neuropsychology: Adult, 24(3), 264–274.  https://doi.org/10.1080/23279095.2017.1298600.CrossRefGoogle Scholar
  49. Erdodi, L. A., & Rai, J. K. (2017). A single error is one too many: Examining alternative cutoffs on trial 2 on the TOMM. Brain Injury, 31(10), 1362–1368.  https://doi.org/10.1080/02699052.2017.1332386.CrossRefPubMedPubMedCentralGoogle Scholar
  50. Erdodi, L. A., Roth, R. M., Kirsch, N. L., Lajiness-O’Neill, R., & Medoff, B. (2014b). Aggregating validity indicators embedded in Conners’ CPT-II outperforms individual cutoffs at separating valid from invalid performance in adults with traumatic brain injury. Archives of Clinical Neuropsychology, 29(5), 456–466.CrossRefPubMedPubMedCentralGoogle Scholar
  51. Erdodi, L. A., Sagar, S., Seke, K., Zuccato, B. G., Schwartz, E. S., & Roth, R. M. (2018c). The Stroop Test as a measure of performance validity in adults clinically referred for neuropsychological assessment. Psychological Assessment, 30(6), 755–766.  https://doi.org/10.1037/pas0000525.CrossRefPubMedPubMedCentralGoogle Scholar
  52. Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017d). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology & Neuroscience, 10(3), 325–344.CrossRefGoogle Scholar
  53. Erdodi, L. A., Tyson, B. T., Abeare, C. A., Lichtenstein, J. D., Pelletier, C. L., Rai, J. K., & Roth, R. M. (2016). The BDAE Complex Ideational Material—A measure of receptive language or performance validity? Psychological Injury and Law, 9, 112–120.CrossRefGoogle Scholar
  54. Erdodi, L. A., Tyson, B. T., Abeare, C. A., Zuccato, B. G., Rai, J. K., Seke, K. R., …, & Roth, R. M. (2017e). Utility of critical items within the Recognition Memory Test and Word Choice Test. Applied Neuropsychology: Adult.  https://doi.org/10.1080/23279095.2017.1298600 CrossRefGoogle Scholar
  55. Erdodi, L. A., Tyson, B. T., Shahein, A., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Zuccato, B. G., Kucharski, B., & Roth, R. M. (2017c). The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383.  https://doi.org/10.1080/13803395.2016.1230181.CrossRefPubMedPubMedCentralGoogle Scholar
  56. Etherton, J. L., Bianchini, K. J., Heinly, M. T., & Greve, K. W. (2006). Pain, malingering, and performance on the WAIS-III Processing Speed Index. Journal of Clinical and Experimental Neuropsychology, 28(7), 1218–1237.CrossRefPubMedPubMedCentralGoogle Scholar
  57. Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2018). A clinical comparison, simulation study testing the validity and IOP-29 with an Italian sample. Psychological Injury and Law.  https://doi.org/10.1007/s12207-018-9314-1.
  58. Green, P. (2003). Green’s word memory test. Edmonton, Canada: Green’s Publishing.Google Scholar
  59. Green, P. (2008). Green’s non-verbal medical symptom validity test. Edmonton: Green’s Publishing.Google Scholar
  60. Green, P., Iverson, G., & Allen, L. (1999). Detecting malingering in head injury litigation with the Word Memory Test. Brain Injury, 13, 813–819.CrossRefPubMedPubMedCentralGoogle Scholar
  61. Greiffenstein, M. F., & Baker, W. J. (2008). Validity testing in dually diagnosed post-traumatic stress disorder and mild closed head injury. The Clinical Neuropsychologist, 22, 565–582.CrossRefPubMedPubMedCentralGoogle Scholar
  62. Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224.CrossRefGoogle Scholar
  63. Greiffenstein, M. F., Baker, W. J., & Gola, T. (1996). Motor dysfunction profiles in traumatic brain injury and postconcussion syndrome. Journal of the International Neuropsychological Society, 2(06), 477.CrossRefPubMedPubMedCentralGoogle Scholar
  64. Greve, K. W., & Bianchini, K. J. (2004). Setting empirical cutoffs on psychometric indicators of negative response bias: A methodological commentary with recommendation. Archives of Clinical Neuropsychology, 19, 533–541.CrossRefPubMedPubMedCentralGoogle Scholar
  65. Greve, K. W., Bianchini, K. J., Mathias, C. W., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction with the Wisconsin Card Sorting Test: A preliminary investigation in traumatic brain injury. The Clinical Neuropsychologist, 16(2), 179–191.CrossRefPubMedPubMedCentralGoogle Scholar
  66. Grote, C., Kooker, E. K., Garron, D. C., Nyenhuis, D. L., Smith, C. A., & Mattingly, M. L. (2000). Performance of compensation seeking and non-compensation seeking samples on the Victoria Symptom Validity Tests: Cross-validation and extension of a standardization study. Journal of Clinical and Experimental Neuropsychology, 22, 709–791.CrossRefPubMedPubMedCentralGoogle Scholar
  67. Halstead, W. (1947). Brain and intelligence. A quantitative study of the frontal lobes. Chicago: University of Chicago Press.Google Scholar
  68. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtis, G. (1993). Wisconsin Card Sorting Test (WCST) manual revised and expanded. Odessa, FL: Psychological Assessment Resources.Google Scholar
  69. Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.Google Scholar
  70. Heaton, R. K., Smith, H. H., Lehman, R. A. W., & Vogt, A. T. (1978). Prospects for faking believable deficits on neuropsychological testing. Journal of Consulting and Clinical Psychology, 46(5), 892–900.CrossRefGoogle Scholar
  71. Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Conference Participants. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129.CrossRefGoogle Scholar
  72. Heinly, M. T., Greve, K. W., Bianchini, K., Love, J. M., & Brennan, A. (2005). WAIS digit-span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444.CrossRefPubMedPubMedCentralGoogle Scholar
  73. Henry, G. K., Helbronner, R. L., Suhr, J., Gornbein, J., Wagner, E., & Drane, D. L. (2018). Illness perceptions predict cognitive performance validity. Journal of the International Neuropsychological Society, 24, 1–11.CrossRefGoogle Scholar
  74. Hopwood, C. J., Morey, L. C., Shea, M. T., McGlashan, T. H., Sanislow, C. A., Grilo, C. M., … Skodol, A. E. (2007). Personality traits predict current and future functioning comparably for individuals with major depressive and personality disorders. Journal of Nervous and Mental Disorders, 195(3), 266–269.CrossRefPubMedPubMedCentralGoogle Scholar
  75. Inman, T. H., & Berry, D. T. R. (2002). Cross-validation of indicators of malingering: A comparison of nine neuropsychological tests, four tests of malingering, and behavioral observations. Archives of Clinical Neuropsychology, 17, 1–23.CrossRefPubMedPubMedCentralGoogle Scholar
  76. Jasinski, L. J., Berry, D. T., Shandera, A. L., & Clark, J. A. (2011). Use of the Wechsler Adult Intelligence Scale Digit Span subtest for malingering detection: A meta-analytic review. Journal of Clinical and Experimental Neuropsychology, 33(3), 300–314.CrossRefPubMedPubMedCentralGoogle Scholar
  77. Johnson, R.W., Ellison, R.A., & Heikkinen, C.A. (1989). Psychological symptoms of counseling center clients. Journal of Counseling Psychology, 36(1), 110-114.CrossRefGoogle Scholar
  78. Johnson, J. L., & Lesniak-Karpiak, K. (1997). The effect of warning on malingering on memory and motor tasks in college samples. Archives of Clinical Neuropsychology, 12, 231–238.CrossRefPubMedPubMedCentralGoogle Scholar
  79. Jones, A. (2013). Test of memory malingering: Cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059.CrossRefPubMedPubMedCentralGoogle Scholar
  80. Kalfon, T. B., Gal, G., Shorer, R., & Ablin, J. N. (2016). Cognitive functioning in fibromyalgia: The central role of effort. Journal of Psychosomatic Research, 87, 30–36.CrossRefGoogle Scholar
  81. Karlin, B. E., Creech, S. K., Grimes, J. S., Clark, T. S., Meagher, M. W., & Morey, L. C. (2005). The Personality Assessment Inventory with chronic pain patients: Psychometric properties and clinical utility. Journal of Clinical Psychology, 61(12), 1571–1585.CrossRefPubMedPubMedCentralGoogle Scholar
  82. Kemp, S., Coughlan, A. K., Rowbottom, C., Wilkinson, K., Teggart, V., & Baker, G. (2008). The base rate of effort test failure in patients with medically unexplained symptoms. Journal of Psychosomatic Research, 65(4), 319–325.CrossRefGoogle Scholar
  83. Kiewel, N. A., Wisdom, N. M., Bradshaw, M. R., Pastorek, N. J., & Strutt, A. M. (2012). Retrospective review of digit span-related effort indicators in probable Alzheimer’s disease patients. The Clinical Neuropsychologist, 26(6), 965–974.CrossRefGoogle Scholar
  84. Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., Ziegler, E. A., & Zeller, M. A. (2010a). The Warrington Recognition Memory Test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25, 60–70.CrossRefGoogle Scholar
  85. Kim, N., Boone, K. B., Victor, T., Lu, P., Keatinge, C., & Mitchell, C. (2010b). Sensitivity and specificity of a digit symbol recognition trial in the identification of response bias. Archives of Clinical Neuropsychology, 25(5), 420–428.CrossRefGoogle Scholar
  86. Kirkwood, M. W., & Kirk, J. W. (2010). The base rate of suboptimal effort in a pediatric mild TBI sample: Performance on the Medical Symptom Validity Test. The Clinical Neuropsychologist, 24(5), 860–872.CrossRefPubMedPubMedCentralGoogle Scholar
  87. Kjærgaard, M., Arfwedson Wang, C. E., Waterloo, K., & Jorde, R. (2014). A study of the psychometric properties of the Beck Depression Inventory-II, the Montgomery and Åsberg Depression Rating Scale, and the Hospital Anxiety and Depression Scale in a sample from a healthy population. Scandinavian Journal of Psychology, 55(1), 83–89.CrossRefGoogle Scholar
  88. Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental Test of Memory Malingering Scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244.CrossRefGoogle Scholar
  89. Lafayette Instrument. (2015). Grooved Pergboard user’s manual. Lafayette, IN.Google Scholar
  90. Lange, R. T., Iverson, G. L., Brickell, T. A., Staver, T., Pancholi, S., Bhagwat, A., & French, L. M. (2013). Clinical utility of the Conners’ Continuous Performance Test-II to detect poor effort in U.S. military personnel following traumatic brain injury. Psychological Assessment, 25(2), 339–352.CrossRefPubMedGoogle Scholar
  91. Lange, R. T., & Lippa, S. M. (2017). Sensitivity and specificity should never be interpreted in isolation without consideration of other clinical utility metrics. The Clinical Neuropsychologist, 31, 1015–1028.CrossRefPubMedGoogle Scholar
  92. Langenecker, S. A., Bieliauskas, L. A., Rapport, L. J., Zubieta, J. K., Wilde, E. A., & Berent, S. (2005). Face emotion perception and executive functioning deficits in depression. Journal of Clinical and Experimental Psychology, 27, 320–333.Google Scholar
  93. Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425.CrossRefPubMedGoogle Scholar
  94. Larrabee, G. J. (2012). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: A scientific approach (2nd ed., pp. 116–159). New York: Oxford University Press.Google Scholar
  95. Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29, 364–373.CrossRefPubMedGoogle Scholar
  96. Larrabee, G. J., Millis, S. R., & Meyers, J. E. (2008). Sensitivity to brain dysfunction of the Halstead-Reitan vs and ability-focused neuropsychological battery. The Clinical Neuropsychologist, 22, 813–825.CrossRefPubMedGoogle Scholar
  97. Leighton, A., Weinborn, M., & Maybery, M. (2014). Bridging the gap between neurocognitive processing theory and performance validity assessment among the cognitively impaired: A review and methodological approach. Journal of the International Neuropsychological Society, 20, 873–886.CrossRefPubMedGoogle Scholar
  98. Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment. New York: Oxford University Press.Google Scholar
  99. Lichtenstein, J. D., Erdodi, L. A., & Linnea, K. S. (2017). Introducing a forced-choice recognition task to the California Verbal Learning Test—Children’s version. Child Neuropsychology, 23(3), 284–299.  https://doi.org/10.1080/09297049.2015.1135422.CrossRefGoogle Scholar
  100. Lichtenstein, J. D., Erdodi, L. A., Rai, J. K., Mazur-Mosiewicz, A., & Flaro, L. (2018). Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children. Child Neuropsychology, 24(2), 247–260.  https://doi.org/10.1080/09297049.2016.1259402.CrossRefPubMedGoogle Scholar
  101. Linn, R. T., Allen, K., & Willer, B. S. (1994). Affective symptoms in the chronic stage of traumatic brain injury: A study of married couples. Brain Injury, 8(2), 135–147.CrossRefPubMedGoogle Scholar
  102. Lu, P. H., Boone, K. B., Cozolino, L., & Mitchell, C. (2003). Effectiveness of the Rey-Osterrieth Complex Figure Test and the Meyers and Meyers recognition trial in the detection of suspect effort. The Clinical Neuropsychologist, 17(3), 426–440.CrossRefPubMedGoogle Scholar
  103. MacAllister, W. S., Nakhutina, L., Bender, H. A., Karantzoulis, S., & Carlson, C. (2009). Assessing effort during neuropsychological evaluation with the TOMM in children and adolescents with epilepsy. Child Neuropsychology, 15(6), 521–531.CrossRefPubMedGoogle Scholar
  104. Mathias, C. W., Greve, K. W., Bianchini, K. J., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction using the reliable digit span in traumatic brain injury. Assessment, 9(3), 301–308.CrossRefPubMedGoogle Scholar
  105. McGuire, B. E., & Shores, E. A. (2001). Simulated pain on the Symptom Checklist-90-Revised. Journal of Clinical Psychology, 57(12), 1589–1596.CrossRefPubMedGoogle Scholar
  106. Moore, B. A., & Donders, J. (2004). Predictors of invalid neuropsychological performance after traumatic brain injury. Brain Injury, 18(10), 975–984.CrossRefPubMedGoogle Scholar
  107. Morey, L. C. (1991). Personality Assessment Inventory. Odessa, FL: Routledge.Google Scholar
  108. Nelson, N. W., Boone, K., Dueck, A., Wagener, L., Lu, P., & Grills, C. (2003). The relationship between eight measures of suspect effort. The Clinical Neuropsychologist, 17(2), 263–272.CrossRefPubMedGoogle Scholar
  109. Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8, 46–63.CrossRefGoogle Scholar
  110. Ord, J. S., Boettcher, A. C., Greve, K. J., & Bianchini, K. J. (2010). Detection of malingering in mild traumatic brain injury with the Conners’ Continuous Performance Test-II. Journal of Clinical and Experimental Neuropsychology, 32(4), 380–387.CrossRefGoogle Scholar
  111. Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV—Technical manual. San Antonio, TX: Author.Google Scholar
  112. Persinger, V. C., Whiteside, D. M., Bobova, L., Saigal, S. D., Vannucci, M. J., & Basso, M. R. (2018). Using the California Verbal Learning Test, second edition as an embedded performance validity measure among individuals with TBI and individuals with psychiatric disorders. The Clinical Neuropsychologist, 32(6), 1039–1053.  https://doi.org/10.1080/13854046.2017.1419507. CrossRefGoogle Scholar
  113. Rapport, L. J., Farchione, T. J., Coleman, R. D., & Axelrod, B. N. (1998). Effects of coaching on malingered motor function profiles. Journal of Clinical and Experimental Neuropsychology, 20(1), 89–97.CrossRefPubMedPubMedCentralGoogle Scholar
  114. Raskin, S. A., Mateer, C. A., & Tweeten, R. (1998). Neuropsychological assessment of individuals with mild traumatic brain injury. The Clinical Neuropsychologist, 12(1), 21–30.CrossRefGoogle Scholar
  115. Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., Ziegler, E. A., Zeller, M. A., & Wright, M. J. (2013). Cross-validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28, 30–37.CrossRefPubMedPubMedCentralGoogle Scholar
  116. Rees, L. M., Tombaugh, T. N., & Boulay, L. (2001). Depression and the Test of Memory Malingering. Archives of Clinical Neuropsychology, 16, 501–506.CrossRefPubMedPubMedCentralGoogle Scholar
  117. Reese, C. S., Suhr, J. A., & Riddle, T. L. (2012). Exploration of malingering indices in the Wechsler Adult Intelligence Scale – Fourth Edition Digit Span subtest. Archives of Clinical Neuropsychology, 27, 176–181.CrossRefGoogle Scholar
  118. Reitan, R. M. (1958). The validity of the Trail Making Test as an indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.CrossRefGoogle Scholar
  119. Retain, R. M. (1955). The relation of the Trail Making Test to organic brain damage. Journal of Consulting Psychology, 19, 393–394.CrossRefGoogle Scholar
  120. Rogers, R., Sewell, K. W., Martin, M. A., & Vitacco, M. J. (2003). Detection of feigned mental disorders: A meta-analysis of the MMPI-2 and malingering. Assessment, 10, 160–177.CrossRefGoogle Scholar
  121. Rohling, M. L., Green, P., Allen, L. M., & Iverson, G. L. (2002). Depressive symptoms and neurocognitive test scores in patients passing symptom validity tests. Archives of Clinical Neuropsychology, 17, 205–222.CrossRefGoogle Scholar
  122. Root, J. C., Robbins, R. N., Chang, L., & Van Gorp, W. G. (2006). Detection of inadequate effort on the California Verbal Learning Test—Second Edition: Forced choice recognition and critical item analysis. Journal of the International Neuropsychological Society, 12, 688–696.CrossRefGoogle Scholar
  123. Schwartz, E. S., Erdodi, L., Rodriguez, N., Jyotsna, J. G., Curtain, J. R., Flashman, L. A., & Roth, R. M. (2016). CVLT-II forced choice recognition trial as an embedded validity indicator: A systematic review of the evidence. Journal of the International Neuropsychological Society, 22(8), 851–858.CrossRefGoogle Scholar
  124. Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gatz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23, 94–104.CrossRefGoogle Scholar
  125. Siefert, C. J., Sinclair, S. J., Kehl-Fie, K. A., & Blais, M. A. (2009). An item-level psychometric analysis of the Personality Assessment Inventory clinical scales in a psychiatric inpatient unit. Assessment, 16(4), 373–383.CrossRefGoogle Scholar
  126. Sims, J. A., Thomas, K. M., Hopwood, C. J., Chen, S. H., & Pascale, C. (2013). Psychometric properties and norms for the Personality Assessment Inventory in egg donors and gestational carriers. Journal of Personality Assessment, 95(5), 495–499.CrossRefGoogle Scholar
  127. Sinclair, S. J., Walsh-Messinger, J., Siefert, C. J., Antonius, D., Baity, M. R., Haggerty, G., Stein, M. B., & Blais, M. A. (2015). Neuropsychological functioning and profile validity on the Personality Assessment Inventory (PAI): An investigation in multiple psychiatric settings. Bulletin of the Menninger Clinic, 79(4), 305–334.CrossRefGoogle Scholar
  128. Slick, D. J., Sherman, E. M. S., Grant, L., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561.CrossRefGoogle Scholar
  129. Sprinkle, S. D., Lurie, D., Insko, S. L., Atkinson, G., Jones, G. L., Logan, A. R., & Bissada, N. N. (2002). Criterion validity, severity cut scores, and test-retest reliability of the Beck Depression Inventory-II in a university counseling center sample. Journal of Counseling Psychology, 49(3), 381–385.CrossRefGoogle Scholar
  130. Storch, E. A., Roberti, J. W., & Roth, D. A. (2004). Factor structure, concurrent validity, and internal consistency of the Beck Depression Inventory—Second Edition in a sample of college students. Depression and Anxiety, 19(3), 187–189.CrossRefGoogle Scholar
  131. Sugarman, M. A., & Axelrod, B. N. (2015). Embedded measures of performance validity using verbal fluency tests in a clinical sample. Applied Neuropsychology: Adult, 22(2), 141–146.CrossRefGoogle Scholar
  132. Suhr, J., & Spickard, B. (2012). Pain-related fear is associated with cognitive task avoidance: Exploration of the cogniphobia construct in a recurrent headache sample. The Clinical Neuropsychologist, 26(7), 1128–1141.  https://doi.org/10.1080/13854046.2012.713121.CrossRefPubMedPubMedCentralGoogle Scholar
  133. Suhr, J., Tranel, D., Wefel, J., & Barrash, J. (1997). Memory performance after head injury: Contributions of malingering, litigation status, psychological factors, and medication use. Journal of Clinical and Experimental Psychology, 19(4), 500–514.Google Scholar
  134. Suhr, J. A. (2003). Neuropsychological impairment in fibromyalgia. Relation to depression, fatigue, and pain. Journal of Psychosomatic Research, 55, 321–329.CrossRefPubMedPubMedCentralGoogle Scholar
  135. Suhr, J. A., & Boyer, D. (1999). Use of the Wisconsin Card Sorting Test in the detection of malingering in student simulator and patient samples. Journal of Clinical and Experimental Psychology, 21(5), 701–708.Google Scholar
  136. Sullivan, K., & King, J. (2008). Detecting faked psychopathology: A comparison of two tests to detect malingered psychopathology using a simulation design. Psychiatry Research, 176, 75–81.CrossRefGoogle Scholar
  137. Sussman, Z. W., Peterson, R. L., Connery, A. K., Baker, D. A., & Kirkwood, M. W. (2017). Utility of Matrix Reasoning as an embedded performance validity indicator in pediatric mild traumatic brain injury. Applied Neuropsychology: Child. Google Scholar
  138. Trueblood, W. (1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 14(4), 697–607.Google Scholar
  139. Tyson, B. T., Baker, S., Greenacre, M., Kent, K., J., Lichtenstein, J. D., Sabelli, A., & Erdodi, L.A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45. CrossRefGoogle Scholar
  140. van Gorp, E. G., Humphrey, L. A., Kalechstein, A. L., Brumm, V. L., McMullen, W. J., Stoddard, M., & McPachana, N. A. (1999). How well do standard clinical neuropsychological tests identify malingering? A preliminary analysis. Journal of Clinical and Experimental Neuropsychology, 21, 245–250.CrossRefPubMedPubMedCentralGoogle Scholar
  141. Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the Inventory of Problems–29: A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99, 534–544.CrossRefPubMedPubMedCentralGoogle Scholar
  142. Wechsler, D. (2008). Wechsler Adult Intelligence Test—Fourth edition (WAIS-IV). San Antonio, TX: Pearson.Google Scholar
  143. Westcott, M. C., & Alfrano, D. P. (2005). The symptoms checklist-90-revised and mild traumatic brain injury. Brain Injury, 19(14), 1261–1267.CrossRefPubMedPubMedCentralGoogle Scholar
  144. Whiteside, D. M., Kogan, J., Wardin, L., Philips, D., Franzwa, M. G., Rice, L., Basso, M., & Roper, B. (2015). Language-based embedded performance validity measures in traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 37(2), 220–227.CrossRefPubMedPubMedCentralGoogle Scholar
  145. Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test 4. Lutz, FL: Psychological Assessment Resources, Inc.Google Scholar
  146. Williamson, D. J., Holsman, M., Chaytor, N., Miller, J. W., & Drane, D. L. (2012). Abuse, not financial incentive, predicts non-credible cognitive performance in patients with psychogenic non-epileptic seizures. The Clinical Neuropsychologist, 26(4), 588–598.CrossRefPubMedPubMedCentralGoogle Scholar
  147. Zenisek, R., Millis, S. R., Banks, S. J., & Miller, J. B. (2016). Prevalence of below-criterion Reliable Digit Span scores in a clinical sample of older adults. Archives of Clinical Neuropsychology, 31(5), 426–433.CrossRefPubMedPubMedCentralGoogle Scholar
  148. Zuccato, B. G., Tyson, T. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment.  https://doi.org/10.1037/pas0000596.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Laszlo A. Erdodi
    • 1
  • Ned L. Kirsch
    • 2
  • Alana G. Sabelli
    • 3
  • Christopher A. Abeare
    • 1
  1. 1.Department of Psychology, Neuropsychology TrackUniversity of WindsorWindsorCanada
  2. 2.Department of Physical Medicine and RehabilitationUniversity of MichiganAnn ArborUSA
  3. 3.Brain-Cognition-Neuroscience ProgramUniversity of WindsorWindsorCanada

Personalised recommendations