Abstract
The identification and management of persistent post-concussion symptoms (PPCS) is reliant on the accurate and valid reporting of symptoms. To assist with the evaluation of validity, symptom validity indicators (SVIs) are used. This study explored the utility of the newly developed modified Rivermead Post-concussion Symptoms Questionnaire (RPQ), which embeds an SVI into the RPQ (mRPQ). Ninety-four participants completed the mRPQ; two existing SVIs (the Validity-10 [Val-10] and the Mild Brain Injury Atypical Symptoms [mBIAS] scale); two performance validity tests (the Test of Memory Malingering [TOMM] and Warrington’s Memory Recognition Test [WMRT]); and, a post-experimental questionnaire. This study utilized a simulation design, with participants randomly allocated to one of two conditions: mTBI Simulator (MS, n = 47) or Biased mTBI Simulator (BMS, n = 47). The BMS group received an additional biasing instruction to motivate distorted responding for a forensic assessment context. The validity measures were highly intercorrelated, as were the PPCS scores (p < 0.05). There were significant group differences on all measures (p < 0.05). The BMS group reported more PPCS than the MS group, and showed more signs of invalidity. Although relatively new and requiring further analysis, this study shows the mRPQ has the potential to aid clinical assessment as an indicator of symptom invalidity.
Similar content being viewed by others
Notes
The term “Symptom (or Performance) Validity Indicator,” or SVI (or PVI), is used in this manuscript, where other authors might use the term “Symptom (Performance) Validity Test,” or SVT (or PVT). We prefer the term SVI (or PVI) because there is no single test of symptom (or performance) invalidity.
In the MS condition, the Shapiro–Wilk statistic for standard RPQ symptoms was not significant.
References
Armistead-Jehle, P., Cooper, D. B., Grills, C. E., Cole, W. R., Lippa, S. M., Stegman, R. L., & Lange, R. T. (2018). Clinical utility of the mBIAS and NSI validity-10 to detect symptom over-reporting following mild TBI: A multicenter investigation with military service members. Journal of Clinical and Experimental Neuropsychology, 40(3), 213–223. https://doi.org/10.1080/13803395.2017.1329406
Blanca, M. J., Alarcon, R., Arnau, J., Bono, R., & Bendayan, R. (2017). Non-normal data: Is ANOVA still a valid option? Psicothema, 29, 552–557. https://doi.org/10.7334/psicothema2016.383
Bodapati, A. S., Combs, H. L., Pastorek, N. J., Miller, B., Troyanskaya, M., Romesser, J., ... & Linck, J. (2019). Detection of symptom over-reporting on the Neurobehavioral Symptom Inventory in OEF/OIF/OND veterans with history of mild TBI. The Clinical Neuropsychologist, 33(3), 539–556. https://doi.org/10.1080/13854046.2018.1482003
Brooks, K. J. L., & Sullivan, K. A. (accepted). Validating the modified Rivermead Post-Concussion Symptoms Questionnaire (mRPQ). The Clinical Neuropsychologist.
Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the Association for Scientific Advancement in Psychological Injury and Law. Psychological Injury and Law, 7(3), 197–205. https://doi.org/10.1007/s12207-014-9198-7
Bush, S. S., Ruff, R. M., Tröster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., ... & Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20(4), 419–426. https://doi.org/10.1016/j.acn.2005.02.002
Carone, D. A., & Bush, S. S. (2013). Introduction: Historical perspectives on mild traumatic brain injury, symptom validity assessment, and malingering. Mild traumatic brain injury: Symptom validity assessment and malingering (pp. 1–29). Springer Publishing Company.
Cartwright, A., Roach, J., & Armitage, R. (2019). Mission impossible? Assessing the veracity of a mental health problem as result of a road traffic accident: A preliminary review of UK experts’ practices. The Journal of Forensic Psychiatry & Psychology, 30(1), 89–111. https://doi.org/10.1080/14789949.2018.1502338
Cato Jackson, M., Brewster, J., Ryan, T., & Giuliano, A. (2003). Coaching and the ability to simulate mild traumatic brain-injury symptoms. The Clinical Neuropsychologist, 16, 524–535. The Clinical Neuropsychologist, 16, 524–535. https://doi.org/10.1076/clin.16.4.524.13901
Cicerone, K. D., & Kalmar, K. (1995). Persistent postconcussion syndrome: The structure of subjective complaints after mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 10(3), 1–17. https://doi.org/10.1097/00001199-199506000-00002
Cooper, D. B., Nelson, L., Armistead-Jehle, P., & Bowles, A. O. (2011). Utility of the mild brain injury atypical symptoms scale as a screening measure for symptom over-reporting in Operation Enduring Freedom/Operation Iraqi Freedom service members with post-concussive complaints. Archives of Clinical Neuropsychology, 26(8), 718–727. https://doi.org/10.1093/arclin/acr070
Dean, P. J. A., O’Neill, D., & Sterr, A. (2012). Post-concussion syndrome: Prevalence after mild traumatic brain injury in comparison with a sample without head injury. Brain Injury, 26(1), 14–26. https://doi.org/10.3109/02699052.2011.635354
Dewan, M. C., Rattani, A., Gupta, S., Baticulon, R. E., Hung, Y.-C., Punchak, M., ... & Park, K. B. (2019). Estimating the global incidence of traumatic brain injury. Journal of Neurosurgery, 130(4), 1080. https://doi.org/10.3171/2017.10.Jns17352
Donaldson, T. S. (1968). Robustness of the F-test to errors of both kinds and the correlation between the numerator and denominator of the F-ratio. Journal of the American Statistical Association, 63(322), 660–676. https://doi.org/10.2307/2284037
Donders, J., Lefebre, N., & Goldsworthy, R. (2019). Patterns of performance and symptom validity test findings after mild traumatic brain injury. Archives of Clinical Neuropsychology, 36(3), 394–402. https://doi.org/10.1093/arclin/acz057%JArchivesofClinicalNeuropsychology
Dretsch, M. N., Williams, K., Staver, T., Grammer, G., Bleiberg, J., DeGraba, T., & Lange, R. T. (2017). Evaluating the clinical utility of the Validity-10 for detecting amplified symptom reporting for patients with mild traumatic brain injury and comorbid psychological health conditions. Applied Neuropsychology: Adult, 24(4), 376–380. https://doi.org/10.1080/23279095.2016.1220947
Dunn, J. T., Lees-Haley, P. R., Brown, R. S., Williams, C. W., & English, L. T. (1995). Neurotoxic complaint base rates of personal injury claimants: Implications for neuropsychological assessment. Journal of Clinical Psychology, 51(4), 577–584.
Gunstad, J., & Suhr, J. (2001). “Expectation as etiology” versus “the good old days”: Postconcussion syndrome symptom reporting in athletes, headache sufferers, and depressed individuals. Journal of the International Neuropsychological Society, 7(3), 323.
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Conference, P. (2009). American Academy of Clinical Neuropsychology Consensus Conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129. https://doi.org/10.1080/13854040903155063
Heilbrun, K., Bennett, W. S., White, A. J., & Kelly, J. (1990). An MMPI-based empirical model of malingering and deception. Behavioral Sciences & the Law, 8(1), 45–53. https://doi.org/10.1002/bsl.2370080106
Iverson, G. L. (2006). Ethical issues associated with the assessment of exaggeration, poor effort, and malingering. Applied Neuropsychology: Adult, 13(2), 77–90. https://doi.org/10.1207/s15324826an1302_3
Iverson, G. L. (2012). A biopsychosocial conceptualization of poor outcome from mild traumatic brain injury. In J. J. Vasterling, R. A. Bryant, & T. M. Keane (Eds.), PTSD and mild traumatic brain injury (pp. 36–60). The Guilford Press.
Jurick, S. M., Crocker, L. D., Keller, A. V., Hoffman, S. N., Bomyea, J., Jacobson, M. W., & Jak, A. J. (2018). The Minnesota Multiphasic Personality Inventory-2-RF in treatment-seeking veterans with history of mild traumatic brain injury. Archives of Clinical Neuropsychology, 34(3), 366–380. https://doi.org/10.1093/arclin/acy048
Jurick, S. M., Crocker, L. D., Merritt, V. C., Hoffman, S. N., Keller, A. V., Eglit, G. M. L., ... & Rodgers, C. S. (2020). Psychological symptoms and rates of performance validity improve following trauma-focused treatment in veterans with PTSD and history of mild-to-moderate TBI. Journal of the International Neuropsychological Society: JINS, 26(1), 108–118.
Jurick, S. M., Twamley, E. W., Crocker, L. D., Hays, C. C., Orff, H. J., Golshan, S., & Jak, A. J. (2016). Postconcussive symptom overreporting in Iraq/Afghanistan Veterans with mild traumatic brain injury. Journal of Rehabilitation Research and Development, 53(5), 571–584.
Kenzie, E. S., Parks, E. L., Bigler, E. D., Lim, M. M., Chesnutt, J. C., & Wakeland, W. (2017). Concussion as a multi-scale complex system: An interdisciplinary synthesis of current knowledge. Frontiers in Neurology, 8(513). https://doi.org/10.3389/fneur.2017.00513
Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., ... & Zeller, M. A. (2010). The Warrington Recognition Memory Test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25(1), 60–70. https://doi.org/10.1093/arclin/acp088
King, N. S., Crawford, S., Wenden, F. J., Moss, N. E. G., & Wade, D. T. (1995). The Rivermead Post Concussion Symptoms Questionnaire: A measure of symptoms commonly experienced after head injury and its reliability. Journal of Neurology, 242(9), 587–592. https://doi.org/10.1007/bf00868811
King, P. R., Donnelly, K., Donnelly, J., Dunnam, M., Warner, G., Kittleson, C. J., ... & Meier, S. (2012). Psychometric study of the Neurobehavioral Symptom Inventory. Journal of Rehabilitation Research and Development, 49, 879–888. https://doi.org/10.1682/JRRD.2011.03.0051
Lange, R. T., Brickell, T. A., & French, L. M. (2015). Examination of the Mild Brain Injury Atypical Symptom Scale and the Validity-10 Scale to detect symptom exaggeration in US military service members. Journal of Clinical & Experimental Neuropsychology, 37(3), 325–337. https://doi.org/10.1080/13803395.2015.1013021
Larrabee, G.J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3):410-25. https://doi.org/10.1076/clin.17.3.410.18089
Lau, L., Basso, M. R., Estevis, E., Miller, A., Whiteside, D. M., Combs, D., & Arentsen, T. J. (2017). Detecting coached neuropsychological dysfunction: A simulation experiment regarding mild traumatic brain injury. The Clinical Neuropsychologist, 31(8), 1412–1431. https://doi.org/10.1080/13854046.2017.1318954
Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421. https://doi.org/10.1080/13854046.2017.1406146
Lippa, S. M., Axelrod, B. N., & Lange, R. T. (2016). The Mild Brain Injury Atypical Symptoms (mBIAS) scale in a mixed clinical sample. Journal of Clinical & Experimental Neuropsychology, 38(7), 721–729. https://doi.org/10.1080/13803395.2016.1161732
McCrea, M., Iverson, G. L., McAllister, T. W., Hammeke, T. A., Powell, M. R., Barr, W. B., & Kelly, J. P. (2009). An integrated review of recovery after mild traumatic brain injury (MTBI): Implications for clinical management. The Clinical Neuropsychologist, 23, 1368.
Menatti, A. R. R., Melinder, M. R. D., & Warren, S. L. (2020). Limited prediction of performance validity using embedded validity scales of the Neurobehavioral Symptom Inventory in an mTBI veteran sample. The Journal of Head Trauma Rehabilitation, 35(1), E36–E42. https://doi.org/10.1097/HTR.0000000000000467
Merckelbach, H., Dandachi-FitzGerald, B., van Helvoort, D., Jelicic, M., & Otgaar, H. (2019). When patients overreport symptoms: More than just malingering. Current Directions in Psychological Science, 28(3), 321–326.
Millis, S. R. (1992). The recognition memory test in the detection of malingered and exaggerated memory deficits. Clinical Neuropsychologist, 6(4), 406–414. https://doi.org/10.1080/13854049208401867
Millis, S. R. 2009. (2009). Methodological challenges in assessment of cognition following mild head injury: Response to Malojcic et al. 2008. Journal of Neurotrauma, 26(12):2409-2410.
Mittenberg, W., DiGiulio, D., Perrin, S., & Bass, A. (1992). Symptoms following mild head injury: Expectation as aetiology. Journal of Neurology, Neurosurgery & Psychiatry, 55(3), 200.
Mooney, G., Speed, J., & Sheppard, S. (2005). Factors related to recovery after mild traumatic brain injury. Brain Injury, 19(12), 975–987. https://doi.org/10.1080/02699050500110264
Rickards, T. A., Cranston, C. C., & McWhorter, J. (2020). Persistent post-concussive symptoms: A model of predisposing, precipitating, and perpetuating factors. Applied Neuropsychology: Adult, 1-11. https://doi.org/10.1080/23279095.2020.1748032
Rogers, R., & Bender, S. D. (2018). Clinical assessment of malingering and deception (4th ed.). Ringgold Inc.
Rohling, M. L., Binder, L. M., Demakis, G. J., Larrabee, G. J., Ploetz, D. M., & Langhinrichsen-Rohling, J. (2011). A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al. (1997), Frencham et al. (2005), and Pertab et al. (2009). The Clinical Neuropsychologist, 25(4), 608–623. https://doi.org/10.1080/13854046.2011.565076
Schenk, K., & Sullivan, K. A. (2010). Do warnings deter rather than produce more sophisticated malingering? Journal of Clinical & Experimental Neuropsychology, 32(7), 752–762. https://doi.org/10.1080/13803390903512678
Sherer, M., Sander, A. M., Ponsford, J., Vos, L., Poritz, J. M. P., Ngan, E., & Leon Novelo, L. (2020). Patterns of cognitive test scores and symptom complaints in persons with TBI who failed performance validity testing. Journal of the International Neuropsychological Society, 26(9), 932–938. https://doi.org/10.1017/S1355617720000351
Sherman, E., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, 35(6), 735–764.
Silverberg, N. D., Gardner, A. J., Brubacher, J. R., Panenka, W. J., Li, J. J., & Iverson, G. L. (2015). Systematic review of multivariable prognostic models for mild traumatic brain injury. Journal of Neurotrauma, 32(8), 517–526. https://doi.org/10.1089/neu.2014.3600
Slick, D. J., Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561. https://doi.org/10.1076/1385-4046(199911)13:04;1-Y;FT545
Slick, D. J., Tan, J. E., Strauss, E. H., & Hultsch, D. F. (2004). Detecting malingering: A survey of experts’ practices. Archives of Clinical Neuropsychology, 19(4), 465–473. https://doi.org/10.1016/j.acn.2003.04.001
Soble, J. R., Silva, M. A., Vanderploeg, R. D., Curtiss, G., Belanger, H. G., Donnell, A. J., & Scott, S. G. (2014). Normative data for the Neurobehavioral Symptom Inventory (NSI) and post-concussion symptom profiles among TBI, PTSD, and nonclinical samples. The Clinical Neuropsychologist, 28(4), 614–632. https://doi.org/10.1080/13854046.2014.894576
Sreenivasan, S., Eth, S., Kirkish, P., & Garrick, T. (2003). A practical method for the evaluation of symptom exaggeration in minor head trauma among civil litigants. Journal of the American Academy of Psychiatry and the Law, 31(2), 220–231.
Stubbs, J. L., Green, K. E., Silverberg, N. D., Howard, A., Dhariwal, A. K., Brubacher, J. R., . . . & Panenka, W. J. (2020). Atypical somatic symptoms in adults with prolonged recovery from mild traumatic brain injury. Frontiers in Neurology, 11(43). https://doi.org/10.3389/fneur.2020.00043
Sullivan, K. A., Edmed, S. L., & Cunningham, L. C. (2012). A comparison of new and existing mild traumatic brain injury vignettes: Recommendations for research into post-concussion syndrome. Brain Injury, 27(1), 19–30. https://doi.org/10.3109/02699052.2012.698360
Sullivan, K. A., & Garden, N. (2011). A comparison of the psychometric properties of 4 postconcussion syndrome measures in a nonclinical sample. The Journal of Head Trauma Rehabilitation, 26(2), 170–176. https://doi.org/10.1097/HTR.0b013e3181e47f95
Sullivan, K. A., Lange, R. T., & Dawes, S. (2006). Methods of detecting malingering and estimated symptom exaggeration base rates in Australia. Journal of Forensic Neuropsychology, 4(4), 49–70. https://doi.org/10.1300/J151v04n04_04
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., ... & Suhr, J. A. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 1-54. https://doi.org/10.1080/13854046.2021.1896036
Szogi, E. G., & Sullivan, K. A. (2018). Malingered Posttraumatic Stress Disorder (PTSD) and the effect of direct versus indirect trauma exposure on symptom profiles and detectability. Psychological Injury and Law, 11, 351–361. https://doi.org/10.1007/s12207-018-9315-0
Tombaugh, T. N. (1996). Test of memory malingering: TOMM: Multi Health Systems Inc. North Tonawanda, NY.
Vanderploeg, R. D., Cooper, D. B., Belanger, H. G., Donnell, A. J., Kennedy, J. E., Hopewell, C. A., & Scott, S. G. (2014). Screening for postdeployment conditions: Development and cross-validation of an embedded validity scale in the Neurobehavioral Symptom Inventory. Journal of Head Trauma Rehabilitation, 29(1), 1–10. https://doi.org/10.1097/HTR.0b013e318281966e
Vanderploeg, R. D., Silva, M. A., Soble, J. R., Curtiss, G., Belanger, H. G., Donnell, A. J., & Scott, S. G. (2015). The structure of postconcussion symptoms on the Neurobehavioral Symptom Inventory: A comparison of alternative models. The Journal of Head Trauma Rehabilitation, 30(1), 1–11. https://doi.org/10.1097/htr.0000000000000009
Vikane, E., Frøyland, K., Næss, H. L., Aßmus, J., & Skouen, J. S. (2019). Predictors for psychological distress 2 months after mild traumatic brain injury. Frontiers in Neurology, 10, 639–639. https://doi.org/10.3389/fneur.2019.00639
Voormolen, D. C., Cnossen, M. C., Polinder, S., Gravesteijn, B. Y., Von Steinbuechel, N., Real, R. G. L., & Haagsma, J. A. (2019). Prevalence of post-concussion-like symptoms in the general population in Italy, The Netherlands and the United Kingdom. Brain Injury, 33(8), 1078–1086. https://doi.org/10.1080/02699052.2019.1607557
Voormolen, D. C., Cnossen, M. C., Spikman, J., Polinder, S., Iverson, G. L., de Koning, M., & van der Naalt, J. (2020). Rating of pre-injury symptoms over time in patients with mild traumatic brain injury: The good-old-days bias revisited. Brain Injury, 34(8), 1001–1009. https://doi.org/10.1080/02699052.2020.1761563
Warrington, E. K. (1984). Recognition Memory Test: Manual. NFER-Nelson Publishing Company.
Wilde, E. A., Whiteneck, G. G., Bogner, J., Bushnik, T., Cifu, D. X., Dikmen, S., ... & von Steinbuechel, N. (2010). Recommendations for the use of common outcome measures in traumatic brain injury research. Archives of Physical Medicine and Rehabilitation, 91(11), 1650-1660.e1617. https://doi.org/10.1016/j.apmr.2010.06.033
Windle, K., & Sullivan, K. A. (2019). Towards an embedded symptom validity indicator for the Rivermead Post-concussion Symptom Questionnaire. Applied Neuropsychology: Adult, 1-13. https://doi.org/10.1080/23279095.2019.1660880
Youngjohn, J. R., Burrows, L., & Erdal, K. (1995). Brain damage or compensation neurosis? The controversial post-concussion syndrome. The Clinical Neuropsychologist, 9(2), 112–123. https://doi.org/10.1080/13854049508401593
Funding
The QUT School of Psychology and Counselling funded the gift cards for this project.
Author information
Authors and Affiliations
Contributions
All the authors contributed to the study conception and design. All the authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics Approval
This project was approved by the QUT Human Research Ethics Committee (HREC approval number: 1900000362). The risk assessment for this project was approved by the QUT (approval number: 1250).
Consent to Participate
Informed written consent was obtained for all participants.
Consent for Publication
All the authors made substantial contributions to this submission and approved this version to be published. The authors agreed to be fully accountable for all aspects of the content.
Conflict of Interest
The authors declare competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sullivan, K.A., Bennett, D. An Experimental Study of the Effects of Biased Responding on the Modified Rivermead Post-concussion Symptoms Questionnaire and Validity Indicators. Psychol. Inj. and Law 14, 161–170 (2021). https://doi.org/10.1007/s12207-021-09419-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12207-021-09419-9