Skip to main content
Log in

Discriminating Feigned from Credible PTSD Symptoms: a Validation of a Brazilian Version of the Inventory of Problems-29 (IOP-29)

  • Published:
Psychological Injury and Law Aims and scope Submit manuscript

Abstract

The Inventory of Problems-29 (IOP-29) is a recently introduced free-standing symptom validity test (SVT) with a rapidly growing evidence base. Its classification accuracy compares favorably with that of the widely utilized Structured Inventory of Malingered Symptomology (SIMS), and it provides incremental validity when used in combination with other symptom and performance validity tests. This project was designed to cross-validate the IOP-29 in a Brazilian context. Study 1 focused on specificity and administered the IOP-29 and a PTSD screening checklist to 154 Brazilian firefighters who had been exposed to one or more potentially traumatic stressors. Study 2 implemented a simulation/analogue research design and administered the IOP-29, together with a new IOP-29 add-on memory module, to nonclinical volunteers; 101 asked to respond honestly, 100 instructed to feign PTSD. Taken together, the results of both study 1 (specificity = .96) and study 2 (Cohen’s d = 2.15; AUC = .92) support the validity, effectiveness, and cross-cultural applicability of the IOP-29. Additionally, study 2 provides preliminary evidence for the incremental utility of the newly introduced, IOP-29 add-on memory module. Despite the encouraging findings, we highlight that the determination of feigning or malingering should never be made off a single test alone.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. Viglione et al. (2017) report that patients included in their original samples were recruited through inpatient hospitals, outpatient clinics, day treatment centers, or criminal investigation units, and that their diagnoses were verified via various approaches, including structured and unstructured interviews, psychological testing, etc

References

  • Abeare, C. A., Hurtubise, J., Cutler, L., Sirianni, C., Brantuo, M., Makhzoun, N., & Erdodi, L. (2020). Introducing a forced choice recognition trial to the Hopkins Verbal Learning Test-Revised. The Clinical Neuropsychologist. https://doi.org/10.1080/13854046.2020.1779348

    Article  PubMed  Google Scholar 

  • Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J., & Erdodi, L. (2019). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation, 34(4), 20–31. https://doi.org/10.1097/HTR.0000000000000451

    Article  Google Scholar 

  • Abeare, C., Sabelli, A., Taylor, B., Holcomb, M., Dumitrescu, C., Kirsch, N., & Erdodi, L. (2019). The importance of demographically adjusted cutoffs: age and education bias in raw score cutoffs within the Trail Making Test. Psychological Injury and Law, 12(2), 170–182.

    Article  Google Scholar 

  • American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (2013).The standards for educational and psychological testing DC, AERA.

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders 5. American Psychiatric Association.

  • An, K. Y., Charles, J., Ali, S., Enache, A., Dhuga, J., & Erdodi, L. A. (2019). Re-examining performance validity cutoffs within the Complex Ideational Material and the Boston Naming Test-Short Form using an experimental malingering paradigm. Journal or Clinical and Experimental Neuropsychology, 41(1), 15–25.

    Article  Google Scholar 

  • An, K. Y., Kaploun, K., Erdodi, L. A., & Abeare, C. A. (2017). Performance validity in undergraduate research participants: a comparison of failure rates across tests and cutoffs. The Clinical Neuropsychologist, 31(1), 193–206.

    Article  Google Scholar 

  • An, K. Y., Zakzanis, K. K., & Joordens, S. (2012). Conducting research with non-clinical healthy undergraduates: does effort play a role in neuropsychological test performance? Archives of Clinical Neuropsychology, 27, 849–857.

    Article  Google Scholar 

  • Bass, C., & Halligan, P. (2014). Factitious disorders and malingering: challenges for clinical assessment and management. The Lancet, 383, 1422–1432.

    Article  Google Scholar 

  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. Guilford.

  • Brislin, R. W. (1980). Translation and content analysis of oral and written material HC Triandis JW Berry Eds Handbook of cross-cultural psychology Allyn & Bacon 389–444.

  • Burges, C., & McMillan, T. (2001). The ability of naïve participants to report symptoms of post-traumatic stress disorder. British Journal of Clinical Psychology, 40(2), 209–214.

    Article  Google Scholar 

  • Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: official position of the Association for Scientific Advancement in Psychological Injury and Law. Psychological Injury and Law, 7(3), 197–205.

    Article  Google Scholar 

  • Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., & Silver, C. H. (2005). Symptom validity assessment: practice issues and medical necessity (NAN Policy and Planning Committees). Archives of Clinical Neuropsychology, 20, 419–426.

    Article  Google Scholar 

  • Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. M., Kaemmer, B. (1989) Minnesota Multiphasic Personality Inventory-2 (MMPI-2): manual for administration and scoring University of Minnesota Press.

  • Chafetz, M. D. (2011). The psychological consultative examination for Social Security Disability. Psychological Injury and Law, 4, 235–244. https://doi.org/10.1007/s12207-011-9112-5

    Article  Google Scholar 

  • Chafetz, M. D., Williams, M. A., Ben-Porath, Y. S., Bianchini, K. J., Boone, K. B., Kirkwood, M. W., et al. (2015). Official position of the American Academy of Clinical Neuropsychology Social Security Administration policy on validity testing: guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences 2. Erlbaum.

  • Erdal, K. (2004). The effects of motivation, coaching, and knowledge of neuropsychology on the simulated malingering of head injury. Archives of Clinical Neuropsychology, 19(1), 73–88.

  • Erdodi, L. A. (2019). Aggregating validity indicators: the salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment. Applied Neuropsychology: Adult, 26(2), 155–172.

    Article  Google Scholar 

  • Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2018). A single error is one too many: The Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology, 33(7), 845–860. https://doi.org/10.1093/arclin/acx110

    Article  PubMed  Google Scholar 

  • Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology and Neuroscience, 10(3), 325–344. https://doi.org/10.1037/pne0000103

    Article  Google Scholar 

  • Erdodi, L. A., Taylor, B., Sabelli, A., Malleck, M., Kirsch, N. L., & Abeare, C. A. (2019). Demographically adjusted validity cutoffs in the Finger Tapping Test are superior to raw score cutoffs. Psychological Injury and Law, 12(2), 113–126.

    Article  Google Scholar 

  • Fox, K. A., & Vincent, J. P. (2020). Types of malingering in PTSD: evidence from a psychological injury paradigm. Psychological Injury and Law, 13, 90–104.

    Article  Google Scholar 

  • Gaasedelen, O. J., Whiteside, D. M., Altmaier, E., Welch, C., & Basso, M. R. (2019). The construction and the initial validation of the Cognitive Bias Scale for the Personality Assessment Inventory. The Clinical Neuropsychologist, 33(8), 1467–1484.

    Article  Google Scholar 

  • Gegner, J., Erdodi, L. A., Giromini, L., Viglione, D. J., Bosi, J., & Brusadelli, E. (2021). An Australian study on feigned mTBI using the Inventory of Problems-29 (IOP-29), its Memory Module (IOP-M), and the Rey Fifteen Item Test (FIT). Applied Neuropsychology: Adult. Advance online publication. https://doi.org/10.1080/23279095.2020.18643752020.1864375

  • Geisinger, K. F. (2003). Testing and assessment in cross-cultural psychology JR Graham JA Naglieri Eds Handbook of psychology: Assessment psychology. John Wiley & Sons Inc. 95–117

  • Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2018). A clinical comparison, simulation study testing the validity of SIMS and IOP-29 with an Italian sample. Psychological Injury and Law, 11(4), 340–350.

    Article  Google Scholar 

  • Giromini, L., Barbosa, F., Coga, G., Azeredo, A., Viglione, D. J., & Zennaro, A. (2019). Using the Inventory of Problems-29 (IOP-29) with the Test of Memory Malingering (TOMM) in symptom validity assessment: A study with a Portuguese sample of experimental feigners. Applied Neuropsychology: Adult, [Epub ahead of print],  https://doi.org/10.1080/23279095.2019.1570929

  • Giromini, L., Carfora Lettieri, S., Zizolfi, S., Zizolfi, D., Viglione, D.J., Brusadelli, E., Perfetti, B., di Carlo, D.A., & Zennaro, A. (2019). Beyond rare-symptoms endorsement: a clinical comparison simulation study using the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) with the Inventory of Problems-29 (IOP-29). Psychological Injury and Law, [Epub ahead of print], https://doi.org/10.1007/s12207-019-09357-7

  • Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2019a). An Inventory of Problems-29 (IOP-29) sensitivity study investigating feigning of four different symptom presentations via malingering experimental paradigm. Journal of Personality Assessment, [Epub ahead of print]. https://doi.org/10.1080/00223891.2019.1566914

  • Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2019b). An Inventory of Problems-29 (IOP-29) study on random responding using experimental feigners, honest controls, and computer-generated data. Journal of Personality Assessment, [Epub ahead of print]. https://doi.org/10.1080/00223891.2019.1639188

  • Giromini, L., Viglione, D. J., Zennaro, A., Maffei, A., & Erdodi, L. (2020). SVT meets PVT: development and initial validation of the Inventory of Problems-Memory (IOP-M). Psychological Injury and Law [Epub ahead of print],  https://doi.org/10.1007/s12207-020-09385-8

  • Green, R. L. (1991). MMPI-2/MMPI: an interpretative manual. Allyn & Bacon.

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Participants, C. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129. https://doi.org/10.1080/13854040903155063

    Article  PubMed  Google Scholar 

  • Hurtubise, J., Baher, T., Messa, I., Cutler, L., Shahein, A., Hastings, M., Carignan-Querqui, M., & Erdodi, L. (2020). Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI Applied Neuropsychology. Child 1–18. https://doi.org/10.1080/21622965.2020.17194092020.1719409

  • Ilgunaite, G., Giromini, L., Bosi, J., Viglione, D. J., & Zennaro, A. (2020). A clinical comparison simulation study using the Inventory of Problems-29 (IOP-29) with the Center for Epidemiologic Studies Depression Scale (CES-D) in Lithuania. Applied Neuropsychology: Adult, [Epub ahead of print]. https://doi.org/10.1080/23279095.2020.17255182020.1725518

  • Jurick, S. M., Crocker, L. D., Merritt, V. C., Hoffman, S. N., Keller, A. V., Eglit, G. M. L., et al. (2020). Psychological symptoms and rates of performance validity improve following trauma-focused treatment in veterans with PTSD and history of mild-to-moderate TBI. Journal of International Neuropsychological Society, 26(1), 108–118.

    Article  Google Scholar 

  • Lace, J. W., Grant, A. F., Kosky, K. M., Teague, C. L., Lowell, K. T., & Gfeller, J. D. (2020). Identifying novel embedded performance validity test formulas within the Repeatable Battery for the Assessment of Neuropsychological Status: a simulation study. Psychological Injury and Law, 13, 303–315.

    Article  Google Scholar 

  • Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: relationship to likelihood ratios. The Clinical Neuropsychologist, 22, 666–679.

    Article  Google Scholar 

  • Lau, L., Basso, M. R., Estevis, E., Miller, A., Whiteside, D. M., Combs, D., & Arentsen, T. J. (2017). Detecting coached neuropsychological dysfunction: a simulation experiment regarding mild traumatic brain injury. The Clinical Neuropsychologist, 31(8), 1412–1431.

  • Lees-Haley, P. R., & Dunn, J. T. (1994). The ability of naive subjects to report symptoms of mild brain injury, post-traumatic stress disorder, major depression and generalized anxiety disorder. Journal of Clinical Psychology, 50(2), 252–256.

    Article  Google Scholar 

  • Merten, T., & Merckelbach, H. (2013). Symptom validity in somatoform and dissociative disorders: a critical review. Psychological Injury and Law, 6(2), 122–137.

    Article  Google Scholar 

  • Merten, T., Thies, E., Schneider, K., & Stevens, A. (2009). Symptom validity testing in claimants with alleged posttraumatic stress disorder: comparing the Morel emotional numbing test, the structure inventory of malingered symptomatology, and the word memory test. Psychological Injury and Law, 2, 284–293.

    Article  Google Scholar 

  • Morey, L. C. (2007). Personality Assessment Inventory (PAI). Professional manual 2 Psychological Assessment Resources.

  • Niesten, I. J. M., Muller, W., Merckelbach, H., Dandachi-FitzGerald, B., & Jelicic, M. (2017). Moral reminders do not reduce symptom over-reporting tendencies. Psychological Injury and Law, 10, 368–384.

    Article  Google Scholar 

  • Osório , F.L. , Silva , T.D.A. , Santos , R.G. , Chagas , M.H.N. , Chagas , N.M. S. , Sanches , R.F. , & Crippa , J.A.S. ( 2017 ). Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): transcultural adaptation of the Brazilian version. Archives of Clinical Psychiatry (São Paulo), 44(1), 10-19. https://doi.org/10.1590/0101-60830000000107

  • Pereira-Lima, K., Loureiro, S. R., Bolsoni, L. M., Apolinario da Silva, T. D., & Osório, F. L. (2019). Psychometric properties and diagnostic utility of a Brazilian version of the PCL-5 (complete and abbreviated versions). European Journal of Psychotraumatology, 10(1), 1581020. https://doi.org/10.1080/20008198.2019.1581020

  • Rai, J., An, K. Y., Charles, J., Ali, S., & Erdodi, L. A. (2019). Introducing a forced choice recognition trial to the Rey Complex Figure Test. Psychology and Neuroscience., 12(4), 451–472.

    Article  Google Scholar 

  • Resnick, P. J., West, S., Wooley, C. N. (2018). The malingering of posttraumatic disorders R Rogers SD Bender Eds Clinical assessment of malingering and deception Guilford Press 188–211.

  • Rogers, R., Bender, D. (2018) Clinical assessment of malingering and deception. Guilford Press.

  • Roma, P., Giromini, L., Burla, F., Ferracuti, S., Viglione, D. J., & Mazza, C. (2020). Ecological validity of the Inventory of Problems-29 (IOP-29): an Italian study of court-ordered, psychological injury evaluations using the Structured Inventory of Malingered Symptomatology (SIMS) as criterion variable. Psychological Injury and Law, 13, 57–65.

    Article  Google Scholar 

  • Roye, S., Calamia, M., Bernstein, J. P., De Vito, A. N., & Hill, B. D. (2019). A multi-study examination of performance validity in undergraduate research participants. The Clinical Neuropsychologist, 33(6), 1138–1155.

    Article  Google Scholar 

  • Schroeder, R. W., Martin, P. K., Heindrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477.

    Article  Google Scholar 

  • Schutte, C., Axelrod, B. N., & Montoya, E. (2015). Making sure neuropsychological data are meaningful: use of performance validity testing in medicolegal and clinical contexts. Psychological Injury and Law, 8(2), 100–105.

    Article  Google Scholar 

  • Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gatz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: cross-validation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23, 94–104.

    Article  Google Scholar 

  • Slovenko, R. (1994). Legal aspects of post-traumatic stress disorder. Psychiatric Clinics of North America, 17, 439–446.

    Article  Google Scholar 

  • Smith, G. P., & Burger, G. K. (1997). Detection of malingering: validation of the Structured Inventory of Malingered Symptomatology (SIMS). Journal of the American Academy on Psychiatry and Law, 25, 180–183.

    Google Scholar 

  • Souto, L. S., de Oliveira, L. M., & Haag, C. K. (2012). Transtorno de estresse pós-traumático decorrente de acidente de trabalho: implicações psicológicas, socioeconômicas e jurídicas. Estudos de Psicologia, 17(2), 329–336.

    Google Scholar 

  • Tan, J. E., Slick, D. J., Strauss, E., & Hultsch, D. F. (2002). How’d they do it? Malingering strategies on symptom validity tests. The Clinical Neuropsychologist, 16(4), 495–5050.

    Article  Google Scholar 

  • Tombaugh, T. N. (1996). Test of Memory Malingering (TOMM) Multi Health Systems.

  • Tyson, B. T., Baker, S., Greenacre, M., Kent J, K., Lichtenstein, J. D., Sabelli, A., & Erdodi, L. A. (2018) Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data Epilepsy & Behavior 87, 39–45.

  • Van de Vijver, F., & Hambleton, R. K. (1996). Translating tests. European Psychologist, 1(2), 89–99.

    Article  Google Scholar 

  • Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the Inventory of Problems–29: a brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99(5), 534–544.

    Article  Google Scholar 

  • Viglione, D. J., Giromini, L., Landis, P., McCullaugh, J. M., Pizitz, T. D., O’Brien, S., et al. (2019). Development and Validation of the False Disorder Score: The Focal Scale of the Inventory of Problems. Journal of Personality Assessment, 101, 653–661.

    Article  Google Scholar 

  • Viglione D. J., Giromini, L. (2020). Inventory of Problems-29: Professional Manual IOP-Test LLC.

  • Viglione, D. J., Wright, D., Dizon, N. T., Moynihan, J. E., DuPuis, S., & Pizitz, T. D. (2001). Evading detection on the MMPI–2: does caution produce more realistic patterns of responding? Assessment, 8, 237–250.

    Article  Google Scholar 

  • Weathers, F. W., Litz, B. T., Keane, T. M., Palmieri, P. A., Marx, B. P., & Schnurr, P. P. (2013). The PTSD Checklist for DSM–5 (PCL-5). Retrieved from http://www.ptsd.va.gov/professional/assessment/adult-sr/ptsd-checklist.asp

  • Whiteside, D. M., Hunt, I., Choate, A., Caraher, K., & Basso, M. R. (2020). Stratified performance on the Test of Memory Malingering (TOMM) is associated with differential responding on the Personality Assessment Inventory (PAI). Journal of Clinical and Experimental Neuropsychology, 42(2), 131–141.

    Article  Google Scholar 

  • Widows, M. R., Smith, G. P. (2005). SIMS-Structured Inventory of Malingered Symptomatology. Professional manual. Psychological Assessment Resources.

  • Winters, C. L., Giromini, L., Crawford, T. J., Ales, F., Viglione, D. J., & Warmelink, L. (2020). An Inventory of Problems–29 (IOP–29) study investigating feigned schizophrenia and random responding in a British community sample. Psychiatry, Psychology and Law, [Epub ahead of print]. https://doi.org/10.1080/13218719.2020.17677202020.1767720

  • van Dyke, S. A., Millis, S. R., Axelrod, B. N., & Hanks, R. A. (2013). Assessing effort: differentiating performance and symptom validity. The Clinical Neuropsychologist, 27(8), 1234–1246.

    Article  Google Scholar 

  • World Medical Association. (2013). World Medical Association Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects. JAMA. 310 (20), 2191–2194.

    Google Scholar 

  • Young, G. (2016). PTSD in Court I: Introducing PTSD for Court. International Journal of Law and Psychiatry, 49, 238–258.

    Article  Google Scholar 

  • Young, G. (2017a). PTSD in Court II. Risk factors, endophenotypes, and biological underpinnings. International Journal of Law and Psychiatry, 51, 1–21.

  • Young, G. (2017b). PTSD in Court III: malingering, assessment, and the law. International Journal of Law and Psychiatry, 52, 81–102.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luciano Giromini.

Ethics declarations

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Copyright Statement

The rights to both Inventory of Problems-29 (IOP-29) and Inventory of Problems-Memory (IOP-M) are possessed by IOP-Test, LLC.

Conflict of Interest

The seventh and eighth authors declare that they own a share in the corporate (LLC) that possesses the rights to Inventory of Problems. The other six authors declare that they have no conflict of interest to report.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carvalho, L., Reis, A., Colombarolli, M.S. et al. Discriminating Feigned from Credible PTSD Symptoms: a Validation of a Brazilian Version of the Inventory of Problems-29 (IOP-29). Psychol. Inj. and Law 14, 58–70 (2021). https://doi.org/10.1007/s12207-021-09403-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12207-021-09403-3

Keywords

Navigation