Advertisement

Evaluation of Screening Tests for PTSD

  • Scott D. McDonaldEmail author
  • Emily L. Gentes
  • Patrick S. Calhoun
Reference work entry

Abstract

Screening programs are an essential component of preventative medicine for conditions of public health importance. For a post-traumatic stress disorder (PTSD) screening program to be effective, valid screening tests are essential. Thus, it is essential for clinicians to be aware of how to evaluate studies of screening test utility for applicability and validity. This chapter (1) reviews the principal components of a diagnostic accuracy study for a screening test, (2) describes the method for finding appropriate diagnostic accuracy studies for a screening test of interest, and (3) outlines how to evaluate the quality and applicability of diagnostic accuracy studies for PTSD screening tests.

Keywords

Posttraumatic stress disorder Test validity Differential diagnosis Sensitivity and specificity Diagnostic efficiency 

List of Abbreviations

CAPS

Clinician Administered PTSD Scale

CI

Confidence interval

CPG

Clinical practice guideline

DSM-5

Diagnostic and Statistical Manual of Mental Disorders

LR-

Negative likelihood ratio

LR+

Positive likelihood ratio

PCL

PTSD Checklist

PC-PTSD

Primary care PTSD screen

PTSD

Post-traumatic stress disorder

References

  1. Aboraya A. Use of structured interviews by psychiatrists in real clinical settings: results of an open-question survey. Psychiatry (Edgmont (Pa: Township)). 2009;6:24–8.Google Scholar
  2. Andrykowski MA, Cordova MJ, Studts JL, Miller TW. Posttraumatic stress disorder after treatment for breast cancer: prevalence of diagnosis and use of the PTSD Checklist-Civilian Version (PCL-C) as a screening instrument. J Consult Clin Psychol. 1998;66:586–90.CrossRefPubMedGoogle Scholar
  3. Bertens LC, Broekhuizen BD, Naaktgeboren CA, et al. Use of expert panels to define the reference standard in diagnostic research: a systematic review of published methods and reporting. PLoS Med. 2013;10:e1001531.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Bossuyt PMM. STARD statement: still room for improvement in the reporting of diagnostic accuracy studies. Radiology. 2008;248:713–4.CrossRefPubMedGoogle Scholar
  5. Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Radiol. 2003a;58:575–80.CrossRefPubMedGoogle Scholar
  6. Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003b;49:7–18.CrossRefPubMedGoogle Scholar
  7. Brewin CR. Systematic review of screening instruments for adults at risk of PTSD. J Trauma Stress. 2005;18:53–62.CrossRefPubMedGoogle Scholar
  8. Calhoun PS, McDonald SD, Guerra VS, et al. Clinical utility of the primary care-PTSD screen among U.S. veterans who served since September 11, 2001. Psychiatry Res. 2010;178:330–5.CrossRefPubMedGoogle Scholar
  9. Carley S, Dosman S, Jones SR, Harrison M. Simple nomograms to calculate sample size in diagnostic studies. Emerg Med J. 2005;22:180–1.CrossRefPubMedPubMedCentralGoogle Scholar
  10. Davidson JRT, Book SW, Colket JT, et al. Assessment of a new self-rating scale for post-traumatic stress disorder. Psychol Med. 1997;27:153–60.CrossRefPubMedGoogle Scholar
  11. Department of Veterans Affairs, Veterans Health Administration. Implementation of a new national clinical reminder, the “Afghan and Iraq Post-deployment Screen”. Washington, DC: Author; 2004.Google Scholar
  12. Freedy JR, Steenkamp MM, Magruder KM, et al. Post-traumatic stress disorder screening test performance in civilian primary care. Fam Pract. 2010;27:615–24.CrossRefPubMedGoogle Scholar
  13. Jaeschke R, Guyatt G, Sackett DL. Users’ guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 1994a;271:389–91.CrossRefPubMedGoogle Scholar
  14. Jaeschke R, Guyatt GH, Sackett DL. Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA. 1994b;271:703–7.CrossRefPubMedGoogle Scholar
  15. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMedGoogle Scholar
  16. Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999;282:1061–6.CrossRefPubMedGoogle Scholar
  17. Mann R, Hewitt CE, Gilbody SM. Assessing the quality of diagnostic studies using psychometric instruments: applying QUADAS. Soc Psychiatry Psychiatr Epidemiol. 2009;44:300–7.CrossRefPubMedGoogle Scholar
  18. McCambridge J, de Bruin M, Witton J. The effects of demand characteristics on research participant behaviours in non-laboratory settings: a systematic review. PLoS One. 2012;7:e39116.CrossRefPubMedPubMedCentralGoogle Scholar
  19. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67:267–77.CrossRefPubMedPubMedCentralGoogle Scholar
  20. McDonald SD, Calhoun PS. The diagnostic accuracy of the PTSD checklist: a critical review. Clin Psychol Rev. 2010;30:976–87.CrossRefPubMedGoogle Scholar
  21. McDonald SD, Thompson ML, Stratton KJ, Calhoun PS, The VA Mid-Atlantic Mental Illness Research, Education, Clinical Center (MIRECC) Workgroup. Diagnostic accuracy of three scoring methods for the Davidson Trauma Scale among U.S. military veterans. J Anxiety Disord. 2014;28:160–8.CrossRefPubMedGoogle Scholar
  22. McDonald SD, Brown WL, Benesek JP, Calhoun PS. A systematic review of the PTSD checklist’s diagnostic accuracy studies using QUADAS. Psychol Trauma Theory Res Pract Policy. In press.Google Scholar
  23. McLay RN, Deal WE, Murphy JA, Center KB, Kolkow TT, Grieger TA. On-the-record screenings versus anonymous surveys in reporting PTSD. Am J Psychiatry. 2008;165:775–6.CrossRefPubMedGoogle Scholar
  24. Meehl PE, Rosen A. Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychol Bull. 1955;52:194–216.CrossRefPubMedGoogle Scholar
  25. National Center for Posttraumatic Stress Disorder. Clinician-Administered PTSD Scale for DSM-5 (CAPS-5). 2014;2014(July 30). http://www.ptsd.va.gov/professional/assessment/adult-int/caps.asp. Accessed 30 July 2014.
  26. National Center for PTSD. PTSD screening instruments. 2014. http://www.ptsd.va.gov/professional/assessment/screens/index.asp. Accessed 1 May 2014.
  27. National Collaborating Centre for Mental Health. Post-traumatic stress disorder: the management of PTSD in adults and children in primary and secondary care. London: National Institute for Clinical Excellence (NICE); 2005.Google Scholar
  28. New York State Department of Health. Prevention of secondary disease: mental health care. New York: New York State Department of Health; 2006.Google Scholar
  29. Prins A, Ouimette PC, Kimerling R, et al. The primary care PTSD screen (PC-PTSD): development and operating characteristics. Prim Care Psychiatry. 2003;9:9–14.CrossRefGoogle Scholar
  30. Ransohoff D, Feinstein A. Problems of spectrum bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926–30.CrossRefPubMedGoogle Scholar
  31. Reid MC, Lachs MS, Feinstein AR. Use of methodological standards in diagnostic test research. Getting better but still not good. JAMA. 1995;274:645–51.CrossRefPubMedGoogle Scholar
  32. Reitsma JB, Rutjes AWS, Whiting P, Vlassov VV, Leeflang MMG, Deeks JJ. Chapter 9: assessing methodological quality. In: Deeks JJ, Bossuyt PM, Gatsonis C, editors. Cochrane handbook for systematic reviews of diagnostic test accuracy version 1.0.0. The cochrane collaboration, 2009. Available from: http://srdta.cochrane.org/.
  33. Rona RJ, Hyams KC, Wessely S. Screening for psychological illness in military personnel. JAMA. 2005;293:1257–60.CrossRefPubMedGoogle Scholar
  34. Rubenzer S. Posttraumatic stress disorder: assessing response style and malingering. Psychol Inj Law. 2009;2:114–42.CrossRefGoogle Scholar
  35. Schmidt RL, Factor RE. Understanding sources of bias in diagnostic accuracy studies. Arch Pathol Lab Med. 2013;137:558–65.CrossRefPubMedGoogle Scholar
  36. Smidt N, Rutjes AWS, van der Windt D, et al. The quality of diagnostic accuracy studies since the STARD statement – Has it improved? Neurology. 2006;67:792–7.CrossRefPubMedGoogle Scholar
  37. Spoont M, Arbisi P, Fu S, et al. Screening for post-traumatic stress disorder (PTSD) in primary care: a systematic review (VA-ESP Project #09-009). Washington, DC: Department of Veterans Affairs, Health Services Research & Development Services; 2013.Google Scholar
  38. Streiner DL. Diagnosing tests: using and misusing diagnostic and screening tests. J Pers Assess. 2003;81:209–19.CrossRefPubMedGoogle Scholar
  39. Terhakopian A, Sinaii N, Engel CC, Schnurr PP, Hoge CW. Estimating population prevalence of posttraumatic stress disorder: an example using the PTSD checklist. J Trauma Stress. 2008;21:290–300.CrossRefPubMedGoogle Scholar
  40. UK National Screening Committee. Criteria for appraising the viability, effectiveness and appropriateness of a screening programme. 2013. http://www.screening.nhs.uk/criteria. Accessed 20 May 2014.
  41. U.S. Preventive Services Task Force. Screening for depression in adults: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2009;151:784–92.CrossRefGoogle Scholar
  42. Warner J. Clinicians’ guide to evaluating diagnostic and screening tests in psychiatry. Adv Psychiatr Treat. 2004;10:446–54.CrossRefGoogle Scholar
  43. Weathers F, Litz B, Herman D, Huska J, Keane T. The PTSD Checklist (PCL): reliability, validity, and diagnostic utility. Poster session presented at the Annual Convention of the International Society for Traumatic Stress Studies, San Antonio, Oct 1993.Google Scholar
  44. Weathers FW, Ruscio AM, Keane TM. Psychometric properties of nine scoring rules for the Clinician-Administered Posttraumatic Stress Disorder Scale. Psychol Assess. 1999;11:124–33.CrossRefGoogle Scholar
  45. Whiting PF, Rutjes AWS, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529–536.CrossRefPubMedGoogle Scholar
  46. Whiting PF, Rutjes AW, Westwood ME, Mallett S. A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. J Clin Epidemiol. 2013;66:1093–104.CrossRefPubMedGoogle Scholar
  47. Wilczynski NL. Quality of reporting of diagnostic accuracy studies: no change since STARD statement publication – before-and-after study. Radiology. 2008;248:817–23.CrossRefPubMedPubMedCentralGoogle Scholar
  48. Willis BH. Spectrum bias-why clinicians need to be cautious when applying diagnostic test studies. Fam Pract. 2008;25:390–6.CrossRefPubMedGoogle Scholar
  49. Wilson JMG, Jungner G. Principles and practice of screening for disease. Geneva: WHO; 1968.Google Scholar
  50. World Health Organization. The global burden of disease: 2004 update. Geneva: World Health Organization; 2008.Google Scholar

Copyright information

© Springer International Publishing Switzerland (outside the USA) 2016

Authors and Affiliations

  • Scott D. McDonald
    • 1
    Email author
  • Emily L. Gentes
    • 2
  • Patrick S. Calhoun
    • 3
  1. 1.Psychology Section (116-B)McGuire VA Medical Center, Mental Health ServiceRichmondUSA
  2. 2.Durham VA Medical CenterVA Mid-Atlantic Mental Illness Research, Education, and Clinical CenterDurhamUSA
  3. 3.Durham VA Medical CenterDurhamUSA

Personalised recommendations