A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration
Since 2006, the Veterans Health Administration (VHA) has instituted policy changes and training programs to support system-wide implementation of two evidence-based psychotherapies (EBPs) for posttraumatic stress disorder (PTSD). To assess lessons learned from this unprecedented effort, we used PubMed and the PILOTS databases and networking with researchers to identify 32 reports on contextual influences on implementation or sustainment of EBPs for PTSD in VHA settings. Findings were initially organized using the exploration, planning, implementation, and sustainment framework (EPIS; Aarons et al. in Adm Policy Ment Health Health Serv Res 38:4–23, 2011). Results that could not be adequately captured within the EPIS framework, such as implementation outcomes and adopter beliefs about the innovation, were coded using constructs from the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework (Glasgow et al. in Am J Public Health 89:1322–1327, 1999) and Consolidated Framework for Implementation Research (CFIR; Damschroder et al. in Implement Sci 4(1):50, 2009). We highlight key areas of progress in implementation, identify continuing challenges and research questions, and discuss implications for future efforts to promote EBPs in large health care systems.
KeywordsEvidence-based practice Posttraumatic stress disorders Psychotherapy Implementation science Competency-based training Diffusion of innovation Veterans
* Indicates empirical study included in the review
- Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 16(10), 11. doi:10.1186/s13012-014-0192-y.CrossRefGoogle Scholar
- Chard, K. M., Schumm, J. A., McIlvain, S. M., Bailey, G. W., & Parkinson, R. B. (2011). Exploring the efficacy of a residential treatment program incorporating cognitive processing therapy-cognitive for Veterans with PTSD and traumatic brain injury. Journal of Traumatic Stress, 24, 347–351.CrossRefPubMedGoogle Scholar
- Chard, K. M. (2014). Cognitive processing therapy train-the-trainer workshop. Cincinnati, OH.Google Scholar
- * Cook, J. M., Dinnen, S., Coyne, J. C., Thompson, R., Simiola, V., Ruzek, J., et al. (2015a). Evaluation of an implementation model: A national investigation of VA residential programs. Administration and Policy in Mental Health and Mental Health Services Research, 42, 147–156.CrossRefPubMedPubMedCentralGoogle Scholar
- * Cook, J. M., Dinnen, S., Thompson, R., Ruzek, J., Coyne, J., & Schnurr, P. P. (2015b). A quantitative test of an implementation framework in 38 VA residential PTSD programs. Administration and Policy in Mental Health and Mental Health Services Research, 42, 462–473.CrossRefPubMedPubMedCentralGoogle Scholar
- Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50.CrossRefPubMedPubMedCentralGoogle Scholar
- Department of Veterans Affairs. (2004). Report to the secretary, a comprehensive VHA strategic plan for mental health services—revised, Veterans Health Administration, Mental Health Strategic Plan Workgroup, Mental Health Strategic Health Care Group, Office of the Assistant Deputy Under Secretary for Health. Washington, DC: Department of Veterans Affairs.Google Scholar
- Department of Veterans Affairs (DVA). (2008). Uniform mental health services in VA a medical centers and clinics. Washington, DC: Department of Veterans Affairs. Retrieved from http://www.mirecc.va.gov/VISN16/docs/UMHS_Handbook_1160.pdf.
- Department of Veterans Affairs (DVA). (2010). VHA HANDBOOK 1160.03: Programs for veterans with post-traumatic stress disorder (PTSD). Washington, DC: Department of Veterans Affairs. Retrieved from http://www.healthquality.va.gov/PTSD-full-2010c.pdf.
- Department of Veterans Affairs (DVA). (2012). Local implementation of evidence-based psychotherapies for mental and behavioral health conditions. Washington, DC: Department of Veterans Affairs. Retrieved from http://www.va.gov/vhapublications/ViewPublication.asp?pub_ID=2801.
- Department of Veterans Affairs (DVA). (2014). VA mental health services public report. Washington, DC: Department of Veterans Affairs. Retrieved from http://www.mentalhealth.va.gov/docs/mental_health_transparency_report_11-24-14.pdf.
- Executive Order No. 13217, Community-based alternatives for individuals with disabilities, CFR 66 FR 33155, June 21, 2001. Retrieved from http://www.gpo.gov/fdsys/pkg/FR-2001-06-21/pdf/01-15758.pdf.
- Harned, M. S., Korslund, K. E., & Linehan, M. M. (2014). A pilot randomized controlled trial of dialectical behavior therapy with and without the dialectical behavior therapy prolonged exposure protocol for suicidal and self-injuring women with borderline personality disorder and PTSD. Behaviour Research Therapy, 55, 7–17. doi:10.1016/j.brat.2014.01.008. Epub 2014 Feb 11.CrossRefPubMedPubMedCentralGoogle Scholar
- Harpaz‐Rotem, I., & Hoff, R. (2014). 2014 PTSD data sheet. VA Office of Mental Health Operations. West Haven, CT: Northeast Program Evaluation Center.Google Scholar
- Institute of Medicine (IOM). (2015). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington, DC: The National Academies Press.Google Scholar
- Jain, S., Greenbaum, M. A., & Rosen, C. S. (2012a) Do Veterans with posttraumatic stress disorder receive first-line pharmacotherapy? Results from the Longitudinal Veterans Health survey. Primary Care Companion for CNS Disorders 1, pii: PCC.11m01162. doi:10.4088/PCC.11m01162.
- Karlin, B. E., Ruzek, J. I., Chard, K. M., Eftekhari, A., Monson, C. M., Hembree, E. A., et al. (2010). Dissemination of evidence-based psychological treatments for posttraumatic stress disorder in the Veterans Health Administration. Journal of Traumatic Stress, 23, 663–673.CrossRefPubMedGoogle Scholar
- * Kehle-Forbes, S. M., Partin, M., Slone, L., Polusny, M., Sayer, N., & Gerould, H. (2014a). Veterans’ attitudes towards prolonged exposure and cognitive processing therapy. Presentation at the Annual Convention of International Society of Traumatic Stress Studies, Miami, FL.Google Scholar
- Kippendorff, K. (2013). Content analysis: An introduction to its methodology (3rd ed.). Thousand Oaks, CA: SAGE Publications Inc.Google Scholar
- * Meis, L. A., Spoont, M. R., Erbes, C. R., Polusny, M. A., Noorbaloochi, S., Hagel Campbell, E., M., Bangerter, A. K., Eftekhari, A. Kattar, K. A., & Tuerk, P. W. (2014a). Can families help shape Veteran’s opinions of and response to evidence based treatments for PTSD? Presentation at the 30th Annual Meeting of the International Society of Traumatic Stress Studies, Miami, FL.Google Scholar
- * Meis, L. A., Spoont, M. R., Erbes, C. R., Polusny, M. A., Noorbaloochi, S., Hagel Campbell, E., M., Bangerter, A. K., Eftekhari, A. Kattar, K., A., & Tuerk, P., W. (2014b). The role of individual beliefs and family involvement in understanding Veterans’ commitment to evidence based treatments for PTSD. Presentation at the 30th Annual Meeting of the International Society of Traumatic Stress Studies, Miami, FL.Google Scholar
- Morland, L. A., Mackintosh, M. A., Greene, C. J., Rosen, C. S., Chard, K. M., Resick, P., et al. (2014). Cognitive processing therapy for posttraumatic stress disorder delivered to rural Veterans via telemental health: A randomized noninferiority clinical trial. Journal of Clinical Psychiatry, 75, 470–476.CrossRefPubMedGoogle Scholar
- Nacasch, N., Huppert, J. D., Su, Y. J., Kivity, Y., Dinshtein, Y., Yeh, R., et al. (2015). Are 60-minute prolonged exposure sessions with 20-minute imaginal exposure to traumatic memories sufficient to successfully treat PTSD? A randomized noninferiority clinical trial. Behavior Therapy, 46, 328–341.CrossRefPubMedGoogle Scholar
- New Freedom Commission on Mental Health. (2003). Achieving the promise: transforming mental health care in America. Final report. DHHS Pub. No. SMA-03-3832. Rockville, MD. Retrieved from http://www.mentalhealthcommission.gov.
- * Osei-Bonsu, P., Bolton, R., Stirman, S. W., Eisen, S., Pellowe, M., & Herz, L. (2016). Mental health provider considerations regarding implementation of evidence-based treatment for PTSD. Journal of Behavioral Health Services Research. Retrieved from http://link.springer.com/article/10.1007/s11414-015-9489-0.
- Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implementation Science, 10, 21. doi:10.1186/s13012-015-0209-1.CrossRefPubMedPubMedCentralGoogle Scholar
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health services Research, 38, 65–76.CrossRefPubMedGoogle Scholar
- * Rosen, C. S., Crowley, J., Eftekhari, A., Kuhn, E., Smith, B. N., Trent, L. & Ruzek, J. I. (2015). Sustained use of evidence-based psychotherapy by graduates of the prolonged exposure training program. Presentation at the VA Health Services Research & Development Conference, Philadelphia, PA.Google Scholar
- * Ruggiero, K. J., Strachan, M., Rheingold, A. A., Foa, E. B., & Acierno, R. A. (2013a). Final report for HSR&D study—PE-Web: Online training for VA providers in prolonged exposure for PTSD. Submitted to VA HSR&D.Google Scholar
- Ruggiero, K. J., Rheingold, A. A., & Foa, E. B. (2013b). PE-Web: A web-based learning course for prolonged exposure. Charleston, SC: Ralph H. Johnson VA Medical Center. (http://pe.musc.edu).
- * Ruzek, J. I., Eftekhari, A., Crowley, J., Kuhn, E. R., Karlin, B. E., & Rosen, C. S. (2015). Post-training beliefs, intentions, and use of prolonged exposure therapy by clinicians in the Veterans Health Administration. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0689-y.Google Scholar
- * Ruzek, J. I., Eftekhari, A., Rosen, C. S., Crowley, J. J., Kuhn, E. R., Foa, E. B., et al. (2016). Effects of a comprehensive training program on clinician beliefs about and intention to use prolonged exposure therapy for PTSD. Psychological Trauma: Theory, Research, Practice, and Policy, 8, 348–355.CrossRefGoogle Scholar
- Sayer, N. (2015). A preliminary look at use of PE and CPT in VHA outpatient programs. Presentation at the VA Health Services Research & Development Conference, Philadelphia, PA.Google Scholar
- Schnurr, P. P., Friedman, M. J., Foy, D. W., Shea, M. T., Hsieh, F. Y., Lavori, P. W., et al. (2003). Randomized trial of trauma-focused group therapy for posttraumatic stress disorder: Results from a Department of Veterans Affairs cooperative study. Archives of General Psychiatry, 60, 481–489.CrossRefPubMedGoogle Scholar
- Schreier, M. (2012). Qualitative content analysis in practice. Thousand Oaks, CA: SAGE Publications Inc.Google Scholar
- Seal, K. H., Bertenthal, D., Maguen, S., Gima, K., Chu, A., & Marmar, C. R. (2008). Getting beyond “Don’t ask; don’t tell”: An evaluation of US Veterans Administration postdeployment mental health screening of Veterans returning from Iraq and Afghanistan. American Journal of Public Health, 98, 714–720.CrossRefPubMedPubMedCentralGoogle Scholar
- * Shiner, B., D’Avolio, L. W., Nguyen, T. M., Zayed, M. H., Young-Xu, Y., Desai, R. A., et al. (2013). Measuring use of evidence based psychotherapy for posttraumatic stress disorder. Administration and Policy in Mental Health and Mental Health Services Research, 40, 311–318.CrossRefPubMedGoogle Scholar
- Singla, D. R., Weobong, B., Nadkarni, A., Chowdhary, N., Shinde, S., Anand, A., et al. (2014). Improving the scalability of psychological treatments in developing countries: An evaluation of peer-led therapy quality assessment in Goa, India. Behaviour Research and Therapy, 60, 53–59.CrossRefPubMedPubMedCentralGoogle Scholar
- Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F. & Charns, M., (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 17. PMCID: 3317864.Google Scholar
- Stirman, S. W., Gutner, C., Graham, J., & Langdon, K. (2015a). Bridging the gap between research and practice in mental health service settings: An overview of developments in implementation theory and research. Behavior Therapy. Google Scholar
- Stirman, S. W., Matza, A., Gamarra, J., Xhezo, R., Hurford, M., Evans, A. C., et al. (2015b). System-level influences on the sustainability of a program to implement cognitive therapy in a community behavioral health network. Psychiatric Services, 66(7), 734–742.CrossRefPubMedPubMedCentralGoogle Scholar
- Tanielen, T., & Jaycox, L. H. (2008). Invisible wounds of war: Psychological and cognitive injuries, their consequences, and services to assist recovery. Santa Monica, CA: Rand Monographs.Google Scholar
- Veterans Administration/Department of Defense Clinical Practice Guideline Working Group. (2010). Management of post-traumatic stress. Washington, DC: Office of Quality and Performance.Google Scholar
- Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., et al. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10:109. doi:10.1186/s13012-015-0295-0.
- Weathers, F., Litz, B., Herman, D., Huska, J., & Keane, T. (1993). The PTSD checklist (PCL): Reliability, validity, and diagnostic utility. Paper presented at the Annual Convention of the International Society for Traumatic Stress Studies, San Antonio, TX.Google Scholar
- Wolf, G. K., Strom, T. Q., Kehle, S. M., & Eftekhari, A. (2012). A preliminary examination of prolonged exposure therapy with Iraq and Afghanistan Veterans with a diagnosis of posttraumatic stress disorder and mild to moderate traumatic brain injury. Journal of Head Trauma Rehabilitation, 27, 26–32.CrossRefPubMedGoogle Scholar
- Yuen, E. K., Gros, D. F., Price, M., Zeigler, S., Tuerk, P. W., Foa, E. B., et al. (2015). Randomized controlled trial of home-based telehealth versus in-person prolonged exposure for combat-related PTSD in Veterans: Preliminary results. Journal of Clinical Psychology, 71, 500–512.CrossRefPubMedGoogle Scholar
- * Zubkoff, L., Carpenter-Song, E., Shiner, B., Ronconi, J. M., & Watts, B. V. (2016). Clinicians’ perception of patient readiness for treatment: An emerging theme in implementation science? Administration and Policy in Mental Health and Mental Health Services Research, 43, 250–258.CrossRefPubMedGoogle Scholar