Advertisement

Evaluation of an Implementation Model: A National Investigation of VA Residential Programs

  • Joan M. CookEmail author
  • Stephanie Dinnen
  • James C. Coyne
  • Richard Thompson
  • Vanessa Simiola
  • Josef Ruzek
  • Paula P. Schnurr
Original Article

Abstract

This national investigation utilizes qualitative data to evaluate an implementation model regarding factors influencing provider use of two evidence-based treatments for posttraumatic stress disorder (PTSD). Semi-structured qualitative interviews with 198 mental health providers from 38 Department of Veterans Affairs’ (VA) residential treatment programs were used to explore these issues regarding prolonged exposure (PE) and cognitive processing therapy (CPT) in VA residential PTSD programs. Several unique and some overlapping predictors emerged. Leadership was viewed as an influence on implementation for both CPT and PE, while a lack of dedicated time and resources was viewed as a deterrent for both. Compatibility of CPT with providers’ existing practices and beliefs, the ability to observe noticeable patient improvement, a perceived relative advantage of CPT over alternative treatments, and the presence of a supportive peer network emerged as influential on CPT implementation. Leadership was associated with PE implementation. Implications for the design and improvement of training and implementation efforts are discussed.

Keywords

Implementation Evidence-based practice Posttraumatic stress disorders 

Notes

Acknowledgments

This project described was supported by Award Number RC1 MH088454 from the National Institute of Mental Health (NIMH). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIMH, the National Institutes of Health or the Department of Veterans Affairs.

References

  1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6, 61–74.CrossRefPubMedCentralPubMedGoogle Scholar
  2. Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health Services Research, 34, 411–419.CrossRefGoogle Scholar
  3. Bernardy, N., Hamblen, J. L., Friedman, M. J., Ruzek, J. I., & McFall, M. E. (2011). Implementation of a posttraumatic stress disorder mentoring program to improve treatment services. Psychological Trauma: Theory, Research, Practice, and Policy, 3, 292–299.CrossRefGoogle Scholar
  4. Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. R. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681.CrossRefPubMedGoogle Scholar
  5. Brunette, M., Asher, D., Whitley, R., Lutz, W., Wieder, B., Jones, A., et al. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59, 989–995.CrossRefPubMedGoogle Scholar
  6. Coleman, J., Katz, E., & Menzel, H. (1957). The diffusion of an innovation among physicians. Sociometry, 20, 253–270.CrossRefGoogle Scholar
  7. Cook, J. M., Biyanova, T., & Coyne, J. C. (2009a). Comparative case study of diffusion of eye movement desensitization and reprocessing in two clinical settings: Empirically supported treatment status is not enough. Professional Psychology: Research and Practice, 40, 518–524.CrossRefGoogle Scholar
  8. Cook, J. M., Schnurr, P. P., Biyanova, T., & Coyne, J. C. (2009b). Apples don’t fall far from the trees: Influences on psychotherapists’ adoption and sustained use of new therapies. Psychiatric Services, 60, 671–676.CrossRefPubMedCentralPubMedGoogle Scholar
  9. Cook, J. M., O’Donnell, C., Dinnen, S., Coyne, J. C., Ruzek, J. J., & Schnurr, P. P. (2012). Measurement of an evidence-based model of implementation in healthcare organizations. Implementation Science, 7, 59–65.CrossRefPubMedCentralPubMedGoogle Scholar
  10. Cook, J. M., O’Donnell, C. O., Dinnen, S., Bernardy, N., Rosenheck, R., & Desai, R. (2013). A formative evaluation of two evidence-based psychotherapies for PTSD in VA residential treatment programs. Journal of Traumatic Stress, 26, 56–63.Google Scholar
  11. Cook, J. M., Dinnen, S., Thompson, R., Simiola, V., & Schnurr, P. P. (2014). Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: A national investigation. Journal of Traumatic Stress, 27, 1–7.CrossRefGoogle Scholar
  12. Curran, G. M., Sullivan, G., Mendel, P., Craske, M. G., Sherbourne, C. D., Stein, M. B., …, & Roy-Byrne, P. (2012). Implementation of the CALM intervention for anxiety disorders: a qualitative study. Implementation Science, 7, 14.Google Scholar
  13. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50–59.CrossRefPubMedCentralPubMedGoogle Scholar
  14. Department of Veterans Affairs. (2013). Dissemination and education within the VA. Washington, DC: Author. Retrieved from http://www.ptsd.va.gov/about/major-initiatives/education/dissemination_education_within_the_va.asp.
  15. Dimeo, M. A., Moore, G. K., & Lichtenstein, C. (2012). Relationship of evidence-based practice and treatments: A survey of community mental health providers. Journal of Community Psychology, 40, 341–357.CrossRefGoogle Scholar
  16. Dopson, S., Locock, L., & Chambers, D. (2001). Implementation of evidence-based medicine: Evaluation of the promoting action on clinical effectiveness programme. Journal of Health Services Research and Policy, 6, 23–31.CrossRefPubMedGoogle Scholar
  17. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters. A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMedGoogle Scholar
  18. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: The National Implementation Research Network, Louis de la Parte Florida Mental Health Institute, University of South Florida.Google Scholar
  19. Foa, E. B., Hembree, E. A., & Rothbaum, B. O. (2007). Prolonged exposure therapy for PTSD: Emotional processing of traumatic experiences—Therapist guide. New York: Oxford University Press.Google Scholar
  20. Garb, H. N. (2005). Clinical judgment and decision making. Annual Review Clinical Psychology, 1, 67–89.CrossRefGoogle Scholar
  21. Granovetter, M. (1973). The strength of weak ties. American Journal of Sociology, 78, 1360–1380.CrossRefGoogle Scholar
  22. Gray, M. J., Elhai, J. D., & Schmidt, L. O. (2007). Trauma professionals’ attitudes toward and utilization of evidence-supported practices. Behavior Modification, 31, 732–768.CrossRefPubMedGoogle Scholar
  23. Greenhalgh, T., Glenn, R., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic literature review and recommendations for future research. Milbank Quarterly, 82, 1–35.CrossRefGoogle Scholar
  24. Horwitz, S. M., Chamberlain, P., Landsverk, J., & Mullican, C. (2010). Improving the mental health of children in child welfare through the implementation of evidence-based parenting interventions. Administration and Policy in Mental Health Services Research, 37, 27–39.CrossRefGoogle Scholar
  25. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.Google Scholar
  26. Karlin, B. E., Ruzek, J. I., Chard, K. M., Eftekhari, A., Monson, C. M. Hembree, E. A., …, & Foa, E. B. (2010). Dissemination of evidence-based psychological treatments for posttraumatic stress disorder in the Veterans Health Administration. Journal of Traumatic Stress, 23, 663–673.Google Scholar
  27. Kessler, R. C. (2000). Posttraumatic stress disorder: The burden to the individual and to society. Journal of Clinical Psychiatry, 61(Suppl 5), 4–12.PubMedGoogle Scholar
  28. Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 593–602.CrossRefPubMedGoogle Scholar
  29. Kirchner, J. E., Cody, M., Thrush, C. R., Sullivan, G., & Rapp, C. G. (2004). Identifying factors critical to implementation of integrated mental health services in rural VA community-based outpatient clinics. Journal of Behavioral Health Services & Research, 31, 13–25.CrossRefGoogle Scholar
  30. McHugh, R. K., Murray, H. W., & Barlow, D. H. (2009). Balancing fidelity and adherence in the dissemination of empirically supported treatments: The promise of transdiagnostic interventions. Behavior Research and Therapy, 47, 946–953.CrossRefGoogle Scholar
  31. Panzano, P. C., Seffrin, B. A., Chaney-Jones, S., Roth, D., Massatti, R., …, & Carstens, C. (2004). The innovation and adoption research project (IDARP): Moving from the diffusion of research results to promoting the adoption of evidence-based innovations in the Ohio mental health system. In D. Roth & W. Lutz (Eds.), New research in mental health. Columbus, OH: Office of Program Evaluation and Research, Ohio Department of Mental Health.Google Scholar
  32. Pogoda, T. K., Cramer, I. E., Rosenheck, R. A., & Resnick, S. G. (2011). Qualitative analysis of barriers to implementation of supported employment in the department of Veterans Affairs. Psychiatric Services, 62, 1289–1295.CrossRefPubMedGoogle Scholar
  33. Popay, J., Rogers, A., & Williams, G. (1998). Rationale and standards for the systematic review of qualitative literature in health services research. Quality of Health Research, 8, 341–351.CrossRefGoogle Scholar
  34. Proctor, E. K., Knudsen, K. J., Fedoravicius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 479–488.CrossRefPubMedGoogle Scholar
  35. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34.CrossRefPubMedGoogle Scholar
  36. Resick, P. A., & Schnicke, M. (1996). Cognitive processing therapy for rape victims: A treatment manual. Newbury Park: Sage Publications.Google Scholar
  37. Rogers, E. M. (1962). Diffusion of innovations. New York: Free Press.Google Scholar
  38. Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.Google Scholar
  39. Rosenheck, R. A., Fontana, A. F., & Errera, P. (1997). Inpatient treatment of war-related PTSD: A twenty-year perspective. Journal of Traumatic Stress, 10, 407–413.PubMedGoogle Scholar
  40. Scheirer, M. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26, 320–347.CrossRefGoogle Scholar
  41. Shiner, B., D’Avolio, L. W., Nguyen, T. M., Zayed, M. H., Young-Xu, Y., Desai, R. A., …, Watts, B. V. (2013). Measuring use of evidence based psychotherapy for posttraumatic stress disorder. Administration and Policy in Mental Health Services Research, 40, 311–318.Google Scholar
  42. Stewart, R. E., Stirman, S. W., & Chambless, D. L. (2012). A qualitative investigation of practicing psychologists’ attitudes toward research-informed practice: Implications for dissemination strategies. Professional Psychology Research and Practice, 43, 100–109.CrossRefGoogle Scholar
  43. Stirman, S. W., Gutierrez-Colina, A., Toder, K., Esposito, G., Barg, F., …, & Crits-Christoph, P. (2013). Clinicians’ perspectives on cognitive therapy in community mental health settings: Implications for training and implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40, 274–285.Google Scholar
  44. Stith, S., Pruitt, I., Dees, J., Fronce, M., Green, N., Som, A., et al. (2006). Implementing community-based prevention programming: A review of the literature. Journal Primary Prevention, 27, 599–617.CrossRefGoogle Scholar
  45. VA/DoD Clinical Practice Guideline Working Group. (December 2010). Management of post-traumatic stress. Washington, DC: Veterans Health Administration, publication 10Q-CPG/PTSD-03.Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Joan M. Cook
    • 1
    Email author
  • Stephanie Dinnen
    • 1
  • James C. Coyne
    • 2
  • Richard Thompson
    • 3
  • Vanessa Simiola
    • 1
  • Josef Ruzek
    • 4
  • Paula P. Schnurr
    • 5
  1. 1.Yale School of Medicine and National Center for PTSDWest HavenUSA
  2. 2.University of GroningenGroningenThe Netherlands
  3. 3.University of Illinois at ChicagoChicagoUSA
  4. 4.National Center for PTSD and Palo Alto UniversityPalo AltoUSA
  5. 5.National Center for PTSD and Geisel School of Medicine at DartmouthWhite River JunctionUSA

Personalised recommendations