Mechanisms of Change in the ARC Organizational Strategy: Increasing Mental Health Clinicians’ EBP Adoption Through Improved Organizational Culture and Capacity
- 526 Downloads
The development of efficient and scalable implementation strategies in mental health is restricted by poor understanding of the change mechanisms that increase clinicians’ evidence-based practice (EBP) adoption. This study tests the cross-level change mechanisms that link an empirically-supported organizational strategy for supporting implementation (labeled ARC for Availability, Responsiveness, and Continuity) to mental health clinicians’ EBP adoption and use. Four hundred seventy-five mental health clinicians in 14 children’s mental health agencies were randomly assigned to the ARC intervention or a control condition. Measures of organizational culture, clinicians’ intentions to adopt EBPs, and job-related EBP barriers were collected before, during, and upon completion of the three-year ARC intervention. EBP adoption and use were assessed at 12-month follow-up. Multilevel mediation analyses tested changes in organizational culture, clinicians’ intentions to adopt EBPs, and job-related EBP barriers as linking mechanisms explaining the effects of ARC on clinicians’ EBP adoption and use. ARC increased clinicians’ EBP adoption (OR = 3.19, p = .003) and use (81 vs. 56 %, d = .79, p = .003) at 12-month follow-up. These effects were mediated by improvement in organizational proficiency culture leading to increased clinician intentions to adopt EBPs and by reduced job-related EBP barriers. A combined mediation analysis indicated the organizational culture-EBP intentions mechanism was the primary carrier of ARC’s effects on clinicians’ EBP adoption and use. ARC increases clinicians’ EBP adoption and use by creating proficient organizational cultures that increase clinicians’ intentions to adopt EBPs.
KeywordsMechanism Mediation Organizational implementation strategy Organizational culture Intervention Mental health Evidence-based practice ARC
This study was funded by grants from the National Institute of Mental Health to NJW (F31MH099846) and CG (R01MH084855). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Mental Health.
Compliance with Ethical Standards
Conflict of interest
Nathaniel Williams declares that he has no conflict of interest. Charles Glisson declares that he has no conflict of interest. Anthony Hemmelgarn declares that he has no conflict of interest. Philip Green declares that he has no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., Landsverk, J. A., & The Research Networkon Youth Mental Health. (2012). The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A United States national study. Implementation Science, 7(1), 56.CrossRefPubMedPubMedCentralGoogle Scholar
- Aarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009). Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science, 4(1), 83.CrossRefPubMedPubMedCentralGoogle Scholar
- Baer, J. S., Wells, E. A., Rosengren, D. B., Hartzler, B., Beadnell, B., & Dunn, C. (2009). Agency context and tailored training in technology transfer: A pilot evaluation of motivational interviewing training for community counselors. Journal of Substance Abuse Treatment, 37, 191–202.CrossRefPubMedPubMedCentralGoogle Scholar
- Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale: Erlbaum.Google Scholar
- Fishbein, M., Triandis, H. C., Kanfer, F. H., Becker, M., Middlestadt, S. E., & Eichler, A. (2001). Factors influencing behavior and behavior change. In A. Baum, T. Revenson, & J. Singer (Eds.), Handbook of health psychology (pp. 3–17). Mahwah: Lawrence Erlbaum Associates.Google Scholar
- Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012b). Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 780–787.CrossRefPubMedGoogle Scholar
- Glisson, C., Hemmelgarn, A., Green, P., & Williams, N. J. (2013). Randomized trial of the availability, responsiveness and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 493–500.CrossRefPubMedGoogle Scholar
- Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., et al. (2008a). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health, 35, 98–113.CrossRefPubMedGoogle Scholar
- Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537–550.CrossRefPubMedPubMedCentralGoogle Scholar
- Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., et al. (2008b). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy In Mental Health, 35, 124–133.CrossRefPubMedGoogle Scholar
- Glisson, C., Williams, N. J., Green, P., Hemmelgarn, A., & Hoagwood, K. (2014). The organizational social context of mental health Medicaid waiver programs with family support services: Implications for research and practice. Administration and Policy In Mental Health, 41, 32–42.CrossRefPubMedPubMedCentralGoogle Scholar
- National Institute of Mental Health. (2008). National Institute of Mental Health strategic plan. Washington, DC: U. S. Department of Health and Human Services.Google Scholar
- Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 1009–1025.CrossRefPubMedPubMedCentralGoogle Scholar
- Olin, S. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C., & Hoagwood, K. E. (2014). Quality indicators for family support services and their relationship to organizational social context. Administration and Policy in Mental Health and Mental Health Services Research, 41, 43–54.CrossRefPubMedGoogle Scholar
- Raghavan, R., Inkelas, M., Franke, T., & Halfon, N. (2007). Administrative barriers to the adoption of high-quality mental health services for children in foster care: A national study. Administration and Policy in Mental Health and Mental Health Services Research, 34, 191–201.CrossRefPubMedGoogle Scholar
- Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis (2nd ed.). Thousand Oaks: Sage publications.Google Scholar
- Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.Google Scholar
- Schein, E. H. (2004). Organizational culture and leadership. San Francisco, CA: Jossey-Bass.Google Scholar
- Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., et al. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy In Mental Health, 35, 84–97.CrossRefPubMedGoogle Scholar
- Sheeran, P. (2002). Intention-behavior relations: A conceptual and empirical review. In W. Stroebe & M. Hewstone (Eds.), European review of social psychology (Vol. 12, pp. 1–36). London: Wiley.Google Scholar
- Trice, H. M., & Beyer, J. M. (1993). The cultures of work organizations. Englewood Cliffs: Prentice Hall.Google Scholar
- Williams, N. J., & Glisson, C. (2014b). The role of organizational culture and climate in the dissemination and implementation of empirically-supported treatments for youth. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence based practices in child and adolescent mental health (pp. 61–81). New York: Oxford University Press.Google Scholar