This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
OSC profiles for each organization are typically created by creating an average score by agency composed of responses from frontline service providers. However, two of the organizations did not have enough frontline providers to create the OSC profile without the inclusion of agency leaders. Given that aggregate statistics (i.e., awg, rwg) were acceptable and empirical work suggesting that agreement in small organizations between leaders and followers is high,[ 12 ] agency leaders were included in the total profile score for those two organizations only.
New Freedom Comission on Mental Health. Achieving the promise: Transforming mental health Care in America. Final report. Rockville, MD: U.S. Department of Health and Human Services; 2003.
U.S. Department of Health and Human Services. Mental health: A report of the surgeon general. Rockville, MD: National Institute of Mental Health; 1999.
Weisz JR, Ng MY, Bearman SK. Odd couple? Reenvisioning the relation between science and practice in the dissemination-implementation era. Clinical Psychology Science 2014;2(1):58–74.
Weisz JR, Jensen-Doss A, Hawley KM. Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. Am Psychol 2006;61(7):671–689.
Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci 2006;1(1):1–1.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health Ment Health Serv Res 2011;38(1):4–23.
Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci 2009;4(1):50–64.
Beidas RS, Marcus S, Aarons GA, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatr 2015;169(4):374–382.
Glisson C, Hemmelgarn A. The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse Negl 1998;22(5):401–421.
Glisson C, Green P. Organizational climate, services, and outcomes in child welfare systems. Child Abuse Negl 2011;35(8):582–591.
Henggeler SW, Chapman JE, Rowland MD, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol 2008;76(4):556–567.
Beidas RS, Edmunds J, Ditty M, et al. Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Adm Policy Ment Health Ment Health Serv Res 2014;41(6):788–799.
Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice Attitude scale (EBPAS). Ment Health Serv Res 2004;6(2):61–74.
Glisson C, Dukes D, Green P. The effects of the ARC organizational intervention on caseworker turnover, climate, and culture in children’s service systems. Child Abuse Negl 2006;30(8):855–880.
Peterson AE, Bond GR, Drake RE, et al. Predicting the long-term sustainability of evidence-based practices in mental health care: An 8-year longitudinal analysis. Journal of Behavioral Health Services & Research. 2014;41(3):337–346.
Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci 2008;3(1):26–34.
Willging CE, Green AE, Gunderson L, et al. From a "perfect storm" to "smooth sailing": Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment 2015;20(1):24–36.
Williams JR, Blais MP, Banks D, et al. Predictors of the decision to adopt motivational interviewing in community health settings. The Journal of Behavioral Health Services & Research 2014;41(3):294–307.
Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv 2006; 3(1): 61–72.
Gallo KP, Barlow DH. Factors involved in clinician adoption and nonadoption of evidence-based interventions in mental health. Clinical Psychology: Science & Practice. 2012;19(1):93–106.
Stewart RE, Chambless DL, Baron J. Theoretical and practical barriers to practitioners’ willingness to seek training in empirically supported treatments. J Clin Psychol 2012;68(1):8–23.
Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: Implications for services and interventions research. Clinical Psychology: Science & Practice. 2006;13(1):73–89.
Wang W, Saldana L, Brown CH, et al. Factors that influenced county system leaders to implement an evidence-based program: A baseline survey within a randomized controlled trial. Implement Sci 2010;5(1):72–79.
Patterson DA, Dulmus CN, Maguin E. Empirically supported treatment’s impact on organizational culture and climate. Res Soc Work Pract 2012;22(6):665–671.
Beidas RS, Aarons GA, Barg FK, et al. Policy to implementation: Evidence-based practice in community mental health - study protocol. Implement Sci 2013;8(1):38–46.
Beidas RS, Stewart RE, Adams DR, et al. A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Adm Policy Ment Health Ment Health Serv Res 2016;43(6):893–908.
Chorpita BF, Yim LM, Donkervoet JC, et al. Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science & Practice. 2002;9(2):165–190.
Dorsey S, Berliner L, Lyon AR, et al. A statewide common elements initiative for children’s mental health. Journal of Behavioral Health Services & Research 2016;43(2):246–261.
Southam-Gerow MA, Daleiden EL, Chorpita BF, et al. MAPping Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child and Adolescent Psychology. 2014;43(2):190–200.
Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev 2002;5(4):233–253.
Gotham HJ. Diffusion of mental health and substance abuse treatments: Development, dissemination, and implementation. Clinical Psychology: Science & Practice 2004;11(2):160–176.
Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: The development and validity testing of the implementation climate scale (ICS). Implement Sci 2014;9(1):157–167.
Stirman SW, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implement Sci 2012;7(1):17–35.
Stirman SW, Spokas M, Creed TA, et al. Training and consultation in evidence-based psychosocial treatments in public mental health settings: The ACCESS model. Professional Psychology: Research & Practice 2010;41(1):48–56.
Beidas RS, Adams DR, Kratz HE, et al. Lessons learned while building a trauma-informed public mental health system in the city of Philadelphia. Evaluation Program and Planning 2016;59:21–32.
Powell BJ, Beidas RS, Rubin RM, et al. Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Adm Policy Ment Health Ment Health Serv Res 2016;43(6):909–926.
Beidas SR, Williams NJ, Green PD, et al. Concordance between administrator and clinician ratings of organizational culture and climate. Administration and Policy in Mental Health and Mental Health Services Research. Available online first, November 5, 2016: 1–10.
Aarons GA, Ehrhart MG, Torres EM, et al. The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatr Serv 2017;68(2):115–122.
Torres EM, Ehrhart MG, Beidas RS, et al. Validation of the Implementation Leadership Scale (ILS) with supervisors’ self-ratings. Community Mental Health Journal. Available online first, February 8, 2017:1–5.
Weisz JR. Therapist background questionnaire. Los Angeles: University of California; 1997.
Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual. Consulting Psychologists Press; 1996.
Maslach C, Schaufeli WB, Leiter MP. Job burnout. Annu Rev Psychol 2001;52:397–422.
Schaufeli WB, Bakker AB, Hoogduin K, et al. On the clinical validity of the maslach burnout inventory and the burnout measure. Psychol Health 2001;16(5):565–582.
Glass DC, Mcknight JD. Perceived control, depressive symptomatology, and professional burnout: A review of the evidence. Psychol Health 1996;11(1):23–48.
Aarons GA, Glisson C, Hoagwood KE, et al. Psychometric properties and U.S. national norms of the evidence-based practice Attitude scale (EBPAS). Psychol Assess 2010;22(2):356–365.
Stumpf RE, Higa-McMillan CK, Chorpita BF. Implementation of evidence-based services for youth assessing provider knowledge. Behav Modif 2009;33(1):48–65.
Weersing VR, Weisz JR, Donenberg GR. Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child and Adolescent Psychology 2002;31(2):168–180.
Kolko DJ, Cohen JA, Mannarino AP, et al. Community treatment of child sexual abuse: A survey of practitioners in the national child traumatic stress network. Adm Policy Ment Health Ment Health Serv Res 2009;36(1):37–49.
Glisson C, Landsverk JA, Schoenwald S, et al. Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Adm Policy Ment Health Ment Health Serv Res 2008;35(1–2):98–113.
Glisson C, Green PD, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: Implications for research and practice. Child Abuse Negl 2012;36(9):621–632.
Brown RD, Hauenstein NMA. Interrater agreement reconsidered: An alternative to the r(wg) indices. Organ Res Methods 2005;8(2):165–184.
James LR, Demaree RG, Wolf G. Estimating within-group interrater reliability with and without response bias. J Appl Psychol 1984;69(1):85–98.
Bliese PD. Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In: Klein K, Kozlowski S, eds. Multilevel theory, research, and methods in organizations. San Francisco: Jossey-Bass; 2000, pp. 349–380.
Aarons GA, Sommerfeld DH, Hecht DB, et al. The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. J Consult Clin Psychol 2009;77(2):270–280.
Rothman KJ. No adjustments are needed for multiple comparisons. Epidemiology 1990;1(1):43–46.
Beidas RS, Stewart RE, Wolk CB, et al. Independent contractors in public mental health clinics: Implications for use of evidence-based practices. Psychiatr Serv 2016;67(7):710–717.
Birdi K, Allan C, Warr P. Correlates and perceived outcomes of four types of employee development activity. J Appl Psychol 1997;82(6):845–857.
Beidas RS, Marcus S, Wolk CB, et al. A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Adm Policy Ment Health Ment Health Serv Res 2015;43(5):640–649.
Shore LM, Barksdale K, Shore TH. Managerial perceptions of employee commitment to the organization. Acad Manag J 1995;38(6):1593–1615.
Aarons GA. Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child Adolescent Psychiatric Clinics of North America 2005;14(2):255–271.
We are especially grateful for the support that the Department of Behavioral Health and Intellectual disAbility Services has provided for this project and for the Evidence Based Practice and Innovation (EPIC) group. We would also like to thank the following experts who provided their consultation on this project: Dr. Steven Marcus and Dr. David Mandell.
Conflict of Interest
Dr. Beidas receives royalties from Oxford University Press and has served as a consultant for Merck and Kinark Child and Family Services. None of the reported disclosures are related to implementation of evidence-based practices for youth in the City of Philadelphia. The remaining authors (Dr. Skriner, Dr. Benjamin Wolk, Dr. Stewart, Ms. Adams, Dr. Rubin, and Dr. Evans) have no disclosures or conflicts of interest to report.
About this article
Cite this article
Skriner, L.C., Wolk, C.B., Stewart, R.E. et al. Therapist and Organizational Factors Associated with Participation in Evidence-Based Practice Initiatives in a Large Urban Publicly-Funded Mental Health System. J Behav Health Serv Res 45, 174–186 (2018). https://doi.org/10.1007/s11414-017-9552-0