Concordance Between Administrator and Clinician Ratings of Organizational Culture and Climate
- 652 Downloads
Organizational culture and climate are important determinants of behavioral health service delivery for youth. The Organizational Social Context measure is a well validated assessment of organizational culture and climate that has been developed and extensively used in public sector behavioral health service settings. The degree of concordance between administrators and clinicians in their reports of organizational culture and climate may have implications for research design, inferences, and organizational intervention. However, the extent to which administrators’ and clinicians’ reports demonstrate concordance is just beginning to garner attention in public behavioral health settings in the United States. We investigated the concordance between 73 administrators (i.e., supervisors, clinical directors, and executive directors) and 247 clinicians in 28 child-serving programs in a public behavioral health system. Findings suggest that administrators, compared to clinicians, reported more positive cultures and climates. Organizational size moderated this relationship such that administrators in small programs (<466 youth clients served annually) provided more congruent reports of culture and climate in contrast to administrators in large programs (≥466 youth clients served annually) who reported more positive cultures and climates than clinicians. We propose a research agenda that examines the effect of concordance between administrators and clinicians on organizational outcomes in public behavioral health service settings.
KeywordsOrganizational social context Organizational culture and climate Concordance Leadership Organizational size
We are especially grateful for the support that the Department of Behavioral Health and Intellectual disAbility Services has provided for this project, and for the Evidence Based Practice and Innovation (EPIC) group. We thank Charles Glisson, PhD, and Sonja Schoenwald, PhD, for their comments on earlier versions of this manuscript.
Funding for this research project was supported by NIMH K23 MH099179 (Beidas).
Compliance with Ethical Standards
Conflict of interest
Dr. Beidas receives royalties from Oxford University Press. Dr. Marcus has received grant support from Ortho-McNeil Janssen and Forest Research Institute and has served as a consultant to AstraZeneca and Alkermes. All other authors have no conflicts of interest to report.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
- Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. doi: 10.1146/annurev-publhealth-032013-182447.CrossRefPubMedPubMedCentralGoogle Scholar
- Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. (2015). Discrepancies in leader and follower ratings of transformational leadership: Relationship with organizational culture in mental health. Administration and Policy in Mental Health. doi: 10.1007/s10488-015-0672-7.Google Scholar
- Aarons, G. A., Ehrhart, M. G., Torres, E. L., Finn, N. K., & Beidas, R. S. (2016). The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health organizations. Psychiatric Services. doi: 10.1176/appi.ps.201600062.
- Aarons, G. A., & Sawitzky, A. C. (2006a). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health, 33(3), 289–301. doi: 10.1007/s10488-006-0039-1.CrossRefPubMedPubMedCentralGoogle Scholar
- Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77(2), 270. doi: 10.1037/a0013223.CrossRefPubMedPubMedCentralGoogle Scholar
- Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S. K., Evans, A. C., … Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. doi: 10.1001/jamapediatrics.2014.3736.CrossRefPubMedPubMedCentralGoogle Scholar
- Beidas, R. S., Marcus, S., Wolk, C. B., Powell, B., Aarons, G. A., Evans, A. C., … Mandell, D. S. (2016). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health, 43(5), 640–649. doi: 10.1007/s10488-015-0673-6.CrossRefPubMedPubMedCentralGoogle Scholar
- Beidas, R. S., Wolk, C. L., Walsh, L. M., Evans, A. C. Jr., Hurford, M. O., & Barg, F. K. (2014). A complementary marriage of perspectives: Understanding organizational social context using mixed methods. Implementation Science, 9, 175. doi: 10.1186/s13012-014-0175-z.CrossRefPubMedPubMedCentralGoogle Scholar
- Cameron, K. S., & Quinn, R. E. (2011). Diagnosing and changing organizational culture: Based on the competing values framework (3 edn.). San Francisco, CA: Jossey-Bass.Google Scholar
- Carlfjord, S., Andersson, A., Nilsen, P., Bendtsen, P., & Lindberg, M. (2010). The importance of organizational climate and implementation strategy at the introduction of a new working tool in primary health care. Journal of Evaluation in Clinical Practice, 16(6), 1326–1332. doi: 10.1111/j.1365-2753.2009.01336.x.CrossRefPubMedGoogle Scholar
- Ehrhart, M., Schneider, B., & Macey, W. H. (2014). Organizational climate and culture: An introduction to theory, research, and practice. New York, NY: Routledge.Google Scholar
- Glisson, C., Landsverk, J., Schoenwald, S. K., Kelleher, K., Hoagwood, K. E., Mayberg, S., … Research Network on Youth Mental Health. (2008a). Assessing the Organizational Social Context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health, 35(1–2), 98–113. doi: 10.1007/s10488-007-0148-5.CrossRefPubMedGoogle Scholar
- Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537–550. doi: 10.1037/a0019160.CrossRefPubMedPubMedCentralGoogle Scholar
- Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., … Research Network on Youth Mental Health. (2008b). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health, 35(1–2), 124–133. doi: 10.1007/s10488-007-0152-9.CrossRefPubMedGoogle Scholar
- Glisson, C., Williams, N. J., Hemmelgarn, A., Proctor, E., & Green, P. (2016). Aligning organizational priorities with ARC to improve youth mental health service outcomes. Journal of Consulting and Clinical Psychology, 84(8), 713–725. doi: 10.1037/ccp0000107.CrossRefPubMedPubMedCentralGoogle Scholar
- Hasson, H., Gilbert-Ouimet, M., Baril-Gingras, G., Brisson, C., Vezina, M., Bourbonnais, R., & Montreuil, S. (2012). Implementation of an organizational-level intervention on the psychosocial environment of work comparison of managers’ and employees’ views. Journal of Occupational and Environmental Medicine, 54(1), 85–91. doi: 10.1097/JOM.0b013e31823ccb2f.CrossRefPubMedGoogle Scholar
- Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis (Vol. 451). Hoboken, NJ: Wiley.Google Scholar
- Klein, K. J., & Kozlowski, S. W. (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. San Francisco, CA: Jossey-Bass.Google Scholar
- Olin, S. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C., & Hoagwood, K. E. (2014). Quality indicators for family support services and their relationship to organizational social context. Administration and Policy in Mental Health, 41(1), 43–54. doi: 10.1007/s10488-013-0499-z.CrossRefPubMedGoogle Scholar
- Ostroff, C., Kinicki, A., & Tamkins, M. (2003). Organizational culture and climate (Vol. 12). Hoboken, NJ: Wiley.Google Scholar
- Raudenbush, S. W. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.Google Scholar
- Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (Vol. 1). Thousand Oaks, CA: Sage.Google Scholar
- Rogers, E. M. (2003). Elements of diffusion. In Diffusion of innovations (5th edn., pp. 1–38). New York, NY: Free Press.Google Scholar
- Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., … Research Network on Youth Mental Health. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health, 35(1–2), 84–97. doi: 10.1007/s10488-007-0147-6.CrossRefPubMedGoogle Scholar
- Weisz, J. R. (1997). Therapist background questionnaire. Los Angeles: University of California.Google Scholar
- Wolf, D. A. P. S., Dulmus, C., Maguin, E., Keesler, J., & Powell, B. (2014). Organizational leaders’ and staff members’ appraisals of their work environment within a children’s social service system. Human Service Organizations Management Leadership & Governance, 38(3), 215–227. doi: 10.1080/23303131.2014.884032.CrossRefGoogle Scholar