Skip to main content
SpringerLink
Log in

Leadership, Organizational Climate, and Perceived Burden of Evidence-Based Practice in Mental Health Services

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

The use of evidence-based practices (EBPs) is associated with favorable client outcomes, yet perceived burden of using EBPs may affect the adoption and implementation of such practices. Multilevel path analysis was used to examine the associations of transformational leadership with organizational climate, and their associations with perceived burden of using EBPs. Results indicated significant relationships between transformational leadership and empowering and demoralizing climates, and between demoralizing climate and perceived burden of EBPs. We found significant indirect associations of leadership and perceived burden through organizational climate. Findings suggest that further research is needed to examine the extent to which improving leadership and organizational climate may reduce perceived burden and use of EBPs with the ultimate goal of enhancing quality of care.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57, 1162–1169.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39, 331–340. doi:10.1007/s10488-010-0302-3.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11. doi:10.1186/s13012-014-0192-y.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. doi:10.1146/annurev-publhealth-032013-182447.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. (2010). Psychometric properties and U.S. national norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment, 22, 356–365. doi:10.1037/a0019188.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration and Policy in Mental Health and Mental Health Services Research, 34, 465–469. doi:10.1007/s10488-007-0127-x.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419. doi:10.1007/s10488-007-0121-3.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33, 289–301. doi:10.1007/s10488-006-0039-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011). The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychological Services, 8, 269–281. doi:10.1037/a0026196.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99, 2087–2095. doi:10.2105/AJPH.2009.161711.

    Article  PubMed  PubMed Central  Google Scholar 

  • American Academy of Child & Adolescent Psychiatry. (2006). Evidence based practice. Retrieved from: http://www.aacap.org/AACAP/Policy_Statements/2006/Evidence_Based_Practice.aspx.

  • American Psychological Association. (2005). Policy statement on evidence-based practice in psychology. Retrieved from http://www.apa.org/practice/guidelines/evidence-based-statement.aspx.

  • Arthur, C. A., & Hardy, L. (2014). Transformational leadership: A quasi-experiment study. Leadership & Organization Development Journal, 35, 38–53. doi:10.1108/LODJ-03-2012-0033.

    Article  Google Scholar 

  • Barling, J., Weber, T., & Kelloway, E. K. (1996). Effects of transformational leadership training on attitudinal and financial outcomes: A field experiment. Journal of Applied Psychology, 81, 827–832.

    Article  Google Scholar 

  • Bass, B. M. (1999). Two decades of research and development in transformational leadership. European Journal of Work and Organizational Psychology, 8, 9–32.

    Article  Google Scholar 

  • Bass, B., & Avolio, B. (1995). MLQ: multifactor leadership questionnaire: technical report. Palo Alto, CA: Mind Garden.

    Google Scholar 

  • Bass, B. M., & Avolio, B. J. (1997). Full range leadership development: manual for the multifactor leadership questionnaire. Palo Alto, CA: Mind Garden.

    Google Scholar 

  • Bass, B. M., & Riggio, R. E. (2006). Transformational leadership (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Bastien, D. T., McPhee, R. D., & Bolton, K. A. (1995). A study and extended theory of the structuration of climate. Communications Monographs, 62(2), 87–109.

    Article  Google Scholar 

  • Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30. doi:10.1111/j.1468-2850.2009.01187.x.

    Google Scholar 

  • Beidas, R. S., & Kendall, P. C. (2014). Dissemination and implementation of evidence-based practices in child and adolescent mental health. New York, NY: Oxford University Press.

    Google Scholar 

  • Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349–381). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Brown, R. D. (2000, April). Interrater agreement reconsidered: The role of maximum possible variance. Paper presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.

  • Brown, R. D., & Hauenstein, N. M. A. (2005). Interrater agreement reconsidered: An alternative to the rwg indices. Organizational Research Methods, 8, 165–184.

    Article  Google Scholar 

  • Bruns, E. J., Hoagwood, K. E., Rivard, J. C., Wotring, J., Marsenich, L., & Carter, B. (2008). State implementation of evidence-based practice for youths, part II: Recommendations for research and policy. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 499–504.

    Article  PubMed  Google Scholar 

  • Carlson, M., Wilcox, R., Chou, C., Chang, M., Yang, F., Blanchard, J., et al. (2011). Psychometric properties of reverse-scored items on the CES-D in a sample of ethnically diverse older adults. Psychological Assessment, 23, 558–562.

    Article  PubMed  PubMed Central  Google Scholar 

  • Cashin, C., Scheffler, R., Felton, M., Adams, N., & Miller, L. (2008). Transformation of the California mental health system: Stakeholder-driven planning as a transformational activity. Psychiatric Services, 59, 1107–1114.

    Article  PubMed  Google Scholar 

  • Conrad, K. J., Wright, B. D., McKnight, P., McFall, M., Fontana, A., & Rosenheck, R. (2004). Comparing traditional and Rasch analyses of the Mississippi PTSD scale: Revealing limitations of reverse-scored items. Journal of Applied Measurement, 5, 15–30.

    PubMed  Google Scholar 

  • Darkes, J., Greenbaum, P. E., & Goldman, M. S. (1998). Sensation seeking-disinhibition and alcohol use: Exploring issues of criterion contamination. Psychological Assessment, 10, 71–76. doi:10.1037/1040-3590.10.1.71.

    Article  Google Scholar 

  • Donnelly, M. (1994). Managing people and quality in a climate of change. Managing Service Quality: An International Journal, 4(4), 41–44. doi:10.1108/09604529410065261.

    Article  Google Scholar 

  • Fisher, D. M. (2014). A multilevel cross-cultural examination of role overload and organizational commitment: Investigating the interactive effects of context. Journal of Applied Psychology, 99(4), 723. doi:10.1037/a0035861.

    Article  PubMed  Google Scholar 

  • Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281. doi:10.2105/AJPH.2012.300755.

    Article  PubMed  PubMed Central  Google Scholar 

  • Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare settings. Child Abuse and Neglect, 35, 582–591.

    Article  PubMed  Google Scholar 

  • Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse and Neglect, 22, 401–421. doi:10.1016/S0145-2134(98)00005-2.

    Article  CAS  PubMed  Google Scholar 

  • Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., & Research Network on Youth Mental Health. (2008a). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98–113. doi:10.1007/s10488-007-0148-5.

    Article  PubMed  Google Scholar 

  • Glisson, C., Shoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., et al. (2008b). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35, 124–133. doi:10.1007/s10488-007-0152-9.

    Article  PubMed  Google Scholar 

  • Grant, A. M. (2012). Leading with meaning: Beneficiary contact, prosocial impact, and the performance effects of transformational leadership. Academy of Management Journal, 55, 458–476. doi:10.5465/amj.2010.0588.

    Article  Google Scholar 

  • Hayes, A. F. (2009). Beyond Baron and Kenny: Statistical mediation analysis in the new millennium. Communication Monographs, 76(4), 408–420. doi:10.1080/03637750903310360.

    Article  Google Scholar 

  • Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567. doi:10.1037/0022-006X.76.4.556.

    Article  PubMed  PubMed Central  Google Scholar 

  • Jacobs, S. R., Weiner, B. J., & Bunger, A. C. (2014). Context matters: measuring implementation climate among individuals and groups. Implementation Science, 9, 46. doi:10.1186/1748-5908-9-46.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kearney, E., & Gebert, D. (2009). Managing diversity and enhancing team outcomes: The promise of transformational leadership. Journal of Applied Psychology, 94, 77–89. doi:10.1037/a0013077.

    Article  PubMed  Google Scholar 

  • Keller, R. T. (2006). Transformational leadership, initiating structure, and substitutes for leadership: A longitudinal study of research and development project team performance. Journal of Applied Psychology, 91, 202–210. doi:10.1037/0021-9010.91.1.202.

    Article  PubMed  Google Scholar 

  • Kenny, D. A., & Judd, C. M. (1996). A general procedure for the estimation of interdependence. Psychological Bulletin, 119(1), 138–148. doi:10.1037/0033-2909.119.1.138.

    Article  CAS  PubMed  Google Scholar 

  • Kirkbride, P. (2006). Developing transformational leaders: The full range leadership model in action. Industrial and Commercial Training, 38, 23–32. doi:10.1108/00197850610646016.

    Article  Google Scholar 

  • Krishnan, V. R. (2012). Transformational leadership and personal outcomes: Empowerment as mediator. Leadership & Organization Development Journal, 33, 550–563. doi:10.1108/01437731211253019.

    Article  Google Scholar 

  • Laschinger, H. K. S., Finegan, J., & Shamian, J. (2001). The impact of workplace empowerment, organizational trust on staff nurses’ work satisfaction and organizational commitment. Health Care Management Review, 26(3), 7–23.

    Article  CAS  PubMed  Google Scholar 

  • Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout. Annual Review of Psychology, 52, 397–422. doi:10.1146/annurev.psych.52.1.397.

    Article  CAS  PubMed  Google Scholar 

  • McArdle, J. J. (2013). Dealing with longitudinal attrition using logistic regression and decision tree analyses. In J. J. McArdle & G. Ritschard (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 282–311). New York: Taylor & Frances.

    Google Scholar 

  • McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84. doi:10.1037/a0018121.

    Article  PubMed  Google Scholar 

  • Mok, E., & Au-Yeung, B. (2002). Relationship between organizational climate and empowerment of nurses in Hong Kong. Journal of Nursing Management, 10(3), 129–137. doi:10.1046/j.1365-2834.2002.00285.x.

    Article  PubMed  Google Scholar 

  • Mullen, J. E., & Kelloway, E. K. (2009). Safety leadership: A longitudinal study of the effects of transformational leadership on safety outcomes. Journal of Occupational and Organizational Psychology, 82(2), 253–272. doi:10.1348/096317908X325313.

    Article  Google Scholar 

  • Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.

    Article  PubMed  Google Scholar 

  • Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12(4), 531–544.

    Article  Google Scholar 

  • Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reserve of social anxiety is not always the opposite: The reverse-scored items of the social interaction anxiety scale do not belong. Behavior Therapy, 38, 192–206.

    Article  PubMed  Google Scholar 

  • Rubin, D. B. (1996). Multiple imputation after 18+ years. Journal of American Statistical Association, 91, 473–489. doi:10.2307/2291635.

    Article  Google Scholar 

  • Sarros, J. C., Cooper, B. K., & Santora, J. C. (2008). Building a climate for innovation through transformational leadership and organizational culture. Journal of Leadership & Organizational Studies, 15, 145–158.

    Article  Google Scholar 

  • Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177. doi:10.1037/1082-989X.7.2.147.

    Article  PubMed  Google Scholar 

  • Scheffer, J. (2002). Dealing with missing data. Research Letters in the Information and Mathematical Sciences, 3, 153–160.

    Google Scholar 

  • Schneider, B., Ehrhart, M. G., & Macey, W. H. (2013). Organizational climate and culture. Annual Review of Psychology, 64, 361–388. doi:10.1146/annurev-psych-113011-143809.

    Article  PubMed  Google Scholar 

  • Seibert, S. E., Silver, S. R., & Randolph, W. A. (2004). Taking empowerment to the next level: A multiple-level model of empowerment, performance, and satisfaction. Academy of Management Journal, 47(3), 332–349. http://www.jstor.org/stable/20159585.

  • Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2011). Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: the triple p-positive parenting program. Child Maltreatment, 17, 86–95. doi:10.1146/annurev-clinpsy-032511-143104.

    Article  PubMed  Google Scholar 

  • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.

    Article  CAS  PubMed  Google Scholar 

  • Siu, O. L., Lu, L., & Cooper, C. L. (1999). Managerial stress in Hong Kong and Taiwan: A comparative study. Journal of Managerial Psychology, 14(1), 6–25. doi:10.1108/02683949910254675.

    Article  Google Scholar 

  • Sivasubramaniam, N., Murry, W. D., Avolio, B. J., & Jung, D. I. (2002). A longitudinal model of the effects of team leadership and group potency on group performance. Group and Organization Management, 27, 66–96. doi:10.1177/1059601102027001005.

    Article  Google Scholar 

  • Spector, P. E. (2006). Method variance in organizational research truth or urban legend? Organizational Research Methods, 9, 221–232.

    Article  Google Scholar 

  • Spreitzer, G. M. (1996). Social structural characteristics of psychological empowerment. Academy of Management Journal, 39(2), 483–504. http://www.jstor.org/stable/256789.

  • Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson.

    Google Scholar 

  • Tofighi, D., & MacKinnon, D. P. (2011). RMediation: An R package for mediation analysis confidence intervals. Behavior Research Methods, 43, 692–700. doi:10.3758/s13428-011-0076-x.

    Article  PubMed  PubMed Central  Google Scholar 

  • Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: The relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research, 39, 353–364. doi:10.1007/s10488-011-0357-9.

    Article  PubMed  Google Scholar 

  • Wang, G., Oh, I.-S., Courtright, S. H., & Colbert, A. E. (2011). Transformational leadership and performance across criteria and levels: A meta-analytic review of 25 years of research. Group and Organization Management, 36, 223–270. doi:10.1177/1059601111401017.

    Article  CAS  Google Scholar 

  • Warren-Gross, L. (2009). How does a failing school stop failing? Knowledge Quest, 38(2), 40–43.

    Google Scholar 

  • Zohar, D. (1980). Safety climate in industrial organizations: Theoretical and applied implications. Journal of Applied Psychology, 65, 96–102.

    Article  CAS  PubMed  Google Scholar 

  • Zohar, D., & Luria, G. (2010). Group leaders as gatekeepers: Testing safety climate variations across levels of analysis. Applied Psychology, 59, 647–673. doi:10.1111/j.1464-0597.2010.00421.x.

    Article  Google Scholar 

  • Zohar, D., & Polachek, T. (2014). Discourse-based intervention for modifying supervisory communication as leverage for safety climate and performance improvement: A randomized field study. Journal of Applied Psychology, 99(1), 113. doi:10.1037/a0034096.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by National Institute of Mental Health Grants R01MH072961, K01MH001695, and R01MH092950. The authors thank the participating community based organizations and clinicians for their participation in this study.

Author information

Authors and Affiliations

  1. School of Social Work, University of Southern California, Los Angeles, CA, USA

    Kim C. Brimhall, Karissa Fenwick & Michael S. Hurlburt

  2. Department of Psychiatry, University of California, San Diego, 9500 Gilman Drive (0812), La Jolla, CA, 92093-0812, USA

    Lauren R. Farahnak & Gregory A. Aarons

  3. Child and Adolescent Services Research Center, San Diego, CA, USA

    Lauren R. Farahnak, Michael S. Hurlburt & Gregory A. Aarons

  4. San Diego State University, San Diego, CA, USA

    Scott C. Roesch

Authors
  1. Kim C. Brimhall
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karissa Fenwick
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lauren R. Farahnak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael S. Hurlburt
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Scott C. Roesch
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gregory A. Aarons
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gregory A. Aarons.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brimhall, K.C., Fenwick, K., Farahnak, L.R. et al. Leadership, Organizational Climate, and Perceived Burden of Evidence-Based Practice in Mental Health Services. Adm Policy Ment Health 43, 629–639 (2016). https://doi.org/10.1007/s10488-015-0670-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-015-0670-9

Keywords

Search

Navigation