Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. C. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.
Ayers, L., Beyea, S., Godfrey, M., Harper, D., Nelson, E., & Batalden, P. (2005). Quality improvement learning collaboratives. Quality Management in Healthcare, 14(4), 234–247.
Becker, D. R., Drake, R. E., Bond, G. R., Nawaz, S., Haslett, W. R., & Martinez, R. A. (2011). Best practices: A national mental health learning collaborative on supported employment. Psychiatric Services, 62(7), 704–706.
Beidas, R. S., Edmunds, J. E., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665.
Berwick, D. M. (1989). Continuous improvement as an ideal in health care. New England Journal of Medicine, 320(1), 53–56.
Bunger, A. C., Hanson, R. F., Doogan, N. J., Powell, B. J., Cao, Y., & Dunn, J. (2016). Can learning collaboratives support implementation by rewiring professional networks? Administration and Policy in Mental Health and Mental Health Services Research, 43(1), 79–92.
Cavaleri, M. A., Gopalan, G., McKay, M. M., Appel, A., Bannon, W. M., Bigley, M. F., & Thalor, S. (2006). Impact of a learning collaborative to improve child mental health service use among low-income urban youth and families. Best Practice in Mental Health, 2(2), 67–79.
Cavaleri, M. A., Gopalan, G., McKay, M. M., Messam, T., Velez, E., & Elwyn, L. (2010). The effect of a learning collaborative to improve engagement in child mental health services. Children and Youth Services Review, 32(2), 281–285.
Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 114–123.
Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579.
Committee on Quality of Health Care in America-Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington: National Academies Press.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50–64.
Davis, D., Thomson, M., Oxman, A., & Haynes, B. (1995). Changing physician performance: A systematic review of the effect of continuing medical education strategies. JAMA, 274, 700–705.
Deming, W. E. (1986). Out of the crisis. Cambridge: MIT Press.
Dückers, M., Spreeuwenberg, P., Wagner, C., & Groenewegen, P. (2009). Exploring the black box of quality improvement collaboratives: Modelling relations between conditions, applied changes and outcomes. Implementation Science, 4(1), 74.
Ebert, L., Amaya-Jackson, L., Markiewicz, J., Kisiel, C., & Fairbank, J. (2011). Use of the Breakthrough Series Collaborative to support broad and sustained use of evidence-based trauma treatment for children in community practice settings. Administration and Policy in Mental Health and Mental Health Services Research, 39(3), 187–199.
Ferlie, E., & Shortell, S. (2001). Improving the quality of health care in the United Kingdom and the United States: A framework for change. The Milbank Quarterly, 79(2), 281–315.
Fremont, A., Joyce, G., Anaya, H., Bowman, C., Halloran, J., Chang, S., & Asch, S. (2006). An HIV collaborative in the VHA: Do advanced HIT and one-day sessions change the collaborative experience? Joint Commission Journal on Quality and Patient Safety, 32(6), 324–336.
Gamble, J. (2008). A developmental evaluation primer. Montreal: JW McConnell Family Foundation.
Gleacher, A. A., Nadeem, E., Moy, A., Whited, A., Albano, A. M., Wang, R., & Hoagwood, K. E. (2010). The Evidence Based Treatment Dissemination Center: An innovative statewide dissemination effort. Journal of Emotional and Behavioral Disorders, 19(1), 1–11.
Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537–550.
Greenhalgh, T., Robert, G., MacFarland, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629.
Gustafson, D. H., Quanbeck, A. R., Robinson, J. M., Ford, J. H., Pulvermacher, A., French, M. T., & McCarty, D. (2013). Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction, 108(6), 1145–1157.
Honberg, R., Kimball, A., Diehl, S., Usher, L., & Fitzpatrick, M. (2011). State mental health cuts: The continuing crisis. Arlington: The National Alliance on Mental Illness.
Hopkin, C. R., Hoyle, R. H., & Gottfredson, N. C. (2015). Maximizing the yield of small samples in prevention research: A review of general strategies and best practices. Prevention Science, 16(7), 950–955.
Institute for Healthcare Improvement. (2003). The Breakthrough Series: IHI’s collaborative model for achieving breakthrough improvement: IHI Innovation Series White Paper.
Juran, J. M. (1951). Quality control handbook. New York: McGraw-Hill.
Juran, J. M. (1964). Managerial breakthrough. New York: McGraw-Hill.
Katzelnick, D. J., Von Korff, M., Chung, H., Provost, L. P., & Wagner, E. H. (2005). Applying depression-specific change concepts in a collaborative breakthrough series. Joint Commission Journal on Quality and Patient Safety, 31(7), 386–397.
Kilo, C. (1998). A framework for collaborative improvement: Lessons from the Institute for Healthcare Improvement’s Breakthrough Series. Quality Management in Health care, 6, 1–14.
Kolb, D. A. (1984). Experiential learning. New Jersey: Prentice Hall.
Leatherman, S. (2002). Optimizing quality collaboratives. Quality and Safety in Health Care, 11(4), 307.
Markiewicz, J., Ebert, L., Ling, D., Amaya-Jackson, L., & Kisiel, C. (2006). Learning Collaborative Toolkit. Los Angeles, CA, and Durham, NC: National Center for Child Traumatic Stress.
Merriam, S. B. (2001). Andragogy and self-directed learning: Pillars of adult learning theory. New Directions for Adult and Continuing Education, 89, 3–14.
Mittman, B. (2004). Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine, 140(11), 897–901.
Nadeem, E., Gleacher, A., & Beidas, R. S. (2013a). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450.
Nadeem, E., Olin, S. S., Hill, L. C., Hoagwood, K. E., & Horwitz, S. M. (2013b). Understanding the components of Quality Improvement Collaboratives: A systematic literature review. The Milbank Quarterly, 91(2), 354–394.
Nadeem, E., Olin, S. S., Hill, L. C., Hoagwood, K. E., & Horwitz, S. M. (2014). Learning Collaboratives in mental health: Used but untested. Psychiatric Services, 65(9), 1088–1099.
Nembhard, I. M. (2009). Learning and improving in quality improvement collaboratives: Which collaborative features do participants value most? Health Services Research, 44(2 Pt. 1), 359–378.
Nembhard, I. M. (2012). All teach, all learn, all improve?: The role of interorganizational learning in quality improvement collaboratives. Health Care Management Review, 37(2), 154–164.
Olin, S. S., Nadeem, E., Gleacher, A. T., Weaver, J., Weiss, D., Hoagwood, K. E., & Horwitz, S. M. (2015). What predicts clinician dropout from state-sponsored managing and adapting practice training. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0709-y.
Ovretveit, J., Bate, P., Cleary, P., & Cretin, S. Gustafson. (2002). Quality collaboratives: Lessons from research. Quality & Safety in Health Care, 11(4), 345–351.
Palinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011). Social networks and implementation of evidence-based practices in public youth-serving systems: A mixed-methods study. Implementation Science, 6(1), 113–123.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.
Pinto, A., Benn, J., Burnett, S., Parand, A., & Vincent, C. (2011). Predictors of the perceived impact of a patient safety collaborative: An exploratory study. International Journal for Quality in Health Care, 23(2), 173–181.
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., & York, J. L. (2011). A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev, 69(2), 123–157.
PracticeWise. (2014). PracticeWise Retrieved September 15, 2014, from http://www.practicewise.com.
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8, 139.
Raghavan, R., Bright, C., & Shadoin, A. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3(1), 26.
Richardson, J. W. (2011). Technology adoption in Cambodia: Measuring factors impacting adoption rates. Journal of International Development, 23, 697–710.
Roosa, M., Scripa, J. S., Zastowny, T. R., & Ford, J. H. (2011). Using a NIATx based local learning collaborative for performance improvement. Evaluation and Program Planning, 34(4), 390–398.
Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410.
Schouten, L., Grol, R., & Hulscher, M. (2010). Factors influencing success in quality-improvement collaboratives: Development and psychometric testing of an instrument. Implementation Science, 5(1), 84.
Schouten, L. M. T., Hulscher, M. E. J. L., Everdingen, J. J. E., Huijsman, R., & Grol, R. P. T. M. (2008). Evidence for the impact of quality improvement collaboratives: A systematic review. British Medical Journal, 336(7659), 1491–1494.
Singer, S. J., Moore, S. C., Meterko, M., & Williams, S. (2012). Development of a short-form learning organization survey: The LOS-27. Medical Care Research and Review, 69(4), 432–459.
Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). MAPping Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43(2), 190–200.
Substance Abuse and Mental Health Services Administration. (2012). SAMHSA is accepting applications for up to $30 million in State Adolescent Enhancement and Dissemination grants. SAMHSA Bulletin Retrieved from http://www.samhsa.gov/newsroom/advisories/1206124742.aspx.
Vannoy, S. D., Mauer, B., Kern, J., Girn, K., Ingoglia, C., Campbell, J., & Unützer, J. (2011). A learning collaborative of CMHCs and CHCs to support integration of behavioral health and general medical care. Psychiatric Services, 62(7), 753–758.
Wilson, T., Berwick, D. M., & Cleary, P. (2004). What do collaborative improvement projects do? Experience from seven countries. Joint Commission Journal on Quality and Patient Safety, 30(Supplement 1), 25–33.
Yin, R. K. (2009). Case Study Research: Design and Methods (4th ed.). Thousand Oaks: Sage Publications.
This study was supported by funding from the National Institute of Mental Health (P30 MH090322).
About this article
Cite this article
Nadeem, E., Weiss, D., Olin, S.S. et al. Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study. Adm Policy Ment Health 43, 978–990 (2016). https://doi.org/10.1007/s10488-016-0735-4