Skip to main content

Long-Term Clinical Outcomes from a Randomized Controlled Trial of Two Implementation Strategies to Promote Collaborative Care Attendance in Community Practices

Administration and Policy in Mental Health and Mental Health Services Research volume 42, pages 642–653 (2015)Cite this article

Abstract

This randomized controlled implementation study compared the effectiveness of a standard versus enhanced version of the replicating effective programs (REP) implementation strategy to improve the uptake of the life goals-collaborative care model (LG-CC) for bipolar disorder. Seven community-based practices (384 patient participants) were randomized to standard (manual/training) or enhanced REP (customized manual/training/facilitation) to promote LG-CC implementation. Participants from enhanced REP sites had no significant changes in primary outcomes (improved quality of life, reduced functioning or mood symptoms) by 24 months. Further research is needed to determine whether implementation strategies can lead to sustained, improved participant outcomes in addition to program uptake.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1

References

  • Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.

    PubMed Central  Article  PubMed  Google Scholar 

  • Bandura, A. (1977). Social Learning Theory. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Baskerville, N. B., Liddy, C., & Hogg, W. (2012). Systematic review and meta-analysis of practice facilitation within primary care settings. Annals of Family Medicine, 10(1), 63–74.

    PubMed Central  Article  PubMed  Google Scholar 

  • Bauer, M. S., McBride, L., Williford, W. O., Glick, H., Kinosian, B., Altshuler, L.,… Cooperative Studies Program 430 Study, T. (2006a). Collaborative care for bipolar disorder: Part I. Intervention and implementation in a randomized effectiveness trial. Psychiatric Services, 57(7), 927–936.

  • Bauer, M. S., McBride, L., Williford, W. O., Glick, H., Kinosian, B., Altshuler, L.,… Cooperative Studies Program 430 Study, T. (2006b). Collaborative care for bipolar disorder: Part II. Impact on clinical outcome, function, and costs. Psychiatric Services, 57(7), 937–945.

  • Bauer, M. S., Vojta, C., Kinosian, B., Altshuler, L., & Glick, H. (2000). The internal state scale: Replication of its discriminating abilities in a multisite, public sector sample. Bipolar Disorders, 2(4), 340–346.

    Article  CAS  PubMed  Google Scholar 

  • Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M.,… Treatment Fidelity Workgroup of the NIH Behavior Change Consortium. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychology, 23, 443–451.

  • Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117.

    PubMed Central  Article  PubMed  Google Scholar 

  • Chinman, M., Imm, P., & Wandersman, A. (2004). Getting to Outcomes TM 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. Santa Monica, CA: RAND Corporation.

    Google Scholar 

  • Coleman, K., Austin, B. T., Brach, C., & Wagner, E. H. (2009). Evidence on the chronic care model in the new millennium. Health Affairs, 28(1), 75–85.

    Article  PubMed  Google Scholar 

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.

    PubMed Central  Article  PubMed  Google Scholar 

  • Dawson, D. A., Grant, B. F., & Stinson, F. S. (2005). The AUDIT-C: Screening for alcohol use disorders and risk drinking in the presence of other psychiatric disorders. Comprehensive Psychiatry, 46(6), 405–416.

    Article  PubMed  Google Scholar 

  • Dean, B. B., Gerner, D., & Gerner, R. H. (2004). A systematic review evaluating health-related quality of life, work impairment, and healthcare costs and utilization in bipolar disorder. Current Medical Research and Opinion, 20(2), 139–154.

    Article  PubMed  Google Scholar 

  • Druss, B. G., Hwang, I., Petukhova, M., Sampson, N. A., Wang, P. S., & Kessler, R. C. (2008). Impairment in role functioning in mental and chronic medical disorders in the United States: Results from the national comorbidity survey replication. Molecular Psychiatry, 14(7), 728–737.

    PubMed Central  Article  PubMed  Google Scholar 

  • Gaglio, B., & Glasgow, R. E. (2012). Evaluation approaches for dissemination and implementation research. In R. Brownson, G. Colditz, & E. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (pp. 327–356). New York, NY: Oxford University Press.

    Chapter  Google Scholar 

  • Gale, C. R., Batty, G. D., Osborn, D. P., Tynelius, P., Whitley, E., & Rasmussen, F. (2012). Association of mental disorders in early adulthood and later psychiatric hospital admissions and mortality in a cohort study of more than 1 million men. Archives of General Psychiatry, 69(8), 823–831.

    PubMed Central  Article  PubMed  Google Scholar 

  • Glasgow, R. E. (2013). What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Education and Behavior, 40(3), 257–265.

    Article  PubMed  Google Scholar 

  • Glick, H. A., McBride, L., & Bauer, M. S. (2003). A manic-depressive symptom self-report in optical scanable format. Bipolar Disorders, 5(5), 366–369.

    Article  PubMed  Google Scholar 

  • Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L.,… O’Brien, M. A. (2001). Changing provider behavior: An overview of systematic reviews of interventions. Medical Care, 39(8 Suppl 2), II2–45.

  • Harpole, L. H., Williams, J. W., Jr., Olsen, M. K., Stechuchak, K. M., Oddone, E., Callahan, C. M.,… Unutzer, J. (2005). Improving depression outcomes in older adults with comorbid medical illness. General Hospital Psychiatry, 27, 4–12.

  • Huxley, N., & Baldessarini, R. J. (2007). Disability and its treatment in bipolar disorder patients. Bipolar Disorders, 9, 183–196.

    Article  PubMed  Google Scholar 

  • Katon, W. (2012). Collaborative depression care models: From development to dissemination. American Journal of Preventive Medicine, 42(5), 550–552.

    Article  PubMed  Google Scholar 

  • Kelly, J. A., Somlai, A. M., DiFranceisco, W. J., Otto-Salaj, L. L., McAuliffe, T. L., Hackl, K. L.,… Rompa, D. (2000). Bridging the gap between the science and service of HIV prevention: Transferring effective research-based HIV prevention interventions to community aids service providers. American Journal of Public Health, 90(7), 1082–1088.

  • Kilbourne, A. M., Goodrich, D. E., Lai, Z., Clogston, J., Waxmonsky, J., & Bauer, M. S. (2012a). Life Goals Collaborative Care for patients with bipolar disorder and cardiovascular disease risk. Psychiatric Services, 63(12), 1234–1238.

    PubMed Central  Article  PubMed  Google Scholar 

  • Kilbourne, A. M., Goodrich, D. E., Lai, Z., Post, E. P., Schumacher, K., Nord, K. M.,… Bauer, M. S. (2013). Randomized controlled trial to assess reduction of cardiovascular disease risk in patients with bipolar disorder: The Self-Management Addressing Heart Risk Trial (SMAHRT). Journal of Clinical Psychiatry, 74(7), e655–662.

  • Kilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007). Implementing evidence-based interventions in health care: Application of the replicating effective programs framework. Implementation Science, 2, 42.

    PubMed Central  Article  PubMed  Google Scholar 

  • Kilbourne, A. M., Neumann, M. S., Waxmonsky, J., Bauer, M. S., Kim, H. M., Pincus, H. A., et al. (2012b). Public-academic partnerships: Evidence-based implementation: The role of sustained community-based practice and research partnerships. Psychiatric Services, 63(3), 205–207.

    Article  PubMed  Google Scholar 

  • Kilbourne, A. M., Post, E. P., Nossek, A., Drill, L., Cooley, S., & Bauer, M. S. (2008). Improving medical and psychiatric outcomes among individuals with bipolar disorder: A randomized controlled trial. Psychiatric Services, 59(7), 760–768.

    Article  PubMed  Google Scholar 

  • Kilbourne, A. M., Schulberg, H. C., Post, E. P., Rollman, B. L., Belnap, B. H., & Pincus, H. A. (2004). Translating evidence-based depression management services to community-based primary care practices. Milbank Quarterly, 82, 631–659.

    PubMed Central  Article  PubMed  Google Scholar 

  • Kirchner, J. E., Kearney, L. K., Ritchie, M. J., Dollar, K. M., Swensen, A. B., & Schohn, M. (2014). Research & services partnerships: Lessons learned through a national partnership between clinical leaders and researchers. Psychiatric Services, 65(5), 577–579.

    Article  PubMed  Google Scholar 

  • Kirchner, J.E., Ritchie, M.J., Dollar, K.M., Gundlach, P., & Smith, J. (2013). Implementation facilitation training manual: Using external and internal faciliation to improve care in the Veterans Health Administration. Retrieved February 15, 2014, from www.queri.research.va.gov/tools/implementation/Facilitation-Manual.pdf.

  • Knox, L., Taylor, E. F., Geonnotti, K., Machta, R., Kim, J., Nysenbaum, J., & Parchman, M. (December 2011). Developing and running a primary care practice facilitation program: A how-to-guide (Prepared by Mathematica Policy Research under contract No. HHSA 2902009000191 TO5). (AHRQ Publication No. 12-011). Rockville, MD: Agency for Healthcare Research and Quality.

  • Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613.

    PubMed Central  Article  CAS  PubMed  Google Scholar 

  • Kroenke, K., Spitzer, R. L., Williams, J. B., & Lowe, B. (2010). The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: A systematic review. General Hospital Psychiatry, 32(4), 345–359.

    Article  PubMed  Google Scholar 

  • Lowe, B., Unutzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004). Monitoring depression treatment outcomes with the Patient Health Questionnaire-9. Medical Care, 42, 1194–1201.

    Article  PubMed  Google Scholar 

  • Luciano, J. V., Ayuso-Mateos, J. L., Fernandez, A., Aguado, J., Serrano-Blanco, A., Roca, M., et al. (2010a). Utility of the twelve-item World Health Organization Disability Assessment Schedule II (WHO-DAS II) for discriminating depression “caseness” and severity in Spanish primary care patients. Quality of Life Research, 19(1), 97–101.

    Article  PubMed  Google Scholar 

  • Luciano, J. V., Ayuso-Mateos, J. L., Fernandez, A., Serrano-Blanco, A., Roca, M., & Haro, J. M. (2010b). Psychometric properties of the twelve item World Health Organization Disability Assessment Schedule II (WHO-DAS) in Spanish primary care patients with a first major depressive episode. Journal of Affective Disorders, 121(1–2), 52–58.

    Article  PubMed  Google Scholar 

  • Meropol, S. B., Schiltz, N. K., Sattar, A., Stange, K. C., Nevar, A. H., Davey, C.,… Cuttler, L. (2014). Practice-tailored facilitation to improve pediatric preventive care delivery: A randomized trial. Pediatrics, 133(6), e1664–1675.

  • Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009). Specifying and reporting complex behaviour change interventions: The need for a scientific method. Implementation Science, 4, 40.

    PubMed Central  Article  PubMed  Google Scholar 

  • Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450.

    PubMed Central  Article  PubMed  Google Scholar 

  • Novick, D. M., Swartz, H. A., & Frank, E. (2010). Suicide attempts in bipolar I and bipolar II disorder: A review and meta-analysis of the evidence. Bipolar Disorders, 12(1), 1–9.

    PubMed Central  Article  PubMed  Google Scholar 

  • Nutting, P. A., Crabtree, B. F., Stewart, E. E., Miller, W. L., Palmer, R. F., Stange, K. C., & Jaen, C. R. (2010). Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Annals of Family Medicine, 8(Suppl 1), S33–S44; S92.

  • Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., Hoagwood, K. (2013). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-013-0528-y.

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829–841.

    Article  PubMed  Google Scholar 

  • Pina, I. L., Cohen, P. D., Larson, D. B., Marion, L. N., Sills, M. R., Solberg, L. I., & Zerzan, J. (2014). A framework for describing health care delivery organizations and systems. American Journal of Public Health, e1–e10.

  • Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C.R., Griffey, R. T., Bunger, A. C.,… York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157.

  • Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34.

    Article  PubMed  Google Scholar 

  • Rogers, E. (2003). Diffusion of innovations (5th ed.). New York, NY: Free Press.

    Google Scholar 

  • Rubenstein, L. V., Parker, L. E., Meredith, L. S., Altschuler, A., dePillis, E., Hernandez, J., et al. (2002). Understanding team-based quality improvement for depression in primary care. Health Services Research, 37(4), 1009–1029.

    PubMed Central  Article  PubMed  Google Scholar 

  • Rycroft-Malone, J. (2004). The PARiHS Framework—a framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19(4), 297–304.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43.

    PubMed Central  Article  PubMed  Google Scholar 

  • Sharfstein, S. S. (2011). Integrated care. American Journal of Psychiatry, 168(11), 1134–1135.

    Article  PubMed  Google Scholar 

  • Simon, G. E., Ludman, E. J., Bauer, M. S., Unutzer, J., & Operskalski, B. (2006). Long-term effectiveness and cost of a systematic care program for bipolar disorder. Archives of General Psychiatry, 63(5), 500–508.

    Article  PubMed  Google Scholar 

  • Simon, G. E., Ludman, E., Unutzer, J., & Bauer, M. S. (2002). Design and implementation of a randomized trial evaluating systematic care for bipolar disorder. Bipolar Disorders, 4(4), 226–236.

    Article  PubMed  Google Scholar 

  • Solberg, L. I. (2007). Improving medical practice: A conceptual framework. Annals of Family Medicine, 5(3), 251–256.

    PubMed Central  Article  PubMed  Google Scholar 

  • Solberg, L. I., Fischer, L. R., Wei, F., Rush, W. A., Conboy, K. S., Davis, T. F., et al. (2001). A CQI intervention to change the care of depression: A controlled study. Effective Clinical Practice, 4(6), 239–249.

    CAS  PubMed  Google Scholar 

  • Spitzer, R. L., Kroenke, K., & Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ Primary Care Study. Primary care evaluation of mental disorders. Patient Health Questionnaire. Journal of the American Medical Association, 282(18), 1737–1744.

    Article  CAS  PubMed  Google Scholar 

  • Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011). A guide for applying a revised version of the PARiHS Framework for implementation. Implementation Science, 6, 99.

    PubMed Central  Article  PubMed  Google Scholar 

  • Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M.,… Wallace, C. M. (2006). Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1, 23.

  • Unutzer, J., Rubenstein, L., Katon, W. J., Tang, L., Duan, N., Lagomasino, I. T., et al. (2001). Two-year effects of quality improvement programs on medication management for depression. Archives of General Psychiatry, 58(10), 935–942.

    Article  CAS  PubMed  Google Scholar 

  • Ustun, T. B., & Chisholm, D. (2001). Global “burden of disease”-study for psychiatric disorders. Psychiatrische Praxis, 28(Suppl 1), S7–S11.

    Article  PubMed  Google Scholar 

  • Von Korff, M., Katon, W. J., Lin, E. H., Ciechanowski, P., Peterson, D., Ludman, E. J.,… Rutter, C. M. (2011). Functional outcomes of multi-condition collaborative care and successful ageing: Results of randomised trial. BMJ, 343, d6612.

  • Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L.,… Saul, J. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 171–181.

  • Ware, J, Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 34(3), 220–233.

    Article  PubMed  Google Scholar 

  • Waxmonsky, J., Kilbourne, A. M., Goodrich, D. E., Nord, K. M., Lai, Z., Laird, C.,… Bauer, M. S. (2014). Enhanced fidelity to treatment for bipolar disorder: Results from a randomized controlled implementation trial. Psychiatric Services, 65(1), 81–90.

  • Woltmann, E., Grogan-Kaylor, A., Perron, B., Georges, H., Kilbourne, A. M., & Bauer, M. S. (2012). Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: Systematic review and meta-analysis. American Journal of Psychiatry, 169(8), 790–804.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

Support for this study was provided by the National Institute of Mental Health (R01 MH 79994) and the University of Michigan Comprehensive Depression Center (Director’s Innovation Fund). We would like to express appreciation for the contributions of partners from the following agencies: (from Colorado) Behavioral Healthcare, Inc.; Colorado Access; Community Reach Center; Mental Health Centers of Denver; and University of Colorado School of Medicine Depression Center, Departments of Psychiatry and Family Medicine; (from Michigan) Community Support and Treatment Services; Genesee Health System; Packard Health; University of Michigan Departments of Psychiatry, School of Public Health, and Depression Center; and Washtenaw Community Health Organization; (Others) Centers for Disease Control and Prevention; Harvard Medical School; National Institute of Mental Health; and Veterans Health Administration. The views expressed in this article are those of the authors and do not necessarily represent the views of the Veterans Administration.

Author information

Affiliations

  1. Department of Psychiatry, University of Michigan Medical School, Ann Arbor, MI, USA

    Amy M. Kilbourne, David E. Goodrich, Kristina M. Nord, Celeste Van Poppelen, Julia Kyle, Zongshan Lai & Hyungjin M. Kim

  2. VA Boston Center for Healthcare Organization and Implementation Research, Boston, MA, USA

    Mark S. Bauer

  3. Department of Psychiatry, University of Colorado School of Medicine, Denver, CO, USA

    Jeanette A. Waxmonsky & Marshall R. Thomas

  4. Department of Health Management and Policy, School of Public Health, University of Michigan, Ann Arbor, MI, USA

    Daniel Eisenberg

  5. VA Ann Arbor Center for Clinical Management Research, 2215 Fuller Road, Mail Stop 152, Ann Arbor, MI, 48105, USA

    Amy M. Kilbourne, David E. Goodrich & Kristina M. Nord

Authors
  1. Amy M. Kilbourne
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David E. Goodrich
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kristina M. Nord
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Celeste Van Poppelen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Julia Kyle
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mark S. Bauer
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jeanette A. Waxmonsky
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Zongshan Lai
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hyungjin M. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Daniel Eisenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Marshall R. Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amy M. Kilbourne.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kilbourne, A.M., Goodrich, D.E., Nord, K.M. et al. Long-Term Clinical Outcomes from a Randomized Controlled Trial of Two Implementation Strategies to Promote Collaborative Care Attendance in Community Practices. Adm Policy Ment Health 42, 642–653 (2015). https://doi.org/10.1007/s10488-014-0598-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-014-0598-5

Keywords

  • Mood disorders-bipolar
  • Implementation
  • Chronic care model
  • Collaborative care
  • Bipolar disorder