Skip to main content

Advertisement

Log in

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems

  • Commentary
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

This special issue of Administration and Policy in Mental Health explores the complexities of the outer system context in implementation science research. In this commentary, we highlight areas of asynchrony between implementation science research and policy realities of public systems. Timing is a critical factor for many aspects of system-level implementation including when and how evidence-based practice initiatives are launched, short and inconsistent timeframes for funding and support, need for early indicators of success and demonstrating return on investment. Greater consideration for the timing that drives change in public systems will strengthen efforts to implement and sustain EBPs in community settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhard, M. G., et al. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0751-4.

    PubMed Central  Google Scholar 

  • Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.

    Article  PubMed  Google Scholar 

  • Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., et al. (2015). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health. doi:10.1007/s10488-015-0705-2.

    Google Scholar 

  • Beidas, R. S., Stewart, R. E., Benjamin Wolk, C., Adams, D. R., Marcus, S. C., Evans, A. C, Jr., et al. (2016). Independent contractors in public mental health clinics: Implications for use of evidence-based practices. Psychiatric Services. doi:10.1176/appi.ps.201500234.

    Google Scholar 

  • Berwick, D. M., Nolan, T. W., & Whittington, J. (2008). The tiple aim: Care health and cost. Health Affairs, 27(3), 759–769. doi:10.1377/hlthaff.27.3.759.

    Article  PubMed  Google Scholar 

  • Brookman-Frazee, L., Stadnick, N., Roesch, S., Regan, J., Barnett, M., Bando, L., et al. (2016). Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0731-8.

    Google Scholar 

  • Cairney, P., Oliver, K., & Wellstead, A. (2016). To bridge the divide between evidence and policy: Reduce ambiguity as much as uncertainty. Public Administration Review, 76(3), 399–402. doi:10.1111/puar.12555.

    Article  Google Scholar 

  • Chelimsky, E. (2008). A clash of cultures: improving the “fit” between evaluative independence and the political requirements of a democratic society. American Journal of Evaluation, 29(4), 400–415. doi:10.1177/1098214008324465.

    Article  Google Scholar 

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi:10.1186/1748-5908-4-50.

    Article  PubMed  PubMed Central  Google Scholar 

  • Head, B. W. (2015). Toward more “evidence-informed” policy making? Public Administration Review, 76(3), 472–484.

    Article  Google Scholar 

  • Kotte, A., Hill, K. A., Mah, A. C., Korathu-Larson, P. A., Au, J. R., Izmirian, S., et al. (2016). Facilitators and barriers of implementing a measurement feedback system in public youth mental health. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0729-2.

    PubMed  Google Scholar 

  • Liu, C. F., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., et al. (2009). Organizational cost of quality improvement for depression care. Health Services Research, 44(1), 225–244. doi:10.1111/j.1475-6773.2008.00911.x.

    Article  PubMed  PubMed Central  Google Scholar 

  • Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480. doi:10.1007/s10464-012-9522-x.

    Article  PubMed  Google Scholar 

  • Nadeem, E., Weiss, D., Olin, S. S., Hoagwood, K. E., & Horwitz, S. M. (2016). Using a theory-guided learning collaborative model to improve implementation of EBPs in a state children’s mental health system: A pilot study. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0735-4.

    Google Scholar 

  • Olin, S. S., Nadeem, E., Gleacher, A., Weaver, J., Weiss, D., Hoagwood, K. E., et al. (2016). What predicts clinician dropout from state-sponsored Managing and Adapting Practice training. Administration and Policy in Mental Health. doi:10.1007/s10488-015-0709-y.

    Google Scholar 

  • Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., et al. (2016). Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-016-0733-6.

    Google Scholar 

  • Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.1177/1077558711430690.

    Article  PubMed  Google Scholar 

  • Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. doi:10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  • Raghavan, R. (2012). The role of economic evaluation in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (pp. 94–113). New York: Oxford University Press.

    Chapter  Google Scholar 

  • Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3, 26. doi:10.1186/1748-5908-3-26.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ritzwoller, D. P., Sukhanova, M. A., Gaglio, B., & Glasgow, R. E. (2009). Costing behavioral interventions: A practical guide to enhance translation. Annals of Behavioral Medicine, 37, 218–227. doi:10.1007/s12160-009-9088-5.

    Article  PubMed  Google Scholar 

  • Rosen, C. S., Matthieu, M. M., Wiltsey Stirman, S., Cook, J. M., Landes, S., Bernardy, N. C., et al. (2016). A review of studies on the system-wide implementation of evidence-based psychotherapies for posttraumatic stress disorder in the Veterans Health Administration. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0755-0.

    Google Scholar 

  • Rosenblatt, A., & Tseng, V. (2010). The demand side: Uses of research in child and adolescent mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 37, 201–204. doi:10.1007/s10488-010-0300-5.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ross, D. F., Ionita, G., & Stirman, S. W. (2016). System-wide implementation of routine outcome monitoring and measurement feedback system in a national network of operational stress injury clinics. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0749-y.

    PubMed  Google Scholar 

  • Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014). The cost of implementing new strategies (COINS): A method for mapping implementaiton resources using the stages of implementation completion. Children and Youth Services Review, 39, 177–182.

    Article  PubMed  Google Scholar 

  • Saldana, L., Chamberlain, P., & Chapman, J. (2016). A supervisor-targeted implementation approach to promote system change: The R model. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0730-9.

    PubMed  Google Scholar 

  • Short, K. H., Weist, M. D., Manion, I. G., & Evans, S. W. (2012). Tying together research and practice: Using ROPE for successful partnership in school mental health. Administration and Policy in Mental Health, 39, 239–247. doi:10.1007/s10488-011-0342-3.

    Article  Google Scholar 

  • Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R., et al. (2016). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services, 67(2), 159–161. doi:10.1176/appi.ps.201500392.

    Article  PubMed  Google Scholar 

  • Tseng, V., & Nutley, S. (2014). Building the infrastructure to improve the use and usefulness of research in education. In K. S. Finnigan & A. J. Daly (Eds.), Using research evidence in education: From the schoolhouse door to Capital Hill (pp. 163–175). New York: Springer.

    Chapter  Google Scholar 

  • Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007). Systematic review of economic evaluations and cost analyses of guideline implementation strategies. European Journal of Health Economics, 8, 111–121.

    Article  PubMed  Google Scholar 

  • Vanlandingham, G. R., & Drake, E. K. (2012). Results first: Using evidence-based policy models in state policymaking. Public Performance and Management Review, 35(3), 550–563. doi:10.2753/PMR1530-9576350309.

    Article  Google Scholar 

  • Walker, S. C., Hurvitz, P., Leith, J., Rodriguez, F. I., & Endler, G. C. (2016). Evidence-based program service deserts: A Geographic Information Systems (GIS) approach to Identifying service gaps for state-level implementation planning. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0743-4.

    PubMed  Google Scholar 

  • Williamson, A., Makkar, S. R., McGrath, C., & Redman, S. (2015). How can the use of evidence in mental health policy be increased? A systematic review. Psychiatric Services, 66(8), 783–797. doi:10.1176/appi.ps.201400329.

    Article  PubMed  Google Scholar 

  • Zimmerman, L., Lounsbury, D. W., Rosen, C. S., Kimerling, R., Trafton, J. A., & Lindley, S. E. (2016). Participatory system dynamics modeling: Increasing stakeholder engagement and precision to improve implementation planning in systems. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0754-1.

    PubMed  Google Scholar 

Download references

Acknowledgments

We thank the behavioral health providers and evidence-based practice developers and trainers who have partnered with the Philadelphia Department of Behavioral Health and Intellectual disAbilities Services on this journey to ensure that evidence-based practices are available throughout our community. We also want to recognize the Evidence-based Practice and Innovation Center (EPIC) Steering Committee members, including our colleagues at the Center for Mental Health Policy and Services Research at the University of Pennsylvania, for their strategic vision for EPIC. Thank you to Danielle Adams, BA and Gayatri Nangia for their assistance with manuscript preparation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ronnie M. Rubin.

Ethics declarations

Conflict of interest

No external funding was obtained for this study and there are no reported conflicts of interest.

Ethical approval

The article does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rubin, R.M., Hurford, M.O., Hadley, T. et al. Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems. Adm Policy Ment Health 43, 1023–1028 (2016). https://doi.org/10.1007/s10488-016-0759-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-016-0759-9

Keywords

Navigation