Abstract
This special issue of Administration and Policy in Mental Health explores the complexities of the outer system context in implementation science research. In this commentary, we highlight areas of asynchrony between implementation science research and policy realities of public systems. Timing is a critical factor for many aspects of system-level implementation including when and how evidence-based practice initiatives are launched, short and inconsistent timeframes for funding and support, need for early indicators of success and demonstrating return on investment. Greater consideration for the timing that drives change in public systems will strengthen efforts to implement and sustain EBPs in community settings.
Similar content being viewed by others
References
Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhard, M. G., et al. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0751-4.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.
Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., et al. (2015). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health. doi:10.1007/s10488-015-0705-2.
Beidas, R. S., Stewart, R. E., Benjamin Wolk, C., Adams, D. R., Marcus, S. C., Evans, A. C, Jr., et al. (2016). Independent contractors in public mental health clinics: Implications for use of evidence-based practices. Psychiatric Services. doi:10.1176/appi.ps.201500234.
Berwick, D. M., Nolan, T. W., & Whittington, J. (2008). The tiple aim: Care health and cost. Health Affairs, 27(3), 759–769. doi:10.1377/hlthaff.27.3.759.
Brookman-Frazee, L., Stadnick, N., Roesch, S., Regan, J., Barnett, M., Bando, L., et al. (2016). Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0731-8.
Cairney, P., Oliver, K., & Wellstead, A. (2016). To bridge the divide between evidence and policy: Reduce ambiguity as much as uncertainty. Public Administration Review, 76(3), 399–402. doi:10.1111/puar.12555.
Chelimsky, E. (2008). A clash of cultures: improving the “fit” between evaluative independence and the political requirements of a democratic society. American Journal of Evaluation, 29(4), 400–415. doi:10.1177/1098214008324465.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi:10.1186/1748-5908-4-50.
Head, B. W. (2015). Toward more “evidence-informed” policy making? Public Administration Review, 76(3), 472–484.
Kotte, A., Hill, K. A., Mah, A. C., Korathu-Larson, P. A., Au, J. R., Izmirian, S., et al. (2016). Facilitators and barriers of implementing a measurement feedback system in public youth mental health. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0729-2.
Liu, C. F., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., et al. (2009). Organizational cost of quality improvement for depression care. Health Services Research, 44(1), 225–244. doi:10.1111/j.1475-6773.2008.00911.x.
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480. doi:10.1007/s10464-012-9522-x.
Nadeem, E., Weiss, D., Olin, S. S., Hoagwood, K. E., & Horwitz, S. M. (2016). Using a theory-guided learning collaborative model to improve implementation of EBPs in a state children’s mental health system: A pilot study. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0735-4.
Olin, S. S., Nadeem, E., Gleacher, A., Weaver, J., Weiss, D., Hoagwood, K. E., et al. (2016). What predicts clinician dropout from state-sponsored Managing and Adapting Practice training. Administration and Policy in Mental Health. doi:10.1007/s10488-015-0709-y.
Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., et al. (2016). Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-016-0733-6.
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.1177/1077558711430690.
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. doi:10.1007/s10488-010-0319-7.
Raghavan, R. (2012). The role of economic evaluation in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (pp. 94–113). New York: Oxford University Press.
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3, 26. doi:10.1186/1748-5908-3-26.
Ritzwoller, D. P., Sukhanova, M. A., Gaglio, B., & Glasgow, R. E. (2009). Costing behavioral interventions: A practical guide to enhance translation. Annals of Behavioral Medicine, 37, 218–227. doi:10.1007/s12160-009-9088-5.
Rosen, C. S., Matthieu, M. M., Wiltsey Stirman, S., Cook, J. M., Landes, S., Bernardy, N. C., et al. (2016). A review of studies on the system-wide implementation of evidence-based psychotherapies for posttraumatic stress disorder in the Veterans Health Administration. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0755-0.
Rosenblatt, A., & Tseng, V. (2010). The demand side: Uses of research in child and adolescent mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 37, 201–204. doi:10.1007/s10488-010-0300-5.
Ross, D. F., Ionita, G., & Stirman, S. W. (2016). System-wide implementation of routine outcome monitoring and measurement feedback system in a national network of operational stress injury clinics. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0749-y.
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014). The cost of implementing new strategies (COINS): A method for mapping implementaiton resources using the stages of implementation completion. Children and Youth Services Review, 39, 177–182.
Saldana, L., Chamberlain, P., & Chapman, J. (2016). A supervisor-targeted implementation approach to promote system change: The R model. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0730-9.
Short, K. H., Weist, M. D., Manion, I. G., & Evans, S. W. (2012). Tying together research and practice: Using ROPE for successful partnership in school mental health. Administration and Policy in Mental Health, 39, 239–247. doi:10.1007/s10488-011-0342-3.
Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R., et al. (2016). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services, 67(2), 159–161. doi:10.1176/appi.ps.201500392.
Tseng, V., & Nutley, S. (2014). Building the infrastructure to improve the use and usefulness of research in education. In K. S. Finnigan & A. J. Daly (Eds.), Using research evidence in education: From the schoolhouse door to Capital Hill (pp. 163–175). New York: Springer.
Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007). Systematic review of economic evaluations and cost analyses of guideline implementation strategies. European Journal of Health Economics, 8, 111–121.
Vanlandingham, G. R., & Drake, E. K. (2012). Results first: Using evidence-based policy models in state policymaking. Public Performance and Management Review, 35(3), 550–563. doi:10.2753/PMR1530-9576350309.
Walker, S. C., Hurvitz, P., Leith, J., Rodriguez, F. I., & Endler, G. C. (2016). Evidence-based program service deserts: A Geographic Information Systems (GIS) approach to Identifying service gaps for state-level implementation planning. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0743-4.
Williamson, A., Makkar, S. R., McGrath, C., & Redman, S. (2015). How can the use of evidence in mental health policy be increased? A systematic review. Psychiatric Services, 66(8), 783–797. doi:10.1176/appi.ps.201400329.
Zimmerman, L., Lounsbury, D. W., Rosen, C. S., Kimerling, R., Trafton, J. A., & Lindley, S. E. (2016). Participatory system dynamics modeling: Increasing stakeholder engagement and precision to improve implementation planning in systems. Administration and Policy in Mental Health. doi:10.1007/s10488-016-0754-1.
Acknowledgments
We thank the behavioral health providers and evidence-based practice developers and trainers who have partnered with the Philadelphia Department of Behavioral Health and Intellectual disAbilities Services on this journey to ensure that evidence-based practices are available throughout our community. We also want to recognize the Evidence-based Practice and Innovation Center (EPIC) Steering Committee members, including our colleagues at the Center for Mental Health Policy and Services Research at the University of Pennsylvania, for their strategic vision for EPIC. Thank you to Danielle Adams, BA and Gayatri Nangia for their assistance with manuscript preparation.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
No external funding was obtained for this study and there are no reported conflicts of interest.
Ethical approval
The article does not contain any studies with human participants or animals performed by any of the authors.
Rights and permissions
About this article
Cite this article
Rubin, R.M., Hurford, M.O., Hadley, T. et al. Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems. Adm Policy Ment Health 43, 1023–1028 (2016). https://doi.org/10.1007/s10488-016-0759-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-016-0759-9