American Journal of Community Psychology

, Volume 50, Issue 3–4, pp 462–480 | Cite as

The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process

  • Duncan C. Meyers
  • Joseph A. Durlak
  • Abraham Wandersman
Original Paper

Abstract

Implementation science is growing in importance among funders, researchers, and practitioners as an approach to bridging the gap between science and practice. We addressed three goals to contribute to the understanding of the complex and dynamic nature of implementation. Our first goal was to provide a conceptual overview of the process of implementation by synthesizing information from 25 implementation frameworks. The synthesis extends prior work by focusing on specific actions (i.e., the “how to”) that can be employed to foster high quality implementation. The synthesis identified 14 critical steps that were used to construct the Quality Implementation Framework (QIF). These steps comprise four QIF phases: Initial Considerations Regarding the Host Setting, Creating a Structure for Implementation, Ongoing Structure Once Implementation Begins, and Improving Future Applications. Our second goal was to summarize research support for each of the 14 QIF steps and to offer suggestions to direct future research efforts. Our third goal was to outline practical implications of our findings for improving future implementation efforts in the world of practice. The QIF’s critical steps can serve as a useful blueprint for future research and practice. Applying the collective guidance synthesized by the QIF to the Interactive Systems Framework for Dissemination and Implementation (ISF) emphasizes that accountability for quality implementation does not rest with the practitioner Delivery System alone. Instead, all three ISF systems are mutually accountable for quality implementation.

Keywords

Implementation Knowledge utilization Implementation framework Implementation science 

References

  1. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23.PubMedCrossRefGoogle Scholar
  2. Aarons, G. A., Sommerfeld, D., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77, 270–280.PubMedCrossRefGoogle Scholar
  3. Abbott, R. D., O’Donnell, J., Hawkins, J. D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542–552.PubMedCrossRefGoogle Scholar
  4. Baker, R., Robertson, N., Rogers, S., Davies, M., Brunskill, N., & Sinfield, P. (2009). The National Institute of Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) for Leicestershire, Northamptonshire and Rutland (LNR): A programme protocol. Implementation Science, 4, 72.Google Scholar
  5. Basch, C. E., Sliepcevich, E. M., Gold, R. S., Duncan, D. F., & Kolbe, L. J. (1985). Avoiding type III errors in health education program evaluations: A case study. Health Education Quarterly, 12, 3154–3331.CrossRefGoogle Scholar
  6. Bellg, A. J., Borrelli, B., Resnick, B., Hecht. J., Minicucci, D. S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychology, 23, 443–451.Google Scholar
  7. Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., et al. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253–268.CrossRefGoogle Scholar
  8. Centers for Disease Control and Prevention Global AIDS Program. (2010, August 9). CDC’s role in PEPFAR and the U.S. Global Health Initiative. Retrieved from http://www.cdc.gov/globalaids/support-evidence-based-programming/implementation-science.html.
  9. Chakravorty, S. S. (2009). Six sigma programs: An implementation model. International Journal of Production Economics, 119, 1–16.CrossRefGoogle Scholar
  10. Chinman, M., Hunter, S. B., Ebener, P., Paddock, S. M., Stillman, L., Imm, P., et al. (2008). The Getting To Outcomes demonstration and evaluation: An illustration of the prevention support system. American Journal of Community Psychology, 41, 206–224.PubMedCrossRefGoogle Scholar
  11. Chinman, M., Imm, P., & Wandersman, A. (2004). Getting to Outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. (No. TR- TR101). Santa Monica, CA: RAND.Google Scholar
  12. Chinowsky, P. S. (2008). Staircase model for new practice implementation. Journal of Management in Engineering, 24, 187–195.CrossRefGoogle Scholar
  13. Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A., Amundsen, M. J., McGee, C., et al. (2002). Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science and Practice, 9, 165–190.Google Scholar
  14. Collaborative for Academic, Social, and Emotional Learning, National Center for Mental Health Promotion and Youth Violence Prevention. (2011). Leading an SEL school: Steps to implement social and emotional learning for all students. 5/20/11, Education Development Center. Google Scholar
  15. Cook, T. D., Habib, F. N., Phillips, M., Settersten, R. A., Shagle, S. C., & Degirmencioglu, S. M. (1999). Comer’s school development program in Prince George’s county, Maryland: A theory-based evaluation. American Educational Research Journal, 36, 543–597.Google Scholar
  16. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.Google Scholar
  17. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clinical Psychology Review, 18, 23–45.PubMedCrossRefGoogle Scholar
  18. Domitrovich, C. E., Bradshaw, C. P., Poduska, J., Hoagwood, K., Buckley, J., Olin, S., et al. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28.CrossRefGoogle Scholar
  19. Domitrovich, C. E., Gest, S. D., Jones, D., Gill, S., & DeRousie, R. M. S. (2010). Implementation quality: Lessons learned in the context of the Head Start REDI trial. Early Childhood Research Quarterly, 25, 284–298.PubMedCrossRefGoogle Scholar
  20. DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30, 157–198.PubMedCrossRefGoogle Scholar
  21. DuFrene, B. A., Noell, G. H., Gilbertson, D. N., & Duhon, G. J. (2005). Monitoring implementation of reciprocal peer tutoring: Identifying and intervening with students who do not maintain accurate implementation. School Psychology Review, 34, 74–86.Google Scholar
  22. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.PubMedCrossRefGoogle Scholar
  23. Elder, J. P., Perry, C. L., Stone, E. J., Johnson, C. C., Yang, M., Edmundson, E. W., et al. (1996). Tobacco use measurement, prediction, and intervention in elementary schools in four states: The CATCH study. Preventive Medicine, 25, 489–494.Google Scholar
  24. Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.PubMedCrossRefGoogle Scholar
  25. Feldstein, A. C., & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety/Joint Commission Resources, 34, 228–243.PubMedGoogle Scholar
  26. Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231). Retrieved November 1, 2006, from http://nirn.fmhi.usf.edu/resources/publications/Monograph/pdf/monograph_full.pdf.
  27. Flaspohler, P. D., Anderson-Butcher, D., & Wandersman, A. (2008a). Supporting implementation of expanded school mental health services: Application of the Interactive Systems Framework in Ohio. Advances in School Mental Health Promotion, 1, 38–48.CrossRefGoogle Scholar
  28. Flaspohler, P., Duffy, J., Wandersman, A., Stillman, L., & Maras, M. A. (2008b). Unpacking prevention capacity: An intersection of research-to-practice models and community-centered models. American Journal of Community Psychology, 41, 182–196.PubMedCrossRefGoogle Scholar
  29. Forehand, R., Dorsey, S., Jones, D. J., Long, N., & McMahon, R. (2010). Adherence and flexibility: They can (and do) coexist! Clinical Psychology: Science and Practice, 17, 258–264.CrossRefGoogle Scholar
  30. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7, 243–259.PubMedCrossRefGoogle Scholar
  31. Gottfredson, D. C., Gottfredson, G. D., & Hybl, L. G. (1993). Managing adolescent behavior: A multiyear, multi school study. American Educational Research Journal, 30, 179–215.Google Scholar
  32. Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research, and practice (volume 3). DHHS Pub. No. (SMA). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, 2005.Google Scholar
  33. Greenhalgh, T., Robert, G., MacFarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82, 581–629.PubMedCrossRefGoogle Scholar
  34. Greenwood, C. R., Tapia, Y., Abbott, M., & Walton, C. (2003). A building-based case study of evidence-based literacy practices: Implementation, reading behavior, and growth in reading fluency, K-4. The Journal of Special Education, 37, 95–110.CrossRefGoogle Scholar
  35. Grimshaw, J. M., & Russell, I. T. (1993). Effect of clinical guidelines on medical practice: A systematic review of rigorous evaluations. The Lancet, 342, 1317–1322.CrossRefGoogle Scholar
  36. Grol, R., & Jones, R. (2000). Twenty years of implementation research. Family Practice, 17, S32–S35.PubMedCrossRefGoogle Scholar
  37. Guldbrandsson, K. (2008). From news to everyday use: The difficult art of implementation. Ostersund, Sweden: Swedish National Institute of Public health. Retrieved from www.fhi.se/PageFiles/3396/R200809_implementering_eng0805.pdf.
  38. Hall, G. E., & Hord, S. M. (2006). Implementing change: Patterns, principles and potholes (2nd ed.). Boston, MA: Allyn and Bacon.Google Scholar
  39. Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951–976.PubMedCrossRefGoogle Scholar
  40. International Organization for Standardization. (1998). ISO/IEC international standard 13236: Information technologyQuality of service: Framework. First edition.Google Scholar
  41. Joyce, R. B., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  42. Kerr, D. M., Kent, L., & Lam, T. C. M. (1985). Measuring program implementation with a classroom observation instrument: The interactive teaching map. Evaluation Review, 9, 461–482.CrossRefGoogle Scholar
  43. Kilbourne, A. M., Neuman, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007). Implementing evidence-based interventions in health care: Applications of the replicating effective programs framework. Implementation Science, 2, 42.PubMedCrossRefGoogle Scholar
  44. Klein, K. J., Conn, A., & Sorra, J. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86(5), 811–824.PubMedCrossRefGoogle Scholar
  45. Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.Google Scholar
  46. Lee, S. J., Altschul, I., & Mowbray, C. T. (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41, 290–303.PubMedCrossRefGoogle Scholar
  47. Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Alonnidis, J. P., et al. (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. BMJ, 339, b2700.Google Scholar
  48. Maxwell, J. A. (2005). Qualitative research design: An interactive approach (2nd ed.). Thousand: SageOaks. 2005.Google Scholar
  49. Mazzucchelli, T. G., & Sanders, M. R. (2010). Facilitating practitioner flexibility within an empirically supported intervention: Lessons from a system of parenting support. Clinical Psychology: Science and Practice, 17, 238–252.CrossRefGoogle Scholar
  50. McGraw, S. A., Sellers, D. E., Stone, E. J., Bebchuk, J., Edmundson, E. W., Johnson, C. C., et al. (1996). Using process data to explain outcomes: An illustration from the child and adolescent trial for cardiovascular health (CATCH). Evaluation Review, 20, 291–312.PubMedCrossRefGoogle Scholar
  51. Meyers, D. C., Katz, J., Chien, V., Wandersman, A., Scaccia, J. P., & Wright, A. (2012). Practical implementation science: Developing and piloting the Quality Implementation Tool. American Journal of Community Psychology. doi:10.1007/s10464-012-9521-y.
  52. Mihalic, S., Fagan, A. A., Irwin, K., Ballard, D., & Elliott, D. (2004). Blueprints for violence prevention. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.Google Scholar
  53. Miles, M., & Huberman, M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). London: Sage.Google Scholar
  54. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, 1050–1062.PubMedCrossRefGoogle Scholar
  55. National Institutes of Health. (2011, October 25). Dissemination and implementation. Retrieved from http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/index.aspx.
  56. Okumus, F. (2003). A framework to implement strategies in organizations. Management Decision, 41(9), 871–882.CrossRefGoogle Scholar
  57. Partnerships for Success Community Planning and Implementation Guide. (2003). www.pfsacademy.org.
  58. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34.PubMedCrossRefGoogle Scholar
  59. Riley, B. L., Taylor, S. M., & Elliott, S. J. (2001). Determinants of implementing heart healthy promotion activities in Ontario public health units: A social ecological perspective. Health Education Research, 16, 425–441.PubMedCrossRefGoogle Scholar
  60. Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.Google Scholar
  61. Rycroft-Malone, J. (2004). The PARIHS framework: A framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19, 297–304.PubMedCrossRefGoogle Scholar
  62. Sandler, I., Ostrom, A., Bitner, M. J., Ayers, T. S., Wolchik, S., & Daniels, V. S. (2005). Developing effective prevention services for the real world: A prevention service development model. American Journal of Community Psychology, 35, 127–142.PubMedCrossRefGoogle Scholar
  63. Saunders, R. P., Ward, D., Felton, G. M., Dowda, M., & Pate, R. R. (2006). Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). Evaluation and Program Planning, 29, 352–364.PubMedCrossRefGoogle Scholar
  64. Schoenwald, S. K. (2008). Toward evidence-based transport of evidence-based treatments: MST as an example. Journal of Child & Adolescent Substance Abuse, 17, 69–91.CrossRefGoogle Scholar
  65. Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in Vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106–115.PubMedCrossRefGoogle Scholar
  66. Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 22, 171–182.PubMedCrossRefGoogle Scholar
  67. Smith, J. D., Schneider, B. H., Smith, P. K., & Ananiadou, K. (2004). The effectiveness of whole-school antibullying programs: A synthesis of evaluation research. School Psychology Review, 33, 547–560.Google Scholar
  68. Sobo, E. J., Bowman, C., Halloran, J., Aarons, G. A., Asch, S., & Gifford, A. L. (2008). Enhancing organizational change and improvement prospects: Lessons from an HIV testing intervention for veterans. Human Organization, 67, 443–453.Google Scholar
  69. Spence, K., & Henderson-Smart, D. (2011). Closing the evidence-practice gap for newborn pain using clinical networks. Journal of Paediatrics and Child Health, 47, 92–98.PubMedCrossRefGoogle Scholar
  70. Spoth, R. L., & Greenberg, M. T. (2005). Toward a comprehensive strategy for effective practitioner-scientist partnerships and larger-scale community benefits. American Journal of Community Psychology, 35, 107–126.PubMedCrossRefGoogle Scholar
  71. Spoth, R., Greenberg, M., Bierman, K., & Redmond, C. (2004). PROSPER community-university partnership model for public education systems: Capacity-building for evidence-based, competence-building prevention. Prevention Science, 5, 31–39.PubMedCrossRefGoogle Scholar
  72. Stetler, C. B., McQueen, L., Demakis, J., & Mittman, B. S. (2008). An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implementation Science, 3, 30.PubMedCrossRefGoogle Scholar
  73. Stith, S., Pruitt, I., Dees, J., Fronce, M., Green, N., Som, A., et al. (2006). Implementing community-based prevention programming: A review of the literature. The Journal of Primary Prevention, 27, 599–617.PubMedCrossRefGoogle Scholar
  74. Tobler, N. S. (1986). Meta-analysis of 143 adolescent drug prevention programs: Quantitative outcome results of program participants compared to a control or comparison group. Journal of Drug Issues, 16, 537–567.Google Scholar
  75. Van de Ven, A. H., Angles, H. L., & Poole, M. S. (1989). Research on the management of innovation: The Minnesota studies. New York: Harper and Row.Google Scholar
  76. Walker, J. S., & Koroloff, N. (2007). Grounded theory and backward mapping: Exploring the implementation context for Wraparound. Journal of Behavioral Health Services & Research, 34, 443–458.CrossRefGoogle Scholar
  77. Wandersman, A., Chien, V., & Katz. J. (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: Tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology. doi:10.1007/s10464-012-9509-7.
  78. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008). Bridging the gap between prevention research and practice: The Interactive Systems Framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181.PubMedCrossRefGoogle Scholar
  79. Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention. American Psychologist, 58, 441–448.PubMedCrossRefGoogle Scholar
  80. Wilson, S. J., Lipsey, M. W., & Derzon, J. H. (2003). The effects of school-based intervention programs on aggressive behavior: A meta-analysis. Journal of Consulting and Clinical Psychology, 71, 136–149.PubMedCrossRefGoogle Scholar

Copyright information

© Society for Community Research and Action 2012

Authors and Affiliations

  • Duncan C. Meyers
    • 1
  • Joseph A. Durlak
    • 2
  • Abraham Wandersman
    • 1
  1. 1.University of South CarolinaColumbiaUSA
  2. 2.Loyola University ChicagoChicagoUSA

Personalised recommendations