Skip to main content

The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process

Abstract

Implementation science is growing in importance among funders, researchers, and practitioners as an approach to bridging the gap between science and practice. We addressed three goals to contribute to the understanding of the complex and dynamic nature of implementation. Our first goal was to provide a conceptual overview of the process of implementation by synthesizing information from 25 implementation frameworks. The synthesis extends prior work by focusing on specific actions (i.e., the “how to”) that can be employed to foster high quality implementation. The synthesis identified 14 critical steps that were used to construct the Quality Implementation Framework (QIF). These steps comprise four QIF phases: Initial Considerations Regarding the Host Setting, Creating a Structure for Implementation, Ongoing Structure Once Implementation Begins, and Improving Future Applications. Our second goal was to summarize research support for each of the 14 QIF steps and to offer suggestions to direct future research efforts. Our third goal was to outline practical implications of our findings for improving future implementation efforts in the world of practice. The QIF’s critical steps can serve as a useful blueprint for future research and practice. Applying the collective guidance synthesized by the QIF to the Interactive Systems Framework for Dissemination and Implementation (ISF) emphasizes that accountability for quality implementation does not rest with the practitioner Delivery System alone. Instead, all three ISF systems are mutually accountable for quality implementation.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2

References

  1. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23.

    PubMed  Article  Google Scholar 

  2. Aarons, G. A., Sommerfeld, D., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77, 270–280.

    PubMed  Article  Google Scholar 

  3. Abbott, R. D., O’Donnell, J., Hawkins, J. D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542–552.

    PubMed  Article  Google Scholar 

  4. Baker, R., Robertson, N., Rogers, S., Davies, M., Brunskill, N., & Sinfield, P. (2009). The National Institute of Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) for Leicestershire, Northamptonshire and Rutland (LNR): A programme protocol. Implementation Science, 4, 72.

  5. Basch, C. E., Sliepcevich, E. M., Gold, R. S., Duncan, D. F., & Kolbe, L. J. (1985). Avoiding type III errors in health education program evaluations: A case study. Health Education Quarterly, 12, 3154–3331.

    Article  Google Scholar 

  6. Bellg, A. J., Borrelli, B., Resnick, B., Hecht. J., Minicucci, D. S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychology, 23, 443–451.

    Google Scholar 

  7. Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., et al. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253–268.

    Article  Google Scholar 

  8. Centers for Disease Control and Prevention Global AIDS Program. (2010, August 9). CDC’s role in PEPFAR and the U.S. Global Health Initiative. Retrieved from http://www.cdc.gov/globalaids/support-evidence-based-programming/implementation-science.html.

  9. Chakravorty, S. S. (2009). Six sigma programs: An implementation model. International Journal of Production Economics, 119, 1–16.

    Article  Google Scholar 

  10. Chinman, M., Hunter, S. B., Ebener, P., Paddock, S. M., Stillman, L., Imm, P., et al. (2008). The Getting To Outcomes demonstration and evaluation: An illustration of the prevention support system. American Journal of Community Psychology, 41, 206–224.

    PubMed  Article  Google Scholar 

  11. Chinman, M., Imm, P., & Wandersman, A. (2004). Getting to Outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. (No. TR- TR101). Santa Monica, CA: RAND.

  12. Chinowsky, P. S. (2008). Staircase model for new practice implementation. Journal of Management in Engineering, 24, 187–195.

    Article  Google Scholar 

  13. Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A., Amundsen, M. J., McGee, C., et al. (2002). Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science and Practice, 9, 165–190.

    Google Scholar 

  14. Collaborative for Academic, Social, and Emotional Learning, National Center for Mental Health Promotion and Youth Violence Prevention. (2011). Leading an SEL school: Steps to implement social and emotional learning for all students. 5/20/11, Education Development Center.

  15. Cook, T. D., Habib, F. N., Phillips, M., Settersten, R. A., Shagle, S. C., & Degirmencioglu, S. M. (1999). Comer’s school development program in Prince George’s county, Maryland: A theory-based evaluation. American Educational Research Journal, 36, 543–597.

    Google Scholar 

  16. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.

  17. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clinical Psychology Review, 18, 23–45.

    PubMed  Article  Google Scholar 

  18. Domitrovich, C. E., Bradshaw, C. P., Poduska, J., Hoagwood, K., Buckley, J., Olin, S., et al. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28.

    Article  Google Scholar 

  19. Domitrovich, C. E., Gest, S. D., Jones, D., Gill, S., & DeRousie, R. M. S. (2010). Implementation quality: Lessons learned in the context of the Head Start REDI trial. Early Childhood Research Quarterly, 25, 284–298.

    PubMed  Article  Google Scholar 

  20. DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30, 157–198.

    PubMed  Article  Google Scholar 

  21. DuFrene, B. A., Noell, G. H., Gilbertson, D. N., & Duhon, G. J. (2005). Monitoring implementation of reciprocal peer tutoring: Identifying and intervening with students who do not maintain accurate implementation. School Psychology Review, 34, 74–86.

    Google Scholar 

  22. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.

    PubMed  Article  Google Scholar 

  23. Elder, J. P., Perry, C. L., Stone, E. J., Johnson, C. C., Yang, M., Edmundson, E. W., et al. (1996). Tobacco use measurement, prediction, and intervention in elementary schools in four states: The CATCH study. Preventive Medicine, 25, 489–494.

    Google Scholar 

  24. Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.

    PubMed  Article  Google Scholar 

  25. Feldstein, A. C., & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety/Joint Commission Resources, 34, 228–243.

    PubMed  Google Scholar 

  26. Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231). Retrieved November 1, 2006, from http://nirn.fmhi.usf.edu/resources/publications/Monograph/pdf/monograph_full.pdf.

  27. Flaspohler, P. D., Anderson-Butcher, D., & Wandersman, A. (2008a). Supporting implementation of expanded school mental health services: Application of the Interactive Systems Framework in Ohio. Advances in School Mental Health Promotion, 1, 38–48.

    Article  Google Scholar 

  28. Flaspohler, P., Duffy, J., Wandersman, A., Stillman, L., & Maras, M. A. (2008b). Unpacking prevention capacity: An intersection of research-to-practice models and community-centered models. American Journal of Community Psychology, 41, 182–196.

    PubMed  Article  Google Scholar 

  29. Forehand, R., Dorsey, S., Jones, D. J., Long, N., & McMahon, R. (2010). Adherence and flexibility: They can (and do) coexist! Clinical Psychology: Science and Practice, 17, 258–264.

    Article  Google Scholar 

  30. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7, 243–259.

    PubMed  Article  Google Scholar 

  31. Gottfredson, D. C., Gottfredson, G. D., & Hybl, L. G. (1993). Managing adolescent behavior: A multiyear, multi school study. American Educational Research Journal, 30, 179–215.

    Google Scholar 

  32. Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research, and practice (volume 3). DHHS Pub. No. (SMA). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, 2005.

  33. Greenhalgh, T., Robert, G., MacFarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82, 581–629.

    PubMed  Article  Google Scholar 

  34. Greenwood, C. R., Tapia, Y., Abbott, M., & Walton, C. (2003). A building-based case study of evidence-based literacy practices: Implementation, reading behavior, and growth in reading fluency, K-4. The Journal of Special Education, 37, 95–110.

    Article  Google Scholar 

  35. Grimshaw, J. M., & Russell, I. T. (1993). Effect of clinical guidelines on medical practice: A systematic review of rigorous evaluations. The Lancet, 342, 1317–1322.

    Article  Google Scholar 

  36. Grol, R., & Jones, R. (2000). Twenty years of implementation research. Family Practice, 17, S32–S35.

    PubMed  Article  Google Scholar 

  37. Guldbrandsson, K. (2008). From news to everyday use: The difficult art of implementation. Ostersund, Sweden: Swedish National Institute of Public health. Retrieved from www.fhi.se/PageFiles/3396/R200809_implementering_eng0805.pdf.

  38. Hall, G. E., & Hord, S. M. (2006). Implementing change: Patterns, principles and potholes (2nd ed.). Boston, MA: Allyn and Bacon.

    Google Scholar 

  39. Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951–976.

    PubMed  Article  Google Scholar 

  40. International Organization for Standardization. (1998). ISO/IEC international standard 13236: Information technologyQuality of service: Framework. First edition.

  41. Joyce, R. B., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.

    Google Scholar 

  42. Kerr, D. M., Kent, L., & Lam, T. C. M. (1985). Measuring program implementation with a classroom observation instrument: The interactive teaching map. Evaluation Review, 9, 461–482.

    Article  Google Scholar 

  43. Kilbourne, A. M., Neuman, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007). Implementing evidence-based interventions in health care: Applications of the replicating effective programs framework. Implementation Science, 2, 42.

    PubMed  Article  Google Scholar 

  44. Klein, K. J., Conn, A., & Sorra, J. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86(5), 811–824.

    PubMed  Article  Google Scholar 

  45. Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.

    Google Scholar 

  46. Lee, S. J., Altschul, I., & Mowbray, C. T. (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41, 290–303.

    PubMed  Article  Google Scholar 

  47. Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Alonnidis, J. P., et al. (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. BMJ, 339, b2700.

  48. Maxwell, J. A. (2005). Qualitative research design: An interactive approach (2nd ed.). Thousand: SageOaks. 2005.

    Google Scholar 

  49. Mazzucchelli, T. G., & Sanders, M. R. (2010). Facilitating practitioner flexibility within an empirically supported intervention: Lessons from a system of parenting support. Clinical Psychology: Science and Practice, 17, 238–252.

    Article  Google Scholar 

  50. McGraw, S. A., Sellers, D. E., Stone, E. J., Bebchuk, J., Edmundson, E. W., Johnson, C. C., et al. (1996). Using process data to explain outcomes: An illustration from the child and adolescent trial for cardiovascular health (CATCH). Evaluation Review, 20, 291–312.

    PubMed  Article  Google Scholar 

  51. Meyers, D. C., Katz, J., Chien, V., Wandersman, A., Scaccia, J. P., & Wright, A. (2012). Practical implementation science: Developing and piloting the Quality Implementation Tool. American Journal of Community Psychology. doi:10.1007/s10464-012-9521-y.

  52. Mihalic, S., Fagan, A. A., Irwin, K., Ballard, D., & Elliott, D. (2004). Blueprints for violence prevention. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.

    Google Scholar 

  53. Miles, M., & Huberman, M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). London: Sage.

    Google Scholar 

  54. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, 1050–1062.

    PubMed  Article  Google Scholar 

  55. National Institutes of Health. (2011, October 25). Dissemination and implementation. Retrieved from http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/index.aspx.

  56. Okumus, F. (2003). A framework to implement strategies in organizations. Management Decision, 41(9), 871–882.

    Article  Google Scholar 

  57. Partnerships for Success Community Planning and Implementation Guide. (2003). www.pfsacademy.org.

  58. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34.

    PubMed  Article  Google Scholar 

  59. Riley, B. L., Taylor, S. M., & Elliott, S. J. (2001). Determinants of implementing heart healthy promotion activities in Ontario public health units: A social ecological perspective. Health Education Research, 16, 425–441.

    PubMed  Article  Google Scholar 

  60. Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.

    Google Scholar 

  61. Rycroft-Malone, J. (2004). The PARIHS framework: A framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19, 297–304.

    PubMed  Article  Google Scholar 

  62. Sandler, I., Ostrom, A., Bitner, M. J., Ayers, T. S., Wolchik, S., & Daniels, V. S. (2005). Developing effective prevention services for the real world: A prevention service development model. American Journal of Community Psychology, 35, 127–142.

    PubMed  Article  Google Scholar 

  63. Saunders, R. P., Ward, D., Felton, G. M., Dowda, M., & Pate, R. R. (2006). Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). Evaluation and Program Planning, 29, 352–364.

    PubMed  Article  Google Scholar 

  64. Schoenwald, S. K. (2008). Toward evidence-based transport of evidence-based treatments: MST as an example. Journal of Child & Adolescent Substance Abuse, 17, 69–91.

    Article  Google Scholar 

  65. Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in Vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106–115.

    PubMed  Article  Google Scholar 

  66. Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 22, 171–182.

    PubMed  Article  Google Scholar 

  67. Smith, J. D., Schneider, B. H., Smith, P. K., & Ananiadou, K. (2004). The effectiveness of whole-school antibullying programs: A synthesis of evaluation research. School Psychology Review, 33, 547–560.

    Google Scholar 

  68. Sobo, E. J., Bowman, C., Halloran, J., Aarons, G. A., Asch, S., & Gifford, A. L. (2008). Enhancing organizational change and improvement prospects: Lessons from an HIV testing intervention for veterans. Human Organization, 67, 443–453.

    Google Scholar 

  69. Spence, K., & Henderson-Smart, D. (2011). Closing the evidence-practice gap for newborn pain using clinical networks. Journal of Paediatrics and Child Health, 47, 92–98.

    PubMed  Article  Google Scholar 

  70. Spoth, R. L., & Greenberg, M. T. (2005). Toward a comprehensive strategy for effective practitioner-scientist partnerships and larger-scale community benefits. American Journal of Community Psychology, 35, 107–126.

    PubMed  Article  Google Scholar 

  71. Spoth, R., Greenberg, M., Bierman, K., & Redmond, C. (2004). PROSPER community-university partnership model for public education systems: Capacity-building for evidence-based, competence-building prevention. Prevention Science, 5, 31–39.

    PubMed  Article  Google Scholar 

  72. Stetler, C. B., McQueen, L., Demakis, J., & Mittman, B. S. (2008). An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implementation Science, 3, 30.

    PubMed  Article  Google Scholar 

  73. Stith, S., Pruitt, I., Dees, J., Fronce, M., Green, N., Som, A., et al. (2006). Implementing community-based prevention programming: A review of the literature. The Journal of Primary Prevention, 27, 599–617.

    PubMed  Article  Google Scholar 

  74. Tobler, N. S. (1986). Meta-analysis of 143 adolescent drug prevention programs: Quantitative outcome results of program participants compared to a control or comparison group. Journal of Drug Issues, 16, 537–567.

    Google Scholar 

  75. Van de Ven, A. H., Angles, H. L., & Poole, M. S. (1989). Research on the management of innovation: The Minnesota studies. New York: Harper and Row.

    Google Scholar 

  76. Walker, J. S., & Koroloff, N. (2007). Grounded theory and backward mapping: Exploring the implementation context for Wraparound. Journal of Behavioral Health Services & Research, 34, 443–458.

    Article  Google Scholar 

  77. Wandersman, A., Chien, V., & Katz. J. (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: Tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology. doi:10.1007/s10464-012-9509-7.

  78. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008). Bridging the gap between prevention research and practice: The Interactive Systems Framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181.

    PubMed  Article  Google Scholar 

  79. Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention. American Psychologist, 58, 441–448.

    PubMed  Article  Google Scholar 

  80. Wilson, S. J., Lipsey, M. W., & Derzon, J. H. (2003). The effects of school-based intervention programs on aggressive behavior: A meta-analysis. Journal of Consulting and Clinical Psychology, 71, 136–149.

    PubMed  Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Duncan C. Meyers.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Meyers, D.C., Durlak, J.A. & Wandersman, A. The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process. Am J Community Psychol 50, 462–480 (2012). https://doi.org/10.1007/s10464-012-9522-x

Download citation

Keywords

  • Implementation
  • Knowledge utilization
  • Implementation framework
  • Implementation science