Abstract
To implement preventive interventions that have had favorable outcomes in research studies into school settings may present challenges to the fidelity of the original research trial that produced these outcomes. Scaling up an evidence-based preventive intervention (EBI) is multifaceted and multilayered. Successful implementation of EBIs depends on more than appropriate selection of the intervention. A school’s organizational capacity has an influence on the quality of implementation. Factors that influence the decision to adopt EBI such as the school’s readiness, funding, time requirements, training required, community influence, and school climate are all areas to be considered. This chapter discusses key challenges in scaling up evidence-based preventive interventions in school settings and key factors that influence dissemination, adoption, and implementation stages in the scaling-up process as well as a summary of findings from studies on the multilevel factors that contribute to successful adoption and implementation with a case study that demonstrates one approach to addressing these challenges and issues.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Since their initial efforts to provide information that practitioners could use to guide decision-making about evidence-based substance abuse prevention programs, SAMHSA has revised its approach and eliminated the distinction between “model” programs and others that have been evaluated (see the National Registry of Evidence-based Programs and Practices, http://nrepp.samsha.gov).
References
Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.1007/s11121-008-0100-2.
Berman, P., & Pauly, E. W. (1975). Federal programs supporting educational change. Vol. II, Factors affecting change agent projects. (Document No: R-1589/2-HEW). Santa Monica: RAND Corporation.
Bishop, D. C., Giles, S. M., & Bryant, K. S. (2005). Teacher receptiveness toward web-based training and support. Teaching and Teacher Education, 21(1), 3–14. doi:10.1016/j.tate.2004.11.002.
Blake, S. M., Ledsky, R. A., Sawyer, R. J., Goodenow, C., Banspach, S., Lohrmann, D. K., & Hack, T. (2005). Local school district adoption of state-recommended policies on HIV prevention education. Preventive Medicine: An International Journal Devoted to Practice and Theory, 40(2), 239–248. http://www.sciencedirect.com/science/article/pii/S0091743504002993.
Bosworth, K., Gingiss, P. M., Potthoff, S., & Roberts-Gray, C. (1999). A Bayesian model to predict the success of the implementation of health and education innovations in school-centered programs. Evaluation and Program Planning, 22, 1–11. doi:10.1016/S0149-7189(98)00035–4.
Botvin, G. J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association, 273(14), 1106–1112. doi:10.1001/jama.1995.03520380042033.
Bumbarger, B. K., & Perkins, D. F. (2008). After randomized trials: Issues related to dissemination of evidence-based interventions. Journal of Children’s Services, 3, 53–61. doi:10.1108/17466660200800012.
Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15–34.
Cho, H., Hallfors, D. D., Iritani, B. J., & Hartman, S. (2009). The influence of “No Child Left Behind” legislation on drug prevention in U.S. schools. Evaluation Review, 33(5), 446–463. doi:10.1177/0193841×09335050.
Cohen, J., McCabe, E. M., Michelli, N. M., & Pickeral (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111(1), 180–213.
Colby, M., Hecht, M. L., Miller-Day, M., Krieger, J. R., Syvertsen, A. K., Graham, J. W., & Pettigrew, J. (2013). Adapting school-based substance use prevention curriculum through cultural grounding: A review and exemplar of adaptation processes for rural schools. American Journal of Community Psychology, 51(1–2), 190–205. doi:10.1007/s10464-012-9524-8.
Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221. doi:10.1207/S1532768XJEPC1102_04.
Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., Romanelli, L. H., & Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. doi:10.1080/1754730X.2008.9715730.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. doi:10.1007/s10464-008-9165-0.
Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256. doi:10.1093/her/18.2.237.
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20(3), 308–313. doi:10.1093/her/cyg134.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5(1), 47–53. doi:10.1023/B:PREV.0000013981.28071.52.
Elmore, R. F. (1996). Getting to scale with good educational practices. Harvard Educational Review, 66, 1–26. http://her.hepg.org/content/g73266758j348t33/.
Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4(1), 1–14. doi:10.1023/A:1021777109369.
Fagan, A. A., & Mihalic, S. (2003). Strategies for enhancing the adoption of school-based prevention programs: Lessons learned from the Blueprints for Violence Prevention replications of the Life Skills Training program. Journal of Community Psychology, 31(3), 235–253. doi:10.1002/jcop.10045.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the community youth development study. American Journal of Community Psychology, 41(3–4), 235–249. doi:10.1007/s10464-008-9176-x.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2009). Translation research in action: Implementation of the communities that care prevention system in 12 communities. Journal of Community Psychology, 37, 809–829. doi:10.1002/jcop.20332.
Fixsen, D., Naoom, S. F., Blase, D. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
Franks, A. L., Kelder, S. H., Dino, G. A., Horn, K. A., Gortmaker, S. L., Wiecha, J. L., & Simoes, E. J. (2007). School-based programs: Lessons learned from CATCH, Planet Health, and Not-On-Tobacco. Preventing Chronic Disease: Public Health Research, Practice, and Policy, 4(2), 1–9. http://www.cdc.gov/pcd/issues/2007/apr/pdf/06_0105.pdf.
Fullan, M. G. (1992). Successful school improvement: The implementation perspective and beyond. Philadelphia: Open University Press.
Gingiss, P. M., Roberts-Gray, C., & Boerm, M. (2006). Bridge-It: A system for predicting implementation fidelity for school-based tobacco prevention programs. Prevention Science, 7(2), 197–207. doi:10.1007/s11121-006-0038-1.
Gittelsohn, J., Merkle, S., Story, M., Stone, E. J., Steckler, A., Noel, J., & Ethelbah, B. (2003). School climate and implementation of the pathways study. Preventive Medicine, 37(Supplement 1), S97–S106. doi:10.1016/j.ypmed.2003.08.010.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1323–1327. doi:10.2105/AJPH.89.9.1322.
Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23(6), 767–794. doi:10.1002/job.162.
Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39(1), 3–35. doi:10.1177/002242780203900101.
Greenberg, M. T. (2010). School-based prevention: Current status and future challenges. Effective Education, 2(1), 27–52. doi:10.1080/19415531003616862.
Gregory, A., Henry, D. B., & Schoeny, M. E. (2007). School climate and implementation of a preventive intervention. American Journal of Community Psychology, 40(3–4), 250–260. doi:10.1007/s10464-007-9142-z.
Hall, G. E. (1979). The concern-based approach to facilitating change. Educational Horizons, 57, 202–208.
Hallfors, D., & Godette, D. (2002). Will the “Principles of Effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research, 17(4), 461–470. doi:10.1093/her/17.4.461.
Hecht, M. L., Graham, J. W., & Elek, E. (2006). The drug resistance strategies intervention: Program effects on substance use. Health Communication, 20, 267–276. doi:10.1207/s15327027hc2003_6.
Honig, M. I., & Coburn, C. (2008). Evidence-based decision making in school district central offices: Toward a policy and research agenda. Educational Policy, 22(4), 578–608. doi:10.1177/0895904807307067.
Huberman, A. M., & Miles, M. B. (1984). Innovation up close: How school improvement works. New York: Plenum Press.
Joyce, B., & Showers, B. (2002). Student achievement through staff development (3rd edn.). Alexandria: Association for Supervision and Curriculum Development.
Kallestad, J. H., & Olweus, D. (2003). Predicting teachers’ and schools’ implementation of the Olweus Bullying Prevention Program: A multilevel study. Prevention & Treatment, 6(1). doi:10.1037/1522-3736.6.1.621a.
Kam, C.-M., Greenberg, M. T., & Walls, C. T. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4(1), 55–63. doi:10.1023/A:1021786811186.
Kann, L., Telljohann, S. K., & Wooley, S. F. (2007). Health education: Results from the School Health Policies and Programs Study 2006. Journal of School Health, 77(8), 408–434. doi:10.1111/j.1746-1561.2007.00228.x.
Kirby, D., Barth, R. P., Leland, N., & Fetro, J. V. (1991). Reducing the risk: Impact of a new curriculum on sexual risk-taking. Family Planning Perspectives, 23(6), 253–263.
Klimes-Dougan, B., August, G. J., Lee, C.-Y. S., Realmuto, G. M., Bloomquist, M. L., Horowitz, J. L., & Eisenberg, T. L. (2009). Practitioner and site characteristics that relate to fidelity of implementation: The early risers prevention program in a going-to-scale intervention trial. Professional Psychology: Research and Practice, 40(5), 467–475. doi:10.1037/a0014623.
Lee, R., & Gortmaker, S. (2013). Health dissemination and implementation within schools. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health (pp. 419–436). Oxford: Oxford University Press.
Little, M. A., Pokhrel, P., Sussman, S., & Rohrbach, L. A. (2014). The process of adoption of evidence-based tobacco use prevention programs in California Schools. Prevention Science. doi:10.1007/s11121-013-0457-8.
McGraw, S. A., Sellers, D. E., Johnson, C. C., Stone, E. J., Bachman, K. J., Bebchuk, J., et al. (1996). Using process data to explain outcomes: An illustration from the Child and Adolescent Trial for Cardiovascular Health (CATCH). Evaluation Review, 20(3), 291–312.
McLeroy, K. R., Bibeau, D., Steckler, A., & Glanz, K. (1988). An ecological perspective on health promotion programs. Health Education & Behavior, 15, 351–377. doi:10.1177/109019818801500401.
Mendez Foundation. (2000). Too good for drugs and violence—High school. Tampa: Mendez Foundation.
Mihalic, S. F., & Irwin, K. (2003). Blueprints for violence prevention: From research to real-world settings—factors influencing the successful replication of model programs. Youth Violence and Juvenile Justice, 1(4), 307–329. doi:10.1177/1541204003255841.
Mihalic, S. F., Fagan, A. A., & Argamaso, S. (2008). Implementing the life skills training drug prevention program: Factors related to implementation fidelity. Implementation Science, 3(1), 5. doi:10.1186/1748-5908-3-5.
Miller-Day, M., Pettigrew, J., Hecht, M. L., Shin, Y., Graham, J., & Krieger, J. (2013). How prevention curricula are taught under real-world conditions: Types of and reasons for teacher curriculum adaptations in 7th grade drug prevention curriculum. Health Education, 113(4), 324–344. doi:10.1108/09654281311329259.
Mrazek, P., & Haggerty, R. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington: National Academy Press.
National Research Council & Institute of Medicine, Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: Research Advances and Promising Interventions. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington: The National Academies Press.
Ozer, E. J., Wanis, M. G., & Bazell, N. (2010). Diffusion of school-based prevention programs in two urban districts: Adaptations, rationales, and suggestions for change. Prevention Science, 11, 42–55. doi:10.1007/s11121-009-0148-7.
Pas, E. T., & Bradshaw, C. P. (2012). Examining the association between implementation and outcomes: State-wide scale-up of school-wide positive behavior intervention and supports. Journal of Behavioral Health Services & Research, 39(4), 417–433. doi:0.1007/s11414-012-9290-2.
Philliber, S., & Nolte, K. (2009). Implementation science: Promoting science-based approaches to teen pregnancy. Prevention Science, 9(3), 166–177. doi:10.1007/s11121-008-0094-9.
Pierre, St. T. L., & Kaltreider, D. L. (2004). Tales of refusal, adoption, and maintenance: Evidence-based substance abuse prevention via school-extension collaborations. American Journal of Evaluation, 25(4), 479–491. doi:10.1016/j.ameval.2004.09.006.
Powers, J. D., Bowen, N. K., & Bowen, G. L. (2011). Supporting evidence-based practice in schools with an online database of best practices. Children & Schools, 33(2), 119–128. doi:10.1093/cs/33.2.119.
Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30(3), 375–391. doi:10.1177/1090198103030003010.
Ringwalt, C., Vincus, A. A., Hanley, S., Ennett, S. T., Bowling, J. M., & Rohrbach, L. A. (2009a). The prevalence of evidence-based drug use prevention curricula in U.S. middle schools in 2005. Prevention Science, 10(1), 33–40. doi:10.1007/s11121-008-0112-y.
Ringwalt, C. L., Pankratz, M. M., Hansen, W. B., Dusenbury, L., Jackson-Newsom, J., Giles, S. M., et al. (2009b). The potential of coaching as a strategy to improve the effectiveness of school-based substance use prevention curricula. Health Education & Behavior, 36(4), 696–710. doi:10.1177/1090198107303311.
Roberts-Gray, C., Gingiss, P. M., & Boerm, M. (2007). Evaluating school capacity to implement new programs. Evaluation and Program Planning, 30(3), 247–257. doi:10.1016/j.evalprogplan.2007.04.002.
Rogers, E. M. (1983). Diffusion of innovations (2nd ed.). New York: The Free Press.
Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260. doi:10.1006/pmed.1993.1020.
Rohrbach, L. A., D’Onofrio, C. N., Backer, T. E., & Montgomery, S. B. (1996). Diffusion of school-based substance abuse prevention programs. American Behavioral Scientist, 39(7), 919–934. doi:10.1177/0002764296039007012.
Rohrbach, L. A., Ringwalt, C. L., Ennett, S. T., & Vincus, A. A. (2005). Factors associated with adoption of evidence-based substance use prevention curricula in U.S. school districts. Health Education Research, 20(5), 514–526. doi:10.1093/her/cyh008.
Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29(3), 302–333. doi:10.1177/0163278706290408.
Rohrbach, L. A., Dent, C. W., Skara, S., Sun, P., & Sussman, S. (2007). Fidelity of implementation in Project Towards No Drug Abuse (TND): A comparison of classroom teachers and program specialists. Prevention Science, 8, 125–132. doi:10.1007/s11121-006-0056-z.
Rohrbach, L. A., Gunning, M., Sun, P., & Sussman, S. (2010a). The Project Towards No Drug Abuse (TND) dissemination trial: Implementation fidelity and immediate outcomes. Prevention Science, 11, 77–88. doi:10.1007/s11121-009-0151-z.
Rohrbach, L. A., Gunning, M., Grana, R., Gunning, G., & Sussman, S. (2010b). Dissemination of Project Towards No Drug Abuse (TND): Findings from a survey of program adopters. Substance Use & Misuse, 45, 2551–2566. doi:10.3109/10826081003725278.
Rohrbach, L. A., Sun, P., & Sussman, S. (2010c). One-year follow-up evaluation of the Project Towards No Drug Abuse (TND) dissemination Trial. Preventive Medicine, 51, 313–319. doi:10.1016/j.ypmed.2008.07.003.
Rolleri, L. A., Fuller, T. R., Firpo-Triplett, R., Lesesne, C. A., Moore, C., & Leeks, K. D. (2014). Adaptation guidance for evidence-based teen pregnancy and STI/HIV prevention curricula: From development to practice. American Journal of Sex Education, 9(2), 135–154. doi: 10.1080/15546128.2014.900467.
Rotheram-Borus, M. J., & Duan, N. (2003). Next generation of preventive interventions. American Academy of Child & Adolescent Psychiatry, 42(5), 518–526. doi:10.1097/01.CHI.0000046836.90931.E9.
Sandler, I., Ostrom, A., Birner, M. J., Ayers, T. S., Wolchik, S. A., & Daniels, V.-S. (2005). Developing effective prevention services for the real world: A prevention service development model. American Journal of Community Psychology, 35(3–4), 127–142. doi:0.1007/s10464-005-3389-z.
Spoth, R., Redmond, C., Clair, S., Shin, C., Greenberg, M., & Feinberg, M. (2011). Preventing substance misuse through community-university partnerships and evidence-based interventions: PROSPER outcomes 4½ years past baseline. American Journal of Preventive Medicine, 40, 440–447. doi:10.1016/j.amepre.2010.12.012.
Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14(4), 319–351. doi:10.1007/s11121-012-0362-6.
Sun, W., Skara, S., Sun, P., Dent, C. W., & Sussman, S. (2006). Project Towards No Drug Abuse: Long-term substance use outcomes evaluation. Preventive Medicine, 42(3), 188–192. doi:10.1016/j.ypmed.2005.11.011.
Sun, P., Dent, C. W., Sussman, S., & Rohrbach, L. A. (2008). One-year follow-up evaluation of Project Towards No Drug Abuse (TND4). Preventive Medicine, 47, 438–442. doi:10.1016/j.ypmed.2008.07.003.
Sussman, S., Dent, C. W., & Stacy, A. W. (2002). Project Towards No Drug Abuse: A review of the findings and future directions. American Journal of Health Behavior, 26(5), 354–365. doi:10.5993/AJHB.26.5.4.
Sussman, S., Earleywine, M., Wills, T., Cody, C., Biglan, T., Dent, C. W., & Newcomb, M. D. (2004a). The motivation, skills, and decision-making model of “drug abuse” prevention. Substance Use & Misuse, 39, 1971–2016. doi:10.1081/JA-200034769.
Sussman, S., Rohrbach, L., & Mihalic, S. (2004b). Blueprints for violence prevention, book twelve: Project Towards No Drug Abuse. Boulder: Center for the Study and Prevention of Violence.
Sussman, S., Sun, P., Rohrbach, L. A., & Spruijt-Metz, D. (2012). One-year outcomes of a drug abuse prevention program for older teens and emerging adults: Evaluating a motivational interviewing booster component. Health Psychology, 31(4), 476–485. doi:10.1037/a0025756.
Thaker, S., Steckler, A., Sánchez, V., Khatapoush, S., Rose, J., & Hallfors, D. D. (2008). Program characteristics and organizational factors affecting the implementation of a school-based indicated prevention program. Health Education Research, 23(2), 238–248. doi:10.1093/her/cym025.
Valente, T. W., Ritt-Olson, A., Stacy, A., Unger, J. B., Okamoto, J., & Sussman, S. (2007). Peer acceleration: Effects of a social network tailored substance abuse prevention program among high-risk adolescents. Addiction, 102(11), 1804–1815. doi:10.1111/j.1360–0443.2007.01992.x.
Vicary, J. R., Smith, E. A., Swisher, J. D., Hopkins, A. M., Elek, E., Bechtel, L. J., & Henry, K. L. (2006). Results of a 3-year study of two methods of delivery of life skills training. Health Education and Behavior, 33, 325–339. doi:10.1177/1090198105285020.
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., & Saul, J. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 171–181. doi:10.1007/s10464-008-9174-z.
Weiss, C. H., Murphy-Graham, E., & Birkeland, S. (2005). An alternate route to policy influence: How evaluations affect D.A.R.E. American Journal of Evaluation, 26(1), 12–30. doi:10.1177/1098214004273337.
Wilson, K. M., Brady, T. J., Lesesne, C., & On Behalf of the NCCDPHP Work Group on Translation (2011). An organizing framework for translation in public health: The knowledge to action framework. Preventing Chronic Disease, 8(2), 1–7. doi:10.1089/jwh.2007.0699.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this chapter
Cite this chapter
Rohrbach, L., Dyal, S. (2015). Scaling Up Evidence-Based Preventive Interventions. In: Bosworth, K. (eds) Prevention Science in School Settings. Advances in Prevention Science. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-3155-2_9
Download citation
DOI: https://doi.org/10.1007/978-1-4939-3155-2_9
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-3154-5
Online ISBN: 978-1-4939-3155-2
eBook Packages: MedicineMedicine (R0)