Advertisement

Prevention Science

, Volume 15, Issue 5, pp 674–683 | Cite as

A Framework for Testing and Promoting Expanded Dissemination of Promising Preventive Interventions That Are Being Implemented in Community Settings

  • W. Alex MasonEmail author
  • Charles B. Fleming
  • Ronald W. Thompson
  • Kevin P. Haggerty
  • James J. Snyder
Article

Abstract

Many evidence-based preventive interventions have been developed in recent years, but few are widely used. With the current focus on efficacy trials, widespread dissemination and implementation of evidence-based interventions are often afterthoughts. One potential strategy for reversing this trend is to find a promising program with a strong delivery vehicle in place and improve and test the program’s efficacy through rigorous evaluation. If the program is supported by evidence, the dissemination vehicle is already in place and potentially can be expanded. This strategy has been used infrequently and has met with limited success to date, in part, because the field lacks a framework for guiding such research. To address this gap, we outline a framework for moving promising preventive interventions that are currently being implemented in community settings through a process of rigorous testing and, if needed, program modification in order to promote expanded dissemination. The framework is guided by RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance) (Glasgow et al., Am J Publ Health 89:1322–1327, 1999), which focuses attention on external as well as internal validity in program tests, and is illustrated with examples. Challenges, such as responding to negative and null results, and opportunities inherent in the framework are discussed.

Keywords

Prevention Dissemination Evidence-based Parent-training Randomized trial 

References

  1. Barth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., et al. (2005). Parent-training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353–371. doi: 10.1177/1049731505276321.CrossRefGoogle Scholar
  2. Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of one-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388. doi: 10.1037/0022-006X.73.3.371.CrossRefPubMedGoogle Scholar
  3. Brown, C. H., Wyman, P. A., Guo, J., & Pena, J. (2006). Dynamic wait-listed designs for randomized trials: New designs for prevention of youth suicide. Clinical Trials, 3, 259–271. doi: 10.1191/1740774506cn152oa.CrossRefPubMedGoogle Scholar
  4. Burke, R. V., Herron, R., & Barnes, B. A. (2006). Common sense parenting: Using your head as well as your heart to raise school-aged children (3rd ed.). Boys Town: Father Flanagan’s Boys’ Home.Google Scholar
  5. Castro, F. G., Barrera, M., Jr., & Martinez, C. R., Jr. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41–45. doi: 10.1023/B:PREV.0000013980.12412.cd.CrossRefPubMedGoogle Scholar
  6. Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., et al. (1993). The science of prevention: A conceptual framework and some directions for a national research program. The American Psychologist, 48, 1013–1022. doi: 10.1037/0003-066X.48.10.1013.CrossRefPubMedGoogle Scholar
  7. Cook, T. D., Shadish, W. R., & Wong, V. C. (2008). Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management, 27, 724–750. doi: 10.1002/pam.20375.CrossRefGoogle Scholar
  8. Cross, W. F., & West, J. C. (2011). Examining implementer fidelity: Conceptualising and measuring adherence and competence. Journal of Children’s Services, 6, 18–33. doi: 10.5042/jcs.2011.0123.PubMedCentralCrossRefPubMedGoogle Scholar
  9. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi: 10.1016/S0272-7358(97)00043-3.CrossRefPubMedGoogle Scholar
  10. DeMarsh, J., & Kumpfer, K. L. (1985). Family-oriented interventions for the prevention of chemical dependency in children and adolescents. Journal of Children in a Contemporary Society, 18, 117–151. doi: 10.1300/J274v18n01_07.CrossRefGoogle Scholar
  11. Duppong Hurley, K., Trout, A., Griffith, A., Epstein, M., Thompson, R., Mason, W. A., et al. (2010). Creating and sustaining effective partnerships to advance research on youth with serious emotional and behavioral disorders. Journal of Disability Policy Studies, 21, 141–151. doi: 10.1177/1044207310376738.CrossRefGoogle Scholar
  12. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi: 10.1007/s10464-008-9165-0.CrossRefPubMedGoogle Scholar
  13. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi: 10.1111/j.1467-8624.2010.01564.x.CrossRefPubMedGoogle Scholar
  14. Eischens, A., Komro, K. A., Perry, C. L., & Bosma, L. M. (2004). The association of extracurricular activity participation with substance use among youth in the D.A.R.E. Plus project. American Journal of Public Health Education, 35, 68–75.CrossRefGoogle Scholar
  15. Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11, 75–113. doi: 10.1007/s10567-008-0036-x.PubMedCentralCrossRefPubMedGoogle Scholar
  16. Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project D.A.R.E. outcome evaluations. American Journal of Public Health, 85, 1394–1401. doi: 10.2105/AJPH.84.9.1394.CrossRefGoogle Scholar
  17. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI #231) University of South Florida, Louis de la Parte Florida Mental Health Institute. Tampa: The National Implementation Research Network.Google Scholar
  18. Flay, B. R. (1986). Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive Medicine, 15, 451–474. doi: 10.1016/0091-7435(86)90024-1.CrossRefPubMedGoogle Scholar
  19. Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175. doi: 10.1007/s11121-005-55543-y.CrossRefPubMedGoogle Scholar
  20. Forgatch, M. S., & DeGarmo, D. S. (2011). Sustaining fidelity following the nationwide PMTO implementation in Norway. Prevention Science, 12, 235–246. doi: 10.1007/s11121-011-0225-6.PubMedCentralCrossRefPubMedGoogle Scholar
  21. Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93, 1261–1267. doi: 10.2105/AJPH.93.8.1261.PubMedCentralCrossRefPubMedGoogle Scholar
  22. Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi: 10.2105/AJPH89.9.1322.PubMedCentralCrossRefPubMedGoogle Scholar
  23. Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27, 3–12. doi: 10.1207/s15324796abm2701_2.CrossRefPubMedGoogle Scholar
  24. Gregory, H., Jr., Van Orden, O., Jordan, L., Portnoy, G. A., Welsh, E., Betkowski, J., et al. (2012). New directions in capacity building: Incorporating cultural competence into the Interactive Systems Framework. American Journal of Community Psychology, 50, 321–333. doi: 10.1007/s10464-012-9508-8.CrossRefPubMedGoogle Scholar
  25. Hansen, K., Romens, K., & LaFleur, S. (2011). Final report on the enhanced school-based mentoring pilot: Developing and substantiating an evidence-based model. Big Brothers Big Sisters of America.Google Scholar
  26. Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics & Adolescent Medicine, 163, 789–798. doi: 10.1001/archpediatrics.2009.141.CrossRefGoogle Scholar
  27. Hirschi, T. (1969). Causes of delinquency. Berkeley, CA: University of California Press.Google Scholar
  28. Kalton, G. (1983). Introduction to survey sampling. Beverly Hills: Sage Publications, Inc.Google Scholar
  29. Kaminski, J. W., Valle, L. A., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589. doi: 10.1007/s10802-007-9201-9.CrossRefPubMedGoogle Scholar
  30. Kazdin, A. E., Siegel, T. C., & Bass, D. (1992). Cognitive problem-solving skills training and parent management training in the treatment of antisocial behavior in children. Journal of Consulting and Clinical Psychology, 60, 733–747. doi: 10.1037/0022-006X.60.5.733.CrossRefPubMedGoogle Scholar
  31. Kazdin, A. E., & Blase, S. L. (2011). Rebooting psychotherapy research and practice to reduce the burden on mental illness. Perspectives on Psychological Science, 6, 21–37. doi: 10.1177/1745691610393527.CrossRefPubMedGoogle Scholar
  32. Kish, L. (1965). Survey sampling. New York: Wiley.Google Scholar
  33. Klesges, L. M., Estabrooks, P. A., Dzewaltowski, D. A., Bull, S. S., & Glasgow, R. E. (2005). Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination. Annals of Behavioral Medicine, 29, 66–75. doi: 10.1207/s15324796abm2902s_10.CrossRefPubMedGoogle Scholar
  34. Lynam, D. R., Milich, R., Zimmerman, R., Novak, S. P., Logan, T. K., Martin, C., et al. (1999). Project D.A.R.E.: No effects at 10-year follow-up. Journal of Consulting and Clinical Psychology, 67, 590–593. doi: 10.1037/0022-006X.67.4.590.CrossRefPubMedGoogle Scholar
  35. Marchand, E., Stice, E., & Becker, C. B. (2011). Moving from efficacy to effectiveness trials in prevention research. Behaviour Research and Therapy, 49, 32–41. doi: 10.1016/j.brat.2010.10.008.CrossRefPubMedGoogle Scholar
  36. McGill, D. E., Mihalic, S. F., & Grotpeter, J. K. (1998). Big Brothers Big Sisters of America: Blueprints for Violence Prevention, Book Two. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado.Google Scholar
  37. Nation, M., Crusto, C., Wandersman, A., Kumpfer, K. L., Seybolt, D., Morrissey-Kane, E., et al. (2003). What works in prevention: Principles of effective prevention programs. The American Psychologist, 58, 449–456. doi: 10.1037/0003-066X.58.6-7.449.CrossRefPubMedGoogle Scholar
  38. Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). A social interactional approach. Antisocial boys (Vol. 4). Eugene: Castalia.Google Scholar
  39. Perry, C. L., Komro, K. A., Veblen-Mortenson, S., Bosma, L. M., Farbakhsh, K., Munson, K. A., et al. (2003). A randomized controlled trial of the middle and junior high school D.A.R.E. and D.A.R.E. Plus programs. Archives of Pediatrics & Adolescent Medicine, 157, 178–184. doi: 10.1001/archpedi.157.2.178.CrossRefGoogle Scholar
  40. Ringwalt, C. L., Ennett, S., Vincus, A., Thorne, J., Rohrbach, L. A., & Simons-Rudolph, A. (2002). The prevalence of effective substance use prevention curricula in U.S. middle schools. Prevention Science, 3, 257–265. doi: 10.1023/A:1020872424136.CrossRefPubMedGoogle Scholar
  41. Rotherham-Borus, M. J., & Duan, N. H. (2003). Next generation of preventive interventions. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 518–526. doi: 10.1097/01.CHI.0000046836.90931.E9.CrossRefGoogle Scholar
  42. Sloboda, Z., Stephens, R.C., Stephens, P.C., Grey, S.F., Teasdale, B., Hawthorne, R.D., Marquette, J.F. (2009). Drug and alcohol dependence, 102, 1–10. doi: 10.1016/j.drugalcdep.2009.01.015.
  43. Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of family-based prevention programs. Family Relations, 58, 1–13. doi: 10.1111/j.1741-3729.2008.00530.x.CrossRefGoogle Scholar
  44. Smith, M. F. (1989). Evaluability assessment: A practical approach. Boston: Kluwer Academic Publishers.CrossRefGoogle Scholar
  45. Spoth, R. L. (2008). Translating family-focused prevention science into effective practice: Toward a translational impact paradigm. Current Directions in Psychological Science, 17, 415–421. doi: 10.1111/j.1467-8721.2008.00617.x.PubMedCentralCrossRefPubMedGoogle Scholar
  46. Spoth, R. L., & Greenberg, M. T. (2005). Toward a comprehensive strategy for effective practitioner-scientist partnerships and larger-scale community health and well-being. American Journal of Community Psychology, 35, 107–126. doi: 10.1007/s10464-005-3388-0.PubMedCentralCrossRefPubMedGoogle Scholar
  47. Spoth, R. L., Redmond, C., Shin, C., Greenberg, M., Clair, S., & Feinberg, M. (2007). Substance use outcomes at 18 months past baseline: The PROSPER Community-University Partnership Trial. American Journal of Preventive Medicine, 32, 395–402. doi: 10.1016/j.amepre.2007.01.014.PubMedCentralCrossRefPubMedGoogle Scholar
  48. Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15, 250–267. doi: 10.1037/a0018719.CrossRefPubMedGoogle Scholar
  49. Thompson, R., Ruma, P. R., Schuchmann, L. F., & Burke, R. V. (1996). A cost-effectiveness evaluation of parent training. Journal of Child and Family Studies, 5, 415–429. doi: 10.1007/BF02233863.CrossRefGoogle Scholar
  50. Thompson, R. W., Ruma, P. R., Brewster, A. L., Besetsney, L. K., & Burke, R. V. (1997). Evaluation of an Air Force child physical abuse prevention project using the reliable change index. Journal of Child and Family Studies, 6, 421–434. doi: 10.1023/A:1025093328618.CrossRefGoogle Scholar
  51. Tibbits, M. K., Bumbarger, B. K., Kyler, S. J., & Perkins, D. F. (2010). Sustaining evidence-based interventions under real-world conditions: Results from a large-scale diffusion project. Prevention Science, 11, 252–262. doi: 10.1007/s11121-010-0170-9.PubMedCentralCrossRefPubMedGoogle Scholar
  52. Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of Big Brothers Big Sisters. Philadelphia: Public/Private Ventures.Google Scholar
  53. Valentine, J. C., Biglan, A., Boruch, R. F., Castro, F. G., Collins, L. M., Flay, B. R., et al. (2011). Replication in prevention science. Prevention Science, 12, 103–117. doi: 10.1007/s11121-011-0217-6.CrossRefPubMedGoogle Scholar
  54. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181. doi: 10.1007/s10464-008-9174-2.CrossRefPubMedGoogle Scholar
  55. Werner, E. E., & Smith, R. S. (1992). Overcoming the odds: High risk children from birth to adulthood. Ithaca: Cornell University Press.Google Scholar
  56. West, R. (2008). Providing full manuals and intervention descriptions: Addiction policy. Addiction, 103, 1411. doi: 10.1111/j.1360-0443.2008.02341.x.CrossRefPubMedGoogle Scholar
  57. West, S. L., & O’Neal, K. K. (2004). Project D.A.R.E. outcome effectiveness revisited. American Journal of Public Health, 94, 1027–1029. doi: 10.2105/AJPH.94.6.1027.PubMedCentralCrossRefPubMedGoogle Scholar
  58. Wolf, M. M., Phillips, E. F., Fixsen, D. L., Braukman, C. J., Kirigin, K. A., Willner, A. G., et al. (1976). Achievement place: The teaching-family model. Child Care Quarterly, 5, 92–103. doi: 10.1007/BF01555232.CrossRefGoogle Scholar

Copyright information

© Society for Prevention Research 2013

Authors and Affiliations

  • W. Alex Mason
    • 1
    Email author
  • Charles B. Fleming
    • 2
  • Ronald W. Thompson
    • 1
  • Kevin P. Haggerty
    • 2
  • James J. Snyder
    • 3
  1. 1.National Research Institute for Child and Family StudiesBoys TownUSA
  2. 2.Social Development Research GroupUniversity of WashingtonSeattleUSA
  3. 3.Department of PsychologyWichita State UniversityWichitaUSA

Personalised recommendations