Abstract
Increasing attention to the evaluation, dissemination, and implementation of evidence-based programs (EBPs) has led to significant advancements in the science of community-based violence prevention. One of the prevailing challenges in moving from science to community involves implementing EBPs and strategies with quality. The CDC-funded National Centers of Excellence in Youth Violence Prevention (YVPCs) partner with communities to implement a comprehensive community-based strategy to prevent violence and to evaluate that strategy for impact on community-wide rates of violence. As part of their implementation approach, YVPCs document implementation of and fidelity to the components of the comprehensive youth violence prevention strategy. We describe the strategies and methods used by the six YVPCs to assess implementation and to use implementation data to inform program improvement efforts. The information presented describes the approach and measurement strategies employed by each center and for each program implemented in the partner communities. YVPCs employ both established and innovative strategies for measurement and tracking of implementation across a broad range of programs, practices, and strategies. The work of the YVPCs highlights the need to use data to understand the relationship between implementation of EBPs and youth violence outcomes.
Similar content being viewed by others
References
National Research Council. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, DC: The National Academies Press.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350.
Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5(1), 47–53.
Matjasko, J. L., Massetti, G. M., & Bacon, S. (2016). Implementing and evaluating comprehensive evidence-based approaches to youth violence prevention: Partnering to create communities where youth are safe from violence. The Journal of Primary Prevention (accepted).
Kingston, B., Bacallao, M., Smokowski, P., Sullivan, T., & Sutherland, K. (2016). Constructing “Packages” of evidence-based programs to prevent youth violence: Processes and illustrative examples from the CDC’s Youth Violence Prevention Centers. The Journal of Primary Prevention (accepted).
Webster, D. W., Whitehill, J. M., Vernick, J. S., & Curriero, F. C. (2013). Effects of Baltimore’s Safe Streets Program on gun violence: A replication of Chicago’s CeaseFire Program. Journal of Urban Health, 90(1), 27–40.
Reischl, T. M., Krusky, A. M., Zimmerman, A. M., Aiyer, S. M., Kruger, D. J., Franzen, S. P., & Lipton, R. (2015). Assessing physical disorder in urban neighborhoods: Reliability and validity of the Parcel Maintenance Observation Tool. Journal of Community Psychology, 44, 7–21.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.
Horner, R. H., Todd, A. W., Lewis-Palmer, T., Irvin, L. K., Sugai, G., & Boland, J. B. (2004). The school-wide evaluation tool (SET): A research instrument for assessing school-wide positive behavior support. Journal of Positive Behavior Interventions, 6(1), 3–12.
Debnam, K. J., Pas, E. T., & Bradshaw, C. P. (2012). Secondary and tertiary support systems in schools implementing school-wide positive behavioral interventions and supports: A preliminary descriptive analysis. Journal of Positive Behavior Interventions, 14(3), 142–152.
Tolan, P., Gorman-Smith, D., & Henry, D. (2004). Supporting families in a high-risk setting: proximal effects of the SAFEChildren preventive intervention. Journal of Consulting and Clinical Psychology, 72(5), 855–869.
Pierson, H. M., Hayes, S. C., Gifford, E. V., Roget, N., Padilla, M., Bissett, R., et al. (2007). An examination of the motivational interviewing treatment integrity code. Journal of Substance Abuse Treatment, 32(1), 11–17.
Kruger, D. J., Reischl, T. M., & Gee, G. C. (2007). Neighborhood social conditions mediate the association between physical deterioration and mental health. American Journal of Community Psychology, 40(3–4), 261–271.
Reischl, T. M., Zimmerman, M. A., Morrel-Samuels, S., Franzen, S. P., Faulk, M., Eisman, A. B., & Roberts, E. (2011). Youth empowerment solutions for violence prevention. Adolescent Medicine: State of the Art Reviews, 22(3), 581–600.
Howard Caldwell, C., Antonakos, C. L., Assari, S., Kruger, D., De Loney, E. H., & Njai, R. (2014). Pathways to prevention: Improving nonresident African American fathers’ parenting skills and behaviors to reduce sons’ aggression. Child Development, 85(1), 308–325.
Cunningham, R. M., Chermack, S. T., Zimmerman, M. A., Shope, J. T., Bingham, C. R., Blow, F. C., & Walton, M. A. (2012). Brief motivational interviewing intervention for peer violence and alcohol use in teens: One-year follow-up. Pediatrics, 129(6), 1083–1090.
Bauer, N. S., Lozano, P., & Rivara, F. P. (2007). The effectiveness of the Olweus Bullying Prevention Program in public middle schools: A controlled trial. Journal of Adolescent Health, 40(3), 266–274.
Olweus, D., & Limber, S. P. (2010). Bullying in school: evaluation and dissemination of the Olweus Bullying Prevention Program. American Journal of Orthopsychiatry, 80(1), 124–134.
Haggerty, K. P., Skinner, M. L., MacKenzie, E. P., & Catalano, R. F. (2007). A randomized trial of Parents Who Care: Effects on key outcomes at 24-month follow-up. Prevention Science, 8(4), 249–260.
Kacir, C. D., & Gordon, D. A. (2000). Parenting adolescents wisely: The effectiveness of an interactive videodisk parent training program in Appalachia. Child Fam Behavior Therapy, 21(4), 1–22.
Bright, C. L., Young, D. W., Bessaha, M. L., & Falls, B. J. (2015). Perceptions and outcomes following teen court involvement. Social Work Research, 39(3), 135–146.
Bavarian, N., Lewis, K. M., Dubois, D. L., Acock, A., Vuchinich, S., Silverthorn, N., et al. (2013). Using social-emotional and character development to improve academic outcomes: A matched-pair, cluster-randomized controlled trial in low-income, urban schools. Journal of School Health, 83(11), 771–779.
Beets, M. W., Flay, B. R., Vuchinich, S., Snyder, F. J., Acock, A., Li, K. K., et al. (2009). Use of a social and character development program to prevent substance use, violent behaviors, and sexual activity among elementary-school students in Hawaii. American Journal of Public Health, 99(8), 1438–1445.
Waasdorp, T. E., Bradshaw, C. P., & Leaf, P. J. (2012). The impact of schoolwide positive behavioral interventions and supports on bullying and peer rejection: A randomized controlled effectiveness trial. Archives of Pediatrics and Adolescent Medicine, 166(2), 149–156.
Lochman, J. E., & Wells, K. C. (2004). The coping power program for preadolescent aggressive boys and their parents: Outcome effects at the 1-year follow-up. Journal of Consulting and Clinical Psychology, 72(4), 571–578.
Hawkins, J. D., Oesterle, S., Brown, E. C., Monahan, K. C., Abbott, R. D., Arthur, M. W., & Catalano, R. F. (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the communities that care prevention system in a randomized trial. Archives of Pediatrics and Adolescent Medicine, 166(2), 141–148.
Crean, H. F., & Johnson, D. B. (2013). Promoting Alternative Thinking Strategies (PATHS) and elementary school aged children’s aggression: Results from a cluster randomized trial. American Journal of Community Psychology, 52(1–2), 56–72.
Van Ryzin, M. J., & Dishion, T. J. (2012). The impact of a family-centered intervention on the ecology of adolescent antisocial behavior: Modeling developmental sequelae and trajectories during adolescence. Development and Psychopathology, 24(3), 1139–1155.
Spoth, R. L., Trudeau, L., Guyll, M., Shin, C., & Redmond, C. (2009). Universal intervention effects on substance use among young adults mediated by delayed adolescent substance initiation. Journal of Consulting and Clinical Psychology, 77(4), 620–632.
Funding
The activities described were supported by the National Centers of Excellence in Youth Violence Prevention Program funded by the Centers for Disease Control and Prevention under Funding Opportunity Announcement CE10-004, Cooperative Agreement Program for the National Academic Centers of Excellence in Youth Violence Prevention. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Massetti, G.M., Holland, K.M. & Gorman-Smith, D. Implementation Measurement for Evidence-Based Violence Prevention Programs in Communities. J Community Health 41, 881–894 (2016). https://doi.org/10.1007/s10900-016-0156-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10900-016-0156-z