Abstract
The Communities That Care (CTC) prevention system has shown effects on reducing incidence and prevalence of problem behaviors among a panel of youth followed from 5th through 12th grade. The present report examines whether similar intervention effects could be observed using a repeated cross-sectional design in the same study. Data were from a community-randomized trial of 24 US towns. Cross-sectional samples of sixth, eighth, and tenth graders were surveyed at four waves. Two-stage ANCOVA analyses estimated differences between CTC and control communities in community-level prevalence of problem behaviors for each grade, adjusting for baseline prevalence. No statistically significant reductions in prevalence of problem behaviors were observed at any grade in CTC compared to control communities. Secondary analyses examined intervention effects within a “pseudo cohort” where cross-sectional data were used from sixth graders at baseline and tenth graders 4 years later. When examining effects within the pseudo cohort, CTC compared to control communities showed a significantly slower increase from sixth to tenth grade in lifetime smokeless tobacco use but not for other outcomes. Exploratory analyses showed significantly slower increases in lifetime problem behaviors within the pseudo cohort for CTC communities with high, but not low, prevention program saturation compared to control communities. Although CTC demonstrated effects in a longitudinal panel from the same community-randomized trial, we did not find similar effects on problem behaviors using a repeated cross-sectional design. These differences may be due to a reduced ability to detect effects because of potential cohort effects, accretion of those who were not exposed, and attrition of those who were exposed to CTC programming in the repeated cross-sectional sample.
Similar content being viewed by others
References
Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors. The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.
Arthur, M. W., Ayers, C. D., Graham, K. A., & Hawkins, J. D. (2003). Mobilizing communities to reduce risks for drug abuse: A comparison of two strategies. In W. J. Bukowski & Z. Sloboda (Eds.), Handbook of drug abuse prevention: Theory, science and practice (pp. 129–144). New York: Kluwer Academic/Plenum Publishers.
Arthur, M. W., Glaser, R. R., & Hawkins, J. D. (2005). Steps towards community-level resilience: Community adoption of science-based prevention programming. In R. D. V. Peters, B. Leadbeater, & R. J. McMahon (Eds.), Resilience in children, families, and communities: Linking context to practice and policy (pp. 177–194). New York: Kluwer Academic/Plenum.
Arthur, M. W., Briney, J. S., Hawkins, J. D., Abbott, R. D., Brooke-Weiss, B. L., & Catalano, R. F. (2007). Measuring risk and protection in communities using the Communities That Care Youth Survey. Evaluation and Program Planning, 30, 197–211.
Brown, E. C., Hawkins, J. D., Arthur, M. W., Briney, J. S., & Abbott, R. D. (2007). Effects of Communities That Care on prevention services systems: Findings from the Community Youth Development Study at 1.5 years. Prevention Science, 8, 180–191.
Brown, E. C., Graham, J. W., Hawkins, J. D., Arthur, M. W., Baldwin, M. M., Oesterle, S., & Abbott, R. D. (2009). Design and analysis of the Community Youth Development Study longitudinal cohort sample. Evaluation Review, 33, 311–334.
Brown, E. C., Hawkins, J. D., Arthur, M. W., & Briney, J. S. (2011). Prevention service system transformation using Communities That Care. Journal of Community Psychology, 39, 183–201.
Brown, E. C., Hawkins, J. D., Rhew, I. C., Shapiro, V. B., Abbott, R. D., Oesterle, S., & Catalano, R. F. (2014). Prevention system mediation of Communities That Care effects on youth outcomes. Prevention Science, 15, 623–632.
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton-Mifflin.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. (2009). Translational research in action: Implementation of the Communities That Care prevention system in 12 communities. Journal of Community Psychology, 37, 809–829.
Fagan, A. A., Arthur, M. W., Hanson, K., Briney, J. S., & Hawkins, J. D. (2011). Effects of Communities That Care on the adoption and implementation fidelity of evidence-based prevention programs in communities: Results from a randomized controlled trial. Prevention Science, 12, 223–234.
Fagan, A. A., Hanson, K., Briney, J. S., & David Hawkins, J. (2012). Sustaining the utilization and high quality implementation of tested and effective prevention programs using the Communities That Care prevention system. American Journal of Community Psychology, 49, 365–377.
Feinberg, M. E., Jones, D., Greenberg, M. T., Osgood, D. W., & Bontempo, D. (2010). Effects of the Communities That Care model in Pennsylvania on change in adolescent risk and problem behaviors. Prevention Science, 11, 163–171.
Feng, Z., & Thompson, B. (2002). Some design issues in a community intervention trial. Controlled Clinical Trials, 23, 431–449.
Glaser, R. R., Van Horn, M. L., Arthur, M. W., Hawkins, J. D., & Catalano, R. F. (2005). Measurement properties of the Communities That Care (R) Youth Survey across demographic groups. Journal of Quantitative Criminology, 21, 73–102.
Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.
Hawkins, J. D., & Catalano, R. F. (2002). Investing in your community’s youth: An introduction to the Communities That Care system. South Deerfield, MA: Channing Bete Company.
Hawkins, J. D., Catalano, R. F., Arthur, M. W., Egan, E., Brown, E. C., Abbott, R. D., & Murray, D. M. (2008). Testing Communities That Care: The rationale, design and behavioral baseline equivalence of the Community Youth Development Study. Prevention Science, 9, 178–190.
Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., & Catalano, R. F. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics and Adolescent Medicine, 163, 789–798.
Hawkins, J. D., Oesterle, S., Brown, E. C., Monahan, K. C., Abbott, R. D., Arthur, M. W., & Catalano, R. F. (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the Communities That Care prevention system in a randomized trial. Archives of Pediatrics and Adolescent Medicine, 166, 141–148.
Hawkins, J. D., Oesterle, S., Brown, E. C., Abbott, R. D., & Catalano, R. F. (2014). Youth problem behaviors 8 years after implementing the Communities That Care prevention system. A community-randomized trial. JAMA Pediatrics, 168, 122–129.
Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford University Press.
Murray, D. M., Lee Van Horn, M., Hawkins, J. D., & Arthur, M. W. (2006). Analysis strategies for a community trial to reduce adolescent ATOD use: A comparison of random coefficient and ANOVA/ANCOVA models. Contemporary Clinical Trials, 27, 188–206.
Rhew, I. C., Brown, E. C., Hawkins, J. D., & Briney, J. S. (2013). Sustained effects of the Communities That Care system on prevention service system transformation. American Journal of Public Health, 103, 529–535.
Rubin, R. (1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
Sorensen, G., Stoddard, A. M., LaMontagne, A. D., Emmons, K., Hunt, M. K., Youngstrom, R., & Christiani, D. C. (2002). A comprehensive worksite cancer prevention intervention: Behavior change results from a randomized controlled trial (United States). Cancer Causes & Control, 13, 493–502.
Substance Abuse and Mental Health Services Administration--U.S. Department of Health and Human Services. (2007). Report to Congress: A Comprehensive Plan for Preventing and Reducing Underage Drinking.
Van Horn, M. L., Fagan, A. A., Hawkins, J. D., & Oesterle, S. (2014). Effects of the Communities That Care system on cross-sectional profiles of adolescent substance use and delinquency. American Journal of Preventive Medicine, 47, 188–197.
Acknowledgments
This work was supported by the National Institute on Drug Abuse (R01 DA015183), with co-funding from the National Cancer Institute, the National Institute of Child Health and Human Development, the National Institute of Mental Health, the Center for Substance Abuse Prevention, and the National Institute on Alcohol Abuse and Alcoholism. The content of this paper is solely the responsibility of the authors and does not necessarily represent the official views of the funding agencies.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Richard F. Catalano is a board member of Channing Bete Company and distributor of Supporting School Success® and Guiding Good Choices®. These programs were used in some communities in the study that produced the data set used in this paper. The other authors of this paper report no financial or other conflicts of interest.
Additional information
Dr. Murray’s work on this research began prior to his appointment to the National Institutes of Health
Rights and permissions
About this article
Cite this article
Rhew, I.C., Hawkins, J.D., Murray, D.M. et al. Evaluation of Community-Level Effects of Communities That Care on Adolescent Drug Use and Delinquency Using a Repeated Cross-Sectional Design. Prev Sci 17, 177–187 (2016). https://doi.org/10.1007/s11121-015-0613-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-015-0613-4