Effectiveness of Positive Youth Development Interventions: A Meta-Analysis of Randomized Controlled Trials
- 2.2k Downloads
Positive youth development is thought to be essential to the prevention of adolescent risk behavior and the promotion of thriving. This meta-analysis examined the effects of positive youth development interventions in promoting positive outcomes and reducing risk behavior. Ten databases and grey literature were scanned using a predefined search strategy. We included studies that focused on young people aged 10–19 years, implemented a positive youth development intervention, were outside school hours, and utilized a randomized controlled design. Twenty-four studies, involving 23,258 participants, met the inclusion criteria and were included in the analysis. The impact of the interventions on outcomes including behavioral problems, sexual risk behavior, academic achievement, prosocial behavior and psychological adjustment were assessed. Positive youth development interventions had a small but significant effect on academic achievement and psychological adjustment. No significant effects were found for sexual risk behaviors, problem behavior or positive social behaviors. Intervention effects were independent of program characteristics and participant age. Low-risk young people derived more benefit from positive youth development interventions than high-risk youth. The studies examined had several methodological flaws, which weakened the ability to draw conclusions. Substantial progress has been made in the theoretical understanding of youth development in the past two decades. This progress needs to be matched in the intervention literature, through the use of high-quality evaluation research of positive youth development programs.
KeywordsPositive youth development Sexual health Substance use Mental health Academic achievement Prosocial behavior Meta-analysis
OA, KG and AE conceived of the study. OA conducted the literature searches, data analysis and drafted the manuscript. KG participated in study design, statistical analysis, quality assessment and helped to draft the manuscript. KP contributed to study design, quality assessment and manuscript revision. AE participated in study design and co-ordination. All authors read and approved the final manuscript.
Conflicts of interest
The authors report no conflicts of interest.
As a review of previous research, this study did not directly involve the use of human participants or animals.
No specific ethical approval was sought in the production of this review.
Where relevant, authors of studies included in this review were contacted for permission to use their data and to seek unpublished data.
- References marked with an asterisk indicate studies included in the meta-analysis.Google Scholar
- Beinart, S., Anderson, B., Lee, S., & Utting, D. (2002). Youth at risk? A national survey of risk factors, protective factors and problem behaviour among young people in England, Scotland and Wales. London: Communities that Care.Google Scholar
- Bellis, M. A., Hughes, K., Calafat, A., Juan, M., Ramon, A., Rodriguez, J. A., et al. (2008). Sexual uses of alcohol and drugs and the associated health risks: A cross sectional study of young people in nine European cities. BMC Public Health, 8, 155. doi: 10.1186/1471-2458-8-155.PubMedPubMedCentralCrossRefGoogle Scholar
- Benson, P. L., Scales, P. C., Hamilton, S. F., & Semsa, A, Jr. (2006). Positive youth development: Theory, research, and applications. In W. Damon, R. M. Lerner, & R. M. Lerner (Eds.), Handbook of child psychology, Vol. 1: Theoretical models of human development (6th ed., pp. 894–941). Hoboken, NJ: Wiley.Google Scholar
- Beyers, J. M., Toumbourou, J. W., Catalano, R. F., Arthur, M. W., & Hawkins, J. D. (2004). A cross-national comparison of risk and protective factors for adolescent substance use: The United States and Australia. Journal of Adolescent Health, 35(1), 3–16. doi: 10.1016/j.jadohealth.2003.08.015.PubMedGoogle Scholar
- Biglan, A. (Ed.). (2004). Helping adolescents at risk: Prevention of multiple problem behaviors. New York: Guilford Press.Google Scholar
- *Bird, J. M. (2014). Evaluating the effects of a strengths-based, professional development intervention on adolescents’ academic, social, and emotional outcomes. (Unpublished doctoral thesis), University, of South Caroline, United States. Retrieved from University of South Caroline website http://scholarcommons.sc.edu/etd/2790/?utm_source=scholarcommons.sc.edu%2Fetd%2F2790&utm_medium=PDF&utm_campaign=PDFCoverPages.
- Bonell, C., Allen, E., Strange, V., Copas, A., Oakley, A., Stephenson, J., et al. (2005). The effect of dislike of school on risk of teenage pregnancy: Testing of hypotheses using longitudinal data from a randomised trial of sex education. Journal of Epidemiology and Community Health, 59(3), 223–230. doi: 10.1136/jech.2004.023374.PubMedPubMedCentralCrossRefGoogle Scholar
- *Bonell, C., Maisey, R., Speight, S., Purdon, S., Keogh, P., Wollny, I., et al. (2013). Randomized controlled trial of “teens and toddlers”: A teenage pregnancy prevention intervention combining youth development and voluntary service in a nursery. Journal of Adolescence, 36(5), 859–870. doi: 10.1016/j.adolescence.2013.07.005.PubMedCrossRefGoogle Scholar
- Bowers, E. P., Li, Y., Kiely, M. K., Brittian, A., Lerner, J. V., & Lerner, R. M. (2010). The five Cs model of positive youth development: A longitudinal analysis of confirmatory factor structure and measurement invariance. Journal of Youth and Adolescence, 39(7), 720–735. doi: 10.1007/s10964-010-9530-9.PubMedCrossRefGoogle Scholar
- Catalano, R. F., Berglund, M. L., Ryan, J. A., Lonczak, H. S., & Hawkins, J. D. (2004). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. The Annals of the American Academy of Political and Social Science, 591(1), 98–124. doi: 10.1177/0002716203260102.CrossRefGoogle Scholar
- Clarke, A. M., Hussein, Y., Morreale, S., Field, C. A., & Barry, M. M. (2015). What works in enhancing social and emotional skills development during childhood and adolescence? A review of the evidence on the effectiveness of school-based and out-of-school programmes in the UK. Retrieved from National University of Ireland Galway. https://aran.library.nuigalway.ie/handle/10379/4981.
- Cohen, J. (1988). Statistical power analysis for the behavioural sciences. Hillside. NJ: Lawrence Earlbaum Associates.Google Scholar
- Connell, C. M., Gilreath, T. D., & Hansen, N. B. (2009). A multiprocess latent class analysis of the co-occurrence of substance use and sexual risk behavior among adolescents. Journal of Studies on Alcohol and Drugs, 70(6), 943–951. doi: 10.15288/jsad.2009.70.943.PubMedPubMedCentralCrossRefGoogle Scholar
- Cross, A. B., Gottfredson, D. C., Wilson, D. M., Rorie, M., & Connell, N. (2009). The impact of after-school programs on the routine activities of middle-school students: Results from a randomized, controlled trial. Criminology & Public Policy, 8(2), 391–412. doi: 10.1111/j.1745-9133.2009.00555.x.CrossRefGoogle Scholar
- *Deane, K. L. (2012). Project K in black & white: A theory-driven & randomised controlled trial evaluation of a youth development programme (Unpublished doctoral thesis) University of Auckland, New Zealand. Retrieved from University of Auckland website https://researchspace.auckland.ac.nz/handle/2292/19753.
- Degenhardt, L., Chiu, W. T., Sampson, N., Kessler, R. C., Anthony, J. C., Angermeyer, M., et al. (2008). Toward a global view of alcohol, tobacco, cannabis, and cocaine use: Findings from the WHO World Mental Health Surveys. PLoS Med, 5(7), e141. doi: 10.1371/journal.pmed.0050141.PubMedPubMedCentralCrossRefGoogle Scholar
- Department of Health (2011). Abortion statistics, England and Wales: 2010. Retrieved from https://www.gov.uk/government/statistics/abortion-statistics-england-and-wales-2010.
- Dickson, K., Vigurs, C. A., & Newman, M. (2013). Youth work: A systematic map of the research literature. Dublin, Department of Children and Youth Affairs. Retrieved from http://www.drugs.ie/resourcesfiles/ResearchDocs/Ireland/2013/SystematicMapping.pdf.
- *Dolan, P., Brady, B., O’Regan, C., Russell, D., Canavan, J., & Forkan, C. (2011). Big brothers big sisters of Ireland: Evaluation study: Report one: Randomised controlled trial and implementation report. Child and Family Research Centre, University of Galway, Foroige. Retrieved from http://www.foroige.ie/sites/default/files/big_brother_big_sister_report_3.pdf.
- Dryfoos, J. (1990). Adolescents at risk: Prevalence and prevention. New York: Oxford University Press.Google Scholar
- DuRant, R. H., Smith, J. A., Kreiter, S. R., & Krowchuk, D. P. (1999). The relationship between early age of onset of initial substance use and engaging in multiple health risk behaviors among young adolescents. Archives of Pediatrics and Adolescent Medicine, 153(3), 286–291. doi: 10.1001/archpedi.153.3.286.PubMedCrossRefGoogle Scholar
- Durlak, J. A., & Weissberg, R. P. (2007). The impact of after-school programs that promote personal and social skills. Chicago, Illinois: Collaborative for Academic, Social, and Emotional Learning. Retrieved from http://www.uwex.edu/ces/4h/afterschool/partnerships/documents/ASP-Full.pdf.
- Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432. doi: 10.1111/j.1467-8624.2010.01564.x.PubMedCrossRefGoogle Scholar
- Eaton, D., Kann, L., Kinchen, S., Ross, J., Hawkins, J., Harris, W.A., Lowry, R., McManus, T., Chyen, D., Shanklin, S., Lim, C., Grunbaum, J.A., & Weschler, H. (2006). Youth risk behavior surveillance—United States 2005. Morbidity & Mortality Weekly Report 55(SS05), 1–108. Retrieved from Centers for Disease Prevention. https://www.cdc.gov/mmwr/preview/mmwrhtml/ss5505a1.htm.
- Emler, N. (2001). Self esteem: The costs and causes of low self worth. York, York Publishing Services. Retrieved from https://www.jrf.org.uk/report/self-esteem-costs-and-causes-low-self-worth.
- *Feinberg, M. E., Solmeyer, A. R., Hostetler, M. L., Sakuma, K. L., Jones, D., & McHale, S. M. (2013). Siblings are special: Initial test of a new approach for preventing youth behavior problems. Journal of Adolescent Health, 53(2), 166–173. doi: 10.1016/j.jadohealth.2012.10.004.PubMedCrossRefGoogle Scholar
- Fergusson, D. M., Horwood, L. J., & Ridder, E. M. (2007). Conduct and attentional problems in childhood and adolescence and later substance use, abuse and dependence: Results of a 25-year longitudinal study. Drug and Alcohol Dependence, 88, S14–S26. doi: 10.1016/j.drugalcdep.2006.12.011.PubMedCrossRefGoogle Scholar
- Flory, K., Lynam, D., Milich, R., Leukefeld, C., & Clayton, R. (2004). Early adolescent through young adult alcohol and marijuana use trajectories: Early predictors, young adult outcomes, and predictive utility. Development and Psychopathology, 16(01), 193–213. doi: 10.1017/S0954579404044475.PubMedCrossRefGoogle Scholar
- Gavin, L. E., Catalano, R. F., David-Ferdon, C., Gloppen, K. M., & Markham, C. M. (2010). A review of positive youth development programs that promote adolescent sexual and reproductive health. Journal of Adolescent Health, 46(3), S75–S91. doi: 10.1016/j.jadohealth.2009.11.215.PubMedCrossRefGoogle Scholar
- *Grossman, J. B., & Sipe, C. L. (1992). Summer Training and Education Program (STEP): Report on long-term impacts. Retrieved from http://ppv.issuelab.org/resource/report_on_long_term_impacts_step_program.
- Gunning, N., Jotangia, D., Nicholson, S., Ogunbadejo, T., Reilly, N., Simmonds, N., et al. (2010). Smoking, drinking and drug use among young people in England in 2009. London: Information Centre for Health and Social Care.Google Scholar
- *Hahn, A., Leavitt T., & Aaron P. (1994). Evaluation of the Quantum Opportunities Program (QOP). Did the program work? A report on the post secondary outcomes and cost-effectiveness of the QOP program (1989–1993). Retrieved from http://files.eric.ed.gov/fulltext/ED385621.pdf.
- Harden, A., Brunton, G., Fletcher, A., Oakley, A., Burchett, H., & Backhans, M. (2006). Young people, pregnancy and social exclusion: A systematic synthesis of research evidence to identify effective, appropriate and promising approaches for prevention and support. London: Institute of Education.Google Scholar
- Higgins, J. P., & Green, S. (Eds.). (2009). Cochrane handbook for systematic reviews of interventions (Vol. 5.0.2). Chichester: Wiley-Blackwell.Google Scholar
- HM Government (2010). Positive for youth: A new approach to cross-government policy for young people aged 13–19. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/175496/DFE-00133-2011.pdf.
- Hoffman, S. D., & Maynard, R. A. (2008). Kids having kids: Economic costs and social consequences of teen pregnancy. Washington DC: The Urban Institute.Google Scholar
- *Karcher, M. J., Davis, C, I. I. I., & Powell, B. (2002). The effects of developmental mentoring on connectedness and academic achievement. School Community Journal, 12(2), 35–50.Google Scholar
- *Komro, K. A., Perry, C. L., Veblen-Mortenson, S., Farbakhsh, K., Toomey, T. L., Stigler, M. H., et al. (2008). Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction, 103(4), 606–618. doi: 10.1111/j.1360-0443.2007.02110.x.PubMedPubMedCentralCrossRefGoogle Scholar
- Komro, K. A., Perry, C. L., Williams, C. L., Stigler, M. H., Farbakhsh, K., & Veblen-Mortenson, S. (2001). How did Project Northland reduce alcohol use among young adolescents? Analysis of mediating variables. Health Education Research, 16(1), 59–70. doi: 10.1093/her/16.1.59.PubMedCrossRefGoogle Scholar
- Lerner, R. M. (2006). Developmental science, developmental systems, and contemporary theories. In W. Damon, R. M. Lerner, & R. M. Lerner (Eds.), Handbook of child psychology, Vol. 1: Theoretical models of human development (6th ed., pp. 1–17). Hoboken, NJ: Wiley.Google Scholar
- Lipsey, m W, & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: Sage publications.Google Scholar
- *Maxfield, M., Castner, L., Maralani, V., & Vencill, M. (2003). The Quantum Opportunity Program Demonstration: Implementation findings. Washington, DC: Mathematica Policy Research Inc.Google Scholar
- Maynard, R. A. (1996). Kids having kids: A special report on the cost of adolescent childbearing. New York: Robin Wood Foundation.Google Scholar
- McVie, S., & Bradshaw, P. (2005). Adolescent smoking, drinking and drug use. Centre for Law and Society: University of Edinburgh.Google Scholar
- Morton, M., & Montgomery, P. (2011). Youth empowerment programs for improving self-efficacy and self-esteem of adolescents. Campbell Systematic Reviews, 7, 5.Google Scholar
- National Youth Agency (2007). The NYA Guide to Youth Work in England. Leicester: National Youth Agency. Retrieved from http://www.nya.org.uk/wp-content/uploads/2014/06/The_NYA_Guide_to_Youth_Work_and_Youth_Services.pdf.
- O’Donnell, L., San Doval, A., Duran, R., Haber, D., Atnafou, R., Piessens, P., et al. (2003). Reach for health: A school sponsored community youth service intervention for middle school students. Los Altos, CA: Sociometrics.Google Scholar
- *O’Donnell, L., Stueve, A., O’Donnell, C., Duran, R., San Doval, A., Wilson, R., et al. (2002). Long-term reductions in sexual initiation and sexual activity among urban middle schoolers in the Reach for Health service learning program. Journal of Adolescent Health, 31(1), 93–100. doi: 10.1016/S1054-139X(01)00389-5.PubMedCrossRefGoogle Scholar
- O’Connell, M. E., Boat, T., & Warner, K. E. (Eds.). (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington: National Academies Press.Google Scholar
- O’Donnell, L., Stueve, A., San Doval, A., Duran, R., Haber, D., Atnafou, R., et al. (1999). The effectiveness of the Reach for Health Community Youth Service learning program in reducing early and unprotected sex among urban middle school students. American Journal of Public Health, 89(2), 176–181. doi: 10.2105/AJPH.89.2.176.PubMedPubMedCentralCrossRefGoogle Scholar
- Parsonage, M. (2009). Diversion: A better way for criminal justice and mental health. London: Sainsbury Centre for Mental Health.Google Scholar
- Perry, C. L., Williams, C. L., Komro, K. A., Veblen-Mortenson, S., Forster, J. L., Bernstein-Lachter, R., et al. (2000). Project Northland high school interventions: Community action to reduce adolescent alcohol use. Health Education & Behavior, 27(1), 29–49. doi: 10.1177/109019810002700105.CrossRefGoogle Scholar
- Perry, C. L., Williams, C. L., Komro, K. A., Veblen-Mortenson, S., Stigler, M. H., Munson, K. A., et al. (2002). Project Northland: Long-term outcomes of community action to reduce adolescent alcohol use. Health Education Research, 17(1), 117–132. doi: 10.1093/her/17.1.117.PubMedCrossRefGoogle Scholar
- *Perry, C. L., Williams, C. L., Veblen-Mortenson, S., Toomey, T. L., Komro, K. A., Anstine, P. S., et al. (1996). Project Northland: Outcomes of a communitywide alcohol use prevention program during early adolescence. American Journal of Public Health, 86(7), 956–965. doi: 10.2105/AJPH.86.7.956.PubMedPubMedCentralCrossRefGoogle Scholar
- Pettit, G. S., Laird, R. D., Bates, J. E., & Dodge, K. A. (1997). Patterns of after-school care in middle childhood: Risk factors and developmental outcomes. Merrill-Palmer Quarterly, 1982, 515–538.Google Scholar
- *Philliber, S., Kaye, J., & Herrling, S. (2001). The national evaluation of the Children’s Aid Society Carrera-Model Program to prevent teen pregnancy. Accord, NY: Philliber Research Associates.Google Scholar
- Philliber, S., Kaye, J. W., Herrling, S., & West, E. (2002). Preventing pregnancy and improving health care access among teenagers: An evaluation of the Children’s Aid Society-Carrera Program. Perspectives on Sexual and Reproductive Health, 34(5), 244–251. doi: 10.2307/3097823.PubMedCrossRefGoogle Scholar
- Qiao, C., & McNaught, H. (2007). Evaluation of project K. Retrieved from Ministry of Social Development website http://thehub.superu.govt.nz/sites/default/files/40181_project_k_0.pdf.
- Rodríguez-Planas, N. (2010). Longer-term impacts of mentoring, educational services, and incentives to learn: Evidence from a randomized trial in the United States. Bonn, Institute for the Stud of Labor. Retrieved from ftp.iza.org/dp4754.pdf.
- Schirm, A., & Rodriguez-Planas, N. (2004). The Quantum Opportunity Program demonstration: Initial post-intervention impacts. Washington, DC: Mathematica Policy Research Inc.Google Scholar
- Schirm, A., Rodriguez-Planas, N., Maxfield, M., & Tuttle, C. (2003). The Quantum Opportunity Program demonstration: Short-term impacts. Washington, DC: Mathematica Policy Research Inc.Google Scholar
- Scottish Government. (2009). Valuing Young people: Principles and connections to support young people achieve their potential. Edinburgh: Scottish Government.Google Scholar
- Shepherd, J., Kavanagh, J., Picot, J., Cooper, K., Harden, A., Barnett-Page, E., et al. (2010). The effectiveness and cost-effectiveness of behavioural interventions for the prevention of sexually transmitted infections in young people aged 13–19: A systematic review and economic evaluation. Health Technology Assessment, 14(7), 1–230. doi: 10.3310/hta14070.CrossRefGoogle Scholar
- Tierney, J.P., Grossman, J., & Resch, N. (1995). Making a difference: An impact study of big brother big sisters. Philadephia, CA, Public/Private Ventures. Retrieved from http://www.ppv.org/ppv/publications/assets/111_publication.pdf.
- Tolan, P. H., Guerra, N. G., & Kendall, P. C. (1995). A developmental-ecological perspective on anti-social behaviour in children and adolescents: Toward a unified risk and intervention framework. Journal of Consulting and Clinical Psychology, 63(4), 579–584. doi: 10.1037/0022-006X.63.4.579.PubMedCrossRefGoogle Scholar
- Trenholm, C., Devaney, B., Fortson, K., Clark, M., Quay, L., & Wheeler, J. (2008). Impacts of abstinence education on teen sexual activity, risk of pregnancy, and risk of sexually transmitted diseases. Journal of Policy Analysis and Management, 27(2), 255–276. doi: 10.1002/pam.20324.PubMedCrossRefGoogle Scholar
- *Trenholm, C., Devaney, B., Fortson, K., Quay, K., Wheeler, J., & Clark, M. (2007). Impacts of Four Title V, Section 510 Abstinence Education Programs. Final Report. Department of Health and Human Services, US, Mathematica Policy Research, Inc.Google Scholar
- Walker G., & Vilella-Velez, F (1992). Testing the model. In: Anatomy of a demonstration: The Summer Training and Education Program (STEP) from pilot through replication and post program impacts. Philadelphia, PA: Public/Private Ventures.Google Scholar
- Walker G., & Vilella-Velez, F. (1992). Long-term impacts. In: Anatomy of a demonstration: The Summer Training and Education Program (STEP) from pilot through replication and post program impacts. Philadelphia, PA: Public/Private Ventures.Google Scholar
- World Health Organisation. (2014). Global status report on health and alcohol. Geneva: Switzerland, World Health Organization.Google Scholar