Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Evaluation of a Whole-School Change Intervention: Findings from a Two-Year Cluster-Randomized Trial of the Restorative Practices Intervention

Abstract

This study fills a gap in research on multi-level school-based approaches to promoting positive youth development and reducing bullying, in particular cyberbullying, among middle school youth. The study evaluates the Restorative Practices Intervention, a novel whole-school intervention designed to build a supportive environment through the use of 11 restorative practices (e.g., communication approaches that aim to build stronger bonds among leadership, staff, and students such as using “I” statements, encouraging students to express their feelings) that had only quasi-experimental evidence prior to this study. Studying multilevel (e.g., individual, peer group, school) approaches like the Restorative Practices Intervention is important because they are hypothesized to address a more complex interaction of risk factors than single level efforts, which are more common. Baseline and two-year post survey data was collected from 2771 students at 13 middle schools evenly split between grades 6 (48 percent) and 7 (52 percent), and primarily ages 11 (38 percent) or 12 (41 percent). Gender was evenly split (51 percent male), and 92 percent of students were white. The intervention did not yield significant changes in the treatment schools. However, student self-reported experience with restorative practices significantly predicted improved school climate and connectedness, peer attachment, and social skills, and reduced cyberbullying victimization. While more work is needed on how interventions can reliably produce restorative experiences, this study suggests that the restorative model can be useful in promoting positive behaviors and addressing bullying.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3

References

  1. Acosta, J. (2003). The effects of cultural differences on peer group relationships. Journal of Prevention and Intervention in the Community, 25(2), 13–26.

  2. Acosta, J. D., Chinman, M., Ebener, P., Phillips, A., Xenakis, L., & Malone, P. S. (2016). A cluster-randomized trial of restorative practices: an illustration to spur high-quality research and evaluation. Journal of Educational and Psychological Consultation, 26(4), 413–430.

  3. Act, E. S. S. (2015). of 2015, Pub. L No. 114–95.

  4. Anderman, E. M. (2002). School effects on psychological outcomes during adolescence. Journal of Educational Psycholgoy, 94, 795–809.

  5. Arango, A., Cole-Lewis, Y., Lindsay, R., Yeguez, C. E., Clark, M., & King, C. (2018). The protective role of connectedness on depression and suicidal ideation among bully victimized youth. Journal of Clinical Child and Adolescent Psychology, 22, 1–12.

  6. Arthur, M. W., Briney, J. S., Hawkins, J. D., Abbott, R. D., Brooke-Weiss, B. L., & Catalano, R. F. (2007). Measuring risk and protection in communities using the communities that care youth survey. Evaluation and Program Planning, 30(2), 197–211.

  7. Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, Jr, A. J. (2002). Measuring risk and protective factors for use, delinquency, and other adolescent problem behaviors: the communities that care youth survey. Evaluation Review, 26(6), 575–601.

  8. Ashworth, J., Van Bockern, S., Ailts, J., Donnelly, J., Erickson, K., & Woltermann, J. (2008). The restorative justice center: an alternative to school detention. Reclaiming Children and Youth, 17(3), 22.

  9. Astor, R. A., Benbenishty, R., & Estrada, J. N. (2009). School violence and theoretically atypical schools: the principal’s centrality in orchestrating safe schools. American Educational Research Journal, 46(2), 423–461.

  10. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B, 57, 289–300.

  11. Benner, A. D., Graham, S., & Mistry, R. S. (2008). Discerning direct and mediated effects of ecological structures and processes on adolescents’ educational outcomes. Developmental Psychology, 44(3), 840.

  12. Bradshaw, C. P., Reinke, W. M., Brown, L. D., Bevans, K. B., & Leaf, P. J. (2008). Implementation of school-wide positive behavioral interventions and supports (PBIS) in elementary schools: observations from a randomized trial. Education and Treatment of Children, 31(1), 1–26.

  13. Brand, S., Felner, R., Shim, M., Seitsinger, A., & Dumas, T. (2003). Middle school improvement and reform: Development and validation of a school-level assessment of climate, cultural pluralism, and school safety. Journal of Educational Psychology, 95(3), 570–588.

  14. Bronfenbrenner, U. (2005). Ecological systems theory. In U. Bronfenbrenner (Ed.), Making human beings human: Bioecological perspectives on human development (pp. 106–173). Thousand Oaks, CA: Sage Publications Ltd.

  15. Catalano, R. F., Berglund, M. L., Ryan, J. A., Lonczak, H. S., & Hawkins, J. D. (2002). Positive youth development in the United States: research findings on evaluations of positive youth development programs. Prevention and Treatment, 5(1), 15a.

  16. Catalano, R. F., Gavin, L. E., & Markham, C. M. (2010). Future directions for positive youth development as a strategy to promote adolescent sexual and reproductive health. Journal of Adolescent Health, 46(3), S92–S96.

  17. De Laet, S., Colpin, H., Vervoort, E., Doumen, S., Van Leeuwen, K., Goossens, L., & Verschueren, K. (2015). Developmental trajectories of children’s behavioral engagement in late elementary school: both teachers and peers matter. Developmental Psychology, 51(9), 1292.

  18. Duggins, S. D., Kuperminc, G. P., Henrich, C. C., Smalls-Glover, C., & Perilla, J. L. (2016). Aggression among adolescent victims of school bullying: protective roles of family and school connectedness. Psychology of Violence, 6(2), 205.

  19. Dulmus, C. N., Theriot, M. T., Sowers, K. M., & Blackburn, J. A. (2004). Student reports of peer bullying victimization in a rural school. Stress Trauma and Crisis, 7(1), 1–16.

  20. Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412.

  21. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: a meta‐analysis of school‐based universal interventions. Child Development, 82(1), 405–432.

  22. Espelage, D. L. (2018). Section 3 introduction: bullying, sexual violence, and suicide in education. In H. Shapiro (Ed.) The Wiley Handbook on Violence in Education: Forms, Factors, and Preventions. (pp. 321–326).

  23. Farrington, D. P., & Ttofi, M. M. (2009). School-based programs to reduce bullying and victimization. The Campbell Collaboration, 6, 1–149.

  24. Frydenberg, E., Care, E., Chan, E., & Freeman, E. (2009). Interrelationships between coping, school connectedness and wellbeing Erica Frydenberg. Australian Journal of Education, 53(3), 261–276.

  25. Gregory, A., Cornell, D., Fan, X., Sheras, P., Shih, T. H., & Huang, F. (2010). Authoritative school discipline: High school practices associated with lower bullying and victimization. Journal of Educational Psychology, 102(2), 483.

  26. Gresham, F. M., & Elliot, S. N. (1990). Manual for the social skills rating system. Circle Pines, MN: American Guidance Service.

  27. Gresham, F. M., Elliott, S. N., & Kettler, R. J. (2010). Base rates of social skills acquisition/performance deficits, strengths, and problem behaviors: an analysis of the Social Skills Improvement System—Rating Scales. Psychological Assessment, 22(4), 809.

  28. Hamilton, M. V. (2008). Restorative justice: reconceptualizing school disciplinary theory and practice. University of the Pacific.

  29. Higgins, E. T. (1987). Self-discrepancy: a theory relating self and affect. Psychological Review, 94(3), 319–340.

  30. Kelley, K. (2017). The MBESS R package. https://cran.r-project.org/web/packages/MBESS/MBESS.pdf

  31. Konishi, C., Miyazaki, Y., Hymel, S., & Waterhouse, T. (2017). Investigating associations between school climate and bullying in secondary schools: Multilevel contextual effects modeling. School Psychology International, 38(3), 240–263.

  32. Lerner, M., Lerner, J. V. & Benson, J. B. (Eds.) (2011). Advances in child development and behavior (pp. 195–228). London: Elsevier. Vol. 41.

  33. Little, R. J., & Rubin, D. B. (1989). The analysis of social science data with missing values. Sociological Methods and Research, 18, 292–326.

  34. Low, S., & Van Ryzin, M. (2014). The moderating effects of school climate on bullying prevention efforts. School Psychology Quarterly, 29(3), 306.

  35. McCold, P. (2008). Evaluation of a restorative milieu: Restorative practices in context. In H. Ventura Miller (Ed.) Restorative justice: From theory to practice (pp. 99–137). Bingley, UK: Emerald Group Publishing Limited.

  36. McCold, P., & Wachtel, T. (2002). Restorative justice theory validation. In: E. Weitekamp, H.-J. Kerner (Eds.) Restorative justice: Theoretical foundations (pp. 110–142). Devon, UK: Willan Publishing.

  37. McDonald, R. P. (1999). Test theory: a unified treatment. Mahwah, NJ: Lawrence Erlbaum.

  38. McNeely, C. A., Nonnemaker, J. M., & Blum, R. W. (2002). Promoting school connectedness: evidence from the national longitudinal study of adolescent health. Journal of School Health, 72(4), 138–146.

  39. Merrell, K. W., Gueldner, B. A., Ross, S. W., & Isava, D. M. (2008). How effective are school bullying intervention programs? A meta-analysis of intervention research. School Psychology Quarterly, 23(1), 26–42.

  40. Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide. Los Angeles: Muthén & Muthén.

  41. O Brennan, L. M., & Furlong, M. J. (2010). Relations between students’ perceptions of school connectedness and peer victimization. Journal of School Violence, 9(4), 375–391.

  42. Overton, W. F. (2006). Developmental psychology: philosophy, concepts, methodology. In W. Damon & R. M. Lerner (Eds), Handbook of Child Psychology: theoretical models of human development (pp. 18–88). Hoboken, NJ: John Wiley.

  43. Peleg-Oren, N., Cardenas, G. A., Comerford, M., & Galea, S. (2012). An association between bullying behaviors and alcohol use among middle school students. The Journal of Early Adolescence, 32(6), 761–775.

  44. R Core Team. (2017). R. https://cran.r-project.org/

  45. Ringwalt, C. L., Clark, H. K., Hanley, S., Shamblen, S. R., & Flewelling, R. L. (2009). Project ALERT: a cluster randomized trial. Archives of Pediatrics and Adolescent Medicine, 163(7), 625–632.

  46. Rudasill, K. M., Reio, T. G., Stipanovic, N., & Taylor, J. E. (2010). A longitudinal study of student–teacher relationship quality, difficult temperament, and risky behavior from childhood to early adolescence. Journal of School Psychology, 48(5), 389–412.

  47. Sallis, J. F., Owen, N., & Fisher, E. (2015). Ecological models of health behavior. Health Behavior: Theory, Research, and Practice, 5, 43–64.

  48. Salmivalli, C. (2010). Bullying and the peer group: a review. Aggression and Violent Behavior, 15(2), 112–120.

  49. SAS Institute, Inc. (2016). SAS software. Cary, NC: SAS Institute.

  50. Taylor, R. D., Oberle, E., Durlak, J. A., & Weissberg, R. P. (2017). Promoting positive youth development through school‐based social and emotional learning interventions: a meta‐analysis of follow‐up effects. Child Development, 88(4), 1156–1171.

  51. Thapa, A., Cohen, J., Guffey, S., & Higgins-D’Alessandro, A. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385.

  52. Tharp-Taylor, S., Haviland, A., & D’Amico, E. J. (2009). Victimization from mental and physical bullying and substance use in early adolescence. Addictive Behaviors, 34(6-7), 561–567.

  53. Thornberg, R., Wänström, L., Pozzoli, T., & Gini, G. (2018). Victim prevalence in bullying and its association with teacher–student and student–student relationships and class moral disengagement: a class-level path analysis. Research Papers in Education, 33(3), 320–335.

  54. Ttofi, M. M., & Farrington, D. P. (2008a). Bullying: short-term and long-term effects, and the importance of defiance theory in explanation and prevention. Victims and Offenders, 3(2), 289–312.

  55. Ttofi, M. M., & Farrington, D. P. (2008b). Reintegrative shaming theory, moral emotions and bullying. Aggressive Behavior, 34(4), 352–368.

  56. U.S. Department of Education. (2011). Average daily attendance (ADA) as a percentage of total enrollment, school day length, and school year length in public schools, by school level and state: 2003-04 and 2007-08, Digest of Education Statistics, Schools and Staffing Survey, Table 43. Washington, DC: Government printing office.

  57. U.S. Department of Education. (2012). Digest of Education Statistics, National Center for Education Statistics, Common Core Data Set, Table 46. Washington, DC: Government printing office.

  58. Vaz, S., Parsons, R., Passmore, A. E., Andreou, P., & Falkmer, T. (2013). Internal consistency, test–retest reliability and measurement error of the self-report version of the Social Skills Rating System in a sample of Australian adolescents. PloS One, 8(9), e73924.

  59. Weare, K. (2015). What works in promoting social and emotional well-being and responding to mental health problems in schools. London: National Children’s Bureau.

  60. Weatherson, K. A., O’Neill, M., Lau, E. Y., Qian, W., Leatherdale, S. T., & Faulkner, G. E. (2018). The protective effects of school connectedness on substance use and physical activity. Journal of Adolescent Health, 63(6), 724–731.

  61. Young, K. R. et al. (2009). The Effects of School-Wide Positive Behavior Support on School Climate: A Middle School Logitudinal Study. Presented on July 29 at the Office of Special Education Programs teacher education and professional development conference. Washington DC: US Department of Education.

  62. Yuan, K. H., & Bentler, P. M. (2000). Three likelihood‐based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30, 165–200.

Download references

Authors’ Contributions:

J.A. conceived of the study, participated in its design and coordination and drafted the manuscript; M.C. and P.E. participated in the design and interpretation of the data; P.M. and A.W. participated in the design of the study and performed the statistical analysis; A.P. participated in the interpretation of data, study coordination and helped to draft the manuscript. All authors read and approved the final manuscript.

Funding:

This research was supported by a grant from the National Institute of Child Health and Human Development (R01# 1HD072235).

Data Sharing and Declaration:

The datasets generated and/or analyzed during the current study are not publicly available but are available from the corresponding author on reasonable request.

Author information

Correspondence to Joie Acosta.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

ClinicalTrials.gov Identifier: NCT02155296

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Acosta, J., Chinman, M., Ebener, P. et al. Evaluation of a Whole-School Change Intervention: Findings from a Two-Year Cluster-Randomized Trial of the Restorative Practices Intervention. J Youth Adolescence 48, 876–890 (2019). https://doi.org/10.1007/s10964-019-01013-2

Download citation