Abstract
The PAX Good Behavior Game (PAX GBG) is a behavior management strategy that has demonstrated positive effects on children’s behavior and well-being in trials conducted mainly in the USA. This study assessed the impact of the PAX GBG on students’ mental health and behavior 7 and 19 months post-baseline in Estonia. This matched-pair, cluster-randomized, waitlist-controlled, open-label trial included 42 Estonian elementary schools with 708 first-grade students. The primary outcome was children’s overall mental health rated by teachers, while secondary objectives were to examine whether the effects of the intervention extended to the home context. Teachers also rated their self-efficacy and overall classroom behavior. Intervention adherence and children’s exposure to the intervention were also measured. Modified intention to treat analysis involved 696 students on first post-baseline and 647 on second post-baseline. Intervention had positive effects on children’s mental health at the end of the first academic year, which lasted and strengthened during the second academic year. Moderation analysis demonstrated positive effects on mental health and prosocial behavior for high-risk students during the first year. A few positive effects extended to the home environment during the second academic year. Implementation fidelity was satisfactory. The intervention also had a positive lasting effect on teacher’s self-efficacy and overall classroom behavior. This study shows the positive effects of the PAX GBG in Estonian schools and supports broader implementation of the intervention in Estonian elementary schools.
Trial registration
ClinicalTrials.gov No. NCT02865603
Similar content being viewed by others
References
Berg, J. K., Bradshaw, C. P., Jo, B., & Ialongo, N. S. (2017). Using complier average causal effect estimation to determine the impacts of the good behavior game preventive intervention on teacher implementers. Administration and Policy in Mental Health and Mental Health Services Research, 44, 558–571. https://doi.org/10.1007/s10488-016-0738-1.
Biglan, A., Flay, B. R., Embry, D. D., & Sandler, I. N. (2012). The critical role of nurturing environments for promoting human well-being. American Psychologist, 67, 257–271. https://doi.org/10.1037/a0026796.
Bowman-Perrott, L., Burke, M. D., Zaini, S., Zhang, N., & Vannest, K. (2016). Promoting positive behavior using the good behavior game: A meta-analysis of single-case research. Journal of Positive Behavior Interventions, 18, 180–190. https://doi.org/10.1177/1098300715592355.
Bühler, A., & Thrul, J. (2015). Prevention of addictive behaviours. Luxembourg: European Monitoring Centre for Drugs and Drug Addiction (EMCDDA). https://doi.org/10.2810/993748.
Bussing, R., Fernandez, M., Harwood, M., Hou, W., Garvan, C., Swanson, J., & Eyberg, S. (2008). Parent and teacher SNAP-IV ratings of attention deficit/hyperactivity disorder symptoms: Psychometric properties and normative rating from a school district sample. Assessment, 15, 317–328. https://doi.org/10.1177/1073191107313888.
Cambron, C., Catalano, R. F., & Hawkins, J. D. (2019). The social development model. In D. P. Farrington, L. Kazemian, & A. R. Piquero (Eds.), The Oxford Handbook of Developmental and Life-Course Criminology (Vol. 191, pp. 223–247). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780190201371.013.13.
Daza, E. J., Hudgens, M. G., & Herring, A. H. (2017). Estimating inverse-probability weights for longitudinal data with dropout or truncation: The Xtrccipw command. The Stata Journal: Promoting Communications on Statistics and Stata, 17, 253–278. https://doi.org/10.1177/1536867X1701700202.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. https://doi.org/10.1037/a0038498.
Diehr, P., Martin, D. C., Koepsell, T., & Cheadle, A. (1995). Breaking the matches in a paired t-test for community interventions when the number of pairs is small. Statistics in Medicine, 14, 1491–1504. https://doi.org/10.1002/sim.4780141309.
Donaldson, J. M., & Wiskow, K. M. (2017). The good behavior game. In Preventing crime and violence (pp. 229–241). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-44124-5_20.
Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11, 75–113. https://doi.org/10.1007/s10567-008-0036-x.
Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2011). Applied longitudinal analysis (2nd ed.). John Wiley & Sons.
Flower, A., McKenna, J. W., Bunuan, R. L., Muething, C. S., & Vega, R. (2014). Effects of the good behavior game on challenging behaviors in school settings. Review of Educational Research, 84, 546–571. https://doi.org/10.3102/0034654314536781.
Fortier, J., Chartier, M., Turner, S., Murdock, N., Turner, F., Sareen, J., … Jiang, D. (2018). Adapting and enhancing PAX good behavior game for first nations communities: A mixed-methods study protocol developed with swampy Cree tribal council communities in Manitoba. BMJ Open, 8, e018454. https://doi.org/10.1136/bmjopen-2017-018454.
Goodman, R. (1999). The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 40, 791–799. https://doi.org/10.1111/1469-7610.00494.
Goodman, A., & Goodman, R. (2009). Strengths and difficulties questionnaire as a dimensional measure of child mental health. Journal of the American Academy of Child & Adolescent Psychiatry, 48, 400–403. https://doi.org/10.1097/CHI.0b013e3181985068.
Gupta, S. (2011). Intention-to-treat concept: A review. Perspectives in Clinical Research, 2, 109–112. https://doi.org/10.4103/2229-3485.83221.
Hayes, R. J., & Moulton, L. H. (2017). Cluster randomised trials (Second ed.). CRC Press. https://doi.org/10.4324/9781315370286.
Hopman, J. A. B., van Lier, P. A. C., van der Ende, J., Struiksma, C., Wubbels, T., Verhulst, F. C., … Tick, N. T. (2018). Impact of the good behavior game on special education teachers. Teachers and Teaching, 24(4), 350–368. https://doi.org/10.1080/13540602.2017.1379389.
Huber, M. J., Fruth, J. D., Avila-John, A., & Rodriquez, E. (2016). Teacher self-efficacy and student outcomes: A transactional approach to prevention. Journal of Education and Human Development, 5, 46–54. https://doi.org/10.15640/jehd.v5n1a5.
Ialongo, N. S., Domitrovich, C., Embry, D., Greenberg, M., Lawson, A., Becker, K. D., & Bradshaw, C. (2019). A randomized controlled trial of the combination of two school-based universal preventive interventions. Developmental Psychology. https://doi.org/10.1037/dev0000715.
Inchley, J. C., Currie, D. B., Young, T., Samdal, O., Torsheim, T., Augustson, L., … Barnekow, V. (2016). Growing up unequal: Gender and socioeconomic differences in young people’s health and well-being: Health behaviour in school-aged children (HBSC) study: International report from the 2013/2014 survey (Health Policy for Children and Adolescents; No. 7). Copenhagen.
Israel, B. A., Schulz, A. J., Parker, E. A., & Becker, A. B. (1998). Review of community-based research: Assessing partnership approaches to improve public health. Annual Review of Public Health, 19, 173–202. https://doi.org/10.1146/annurev.publhealth.19.1.173.
Kellam, S. G., Wang, W., Mackenzie, A. C. L., Brown, C. H., Ompad, D. C., Or, F., … Windham, A. (2014). The impact of the good behavior game, a universal classroom-based preventive intervention in first and second grades, on high-risk sexual behaviors and drug abuse and dependence disorders into young adulthood. Prevention Science, 15, 6–18. https://doi.org/10.1007/s11121-012-0296-z.
Korpershoek, H., Harms, T., de Boer, H., van Kuijk, M., & Doolaard, S. (2016). A meta-analysis of the effects of classroom management strategies and classroom management programs on students academic, behavioral, emotional, and motivational outcomes. Review of Educational Research, 86, 1–38. https://doi.org/10.3102/0034654315626799.
Kutsar, D. (2016). Estonia. In Children’s views on their lives and well-being in 17 countries: Key messages from each country (pp. 20–23). Children’s worlds. Retrieved from http://www.isciweb.org/_Uploads/dbsAttachedFiles/KeyMessagesfromeachcountry_final.pdf. Accessed 7 Apr 2019.
McLean, L., Abry, T., Taylor, M., & Connor, C. M. (2018). Associations among teachers’ depressive symptoms and students’ classroom instructional experiences in third grade. Journal of School Psychology, 69, 154–168. https://doi.org/10.1016/j.jsp.2018.05.002.
Meltzer, H., Gatward, R., Goodman, R., & Ford, F. (2000). Mental health of children and adolescents in Great Britain. London.
Ministry of the Interior. (2014). Estonia’s drug prevention policy. White paper (2014). Retrieved from https://www.siseministeerium.ee/sites/default/files/dokumendid/Ennetus/white_paper_on_drug_policy_estonia_2014.pdf. Accessed 7 Apr 2019.
O’Keeffe, J., Thurston, A., Kee, F., O’Hare, L., & Lloyd, K. (2017). Protocol: A feasibility study and a pilot cluster randomised controlled trial of the PAX ‘good behaviour game’ in disadvantaged schools. International Journal of Educational Research, 86, 78–86. https://doi.org/10.1016/j.ijer.2017.08.003.
OECD. (2018). PISA 2015 results in focus. https://doi.org/10.1787/aa9237e6-en.
Organisation for Economic Co-operation and Development. (2013). Teaching and Learning International Survey (TALIS). Teacher Questionnaire. Retrieved December 2, 2016, from https://www.oecd.org/edu/school/TALIS-2013-Teacher-questionnaire.pdf.
Roberts, A., LoCasale-Crouch, J., Hamre, B., & DeCoster, J. (2016). Exploring teachers’ depressive symptoms, interaction quality, and children’s social-emotional development in head start. Early Education and Development, 27, 642–654. https://doi.org/10.1080/10409289.2016.1127088.
Rubow, C. C., Vollmer, T. R., & Joslyn, P. R. (2018). Effects of the good behavior game on student and teacher behavior in an alternative school. Journal of Applied Behavior Analysis, 51, 382–392. https://doi.org/10.1002/jaba.455.
Santiago, P., Levitas, A., Radó, P., & Shewbridge, C. (2016). School education in Estonia. In OECD reviews of school resources: Estonia 2016 (pp. 35–68). Paris: OECD Publishing. https://doi.org/10.1787/9789264251731-5-en.
Smith, E. P., Osgood, D. W., Oh, Y., & Caldwell, L. C. (2018). Promoting afterschool quality and positive youth development: Cluster randomized trial of the Pax good behavior game. Prevention Science, 19, 159–173. https://doi.org/10.1007/s11121-017-0820-2.
StataCorp. (2013). Stata statistical software: Release 13. College Station: StataCorp LP.
Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010). Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4- to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13, 254–274. https://doi.org/10.1007/s10567-010-0071-2.
Streimann, K., Trummal, A., Klandorf, K., Akkermann, K., Sisask, M., Toros, K., & Selart, A. (2017). Effectiveness of a universal classroom-based preventive intervention (PAX GBG): A research protocol for a matched-pair cluster-randomized controlled trial. Contemporary Clinical Trials Communications, 8, 75–84. https://doi.org/10.1016/j.conctc.2017.08.013.
Theimann, M. (2016). School as a space of socialization and prevention. European Journal of Criminology, 13, 67–91. https://doi.org/10.1177/1477370815597254.
Tingstrom, D. H. (2006). The good behavior game: 1969-2002. Behavior Modification, 30, 225–253. https://doi.org/10.1177/0145445503261165.
Tschannen-Moran, M., & Hoy, A. W. (2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17, 783–805. https://doi.org/10.1016/S0742-051X(01)00036-1.
Vuijk, P., van Lier, P. A. C., Crijnen, A. A. M., & Huizink, A. C. (2007). Testing sex-specific pathways from peer victimization to anxiety and depression in early adolescents through a randomized intervention trial. Journal of Affective Disorders, 100, 221–226. https://doi.org/10.1016/j.jad.2006.11.003.
Weis, R., Osborne, K. J., & Dean, E. L. (2015). Effectiveness of a universal, interdependent group contingency program on children’s academic achievement: A countywide evaluation. Journal of Applied School Psychology, 31, 199–218. https://doi.org/10.1080/15377903.2015.1025322.
Wilcox, H. C., Kellam, S. G., Brown, C. H., Poduska, J. M., Ialongo, N. S., Wang, W., & Anthony, J. C. (2008). The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts. Drug and Alcohol Dependence, 95. https://doi.org/10.1016/j.drugalcdep.2008.01.005.
World Health Organization. (2004). Prevention of mental disorders: Effective interventions and policy options: Summary report. Geneva.
Acknowledgments
The authors would like to express their gratitude to the following people and institutions: PAXIS Institute and Dr. Dennis Embry; ERSI with prof. Merike Sisask and Joosep Vaikma; NIHD with Tiia Pertel, Anita Baumbach, Mari Orusalu, Kaja-Kristen Sune and Kai Klandorf.
Funding
The study was funded by the European Social Fund and Ministry of the Interior in Estonia.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Ethical Approval
Ethical approval for the study was received from Tallinn Medical Research Ethics Committee on June 2016. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Streimann, K., Selart, A. & Trummal, A. Effectiveness of a Universal, Classroom-Based Preventive Intervention (PAX GBG) in Estonia: a Cluster-Randomized Controlled Trial. Prev Sci 21, 234–244 (2020). https://doi.org/10.1007/s11121-019-01050-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-019-01050-0