Journal of Youth and Adolescence

, Volume 47, Issue 9, pp 1978–1991 | Cite as

Differential Effectiveness of a Middle School Social and Emotional Learning Program: Does Setting Matter?

  • Vítor Alexandre CoelhoEmail author
  • Vanda Sousa
Empirical Research


There is a lack of studies in the literature addressing the differential effectiveness of Social and Emotional Learning according to their implementation setting. This study compared the effectiveness of an upper middle school Social and Emotional Learning program applied in two different settings: within school and after-school hours, while controlling for individual and class-level variables. There were 837 students (Mage = 12.70; SD = 0.98; 47.6% were female): 246 in the control group, 319 in the after-school intervention group and 272 in the within school schedule intervention group, assessed at pretest, post-test and follow-up seven months later. Multilevel analyses identified more positive intervention results in on self-esteem, self-control, and social awareness for students in the within school schedule groups. Girls gained more in social awareness in both program settings. This study highlights the importance of analyzing Social and Emotional Learning program´s differential effectiveness in order to optimize it.


Social and Emotional Learning Program effectiveness Program setting Classroom-level variables 



We would like to thank Richard Inman for his English revision; Ana Maria Romão, Marta Marchante, and Patrícia Brás for collecting and organizing the data. We would also like to thank the students who took part in this study.

Authors’ Contributions

V.A.C. conceived the study and its design, drafted the manuscript, and performed the statistical analysis; V.S. conceived the study, drafted the manuscript, and participated in the interpretation of the data. Both authors read and approved the final manuscript.


Project Positive Attitude is funded by Municipality of Torres Vedras.

Data Sharing and Declaration

The datasets generated and/or analyzed during the current study are not publicly available but are available from the corresponding author on reasonable request.

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

The current study was approved by the Psychology for Positive Development Research Center. The present study was conducted following the national professional code of ethics for psychologists (OPP), following national legislation.

Informed Consent

All school directors agreed to the implementation of the programs and schools used passive informed parental consent, because the program could be considered part of the school offering.


  1. Arsenio, W.F., Adams, E., & Gold, J. (2009). Social information processing, moral reasoning, and emotion attributions: Relations with adolescents’ reactive and proactive aggression. Child Development, 80, 1739–1755. Scholar
  2. Belfield, C., Bowden, B., Klapp, A., Levin, H., Shand, R., & Zander, S. (2015). The economic value of social and emotional learning. New York, NY: Center for Benefit-Cost Studies in Education.Google Scholar
  3. Caemmerer, J.M., & Keith, T.Z. (2015). Longitudinal, reciprocal effects of social skills and achievement from kindergarten to eighth grade. Journal of School Psychology, 53, 265–281. Scholar
  4. Castillo, R., Fernández-Berrocal, P., & Brackett, M.A. (2013). Enhancing teacher effectiveness in Spain: A pilot study of The RULER approach to social and emotional learning. Journal of Education and Training Studies, 1, 263–272.CrossRefGoogle Scholar
  5. Coelho, V., & Figueira, A. (2011). Project “Positive Attitude”: promoting school success through social and emotional abilities development. Design for elementary and middle school students, in Portugal. Interamerican Journal of Psychology, 45(2), 185–192.Google Scholar
  6. Coelho, V., Marchante, M., & Sousa, V. (2015). “Positive Attitude”: A multilevel model analysis of the effectiveness of a social and emotional learning program for Portuguese middle school students. Journal of Adolescence, 43, 29–38. Scholar
  7. Coelho, V., Marchante, M., Sousa, V., & Romão, A.M. (2016). Programas de intervenção para o desenvolvimento de competências socioemocionais: Uma revisão crítica dos enquadramentos SEL e SEAL [Social and emotional learning programs: A critical review of SEL and SEAL frameworks]. Análise Psicológica, 34, 61–72. Scholar
  8. Coelho, V., & Sousa, V. (2017a). Comparing two low middle school social and emotional learning program formats: A multilevel effectiveness study. Journal of Youth and Adolescence, 46, 656–667. Scholar
  9. Coelho, V.A., & Sousa, V. (2017b). The impact of class-level variables on the effectiveness of a middle school social and emotional learning program: A multilevel analysis. Journal of Relationships Research, 8, e21 Scholar
  10. Coelho, V., Sousa, V., & Marchante, M. (2015). Development and validation of the social and emotional competencies evaluation questionnaire. Journal of Developmental and Educational Psychology, 5(1), 139–147. Scholar
  11. Coelho, V., Sousa, V., & Figueira, A.P. (2016). Positive attitude program’s impact upon self-concept across childhood and adolescence. Revista de Psicodidactica, 21(2), 261–280.
  12. Collaborative for Academic, Social, and Emotional Learning. (2015). 2015 CASEL guide: Effective social and emotional learning programs (Middle and high school edition). Chicago, IL: Author.Google Scholar
  13. Conduct Problems Prevention Research Group. (2010). The effects of a multiyear universal social–emotional learning program: The role of student and school characteristics. Journal of Consulting and Clinical Psychology, 78(2), 156–168. Scholar
  14. Cook, C.R., Williams, K.R., Guerra, N.G., Kim, T.E., & Sadek, S. (2010). Predictors of bullying and victimization in childhood and adolescence: A meta-analytic investigation. School Psychology Quarterly, 25(2), 65–83. Scholar
  15. Domitrovich, C.E., Durlak, J.A., Staley, K.C., & Weissberg, R.P. (2017). Social-emotional competence: An essential factor for promoting positive adjustment and reducing risk in school children. Child Development, 88, 408–16. Scholar
  16. Durlak, J., Weissberg, R., Dymnicki, A., Taylor, R., & Schellinger, K. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. Scholar
  17. Durlak, J.A., Weissberg, R.P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309. Scholar
  18. Fontaine, A.M. (1991). Desenvolvimento do conceito de si próprio e realização escolar na adolescência. Psychologica, 5, 13–31.Google Scholar
  19. Greenberg, M.T., Domitrovich, C.E., Weissberg, R.P., & Durlak, J.A. (2017). Social and emotional learning as a public health approach to education. Future of Children, 27, 13–32. Retrieved from.Google Scholar
  20. Greenberg, M., Weissberg, R., O’Brien, M., Zins, J., Fredericks, L., & Resnik, H., et al. (2003). Enhancing school-based prevention and youth development through coordinated social, emotional, and academic learning. American Psychologist, 58, 466–474. Scholar
  21. Heck, R.H., Thomas, S.L., & Tabata, L.N. (2013). Multilevel and longitudinal modeling with IBM SPSS. 2nd edn. London: Routledge.Google Scholar
  22. Holsen, I., Smith, B.H., & Frey, K.S. (2008). Outcomes of the social competence program Second Step in Norwegian elementary schools. School Psychology International, 29, 71–88. Scholar
  23. Hurd, N., & Deutsch, N. (2017). SEL-focused after-school programs. Future of Children, 27, 95–116. Retrieved from.Google Scholar
  24. Jones, S.M., Barnes, S.P., Bailey, R., & Doolittle, E.J. (2017). Promoting social and emotional competencies in elementary school. Future of Children, 27, 49–72. Retrieved from.Google Scholar
  25. Kataoka, S., & Vandell, D.L. (2013). Quality of afterschool activities and relative change in adolescent functioning over two years. Applied Developmental Science, 17, 123–34. Scholar
  26. Malti, T., Ribeaud, D., & Eisner, M.P. (2011). The effectiveness of two universal preventive interventions in reducing children’s externalizing behavior: a cluster randomized controlled trial. Journal of Clinical Children and Adolescent Psychology, 40, 677–92. Scholar
  27. Marsh, H.W., & Ayotte, V. (2003). Do multiple dimensions of self-concept become more differentiated with age? The differential distinctiveness hypothesis. Journal of Educational Psychology, 95(4), 687–706. Scholar
  28. Marsh, H.W., Relich, J.D., & Smith, I.D. (1983). Self-concept: the construct validity of interpretations based upon SDQ. Journal of Personality and Social Psychology, 45, 173–187. Scholar
  29. McClelland, M.M., Tominey, S.L., Schmitt, S.A., & Duncan, R. (2017). SEL interventions in early childhood. The Future of Children, 27(1), 33–47. Retrieved from
  30. McKown, C. (2017). Social-emotional assessment, performance, and standards. Future of Children, 27, 157–178. Retrieved from.Google Scholar
  31. Sandler, I., Wolchik, S.A., Cruden, G., Mahrer, N.E., Ahn, S., Brincks, A., & Brown, C.H. (2014). Overview of meta-analyses of the prevention of mental health, substance use and conduct problems. Annual Review of Clinical Psychology, 10, 243–273. Scholar
  32. Sklad, M., Diekstra, R., DeRitter, M., Ben, J., & Gravesteijn, C. (2012). Effectiveness of school-based universal social, emotional, and behavioral programs: Do they enhance students’ development in the area of skill, behavior and adjustment? Psychology in the Schools, 49, 892–909. Scholar
  33. Taylor, R.D., Oberle, E., Durlak, J.A., & Weissberg, R.P. (2017). Promoting positive youth development through school-based social and emotional learning interventions: A meta-analysis of follow-up Effects. Child Development, 88, 1156–1171. Scholar
  34. VanSchoiack-Edstrom, L., Frey, K.S., & Beland, K. (2002). Changing adolescents’ attitudes about relational and physical aggression: An early evaluation of a school-based intervention. School Psychology Review, 31, 201–217.Google Scholar
  35. Weissberg, R.P., Durlak, J.A., Domitrovich, C.E., & Gullotta, T.P. (2015). Social and emotional learning: Past, present, and future. In J.A. Durlak, C.E. Domitrovich, R.P. Weissberg & T.P. Gullotta (Eds.), Handbook of social and emotional learning: Research and practice (pp. 3–19). New York, NY: Guilford.Google Scholar
  36. Wigelsworth, M., Humphrey, N., Kalambouka, A., & Lendrum, A. (2010). A review of key issues in the measurement of children’s social and emotional skills. Educational Psychology in Practice, 26(2), 173–186. Scholar
  37. Wigelsworth, M., Humphrey, N., & Lendrum., A. (2013). Evaluation of a school-wide preventive intervention for adolescents: The secondary Social and Emotional Aspects of Learning (SEAL) programme. School Mental Health, 5, 96–109. Scholar
  38. Wigelsworth, M., Lendrum, A., Oldfield, J., Scott, A., ten Bokkel, I., Tate, K., & Emery, C. (2016). The impact of trial stage, developer involvement and international transferability on universal social and emotional learning programme outcomes: a meta-analysis. Cambridge Journal of Education, 46, 347–376. Scholar
  39. Wolpert, M., Humphrey, N., Deighton, J., Patalay, P., Fugard, A.J.B., Fonagy, P., Belsky, J., & Vostanis, P. (2015). An evaluation of the implementation and impact of England’s mandated school-based Mental Health Initiative in elementary schools. School Psychology Review, 44, 117–138. Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Académico de Torres VedrasTorres VedrasPortugal
  2. 2.Centro de Investigação para a Psicologia do DesenvolvimentoPortoPortugal

Personalised recommendations