Advertisement

A Feasibility Study of a School-Based Social Emotional Learning Program: Informing Program Development and Evaluation

  • Laura A. VoithEmail author
  • Susan Yoon
  • James Topitzes
  • Michael J. Brondino
Article
  • 71 Downloads

Abstract

The Peace Program is a school-based social emotional learning program. Despite increased efforts to develop, implement, and evaluate school-based SEL programs in the past few decades, the short- and long-term effectiveness of such programs remains unclear. Considering the previously identified gaps that may contribute to modest effect sizes and erosion of initial effects over time, we conducted a feasibility study to better understand adoption and implementation of a local SEL program in order to inform future program design, delivery, and evaluation. Using mixed-methods, feasibility indicators: program acceptability, facilitator competence, and students’ social–emotional outcomes were examined. Qualitative data were analyzed using thematic analysis. Outcome analyses were conducted on facilitator competence measures and student outcomes using mixed-model repeated measures analysis of variance. Qualitative results indicated acceptance for the Peace Program. Facilitators demonstrated competence, with no difference across grade, classroom, or schools. Significant interactions effects were found for students’ aggression, concentration/attention, and emotional competence. School-level associations were found for students’ concentration/attention. Implications of results and future directions are discussed, including the critical role of teachers and social workers in promoting SEL among socioeconomically disadvantaged children; the impact on SEL programming on children in early elementary grades; and the potential effects of school climate and culture.

Keywords

Social emotional learning Feasibility Mixed-methods School 

Notes

Acknowledgements

We would like to acknowledge the leadership team and staff of the Peace Program and SET Ministry, Inc. for their commitment to the evaluation process.

Compliance with Ethical Standards

Conflict of interest

The first author declares a potential conflict of interest: the first author was paid a fee by SET Ministry, Inc. to conduct an evaluation of the Peace Program. The other co-authors declare no conflicts of interests. We have followed approved ethical standards.

References

  1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.CrossRefPubMedGoogle Scholar
  2. Anda, R. F., Felitti, V. J., Bremner, J. D., Walker, J. D., Whitfield, C. H., Perry, B. D., … Giles, W. H. (2006). The enduring effects of abuse and related adverse experiences in childhood. European Archives of Psychiatry and Clinical Neuroscience, 256, 174–186.Google Scholar
  3. Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010). What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Medical Research Methodology, 10, 67.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., … Fernandez, M. (2009). How we design feasibility studies. American Journal of Preventive Medicine, 36, 452–457.Google Scholar
  5. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77–101.CrossRefGoogle Scholar
  6. Cohen, J. (2006). Social, emotional, ethical, and academic education: Creating a climate for learning, participation in democracy, and well-being. Harvard Educational Review, 76, 201–237.CrossRefGoogle Scholar
  7. Cohen, J., McCabe, L., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111, 180–213.Google Scholar
  8. Cohen, J., Onunaku, N., Clothier, S., & Poppe, J. (2005). Helping young children succeed: Strategies to promote early childhood social and emotional development. Early Childhood Research and Policy Report No. 016168. Retrieved from Build Initiative. http://www.buildinitiative.org/WhatsNew/ViewArticle/tabid/96/ArticleId/396/Helping-Young-Children-Succeed-Strategies-to-Promote-Early-Childhood-Social-and-Emotional-Developmen.aspx.
  9. Conduct Problems Prevention Research Group. (1999). Technical reports for the Fast Track assessment battery. Unpublished manuscript.Google Scholar
  10. Conner, N. W., & Fraser, M. W. (2011). Preschool social–emotional skills training: A controlled pilot test of the making choices and strong families programs. Research on Social Work Practice, 21, 699–711.CrossRefGoogle Scholar
  11. Cook, N. R., & Ware, J. H. (1983). Design and analysis methods for longitudinal research. Annual Review of Public Health, 4, 1–23.CrossRefPubMedGoogle Scholar
  12. Cross, W., & West, J. (2011). Examining implementer fidelity: Conceptualising and measuring adherence and competence. Journal of Children’s Services, 6, 18–33.CrossRefPubMedPubMedCentralGoogle Scholar
  13. Davidson, R., & Begley, S. (2012). The emotional life of your brain. New York: Hudson Street Press.Google Scholar
  14. Devaney, E., O’Brien, M. U., Resnik, H., Keister, S., & Weissberg, R. P. (2006). Sustainable schoolwide social and emotional learning (SEL): Implementation guide and toolkit. Chicago, IL: Collaborative for Academic, Social, and Emotional Learning.Google Scholar
  15. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432.CrossRefPubMedGoogle Scholar
  16. Dusenbury, L., Weissberg, R. P., Goren, P., & Domitrovich, C. (2014). State standards to advance social and emotional learning: Findings from CASEL’s state scan of social and emotional learning standards, preschool through high school. Retrieved from CASEL website: http://www.casel.org/wp-content/uploads/2016/06/CASELBriefonStateStandards-January2014.pdf.
  17. Elbertson, N. A., Brackett, M. A., & Weissberg, R. P. (2010). School-based social and emotional learning (SEL) programming: Current perspectives. In A. Hargreaves, A. Lieberman, M. Fullan, & D. Hopkins (Eds.), Second international handbook of educational change (pp. 1017–1032). Dordrecht: Springer.CrossRefGoogle Scholar
  18. Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11, 75–113.CrossRefPubMedPubMedCentralGoogle Scholar
  19. Ersan, C. (2019). Physical aggression, relational aggression and anger in preschool children: The mediating role of emotion regulation. The Journal of General Psychology, 14, 1–25.CrossRefGoogle Scholar
  20. Evans, R., Murphy, S., & Scourfield, J. (2015). Implementation of a school-based social and emotional learning intervention: Understanding diffusion processes within complex systems. Prevention Science, 16, 754–764.CrossRefPubMedPubMedCentralGoogle Scholar
  21. Farrell, A. D., Meyer, A. L., Kung, E. M., & Sullivan, T. N. (2001). Development and evaluation of school-based violence prevention programs. Journal of Clinical Child Psychology, 30, 207–220.CrossRefPubMedGoogle Scholar
  22. Feldman, N. (2008). Assisting children in the creation of new life performances: Expanding possibilities for social and emotional development. Child and Adolescent Social Work Journal, 25, 85–97.CrossRefGoogle Scholar
  23. Felitti, V. J., Anda, R. F., Nordenberg, D., Williamson, D. F., Spitz, A. M., Edwards, V., … Marks, J. S. (1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: The Adverse Childhood Experiences (ACE) Study. American Journal of Preventive Medicine, 14, 245–258.Google Scholar
  24. Fish, M. C., & Dane, E. (2000). The classroom systems observation scale: Development of an instrument to assess classrooms using a systems perspective. Learning Environments Research, 3, 67–92.CrossRefGoogle Scholar
  25. Flay, B. R., & Allred, C. G. (2010). The positive action program: Improving academics, behavior, and character by teaching comprehensive skills for successful learning and living. In T. Lovat & R. Toomey (Eds.), International research handbook on values education and student wellbeing (pp. 471–501). Dordrecht: Springer.CrossRefGoogle Scholar
  26. Gordon, M. (2000). Roots of Empathy: Training manual. Roots of Empathy. www.Rootsofempathy.org.
  27. Green, L. W. (2006). Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence? American Journal of Public Health, 96, 406–409.CrossRefPubMedPubMedCentralGoogle Scholar
  28. Greenberg, M. T., & Kusché, C. A. (1993). Promoting social and emotional development in deaf children: The PATHS project. Seattle, WA: University of Washington Press.Google Scholar
  29. Greenberg, M. T., & Kusché, C. A. (2005). Promoting Alternative THinking Strategies Evaluation Kit. Developmental Research & Programs.Google Scholar
  30. Gumora, G., & Arsenio, W. F. (2002). Emotionality, emotion regulation, and school performance in middle school children. Journal of School Psychology, 40, 395–413.CrossRefGoogle Scholar
  31. Gwet, K. L. (2012). Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters. Gaithersburg, MD: Advanced Analytics.Google Scholar
  32. Hahn, R., Fuqua-Whitley, D., Wethington, H., Lowy, J., Crosby, A., Fullilove, M., … Dahlberg, L. (2007). Effectiveness of universal school-based programs to prevent violent and aggressive behavior: A systematic review. American Journal of Preventive Medicine, 33, S114–S129.Google Scholar
  33. Hamre, B. K., Pianta, R. C., & Chomat-Mooney, L. (2009). Conducting classroom observations in school-based research. In L. M. Dinella (Ed.), Conducting science-based psychology research in schools (pp. 79–105). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  34. Heckman, J. J., & Masterov, D. V. (2007). The productivity argument for investing in young children. Applied Economic Perspectives and Policy, 29, 446–493.Google Scholar
  35. Hessler, D. M., & Katz, L. F. (2010). Brief report: Associations between emotional competence and adolescent risky behavior. Journal of Adolescence, 33, 241–246.CrossRefPubMedGoogle Scholar
  36. Jimerson, S. R., Ferguson, P., Whipple, A. D., Anderson, G. E., & Dalton, M. J. (2002). Exploring the association between grade retention and dropout: A longitudinal study examining socio-emotional, behavioral, and achievement characteristics of retained students. The California School Psychologist, 7, 51–62.CrossRefGoogle Scholar
  37. Jones, S. M., & Bouffard, S. M. (2012). Social and emotional learning in schools: From programs to strategies. Social Policy Report, 26(4), 3–26.CrossRefGoogle Scholar
  38. Jones, S. M., Brown, J. L., & Aber, J. L. (2011). Two-year impacts of a universal school-based social–emotional and literacy intervention: An experiment in translational developmental research. Child Development, 82, 533–554.CrossRefPubMedGoogle Scholar
  39. Kam, C., & Greenberg, M. T. (1998). Technical measurement report on the teacher social competence rating scale. Unpublished Technical Report, Prevention Research Center for the Promotion of Human Development, The Pennsylvania State University.Google Scholar
  40. Kolb, D. A., Boyatzis, R. E., & Mainemelis, C. (2001). Experiential learning theory: Previous research and new directions. In R. J. Sternberg & L. Zhang (Eds.), Perspectives on thinking, learning, and cognitive styles (pp. 227–247). Mahwah, NJ: Lawrence Erlbaum Associates Inc.Google Scholar
  41. Kourmousi, N., Markogiannakis, G., Tzavara, C., Kounenou, K., Mandrikas, A., Christopoulou, E., & Koutras, V. (2018). Students’ psychosocial empowerment with the ‘Steps For Life’ personal and social skills Greek elementary programme. International Electronic Journal of Elementary Education, 10, 535–549.Google Scholar
  42. Liew, J. (2012). Effortful control, executive functions, and education: Bringing self-regulatory and social–emotional competencies to the table. Child Development Perspectives, 6, 105–111.CrossRefGoogle Scholar
  43. Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage Publications.CrossRefGoogle Scholar
  44. MacNeil, A. J., Prater, D. L., & Busch, S. (2009). The effects of school culture and climate on student achievement. International Journal of Leadership in Education, 12, 73–84.CrossRefGoogle Scholar
  45. Nelis, D., Kotsou, I., Quoidbach, J., Hansenne, M., Weytens, F., Dupuis, P., & Mikolajczak, M. (2011). Increasing emotional competence improves psychological and physical well-being, social relationships, and employability. Emotion, 11, 354.CrossRefPubMedGoogle Scholar
  46. Preece, S., & Mellor, D. (2009). Learning patterns in social skills training programs: An exploratory study. Child and Adolescent Social Work Journal, 26, 87.CrossRefGoogle Scholar
  47. Rhoades, B. L., Warren, H. K., Domitrovich, C. E., & Greenberg, M. T. (2011). Examining the link between preschool social–emotional competence and first grade academic achievement: The role of attention skills. Early Childhood Research Quarterly, 26, 182–191.CrossRefGoogle Scholar
  48. Shonkoff, J. P., Garner, A. S., Siegel, B. S., Dobbins, M. I., Earls, M. F., McGuinn, L., … Committee on Early Childhood, Adoption, and Dependent Care. (2012). The lifelong effects of early childhood adversity and toxic stress. Pediatrics, 129, e232–e246.Google Scholar
  49. Sklad, M., Diekstra, R., Ritter, M. D., Ben, J., & Gravesteijn, C. (2012). Effectiveness of school-based universal social, emotional, and behavioral programs: Do they enhance students’ development in the area of skill, behavior, and adjustment? Psychology in the Schools, 49, 892–909.CrossRefGoogle Scholar
  50. Sroufe, L. A., & Rutter, M. (1984). The domain of developmental psychopathology. Child Development, 55, 17–29.CrossRefPubMedGoogle Scholar
  51. Stiles, J. (2008). Fundamentals of brain development. Cambridge, MA: Harvard University Press.Google Scholar
  52. Taylor, R. D., Oberle, E., Durlak, J. A., & Weissberg, R. P. (2017). Promoting positive youth development through school-based social and emotional learning interventions: A meta-analysis of follow-up effects. Child Development, 88, 1156–1171.CrossRefPubMedGoogle Scholar
  53. Werthamer-Larsson, L., Kellam, S., & Wheeler, L. (1991). Effect of first-grade classroom environment on shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 585–602.CrossRefPubMedGoogle Scholar
  54. Wilson, S. J., Lipsey, M. W., & Derzon, J. H. (2003). The effects of school-based intervention programs on aggressive behavior: A meta-analysis. Journal of Consulting and Clinical Psychology, 71, 136–149.CrossRefGoogle Scholar
  55. Yalom, I., & Leszcz, M. (2005). The theory and practice of group psychotherapy (5th ed.). New York: Basic Books.Google Scholar
  56. Zeidner, M., Roberts, R. D., & Matthews, G. (2002). Can emotional intelligence be schooled? A critical review. Educational Psychologist, 37, 215–231.CrossRefGoogle Scholar
  57. Zins, J. E. (Ed.). (2004). Building academic success on social and emotional learning: What does the research say?. New York: Teachers College Press.Google Scholar
  58. Zins, J. E., Bloodworth, M. R., Weissberg, R. P., & Walberg, H. J. (2007). The scientific base linking social and emotional learning to school success. Journal of Educational and Psychological Consultation, 17, 191–210.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Jack, Joseph and Morton Mandel School of Applied Social SciencesCase Western Reserve UniversityClevelandUSA
  2. 2.College of Social WorkThe Ohio State UniversityColumbusUSA
  3. 3.Helen Bader School of Social Welfare, The Institute for Child and Family Well-beingUniversity of Wisconsin – MilwaukeeMilwaukeeUSA
  4. 4.Helen Bader School of Social WelfareUniversity of Wisconsin – MilwaukeeMilwaukeeUSA

Personalised recommendations