School Mental Health

, Volume 4, Issue 3, pp 143–154 | Cite as

Modifying an Evidence-Based Summer Treatment Program for Use in a Summer School Setting: A Pilot Effectiveness Evaluation

  • Briannon C. O’ConnorEmail author
  • Katy E. Tresco
  • William E. Pelham
  • Daniel A. Waschbusch
  • Elizabeth M. Gnagy
  • Andrew R. Greiner
Original Paper


This report evaluates a pilot implementation of a modified version of the Summer Treatment Program (STP; Pelham et al. in Evidence-based psychotherapies for children and adolescents. The Guilford Press, New York, 2010) as an afternoon adjunct to a mandatory summer school curriculum in three inner city elementary schools (Summer School STP; SSSTP). Using preliminary post-test measures, the SSSTP was compared with afternoon adjunct programs implemented in two comparison schools. Students in pre-kindergarten through sixth grade who failed to meet grade-level requirements for grade promotion were required to attend the program and served as participants (SSSTP n = 585; Comparison n = 686). Measures collected include the following: student self-reports, teachers’ program evaluations, staff evaluations (of students, program, benefit to self), staff ratings of benefit to junior counselors (i.e., adolescent employees), and independent observations. Results suggest that the SSSTP is an acceptable and feasible adjunctive intervention for the summer school setting in inner city schools. Further research is needed to examine academic and therapeutic benefits.


Summer school Disruptive behavior Program evaluation 


  1. Adelman, H. S., & Taylor, L. (2009). Ending the marginalization of mental health in schools: A comprehensive approach. In R. W. Christner & R. B. Mennuti (Eds.), School-based mental health: A practitioner’s guide to comparative practices (pp. 25–54). New York: Routledge.Google Scholar
  2. Arnold, D. H. (1997). Co-occurrence of externalizing behavior problems and emergent academic difficulties in young high-risk boys: A preliminary evaluation of patterns and mechanisms. Journal of Applied Developmental Psychology, 18, 317–330.CrossRefGoogle Scholar
  3. Atkins, M. S., Frazier, S. L., Birman, D., Adil, J. A., Jackson, M., Graczyk, P. A., et al. (2006). School-based mental health services for children living in high poverty urban communities. Administration and Policy in Mental Health and Mental Health Services Research, 33, 146–159.PubMedCrossRefGoogle Scholar
  4. Barth, J. M., Dunlap, S. T., Dane, H., Lochman, J. E., & Wells, K. C. (2004). Classroom environment influences on aggression, peer relations, and academic focus. Journal of School Psychology, 42, 115–133.CrossRefGoogle Scholar
  5. Bond, L., Butler, H., Thomas, L., Carlin, J., Glover, S., Bowes, G., et al. (2007). Social and school connectedness in early secondary school as predictors of late teenage substance use, mental health, and academic outcomes. Journal of Adolescent Health, 40, e9–e18.PubMedCrossRefGoogle Scholar
  6. Boston Public Schools. (2000). Transition services summer school 2000. Boston: Boston Public Schools, Office of Research, Assessment, and Evaluation.Google Scholar
  7. Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of school-wide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12, 133–148.CrossRefGoogle Scholar
  8. Burns, B. J., Costello, E. J., Angold, A., Tweed, D., Stangl, D., Farmer, E. M., et al. (1995). Children’s mental health service use across service sectors. Health Affairs, 14, 147–159.PubMedCrossRefGoogle Scholar
  9. Catholic Charities. (2011). Closing the gap: Services. Retrieved from:
  10. Chorpita, B. F. (2003). The frontier of evidence-based practice. In A. E. Kazdin & J. R.Weisz (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 42–59). New York: Guilford.Google Scholar
  11. Chronis, A. M., Fabiano, G. A., Gnagy, E. M., Onyango, A. N., Pelham, W. E., Williams, A., et al. (2004). An evaluation of the summer treatment program for children with ADHD using a treatment withdrawal design. Behavior Therapy, 35, 561–585.CrossRefGoogle Scholar
  12. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.Google Scholar
  13. Cooper, H. (2004). Is the school calendar dated? Education, economics, and the politics of time. In G. D. Borman & M. Boulay (Eds.), Summer learning: Research, policies, and programs (pp. 3–23). New Jersey: Lawrence Erlbaum Associates.Google Scholar
  14. Cooper, H., Charlton, K., Valentine, J. C., & Muhlenbruck, L. (2000). Making the most of summer school: A meta-analytic and narrative review. Monographs of the Society for Research in Child Development, 65(1, Serial No. 260).Google Scholar
  15. Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996). The effects of summer vacation on achievement test scores: A narrative and meta-analytic review. Review of Educational Research, 66, 227–268.Google Scholar
  16. Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309.CrossRefGoogle Scholar
  17. Eckert, T. L., & Hintze, J. M. (2000). Behavioral conceptions and applications of acceptability: Issues related to service delivery and research methodology. School Psychology Quarterly [Special issue], 15, 123–148.CrossRefGoogle Scholar
  18. Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37, 215–237.PubMedCrossRefGoogle Scholar
  19. Fischer, M., Barkley, R. A., Edelbrock, C. S., & Smallish, L. (1990). The adolescent outcome of hyperactive children diagnosed by research criteria: II. Academic, attentional, and neuropsychological status. Journal of Consulting and Clinical Psychology, 58, 580–588.PubMedCrossRefGoogle Scholar
  20. Frazier, S. L., Cappella, E., & Atkins, M. S. (2007). Linking mental health and after school systems for children in urban poverty: Preventing problems, promoting possibilities. Administration and Policy in Mental Health and Mental Health Services Research, 3, 389–399.CrossRefGoogle Scholar
  21. Gottfredson, G. D., Gottfredson, D. C., Payne, A. A., & Gottfredson, N. C. (2005). School climate predictors of school disorder: Results from a national study of delinquency prevention in schools. Journal of Research in Crime and Delinquency, 42, 412–444.CrossRefGoogle Scholar
  22. Hinshaw, S. P. (1992). Externalizing behavior problems and academic underachievement in childhood and adolescence: Causal relationships and underlying mechanisms. Psychological Bulletin, 111, 127–155.PubMedCrossRefGoogle Scholar
  23. Hoagwood, K., Burns, B. J., & Weisz, J. R. (2002). A profitable conjunction: From science to service in children’s mental health. In B. J. Burns & K. Hoagwood (Eds.), Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders (pp. 327–338). New York: Oxford University Press.Google Scholar
  24. Lamdin, D. J. (1996). Evidence of school attendance as an independent variable in education production functions. Journal of Educational Research, 89, 155–162.CrossRefGoogle Scholar
  25. Lauer, P. A., Akiba, M., Wilderson, S. B., Apthorp, H. S., Snow, D., & Martin-Glenn, M. L. (2006). Out-of-school-time programs: A meta-analysis of effects for at-risk students. Review of Educational Research, 76, 275–313.CrossRefGoogle Scholar
  26. Mahatmya, D., & Lohman, B. (2011). Predictors of late adolescent delinquency: The protective role of after-school activities in low-income families. Children and Youth Services Review, 33, 1309–1317.CrossRefGoogle Scholar
  27. Massetti, G. M., Lahey, B. B., Pelham, W. E., Loney, J., Ehrhardt, A., et al. (2008). Academic achievement over 8 years among children who met modified criteria for Attention-Deficit/Hyperactivity Disorder at 4–6 years of age. Journal of Abnormal Child Psychology, 36, 399–410.PubMedCrossRefGoogle Scholar
  28. Mcintosh, K., Horner, R. H., & Sugai, G. (2009). Sustainability of systems-level evidence-based practices in schools: Current knowledge and future directions. In W. Sailor, G. Dunlop, G. Sugai, & R. Horner (Eds.), Handbook of positive behavior support (pp. 327–352). New York: Springer Publishing Co.CrossRefGoogle Scholar
  29. Pelham, W. E., & Fabiano, G. A. (2008). Evidence-based psychosocial treatments for attention deficit/hyperactivity disorder. Journal of Clinical Child and Adolescent Psychology, 37, 184–214.PubMedCrossRefGoogle Scholar
  30. Pelham, W. E., Fabiano, G. A., Gnagy, E. M., Greiner, A. R., & Hoza, B. (2005a). The role of summer treatment programs in the context of comprehensive treatment for ADHD. In E. Hibbs & P. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (2nd ed., pp. 377–410). Washington, DC: APA Press.Google Scholar
  31. Pelham, W. E., Gnagy, E. M., Greiner, A. R., Waschbusch, D. A., Fabiano, G. A., & Burrows-MacLean, L. (2010). Summer treatment programs for attention deficit/hyperactivity disorder. In A. E. Kazdin & J. R. Weisz (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed.). New York: The Guilford Press.Google Scholar
  32. Pelham, W. E., Greiner, A. R., & Gnagy, E. M. (1997). Children’s summer treatment program manual. Buffalo, NY: Comprehensive Treatment for Attention Deficit Disorder.Google Scholar
  33. Pelham, W. E., & Hoza, B. (1996). Intensive treatment: A summer treatment program for children with ADHD. In E. Hibbs & P. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (pp. 311–340). New York: APA Press.CrossRefGoogle Scholar
  34. Pelham, W. E., Massetti, G. M., Wilson, T., Kipp, H., Myers, D. M., Newman Standley, B. B., et al. (2005b). Implementation of a comprehensive schoolwide behavioral intervention: The ABC Program. Journal of Attention Disorders, 9, 248–260.PubMedCrossRefGoogle Scholar
  35. Portz, J. (2004). Summer school 2000 and 2001: The Boston Public Schools transition services program. In G. D. Borman & M. Boulay (Eds.), Summer learning: Research, policies, and programs (pp. 103–120). New Jersey: Lawrence Erlbaum Associates.Google Scholar
  36. Reinke, W. M., Herman, K. C., Petras, H., & Ialongo, N. S. (2008). Empirically derived subtypes of child academic and behavior problems: Co-occurrence and distal outcomes. Journal of Abnormal Child Psychology, 35, 759–770.CrossRefGoogle Scholar
  37. Resnick, M. D., Bearman, P. S., Blum, R. W., et al. (1997). Protecting adolescents from harm: Findings from the National Longitudinal Study on Adolescent Health. The Journal of the American Medical Association, 278, 823–832.CrossRefGoogle Scholar
  38. Resnick, M. D., Harris, L., & Blum, R. W. (1993). The impact of caring and connectedness on adolescent health and well-being. Journal of Pediatrics and Child Heath, 29, S3–S9.CrossRefGoogle Scholar
  39. Ringeisen, H., Henderson, K., & Hoagwood, K. (2003). Context matters: Schools and the ‘research to practice gap’ in children’s mental health. School Psychology Review, 32, 153–168.Google Scholar
  40. Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3, 223–241.PubMedCrossRefGoogle Scholar
  41. Safyer, A. W., Leahy, B. H., & Colan, N. B. (1995). The impact of work on adolescent development. Families in Society, 76, 38–45.Google Scholar
  42. Severson, H. H., Walker, H. M., Hope-Doolittle, J., Kratochwill, T. R., & Gresham, F. M. (2007). Proactive, early screening to detect behaviorally at-risk students: Issues, approaches, emerging innovations, and professional practices. Journal of School Psychology, 45, 193–223.CrossRefGoogle Scholar
  43. Stage, S. A., & Quiroz, D. R. (1997). A meta-analysis of interventions to decrease disruptive classroom behavior in public education settings. School Psychology Review, 26, 333–368.Google Scholar
  44. Sugai, G., & Horner, R. H. (2006). A promising approach for expanding and sustaining school wide positive behavior support. School Psychology Review, 35, 245–259.Google Scholar
  45. Sugai, G., Horner, R. H., & Gresham, F. M. (2002). Behaviorally effective school environments. In M. R. Shinn, H. M. Walker, & G. Stoner (Eds.), Interventions for academic and behavior problems II: Preventive and remedial approaches (pp. 143–166). Bethesda: NASP.Google Scholar
  46. Walker, H. M., Horner, R. H., Sugai, G., Bullis, M., et al. (1996). Integrated approaches to preventing antisocial behavior patterns among school–age children and youth. Journal of Emotional and Behavioral Disorders, 4, 194–209.CrossRefGoogle Scholar
  47. Walker, H. M., Ramsey, E., & Gresham, F. M. (2003). Antisocial behavior in schools: Evidence based practices. Stamford: Wadsworth Publishing.Google Scholar
  48. Walker, H. M., Seeley, J. R., Small, J., Severson, H. H., Graham, B. A., Feil, E. G., et al. (2009). A randomized controlled trial of the first step to success early intervention: Demonstration of program efficacy outcomes in a diverse, urban school district. Journal of Emotional and Behavioral Disorders, 17, 197–212.CrossRefGoogle Scholar
  49. Waschbusch, D. A., Carrey, N., Willoughby, M. T., King, S., & Andrade, B. F. (2007). Effects of methylphenidate and behavior modification on the social and academic behavior of children with disruptive behavior disorders: The moderating role of callous/unemotional traits. Journal of Clinical Child and Adolescent Psychology, 36, 629–644.PubMedCrossRefGoogle Scholar
  50. Waschbusch, D. A., Pelham, W. E., Massetti, G., & Northern Partners in Action for Children and Youth. (2005). The behavior education support and treatment (BEST) school intervention program: Pilot project data examining schoolwide, targeted-school, and targeted-home approaches. Journal of Attention Disorders, 9, 313–322.PubMedCrossRefGoogle Scholar
  51. Weisz, J. R., Jensen, A. L., & McLeod, B. D. (2005a). Development and dissemination of child and adolescent psychotherapies: Milestones, methods, and a new deployment-focused model. In E. D. Hibbs & P. S. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (2nd ed., pp. 9–39). Washington, DC: American Psychological Association.Google Scholar
  52. Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005b). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60, 628–648.PubMedCrossRefGoogle Scholar
  53. Wilson, D. B., Gottfredson, D. C., & Najaka, S. S. (2001). School-based prevention of problem behaviors: A meta-analysis. Journal of Quantitative Criminology, 17, 247–272.CrossRefGoogle Scholar
  54. Yamashita, Y., Mukasa, A., Muira, N., Honda, Y., Anai, C., Kunisaki, C., et al. (2010). Short term effects of American summer treatment program for Japanese children with attention deficit hyperactivity disorder. Brain & Development, 32, 115–122.CrossRefGoogle Scholar

Copyright information

© Springer Science + Business Media, LLC 2012

Authors and Affiliations

  • Briannon C. O’Connor
    • 1
    Email author
  • Katy E. Tresco
    • 2
  • William E. Pelham
    • 3
  • Daniel A. Waschbusch
    • 3
  • Elizabeth M. Gnagy
    • 3
  • Andrew R. Greiner
    • 3
  1. 1.Department of PsychologyState University of New York at BuffaloBuffaloUSA
  2. 2.The Children’s Hospital of PhiladelphiaPhiladelphiaUSA
  3. 3.Center for Children and FamiliesFlorida International UniversityMiamiUSA

Personalised recommendations