Advertisement

Not Just a Walk in the Park: Efficacy to Effectiveness for After School Programs in Communities of Concentrated Urban Poverty

  • Stacy L. FrazierEmail author
  • Tara G. Mehta
  • Marc S. Atkins
  • Kwan Hur
  • Dana Rusch
Original Article

Abstract

This study examined a model for mental health consultation, training and support designed to enhance the benefits of publicly-funded recreational after-school programs in communities of concentrated urban poverty for children’s academic, social, and behavioral functioning. We assessed children’s mental health needs and examined the feasibility and impact of intervention on program quality and children’s psychosocial outcomes in three after-school sites (n = 15 staff, 89 children), compared to three demographically-matched sites that received no intervention (n = 12 staff, 38 children). Findings revealed high staff satisfaction and feasibility of intervention, and modest improvements in observed program quality and staff-reported children’s outcomes. Data are considered with a public health lens of mental health promotion for children in urban poverty.

Keywords

Efficacy to effectiveness Urban poverty After school Mental health promotion 

Notes

Acknowledgments

This work was funded by a National Institute of Mental Health R34 grant MH-070637. The second author was supported during this work by a NIDA T32 grant DA-007293. The authors gratefully acknowledge William E. Pelham for his consultation on this work, and Christine Van Gessel, Christine A. Kesselring, Markeita King, Aaron Lyon, and Easter Young for their extraordinary efforts in recruitment and data collection. The authors also extend their gratitude to the social work students and psychology interns who contributed extensive time and effort to this work, and to the families and staff at the after school programs for their candid feedback and enthusiastic participation.

References

  1. Afterschool Alliance. (2008). Afterschool Alliance after school for all. Retrieved September 16, 2008, from http://www.afterschoolalliance.org/Fact%20Sheet_Afterschool%20Essential%20stats%2004_08%20FINAL.pdf.
  2. Armstrong, T., & Armstrong, G. (2008). The organizational, community, and programmatic characteristics that predict the effective implementation of after-school programs. Journal of School Violence, 3, 93–109.CrossRefGoogle Scholar
  3. Atkins, M. S., & Frazier, S. L. (2011). Expanding the toolkit or changing the paradigm: Are we ready for a public health approach to mental health? Perspectives on Psychological Science, 6, 483–487.Google Scholar
  4. Barrish, H. H., Saunders, M., & Wolf, M. M. (1969). Good behavior game: Effects of individual contingencies for group consequences on disruptive behavior in a classroom. Journal of Applied Behavior Analysis, 2, 119–124.PubMedCrossRefGoogle Scholar
  5. Botvin, J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association, 273, 1106–1112.PubMedCrossRefGoogle Scholar
  6. Bourdon, K. H., Goodman, R., Rae, D. S., Simpson, G., & Koretz, D. S. (2005). The strengths and difficulties questionnaire: U. S. normative data and psychometric properties. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 557–564.PubMedCrossRefGoogle Scholar
  7. Bradley, R. H., & Corwyn, R. F. (2002). Socioeconomic status and child development. Annual Review of Psychology, 53, 371–399.PubMedCrossRefGoogle Scholar
  8. Brooks-Gunn, J., & Duncan, G. J. (1997). The effects of poverty on children. Future of Children, 7, 55–71.PubMedCrossRefGoogle Scholar
  9. Cappella, E., Frazier, S. L., Atkins, M. S., Schoenwald, S. K., & Glisson, C. (2008). Enhancing schools’ capacity to support children in poverty: An ecological model of school-based mental health services. Administration and Policy in Mental Health, 35, 395–409.PubMedCrossRefGoogle Scholar
  10. Chronis, A. M., Fabiano, G. A., Gnagy, E. M., Onyango, A. N., Pelham, W. E., Williams, A., et al. (2004). An evaluation of the Summer Treatment Program for children with attention-deficit-hyperactivity disorder using a treatment withdrawal design. Behavior Therapy, 35, 561–585.CrossRefGoogle Scholar
  11. Coie, J. D., & Dodge, K. A. (1988). Multiple sources of data on social behavior and social status in the school: A cross-age comparison. Child Development, 59, 815–829.PubMedCrossRefGoogle Scholar
  12. Cross, A. B., Gottfredson, D. C., Wilson, D. M., Rorie, M., & Connell, N. (2009). The impact of after-school programs ton the routine activities of middle-school students: Results from a randomized, controlled trial. Criminology and Public Policy, 8, 391–412.CrossRefGoogle Scholar
  13. Dishion, T. J. (2000). Cross-setting consistency in early adolescent psychopathology: Deviant friendships and problem behavior sequelae. Journal of Personality, 68, 1109–1127.PubMedCrossRefGoogle Scholar
  14. Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm: Peer groups and problem behavior. American Psychologist, 54, 255–266.CrossRefGoogle Scholar
  15. Durlak, J. A., & Weissberg, R. P. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309.PubMedCrossRefGoogle Scholar
  16. Embry, D. D. (2002). The Good Behavior Game: A best practice candidate as a universal behavioral vaccine. Clinical Child and Family Psychology Review, 5, 273–297.PubMedCrossRefGoogle Scholar
  17. Evans, G. W., & Kantrowitz, E. (2002). Socioeconomic status and health: The potential role of environmental risk exposure. Annual Review of Public Health, 23, 303–331.PubMedCrossRefGoogle Scholar
  18. Fabiano, G. A., Pelham, W. E., Manos, M., Gnagy, E. M., Chronis, A. M., Onyango, A. N., et al. (2004). An evaluation of three time out procedures for children with attention-deficit-hyperactivity disorder. Behavior Therapy, 35, 449–469.CrossRefGoogle Scholar
  19. Federal Interagency Forum on Child and Family Statistics. (2008). Childstats.gov: Forum on child and family statistics. Retrieved September 16, 2008, from http://www.childstats.gov/index.asp.
  20. Frazier, S. L., Cappella, E., & Atkins, M. S. (2007). Linking mental health and after school systems for children in urban poverty. Preventing problems, promoting possibilities. Administration and Policy in Mental Health and Mental Health Services Research, 34, 389–399.PubMedCrossRefGoogle Scholar
  21. Frazier, S. L., Chacko, A., Van Gessel, C., O’Boyle, C., & Pelham, W. E. (2012). The summer treatment program meets the south side of Chicago: Bridging science and service in urban after-school programs. Child and Adolescent Mental Health, 17, 86–92.PubMedCrossRefGoogle Scholar
  22. Fuchs, L., & Fuchs, D. (2000). Analogue assessment of academic skills: Curriculum-based measurement and performance assessment. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools (pp. 168–201). New York: Guilford Press.Google Scholar
  23. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7, 243–259.PubMedCrossRefGoogle Scholar
  24. Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345.PubMedCrossRefGoogle Scholar
  25. Gottfredson, D. C., Cross, A., & Soulé, D. A. (2007). Distinguishing characteristics of effective and ineffective afterschool programs to prevent delinquency and victimization. Criminology and Public Policy, 6, 289–318.CrossRefGoogle Scholar
  26. Gottfredson, D. C., Gerstenblith, S. A., Soulé, D. A., Womer, S. C., & Lu, S. (2004). Do after school programs reduce delinquency? Prevention Science, 5, 253–266.PubMedCrossRefGoogle Scholar
  27. Gottfredson, G. D., Gottfredson, D. C., Payne, A. A., & Gottfredson, N. C. (2005). School climate predictors of school disorder: Results from the national study of delinquency prevention in schools. Journal of Research in Crime and Delinquency, 42, 412–444.CrossRefGoogle Scholar
  28. Gottfredson, D. C., Gottfredson, G. D., & Weisman, S. A. (2001). The timing of delinquent behavior and its implications for ASPs. Criminology & Public Policy, 1, 61–80.CrossRefGoogle Scholar
  29. Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. New York: Wiley-Interscience.Google Scholar
  30. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30, 448–466.PubMedCrossRefGoogle Scholar
  31. Hoagwood, K., Burns, B. J., & Weisz, J. R. (2002). A profitable conjunction: From science to service in children’s mental health. In B. Burns & K. Hoagwood (Eds.), Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders (pp. 327–338). Oxford: New York.Google Scholar
  32. Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22, 363–368.PubMedCrossRefGoogle Scholar
  33. Ladd, G. W., & Profilet, S. M. (1996). The Child Behavior Scale: A teacher-report measure of young children’s aggressive, withdrawn, and prosocial behaviors. Developmental Psychology, 32, 1008–1024.CrossRefGoogle Scholar
  34. Larner, L.B. (Ed.). (1999). When school is out. The Future of Children, 9(2).Google Scholar
  35. Lyon, A., Frazier, S. L., Mehta, T. G., Atkins, M. S., & Weisbach, J. (2011). Easier said than done: Intervention sustainability in an urban after-school program. Administration and Policy in Mental Health and Mental Health Services Research, 38, 504–517.PubMedCrossRefGoogle Scholar
  36. Mahoney, J. L., Lord, H., & Carryl, E. (2005). An ecological analysis of after-school program participation and the development of academic performance and motivational attributes for disadvantaged children. Child Development, 76, 811–825.PubMedCrossRefGoogle Scholar
  37. Mahoney, J. L., Parente, M. E., & Lord, H. (2007). After-school program engagement: Links to child competence and program quality and content. The Elementary School Journal, 4, 385–404.CrossRefGoogle Scholar
  38. Mahoney, J. L., Parente, M. E., & Zigler, E. F. (2010). After-school program participation and children’s development. In J. Meece & J. S. Eccles (Eds.), Handbook of research on schools, schooling, and human development (pp. 379–397). New York, NY: Routledge.Google Scholar
  39. Mahoney, J. L., Stattin, H., & Magnusson, D. (2000). Youth recreation centre participation and criminal offending: A 20-year longitudinal study of Swedish boys. International Journal of Behavioral Development, 24, 1–12.CrossRefGoogle Scholar
  40. Mahoney, J. L., Vandell, D. L., Simpkins, S. D., & Zarrett, N. R. (2009). Adolescent out-of-school activities. In R. M. Lerner & L. Steinberg (Eds.), Handbook of adolescent psychology: Contextual influences on adolescent development (3rd ed., Vol. 2, pp. 228–267). Hoboken, NJ: Wiley.Google Scholar
  41. Marshall, N. L., Coll, C. G., Marx, F., McCartney, K., Keefe, N., & Ruh, J. (1997). After-school time and children’s behavioral adjustment. Merrill-Palmer Quarterly, 43, 497–514.Google Scholar
  42. National Institute of Mental Health. (1999). Bridging science and service: A report by the National Advisory Mental Health Council’s Clinical Treatment and Services Research Workgroup. Washington, D.C.: Author.Google Scholar
  43. Pelham, W. E., Burrows-MacLean, L., Gnagy, E. M., Fabiano, G. A., Coles, E. K., Tresco, K. E., et al. (2005). Transdermal methylphenidate, behavioral, and combined treatment for children with ADHD. Experimental and Clinical Psychopharmacology, 13, 111–126.PubMedCrossRefGoogle Scholar
  44. Pelham, W. E., Gnagy, E. M., Greiner, A. R., Hoza, B., Hinshaw, S. P., Swanson, J. M., et al. (2000). Behavioral vs. behavioral and pharmacological treatment in ADHD children attending a summer treatment program. Journal of Abnormal Child Psychology, 28, 507–525.PubMedCrossRefGoogle Scholar
  45. Pelham, W. E., Greiner, A., & Gnagy, E. M. (1997). Children’s summer treatment program manual. Buffalo, NY: Comprehensive Treatment for Attention Deficit Disorder.Google Scholar
  46. Pierce, K. M., Bolt, D. M., & Vandell, D. L. (2010). Specific features of after-school program quality: Associations with children’s functioning in middle childhood. American Journal of Community Psychology, 45, 381–393.PubMedCrossRefGoogle Scholar
  47. Pierce, K. M., Hamm, J. V., & Vandell, D. L. (1999). Experiences in after-school programs and children’s adjustment in first-grade classrooms. Child Development, 70, 756–767.PubMedCrossRefGoogle Scholar
  48. Posner, J. K., & Vandell, D. L. (1994). Low-income children’s after-school care: Are there beneficial effects of after-school programs? Child Development, 65, 440–456.PubMedCrossRefGoogle Scholar
  49. Riggs, N. R., Bohnert, A. M., & Guzman, M. D. (2010). Examining the potential of community-based after-school programs for Latino youth. American Journal of Community Psychology, 45, 417–429.PubMedCrossRefGoogle Scholar
  50. Riggs, N. R., & Greenberg, M. T. (2004). After-school youth development programs: A developmental-ecological model of current research. Clinical Child and Family Psychology Review, 7, 177–190.PubMedCrossRefGoogle Scholar
  51. Ringeisen, H., Henderson, K., & Hoagwood, K. (2003). Context matters: Schools and the “research to practice gap” in children’s mental health. School Psychology Review, 32, 153–168.Google Scholar
  52. Roffman, J. G., Pagano, M. E., & Hirsch, B. J. (2001). Youth functioning and experiences in inner-city after-school programs among age, gender, and race groups. Journal of Child and Family Studies, 10, 85–100.PubMedCrossRefGoogle Scholar
  53. Rosenthal, R., & Vandell, D. L. (1996). Quality of care at school-aged child-care programs: Regulatable features, observed experiences, child perspectives and parent perspectives. Child Development, 67, 2434–2445.PubMedCrossRefGoogle Scholar
  54. Rubenstein, M., Patrikakou, E., Weissberg, R., & Armstrong, M. (2000). Enhancing school-family partnerships: A teacher’s guide. Chicago: University of Illinois at Chicago, Dept of Psychology.Google Scholar
  55. Rubin, D. B. (1976). Inference and missing data. Biometrika, 63, 581–592.CrossRefGoogle Scholar
  56. Sheldon, J., Arbreton, A., Hopkins, L., & Baldwin Grossman, J. (2010). Investing in success: Key strategies for building quality in after-school programs. American Journal of Community Psychology, 45, 394–404.PubMedCrossRefGoogle Scholar
  57. Shernoff, D. J. (2010). Engagement in after-school programs as a predictor of social competence and academic performance. American Journal of Community Psychology, 45, 325–337.PubMedCrossRefGoogle Scholar
  58. Shernoff, D. J., & Vandell, D. L. (2007). Engagement in after-school program activities: quality of experience from the perspective of participants. Journal of Youth and Adolescence, 36, 891–903.CrossRefGoogle Scholar
  59. Shumway, M., & Sentell, T. (2004). An examination of leading mental health journals for evidence to inform evidence-based practice. Psychiatric Services, 55, 649–653.PubMedCrossRefGoogle Scholar
  60. Smith, C., Peck, S. C., Denault, A. S., Blazevski, J., & Akiva, T. (2010). Quality at the point of service: Profiles of practice in after-school settings. American Journal of Community Psychology, 45, 358–369.PubMedCrossRefGoogle Scholar
  61. Snyder, H. N., & Sickmund, M. (1999). Juvenile offenders and victims: 1999 national report. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.Google Scholar
  62. Strein, W., Hoagwood, K., & Cohn, A. (2003). School psychology: A public health perspective I. Prevention, populations, and, systems change. Journal of School Psychology, 41, 23–38.CrossRefGoogle Scholar
  63. Tashman, N. A., Weist, M. D., Acosta, O., Bickham, N. L., Grady, M., Nabors, L., et al. (2000). Toward the integration of prevention research and expanded school mental health programs. Children’s Services: Social Policy, Research, & Practice, 3, 97–115.Google Scholar
  64. U.S. Department of Justice. (2003). Youth victimization: Prevalence and implications. Washington, DC: Author.Google Scholar
  65. Vandell, D. L. (2005). Program staff student report. Madison, WI: University of Wisconsin-Madison, Wisconsin Center for Education Research. Retrieved September 21, 2006, from http://www.wcer.wisc.edu/childcare/pdf/pp/program_staff_student_report_spring2005.pdf.
  66. Vandell, D. L. (2005). Study of promising after-school programs: Observation manual for site verification visits. Madison, WI: University of Wisconsin-Madison, Wisconsin Center for Education Research. Retrieved September 21, 2006, from http://www.wcer.wisc.edu/.
  67. Vandell, D. L., Shernoff, D. J., Pierce, K. M., Bolt, D. M., Dadisman, K., & Bradford Brown, B. (2005). Activities, engagement, and emotion in after-school programs (and elsewhere). New Directions for Youth Development, 105, 121–129.PubMedCrossRefGoogle Scholar
  68. Vandell, D. L., Shumow, L., & Posner, J. K. (1997). Children’s after-school programs: Promoting resiliency or vulnerability? In H. I. McCubbin, A. I. Thompson, J. Futrell, & L. D. McCubbin (Eds.), Promoting resiliency in families and children at risk: Interdisciplinary perspectives (pp. 1–35). Thousand Oaks, CA: Sage Publications.Google Scholar
  69. Weisman, S. A., Womer, S. C., Kellstrom M. A., Bryner, S. L., Kahler, A., Slocum, L., & Gottfredson, D. C. (2002). Maryland after school community grant program. Report on the 20012002 school year evaluation of the phase 3 after school programs. (Technical report available from the authors).Google Scholar
  70. Weisz, J. R., Doss, A. J., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337–363.PubMedCrossRefGoogle Scholar
  71. Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy. American Psychologist, 47, 1578–1585.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Stacy L. Frazier
    • 1
    • 2
    Email author
  • Tara G. Mehta
    • 1
  • Marc S. Atkins
    • 1
  • Kwan Hur
    • 1
  • Dana Rusch
    • 1
  1. 1.Department of PsychiatryThe University of Illinois at ChicagoChicagoUSA
  2. 2.Center for Children and FamiliesFlorida International UniversityMiamiUSA

Personalised recommendations