Abstract
Background
Afterschool programs (ASPs) in the United States have been implemented in low income neighborhoods to enable at-risk youth to access educational support services to increase academic skills. However, mixed findings about the ASPs positively affecting academic performance suggests a need for additional evaluative studies.
Objective
The current study examines the effects of literacy training on the reading skills of kindergarten to third grade students who were enrolled in a community-based ASP in four public housing neighborhoods. Participants received structured literacy and reading training, individual tutoring, and a choice-based book distribution program.
Method
Assignment to treatment and comparison groups was based on residence in public housing neighborhoods. We implemented a quasi-experimental design to compare improvements in reading proficiency among ASP literacy program participants in four public housing neighborhoods and a comparable group of students residing in two other public housing neighborhoods without this ASP. Participants were enrolled in grades K to 3 (n = 543). The study lasted for 4 years, and an intent-to-treat approach was used to analyze outcomes.
Results
Mixed-effects models indicated that among a full sample and propensity-score matched sample, ASP participants demonstrated significantly better reading proficiency than comparison group participants over time.
Conclusions
Study findings provide preliminary evidence that it is possible to impact reading proficiency for very high-risk students in the early grades of elementary school. ASPs that target literacy among low-income students could play an important role in boosting student achievement, and therefore in narrowing the achievement gap as young people progress through school.
Similar content being viewed by others
References
Afterschool Alliance. (2017). America after 3 PM. Retrieved from http://www.afterschoolalliance.org/researchFactSheets.cfm. Accessed 26 May 2017.
Anthony, E. K., Alter, C. F., & Jenson, J. M. (2009). Development of a risk and resilience-based out-of-school program for children and youth. Social Work, 54, 45–55. https://doi.org/10.1093/sw/54.1.45.
Arcaira, E., Vile, J. D., & Reisner, E. R. (2010). Achieving high school graduation: Citizen Schools’ youth outcomes in Boston. Washington, DC: Policy Studies Associates Inc.
Bender, K., Brisson, D., Jenson, J. M., Forrest-Bank, S., Lopez, A., & Yoder, J. (2011). Challenges and strategies for conducting program-based research in after-school settings. Child and Adolescent Social Work, 28, 319–334. https://doi.org/10.1007/s10560-011-0236-y.
Blachman, B. A., Schatschneider, C., Fletcher, J. M., Murray, M. S., Munger, K. A., & Vaughn, M. G. (2014). Intensive reading remediation in grade 2 or 3: Are there effects a decade later? Journal of Educational Psychology, 106(1), 46–57. https://doi.org/10.1037/a0033663.
Cambium Learning Group. (n.d.). Read Well research base: Grades K-3 intensive intervention. Accessed online at http://www.voyagersopris.com/docs/default-source/researchlibrary/read-well-research-base.pdf?sfvrsn=6. Accessed 26 May 2017.
Chatterji, M. (2006). Reading achievement gaps, correlates, and moderators of early reading achievement: Evidence from the Early Childhood Longitudinal Study (ECLS) kindergarten to first grade sample. Journal of Educational Psychology, 98(3), 489–507. https://doi.org/10.1037/0022-0663.98.3.489.
Clark, S. L. (2010). Housing instability: Toward a better understanding of frequent residential mobility among America’s urban poor. Final report submitted to the Center for Housing Policy. Available online at http://www.partnering-for-change.org/wp-content/uploads/2014/11/Hoursing-Instability-Toward-a-Better-Understanding-of-Frequent-Residential-Mobility-Among-America%E2%80%99s-Urban.pdf. Accessed 26 May 2017
Duncan, G. J., & Murnane, R. J. (2014). Growing income inequality threatens American education. Phi Delta Kappan, 95(6), 8–14. https://doi.org/10.1177/003172171409500603.
Durlak, J. A., & Weissberg, R. P. (2007). The impact of after-school programs that promote personal and social skills. Chicago, IL: Collaborative for Academic, Social, and Emotional Learning.
Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309. https://doi.org/10.1007/s10464-010-9300-6.
Dynarski, M. (2006). Advancing the use of scientifically based research in forming policy: A response to Mahoney and Zigler. Journal of Applied Developmental Psychology, 27(4), 295–297. https://doi.org/10.1016/j.appdev.2006.04.001.
Dynarski, M., James-Birdumy, S., Moore, M., Rosenberg, L., Deke, J., & Mansfield, W. (2004). When schools stay open late: The national evaluation of the 21st Century Community Learning Centers Program. U.S. Department of Education, National Center for Education Evaluation and Regional Assistance. Washington, DC: U.S. Government Printing Office.
Fabiano, L., Pearson, L. M., & Williams, I. J. (2005). Putting students on a pathway to academic and social success: Phase III findings of the Citizen Schools evaluation. Washington, DC: Policy Studies Associates.
Fashola, O., & Cooper, R. (1999). Developing the academic talents of African American students during the non-school hours: Four exemplary programs. Journal of Negro Education, 68, 130–137. https://doi.org/10.2307/2668120.
Frasco, R. D. (2008). Effectiveness of reading first for English language learners: Comparison of two programs. Doctoral Dissertation, Walden University.
Griffin, E. A., & Morrison, F. J. (1997). The unique contribution of home literacy environment to differences in early literacy skills. Early Child Development and Care, 127(1), 233–243. https://doi.org/10.1080/0300443971270119.
Gunn, B., Smolkowski, K., & Vadasy, P. (2011). Evaluating the effectiveness of Read Well Kindergarten. Journal of Research on Educational Effectiveness, 4, 53–86. https://doi.org/10.1080/19345747.2010.488716.
Guthrie, J. T., & Humenick, N. M. (2004). Motivating students to read: Evidence for classroom practices that increase reading motivation and achievement. In P. McCardle & V. Chhabra (Eds.), The voice of evidence in reading research (pp. 329–354). Baltimore, MD: Brookes Publishing.
Halpern, R. (1999). After-school programs for low-income children: Promises and challenges. When School is Out, 9, 81–95. https://doi.org/10.2307/1602708.
Halpern, R. (2003). Making play work: The promise of after-school programs for low-income children. New York: Teachers College Press.
Halpern, R. (2006). Critical issues in after-school programming. Monographs of the Herr Research Center for Children and Social Policy. Chicago: Erikson Institute.
Hasselbring, T. S., & Goin, L. (2004). Literacy instruction for older struggling readers: What is the role of technology? Reading and Writing Quarterly, 20, 123–144. https://doi.org/10.1080/10573560490262073.
Hoff, E. (2013). Interpreting early language trajectories of children from low SES and language minority homes: Implications for closing achievement gaps. Developmental Psychology, 49(1), 4–14. https://doi.org/10.1037/a0027238.
Invernizzi, M. A. (2003). The complex world of one-one-one tutoring. In S. B. Neuman & D. K. Dickinson (Eds.), Handbook of early literacy research (Vol. 1, pp. 459–470). New York: The Guilford Press.
James-Burdumy, S., Dynarski, M., Moore, M., Deke. J., Mansfield, W., Pistorino, C., et al. (2005). When schools stay open late: The national evaluation of the 21st Century Community Learning Centers program: Final report. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.
Jenson, J. M. (2013). Risk, resilience, and positive youth development: Developing effective community programs for high-risk youth. Lessons from the Denver Bridge Project. New York: Oxford University Press.
Jenson, J. M., & Bender, K. (2014). Preventing child and adolescent problem behavior: Evidence-based strategies in schools, families, and communities. New York: Oxford University Press.
Kim, J. S. (2007). The effects of a voluntary summer reading intervention on reading activities and reading achievement. Journal of Educational Psychology, 99(3), 505–515. https://doi.org/10.1037/0022-0663.99.3.505.
Kim, J. S., Capotosto, L., Hartry, A., & Fitzgerald, R. (2011). Can a mixed-method literacy intervention improve the reading achievement of low-performing elementary school students in an after-school program? Results from a randomized controlled trial of READ 180 Enterprise. American Educational Research Association, 33, 183–201. https://doi.org/10.3102/0162373711399148.
Kim, J. S., & Guryan, J. (2010). The efficacy of a voluntary summer book reasing intervention for low-income Latino children from language minority families. Journal of Educational Psychology, 102(1), 20–31. https://doi.org/10.1037/a0017270.
Kim, J. S., Samson, J. F., Fitzgerald, R., & Hartry, A. (2010). A randomized experiment of a mixed-methods literacy intervention for struggling readers in grades 4–6: Effects on word reading efficiency, reading comprehension and vocabulary, and oral reading fluency. Reading and Writing, 23, 1109–1129. https://doi.org/10.1007/s11145-009-9198-2.
Kremer, K. P., Maynard, B. R., Polanin, J. R., Vaughn, M. G., & Sarteschi, C. M. (2015). Effects of after-school programs with at-risk youth on attendance and externalizing behaviors. A systematic review and meta-analysis. Journal of Youth and Adolescence, 44, 616–636. https://doi.org/10.1007/s10964-014-0226-4.
Lauer, P. A., Akiba, M., Wilkerson, S. B., Apthorp, H. S., Snow, D., & Martin-Green, M. (2006). Out-of-school time programs: A meta-analysis of effects for at-risk students. Review of Educational Research, 76, 275–313. https://doi.org/10.3102/00346543076002275.
Leventhal, T., & Newman, S. (2010). Housing and child development. Children and Youth Services Review, 32(9), 1165–1174. https://doi.org/10.1016/j.childyouth.2010.03.008.
LoSciuto, L., Hilbert, S. M., Fox, M. M., Porcellini, L., & Lanphear, A. (1999). A two-year evaluation of the Woodrock Youth Development Project. Journal of Early Adolescence, 19, 488–507. https://doi.org/10.1177/0272431699019004004.
Mahoney, J. L., Lord, H., & Carryl, E. (2005). An ecological analysis of after-school program participation and the development of academic performance and motivational attributes for disadvantaged children. Child Development, 76, 811–825. https://doi.org/10.1111/j.1467-8624.2005.00879.x.
Mahoney, J. L., & Zigler, E. F. (2006a). Translating science to policy under the No Child Left Behind Act of 2001: Lessons from the national evaluation of the 21st-Century Community Learning Centers. Journal of Applied Developmental Psychology, 27(4), 282–294. https://doi.org/10.1016/j.appdev.2006.04.001.
Mahoney, J. L., & Zigler, E. F. (2006b). Translating science to policy: Response to Dynarski. Journal of Applied Developmental Psychology, 27(4), 282–294. https://doi.org/10.1016/j.appdev.2006.04.001.
McElvain, C. M. (2015). The Bridge Project: Connecting home, school and community for Mexican immigrant children. Journal of Latinos and Education, 14, 153–170. https://doi.org/10.1080/15348431.2014.973568.
Muthén, L. K., & Muthén, B. O. (1998–2016). Mplus User’s Guide, 7th edn. Los Angeles, CA: Muthén & Muthén.
Neuman, S. B., & Celano, D. (2001). Access to print in low-income and middle-income communities: An ecological study of four neighborhoods. Reading Research Quarterly, 36(1), 8–26. https://doi.org/10.1598/RRQ.36.1.1.
O’Donnell, J., & Kirkner, S. L. (2014). Effects of an out-of-school program on urban high school youth’s academic performance. Journal of Community Psychology, 42, 176–190. https://doi.org/10.1002/jcop.21603.
Payne, A. C., Whitehurst, G. J., & Angell, A. L. (1994). The role of home literacy environment in the development of language abilities in preschool children from low-income families. Early Childhood Research Quarterly, 9(3–4), 427–440. https://doi.org/10.1016/0885-2006(94)90018-3.
Pearson Education, Inc. (2011). K-8 technical manual: Developmental reading assessment (2nd ed.). Saddle River, NJ: Pearson Education, Inc.
Pierce, K. M., Bolt, D. M., & Vandell, D. L. (2010). Specific features of after-school program quality: Associations with children’s functioning in middle adulthood. American Journal of Community Psychology, 45(3–4), 381–393. https://doi.org/10.1007/s10464-010-9304-2.
Rathvon, N. (2008). Effective school interventions: Evidence based strategies for improving student outcomes (2nd ed.). New York: Guilford Press.
Read Well. (2017). Read Well reading curriculum: Research and results. Retrieved from http://www.voyagersopris.com/curriculum/subject/literacy/read-well/research-results. Accessed 26 May 2017.
Roth, J. L., Malone, L. M., & Brooks-Gunn, J. (2010). Does the amount of participation in afterschool programs relate to developmental outcomes? A review of the literature. American Journal of Community Psychology, 45, 310–324. https://doi.org/10.1007/s10464-0109303-3.
Shernoff, D. J. (2010). Engagement in after-school programs as a predictor of social competence and academic performance. American Journal of Community Psychology, 45, 325–337. https://doi.org/10.1007/s10464-010-9314-0.
Slavin, R. E., Cheung, A., Groff, C., & Lake, C. (2008). Effective reading programs for middle and high schools: A best-evidence synthesis. Reading Research Quarterly, 43, 290–322. https://doi.org/10.1598/RRQ.43.3.4.
U.S. Department of Education. (2011). Elementary and secondary education: Part B-21st Century Community Learning Centers. Retrieved from https://www2.ed.gov/policy/elsec/leg/esea02/pg55.html. Accessed 26 May 2017.
What Works Clearinghouse. (2010). Read well. Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from https://ies.ed.gov/ncee/wwc. Accessed 26 May 2017.
What Works Clearinghouse. (2017). Intervention READ 180. Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from https://ies.ed.gov/ncee/wwc. Accessed 26 May 2017.
White, T. G., Kim, J. S., Kingston, H. C., & Foster, L. (2014). Replicating the effects of a teacher scaffolded voluntary summer reading program: The role of poverty. Reading Research Quarterly, 49(1), 5–30. https://doi.org/10.1002/rrq.62.
Wilkins, C., Gersten, R., Decker, L. E., Grunden, L., Braisiel, S., et al. (2012). Does a summer reading program based on Lexiles affect reading comprehension?. Washington, DC: Southwest Regional Educational Laboratory at Edvance Research.
Acknowledgements
This study was supported by the Social Innovation Fund, a White House initiative and program of the Corporation for National and Community Service. Program and evaluation activities described in this manuscript were made possible by Mile High United Way, the Bridge Project, and the University of Denver. We thank Jesse Burne, Executive Director of the Bridge Project, for his support in conducting this investigation.
Funding
This study was funded by the Social Innovative Fund (Grant No. 37366).
Author information
Authors and Affiliations
Contributions
Intake data were collected jointly by researchers at two institutions, where the second and third authors were Principal Investigators, and they take responsibility for the integrity of that data. Outcome data were provided by an analyst at the school system and could not be independently verified by any members of the research team. The first author takes responsibility for the accuracy of the data analysis.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from the parents of all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Bayless, S.D., Jenson, J.M., Richmond, M.K. et al. Effects of an Afterschool Early Literacy Intervention on the Reading Skills of Children in Public Housing Communities. Child Youth Care Forum 47, 537–561 (2018). https://doi.org/10.1007/s10566-018-9442-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10566-018-9442-5