Skip to main content

Advertisement

Log in

Utilizing Teacher Ratings of Student Literacy to Identify At-Risk Students: an Analysis of Data from the Early Childhood Longitudinal Study

  • Published:
Contemporary School Psychology Aims and scope Submit manuscript

Abstract

The identification of children at-risk for reading problems can be costly and time-consuming. Previous research has indicated that teachers are relatively accurate in assessing children's overall reading ability. This study investigated the accuracy of kindergarten and first grade teacher rating scales in predicting children's reading scores on assessments in kindergarten, first, third, and fifth grades. The sample included 8,806 children from the Early Childhood Longitudinal Study-Kindergarten cohort (ECLS-K). Results demonstrated that teacher ratings significantly predicted children's later reading scores through fifth grade. The practical implications of the results are discussed in relation to early identification of children at-risk for learning disabilities in reading.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Scatter plots are available from the first author.

References

  • Bates, C., & Nettelbeck, T. (2001). Primary school teachers' judgments of reading achievement. Educational Psychology, 21, 177–187.

    Article  Google Scholar 

  • Bishop, A. G., & League, M. B. (2006). Identifying a multivariate screening model to predict reading difficulties at the onset of kindergarten: a longitudinal analysis. Learning Disability Quarterly, 29, 235–252.

    Article  Google Scholar 

  • Clements, M. A., Bolt, D., Hoyt, W., & Kratochwill, T. R. (2007). Using multilevel modeling to examine the effects of multitiered interventions. Psychology in the Schools, 44, 503–513.

    Article  Google Scholar 

  • Demaray, M. K., & Elliot, S. N. (1998). Teachers' judgments of students' academic functioning: a comparison of actual and predicted performances. School Psychology Quarterly, 13, 8–24.

    Article  Google Scholar 

  • Donovan, M. S., & Cross, C. T. (2002). Minority students in special and gifted education. Washington, DC: National Academy Press.

    Google Scholar 

  • Eckert, T. L., Dunn, E. K., Codding, R. S., Begeny, J. C., & Kleinmann, A. E. (2006). Assessment of mathematics and reading performance: an examination of the correspondence between direct assessment of student performance and teacher report. Psychology in the Schools, 43, 247–265.

    Article  Google Scholar 

  • Espin, C., Wallace, T., Lembke, E., Campbell, H., & Long, J. D. (2010). Creating a progress-monitoring system in reading for middle-school students: tracking progress toward meeting high-stakes standards. Learning Disabilities Research and Practice, 25, 60–75.

    Article  Google Scholar 

  • Felton, R. H. (1992). Early identification of children at risk for reading disabilities. Topics in Early Childhood Special Education, 12, 212–229.

    Article  Google Scholar 

  • Flynn, J. M., & Rabbar, M. H. (1998). Improving teacher prediction of children at-risk for reading failure. Psychology in the Schools, 35, 163–172.

    Article  Google Scholar 

  • Foorman, B. R., Fletcher, J. M., & Francis, D. (1997). A scientific approach to reading instruction. LD Online. www.ldonline.org. Accessed 15 July 2007

  • Good, R. H., Simmons, D. C., & Smith, S. B. (1998). Effective academic interventions in the United States: evaluating and enhancing the acquisition. School Psychology Review, 27(1), 45–57.

    Google Scholar 

  • Good, R. H., Simmons, D. C., & Kame'enui, E. J. (2001). The importance and decision-making utility of a continuum of fluency-based indicators of foundational reading skills for third-grade high-stakes outcomes. Scientific Studies of Reading, 5, p257–p288.

    Article  Google Scholar 

  • Hintze, J., & Silberglitt, B. (2005). A longitudinal examination of the diagnostic accuracy and predictive validity of R-CBM and high-stakes testing. School Psychology Review, 34(3), 372–386.

    Google Scholar 

  • Hoge, R. D., & Coladarci, T. (1989). Teacher-based judgments of academic achievement: a review of literature. Review of Educational Research, 59, 297–313.

    Article  Google Scholar 

  • Invernizzi, M., Sullivan, A., Meier, J., & Swank, L. (2004). Teacher's manual for the phonological awareness literacy screening—pre-kindergarten. Charlottesville: University of Virginia.

    Google Scholar 

  • Invernizzi, M., Juel, C., Swank, L., & Meier, J. (2007). Technical manual for the phonological awareness literacy screening kindergarten. Charlottesville: University of Virginia.

    Google Scholar 

  • Koehler-Hak, K. M., & Bardos, A. (2009). Dynamic Indicators of Basic Early Literacy Skills: General outcomes measurement for prevention and remediation of early reading problems. In. Naglieri, J. A. & Goldstein, S. Practitioners Guide to Assessing Intelligence.

  • Lomax, R. G. (2001). An introduction to statistical concepts for education and behavioral sciences. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Mandalaine, A., & Wheldall, K. (2005). Identifying low-progress readers: comparing teacher judgment with a curriculum-based measurement procedure. International Journal of Disability, Development and Education, 52, 33–42.

    Article  Google Scholar 

  • Morris, D., Bloodgood, J., & Perney, J. (2003). Kindergarten predictors of first- and second-grade reading achievement. The Elementary School Journal, 104, 94–109.

    Article  Google Scholar 

  • National Center for Education Statistics [NCES]. (2006). Early childhood longitudinal study, kindergarten class of 1998-99: Combined user's manual for the ECLS-K fifth-grade data files and electronic codebooks (NCES 2006-032). Washington DC: U.S. Department of Education.

    Google Scholar 

  • National Reading Panel. (2000). A Report of the National Reading Panel: Teaching children to read (Vol. NIH Pub. No. 00-4754). Washington, DC: National Institute of Child Health and Human Development.

    Google Scholar 

  • Perry, N. E., & Meisels, S. J. (1996). How accurate are teacher judgments of students' academic performance? Washington, DC: National Center for Education Statistics.

    Google Scholar 

  • Racz, S. J., King, K. M., Wu, J., Witkiewitz, K., & McMahon, R. (2013). The predictive utility of a brief kindergarten screening measure of child behavior problems. Journal of Consulting and Clinical Psychology, 81, 588–599.

    Article  PubMed Central  PubMed  Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: applications and data analysis methods (2nd ed.). Thousand Oaks: Sage Publications.

    Google Scholar 

  • Sadeh, S. S., Burns, M. K., & Sullivan, A. L. (2012). Examining an executive function rating scale as a predictor of achievement in children at risk for behavior problems. School Psychology Quarterly, 27, 236–246.

    Article  PubMed  Google Scholar 

  • Scarborough, H. S. (1998). Early identification of children at risk for reading disabilities: Phonological awareness and some other promising predictors. In B. K. Shapiro, P. J. Accardo, & A. J. Capute (Eds.), Specific reading disability: a view of the spectrum. Timonium: York Press, Inc.

    Google Scholar 

  • Schatschneider, C., Fletcher, J. M., Francis, D. J., Carlson, C. D., & Foorman, B. R. (2004). Kindergarten prediction of reading skills: a longitudinal comparative analysis. Journal of Educational Psychology, 96, 265–282.

    Article  Google Scholar 

  • Snow, C. E., Burns, M. S., & Griffin, P. (Eds.). (1998). Preventing reading difficulties in young children. Washington, DC: National Academy Press.

    Google Scholar 

  • Taylor, H. G., Anselmo, M., Foreman, A. L., Schatschneider, C., & Angelopoulos, J. (2000). Journal of Learning Disabilities, 33, 200–210.

    Article  PubMed  Google Scholar 

  • Teisl, J. T., Mazzocco, M. M. M., & Myers, G. F. (2001). The utility of kindergarten teacher ratings for predicting low academic achievement in first grade. Journal of Learning Disabilities, 34, 286–293.

    Article  PubMed  Google Scholar 

  • U.S. Department of Education (2005). National Assessment of Educational Progress: The Nation's Report Card. Washington, DC: National Center for Educational Statistics. http://nces.ed.gov/nationsreportcard/pdf/main2005/2006451.pdf. Accessed 1 September 2007

  • Wagner, R. K., Torgeson, J. K., & Rashotte, C. A. (2004). Comprehensive test of phonological processing kit. Austin: PRO-ED.

    Google Scholar 

  • Witsken, D., Stoeckel, A., & D'Amato, R. C. (2008). Leading educational change using a neuropsychological response-to-intervention approach: linking our past, present, and future. Psychology in the Schools, 45, 781–798.

    Article  Google Scholar 

  • Wolf, M., & Bowers, P. G. (1999). The double-deficit hypothesis for developmental dyslexia. Journal of Educational Psychology, 9, 415–438.

    Article  Google Scholar 

  • Woodcock, R. W., McGrew, K. S., & Werder, J. K. (1994). Woodcock–McGrew–Werder Mini Battery of Achievement. Itasca: Riverside Publishing.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jonathan E. Titley.

Additional information

This article was based on research conducted as part of a doctoral dissertation by the first author.

Appendixes

Appendixes

Appendix 1

Table 4 Academic rating scale-language and literacy—kindergarten version

Appendix 2

Table 5 Academic rating scale-language and literacy—first grade version

Rights and permissions

Reprints and permissions

About this article

Cite this article

Titley, J.E., D’Amato, R.C. & Koehler-Hak, K.M. Utilizing Teacher Ratings of Student Literacy to Identify At-Risk Students: an Analysis of Data from the Early Childhood Longitudinal Study. Contemp School Psychol 18, 59–68 (2014). https://doi.org/10.1007/s40688-013-0005-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40688-013-0005-3

Keywords

Navigation