Skip to main content

Advertisement

Log in

Developing and evaluating a kindergarten to third grade CBM mathematics assessment

  • Original Article
  • Published:
ZDM Aims and scope Submit manuscript

Abstract

The present study examined the technical adequacy of curriculum-based measurement (CBM) measure of early numeracy for kindergarten through third grade students. Our CBM measures were developed to reflect broad and theoretically derived categories of mathematical thinking: quick retrieval, written computation, and number sense. The mastery of these three categories comprises the larger construct of numeracy proficiency for the early elementary grades. Approximately 300 students in each grade (Kindergarten to Grade 3) were administered a standardized measure, WJ-III, and the following timed measures: kindergarten—counting, missing number, number identification, quantity discrimination; Grade 1—counting, missing number, next number, number facts, number identification, quantity discrimination; Grades 2 and 3—computation, concepts, missing number, number facts, quantity discrimination. Alpha and test–retest reliabilities were assessed, and construct validity and criterion validity were examined for the CBM measures developed in the study. Overall, the results indicated that the measures were reliable and showed evidence to support both construct and concurrent validity. Methods to improve the measures are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Monterey: Brooks/Cole.

    Google Scholar 

  • Ansari, D., & Karmiloff-Smith, A. (2002). Atypical trajectories of number development: a neuroconstructivist perspective. Trends in Cognitive Sciences, 6(12), 511–516.

    Article  Google Scholar 

  • Baroody, A. J. (1992). The development of preschoolers’ counting skills and principles. In J. Bideaud, C. Meljac, & J. P. Fischer (Eds.), Pathways to number: Children’s developing numerical abilities (pp. 99–126). Hillsdale: Lawrence Erlbaum Associates Inc.

    Google Scholar 

  • Bergan, J. R., Sladeczek, I. E., Schwarz, R. D., & Smith, A. N. (1991). Effects of a measurement and planning system on kindergarteners’ cognitive development and educational programming. American Educational Research Journal, 28(3), 683–714.

    Article  Google Scholar 

  • Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139–148.

    Google Scholar 

  • Bowman, B. T., Donovan, M. S., & Burns, M. S. (Eds.). (2001). Eager to learn: Educating our preschoolers. Washington, DC: National Academy Press.

    Google Scholar 

  • Campbell, F. A., & Ramey, C. T. (1994). Effects of early intervention on intellectual and academic achievement: A follow-up study of children from low-income families. Child Development, 65(2), 684–698.

    Article  Google Scholar 

  • Chard, D. J., Clarke, B., Baker, S., Otterstedt, J., Braun, D., & Katz, R. (2005). Using measures of number sense to screen for difficulties in mathematics: Preliminary findings. Assessment for Effective Intervention, 30(2), 3–14.

    Article  Google Scholar 

  • Christ, T. J., & Vining, O. (2006). Curriculum-based measurement procedures to develop multiple-skill mathematics computation probes: Evaluation of random and stratified stimulus-set arrangements. School Psychology Review, 35, 387–400.

    Google Scholar 

  • Clarke, B., & Shinn, M. R. (2004). A preliminary investigation into the identification and development of early mathematics curriculum-based measurement. School Psychology Review, 33, 234–248.

    Google Scholar 

  • Crocker, L., & Algina, J. (1986). Introduction to classical modern test theory. Belmont: Wadsworth Group.

    Google Scholar 

  • Cross, C. T., Woods, T. A., & Schweingruber, H. (Eds.). (2009). Mathematics learning in early childhood: Paths toward excellence and equity. Washington, DC: National Academy Press.

    Google Scholar 

  • CTB, McGraw-Hill. (1976). Comprehensive tests of basic skills. Monterey: McGraw-Hill.

    Google Scholar 

  • Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52, 219–232.

    Google Scholar 

  • Deno, S. L., & Jiban, C. (2006). Elementary math measures. Baltimore: Presentation at the National Council for Exceptional Children conference.

    Google Scholar 

  • Duncan, G.J., Dowsett, C.J., Claessens, A., Magnuson, K., Huston, A.C., Klebanov, P., Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428–1446.

    Article  Google Scholar 

  • Fuchs, L. S. (2004). The past, present, and future of curriculum-based measurement research. School Psychology Review, 33(2), 188–192.

    Google Scholar 

  • Fuchs, L. S., & Fuchs, D. (1986). Effects of systematic formative evaluation: A meta-analysis. Exceptional Children, 53(3), 199–208.

    Google Scholar 

  • Fuchs, L. S., Fuchs, D., Compton, D. L., Hamlett, C. L., & Seethaler, P. M. (2007). Mathematics screening and progress monitoring at first grade: Implications for responsiveness to intervention. Council for Exceptional Children, 73(3), 311–330.

    Article  Google Scholar 

  • Fuchs, L. S., Fuchs, D., & Hamlett, C. L. (1989a). Effects of instrumental use of curriculum-based measurement to enhance instructional programs. RASE: Remedial and Special Education, 10(2), 43–52.

    Google Scholar 

  • Fuchs, L. S., Fuchs, D., & Hamlett, C. L. (1989b). Effects of alternative goal structures within curriculum-based measurement. Exceptional Children, 55(5), 429–438.

    Google Scholar 

  • Fuchs, L. S., Fuchs, D., Hamlett, C. L., & Stecker, P. M. (1990a). The role of skills analysis in curriculum-based measurement in math. School Psychology Review, 19(1), 6–23.

    Google Scholar 

  • Fuchs, L. S., Fuchs, D., Hamlett, C. L., Thompson, A., Roberts, P. H., Kubek, P., & Stecker, P. M. (1994). Technical features of a mathematics concepts and applications curriculum-based measurement system. Diagnostique, 19(4), 23–49.

    Google Scholar 

  • Fuchs, L. S., Hamlett, C. L., & Fuchs, D. (1990b). Monitoring basic skills progress: Basic math computation and concepts and applications programs. Austin: Pro-Ed.

    Google Scholar 

  • Gersten, R., Jordan, N. C., & Flojo, J. R. (2005). Early identification and interventions for students with mathematics difficulties. Journal of Learning Disabilities, 38(4), 293–304.

    Article  Google Scholar 

  • Ginsburg, H. P., Greenes, C., & Balfanz, R. (2003). Big math for little kids. Parsippany: Dale Seymour Publications.

    Google Scholar 

  • Gulliksen, H. (1987). Theory of mental tests. Hillsdale: Erlbaum. (Reprinted from Theory of mental tests, by H. Gulliksen, 1950, New York: Wiley).

  • Hintze, J. M., Christ, T. J., & Keller, L. A. (2002). The generalizability of CBM survey-level mathematics assessments: Just how many samples do we need? School Psychology Review, 31, 540–553.

    Google Scholar 

  • Howes, C., Burchinal, M., Pianta, R., Bryant, D., Early, D., Clifford, R., & Barbarin, O. (2008). Ready to learn? Children’s pre-academic achievement in pre-kindergarten programs. Early Childhood Research Quarterly, 23(1), 27–50.

    Article  Google Scholar 

  • Hu, L.-T., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76–99). Thousand Oaks: Sage.

    Google Scholar 

  • Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55.

    Article  Google Scholar 

  • Individuals with Disabilities Education Act, 20 U.S.C. § 1400 (2004).

  • Jordan, N. C., Kaplan, D., Locuniak, M. N., & Ramineni, C. (2007). Predicting first-grade math achievement from developmental number sense trajectories. Learning Disabilities Research & Practice, 22, 36–46.

    Article  Google Scholar 

  • Jordan, N. C., Kaplan, D., Nabors Oláh, L., & Locuniak, M. N. (2006). Number sense growth in Kindergarten: A longitudinal investigation of children at risk for mathematics difficulties. Child development, 77(1), 153–175.

    Article  Google Scholar 

  • Jordan, N. C., Kaplan, D., Ramineni, C., & Locuniak, M. N. (2009). Early math matters: kindergarten number competence and later mathematics outcomes. Developmental psychology, 45(3), 850–867.

    Article  Google Scholar 

  • Kaufman, A. S., & Kaufman, A. S. (1985). Kaufman test of educational achievement comprehensive form manual. Circle Pines: American Guidance Service.

    Google Scholar 

  • Kim, S.-H. (1999). CIA: A Computer Program for Classical Item Analysis. [Computer Software]. Athens: University of Georgia.

  • Lembke, E. S., & Foegen, A. (2009). Identifying early numeracy indicators for kindergarten and first-grade students. Learning Disabilities Research & Practice, 24(1), 12–20.

    Article  Google Scholar 

  • Lembke, E. S., Foegen, A., Whittaker, T. A., & Hampton, D. (2008). Establishing technically adequate measures of progress in early numeracy. Assessment for Effective Intervention, 33(4), 206–214.

    Article  Google Scholar 

  • National Association for the Education of Young Children and National Council of Teachers of Mathematics. (2002). Position statement. Early childhood mathematics: Promoting good beginnings, Retrieved October 26, 2013 from the World Wide Web: http://www.naeyc.org/about/positions/psmath.asp.

  • National Council of Teachers of Mathematics. (1989). Curriculum and evaluation NCTM Standards for school mathematics. Reston: The National Council of Teachers of Mathematics Inc.

    Google Scholar 

  • Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press.

    Google Scholar 

  • Russell, R. L., & Ginsburg, H. P. (1984). Cognitive analysis of children’s mathematics difficulties. Cognition and Instruction, 1, 217–244.

    Article  Google Scholar 

  • Siegler, R. S., Duncan, G. J., Davis-Kean, P. E., Duckworth, K., Claessens, A., Engel, M., et al. (2012). Early predictors of high school mathematic achievement. Psychological science, 23(7), 691–697.

    Article  Google Scholar 

  • Skiba, R., Magnusson, D., Marston, D., & Erickson, K. (1986). The assessment of mathematics performance in special education: Achievement tests, proficiency tests, or formative evaluation. Minneapolis: Special Services, Minneapolis Public Schools.

    Google Scholar 

  • Speece, D. L., Molloy, D. E., & Case, L. P. (2003). Responsiveness to general education instruction as the first gate to learning disabilities identification. Learning Disabilities Research & Practice, 18, 145–156.

    Article  Google Scholar 

  • Stecker, P. M., Fuchs, L. S., & Fuchs, D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42(8), 795–819.

    Article  Google Scholar 

  • The Psychological Corporation. (1992). Wechsler Individual Achievement Test. San Antonio: Author.

    Google Scholar 

  • Tindal, G., Germann, G., & Deno, S. L. (1983). Descriptive research on the Pine County norms: A compilation of findings (Research Report No. 132). Minneapolis: University of Minnesota Institute for Research on Learning Disabilities.

  • Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.

    Article  Google Scholar 

  • VanDerHeyden, A. M., Witt, J. C., Haquin, G., & Noell, G. (2001). The reliability and validity of curriculum-based measurement readiness probes for kindergarten students. School Psychology Review, 30, 363–382.

    Google Scholar 

  • Vellutino, F. R., Scanlon, D. M., Sipay, E. R., Small, S. G., Pratt, A., Chen, R., & Denckla, M. B. (1996). Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Early intervention as a vehicle for distinguishing between cognitive and experiential deficits as basic causes of specific reading disability. Journal of Educational Psychology, 88(4), 601–638.

    Article  Google Scholar 

  • Woodcock, R. W., McGrew, K. F., & Mather, N. (2001). Woodcock-Johnson III Tests of achievement. Itasca: Riverside Publishing.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Young-Sun Lee.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 222 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, YS., Lembke, E. Developing and evaluating a kindergarten to third grade CBM mathematics assessment. ZDM Mathematics Education 48, 1019–1030 (2016). https://doi.org/10.1007/s11858-016-0788-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11858-016-0788-6

Keywords

Navigation