Abstract
This article discusses large-scale assessment of change in student achievement and takes the study by Hickendorff, Heiser, Van Putten, and Verhelst (2009) as an example. This study compared the achievement of students in the Netherlands in 1997 and 2004 on written division problems. Based on this comparison, they claim that there is a performance decline in this subdomain of mathematics, and that there is a move from applying the digit-based long division algorithm to a less accurate way of working without writing down anything. In our discussion of this study, we address methodological challenges that come in when investigating long-term trends in student achievements, such as the need for adequate operationalizations, the influence of the time of measurement and the necessity of the comparability of assessments, the effect of the assessment format, and the importance of inclusion relevant covariates in item response models. All these issues matter when assessing change in student achievement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahlers, J. (1987). Grote eensgezindheid over basisonderwijs. Onderzoek onder leraren en ouders [Large consensus about primary education. A survey among teachers and parents]. School, 15(4), 5–10.
Cadot, J., & Vroegindeweij, D. (1986). 10 voor de basisvorming onderzocht [Ten points for basic education in mathematics investigated]. Utrecht University, OW & OC: Utrecht.
Caygill, R., & Eley, L. (2001). Evidence about the effects of assessment task format on student achievement. Paper presented at the Annual Conference of the British Educational Research Association, University of Leeds, England, September 13–15, 2001. Retrieved from http://www.leeds.ac.uk/educol/documents/00001841.htm.
Danili, E., & Reid, N. (2005). Assessment formats: do they make a difference? Chemistry Education Research and Practice, 6(4), 204–212.
Edwards, J. R., & Bagozzi, R. P. (2000). On the nature and direction of relationships between constructs and their measures. Psychological Methods, 5(2), 155–174.
Floden, R. E. (2002). The measurement of opportunity to learn. In A. C. Porter & A. Gamoran (Eds.), Methodological advances in cross-national surveys of educational achievement (pp. 231–266). Washington: National Academy Press.
Freudenthal, H. (1973). Mathematics as an educational task. Dordrecht: Reidel.
Freudenthal, H. (1978a). Weeding and sowing. Preface to a science of mathematical education. Dordrecht: Reidel.
Freudenthal, H. (1978b). Cognitieve ontwikkeling—kinderen geobserveerd [Cognitive development—observing children]. In Provinciaals Utrechts Genootschap, Jaarverslag 1977 (pp. 8–18)
Goldstein, H. (1979). Consequences of using the Rasch model for educational assessment. British Educational Research Journal, 5, 211–220.
Gölitz, D., Roick, T., & Hasselhorn, M. (2006). DEMAT 4: Deutscher Mathematiktest für vierte Klassen [DEMAT 4: German mathematics test for grade 4]. Göttingen: Hogrefe.
Haggarty, L., & Pepin, B. (2002). An investigation of mathematics textbooks and their use in English, French and German classrooms: Who gets an opportunity to learn what?. British Educational Research Journal, 28(4), 567–590.
Hickendorff, M., Heiser, W. J., Van Putten, C. M., & Verhelst, N. D. (2009). Solution strategies and achievement in Dutch complex arithmetic: Latent variable modeling of change. Psychometrika, 74(2), doi:10.1007/s11336-008-9074-z
Husén, T. (1967). International study of achievement in mathematics: A comparison of twelve countries (Vol. II). New York: Wiley.
Janssen, J., Van der Schoot, F., & Hemker, B. (2005). Balans van het reken-wiskundeonderwijs aan het einde van de basisschool 4 [Fourth assessment of mathematics education at the end of primary school]. Arnhem: CITO.
Mazzeo, J., & von Davier, M. (2008). Review of the programme for international student assessment (PISA) test design: Recommendations for fostering stability in assessment results (OECD Education Working Papers) (EDU/PISA/GB(2008)28). Paris: OECD
Molenaar, P. C. M. (2004). A manifesto on Psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2(4), 201–218.
Ramsay, J. O., & Silverman, B. W. (2005). Functional data analysis. New York: Springer.
Siegler, R. S., & Lemaire, P. (1997). Older and younger adults’ strategy choices in multiplication: Testing predictions of ASCM using the choice/no-choice method. Journal of Experimental Psychology: General, 126(1), 71–92.
Sijtsma, K. (2006). Psychometrics in psychological research: Role model or partner in science. Psychometrika, 71, 451–455.
Stenner, A. J., Burdick, D. S., & Stone, M. H. (2008). Formative and reflective models: Can a Rasch analysis tell the difference?. Rasch Measurement Transactions, 22, 1152–1153.
Törnroos, J. (2005). Mathematical textbooks, opportunity to learn and student achievement. Studies in Educational Evaluation, 31(4), 315–327.
Treffers, A., & De Moor, E. (1984). 10 voor de basisvorming rekenen/wiskunde [Ten points for basic education in mathematics]. Utrecht: Utrecht University, OW&OC.
Treffers, A. (2008). Comparing WIG’s en PLUSPUNT’s teaching of written arithmetic (Unpublished manuscript). Utrecht: Utrecht University, Freudenthal Institute for Science and Mathematics Education.
Van der Schoot, F. (2008). Onderwijs op peil? Een samenvattend overzicht van 20 jaar PPON [A summary overview of 20 years of national assessments of the level of education]. Arnhem: CITO.
Van den Heuvel-Panhuizen, M. (1996). Assessment and realistic mathematics education. Utrecht: CD-β Press/Freudenthal Institute, Utrecht University.
Van Putten, C. M., & Hickendorff, M. (2006). Strategieën van leerlingen bij het beantwoorden van deelopgaven in de periodieke peilingen aan het eind van de basisschool van 2004 en 1997 [Students’ strategies when solving division problems in the PPON test end primary school 2004 and 1997]. Reken-wiskundeonderwijs: onderzoek, ontwikkeling, praktijk, 25(2), 16–25.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
van den Heuvel-Panhuizen, M., Robitzsch, A., Treffers, A. et al. Large-Scale Assessment of Change in Student Achievement: Dutch Primary School Students’ Results on Written Division in 1997 and 2004 as an Example. Psychometrika 74, 351–365 (2009). https://doi.org/10.1007/s11336-009-9110-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11336-009-9110-7