Monitoring Mathematics Achievement over Time

A Secondary Analysis of FIMS, SIMS and TIMS: A Rasch Analysis
  • Tilahun Mengesha Afrassa
Part of the Education in the Asia-Pacific Region: Issues, Concerns and Prospects book series (EDAP, volume 4)


This paper is concerned with the analysis and scaling of mathematics achievement data over time by applying the Rasch model using the QUEST (Adams & Khoo, 1993) computer program. The mathematics achievements of the students are brought to a common scale. This common scale is independent of both the samples of students tested and the samples of items employed. The scale is used to examine the changes in mathematics achievement of students in Australia over 30 years from 1964 to 1994. Conclusions are drawn as to the robustness of the common scale, and the changes in students’ mathematics achievements over time in Australia.

Key words

Mathematics achievement measurement Rasch analysis change 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

6. References

  1. Adams, R. J. & Khoo, S.T. (1993). Quest-The Iinteractive Test Analysis System. Hawthorn, Victoria: ACERGoogle Scholar
  2. Adams, R. J. & Gonzalez, E. J. (1996). The TIMSS test design. In M.O. Martin & D.L. Kelly (eds), Third International Mathematics and Science Study Technical Report vol. 1, Boston: IEA, pp. 3-1–3-26.Google Scholar
  3. Anderson, L. W. (1994). Attitude Measures. In T. Husén (ed), The international Encyclopedia of Education, vol. 1, (second ed.), Oxford: Pergamon, pp. 380–390.Google Scholar
  4. Beaton, A. E., Mulls, I. V. S., Martin, M. O, Gonzalez, E. J, Kelly, D. L. and Smith, T. A. (1996a). Mathematics Achievement in the Middle School Years: IEA’s Third International Mathematics and Science Study. Boston: IEA.Google Scholar
  5. Beaton, A. E., Martin, M. O, Mulls, I. V. S., Gonzalez, E. J., Smith, T. A. & Kelly, D. L. (1996b). Science Achievement in the Middle School Years: IEA’s Third International Mathematics and Science Study. Boston: IEA.Google Scholar
  6. Beard, J. G. & Pettie, A. L. (1979). A comparison of Linear and Rasch Equating results for basic skills assessment Tests. Florida State University. Florida: ERIC.Google Scholar
  7. Brick, J. M., Broene, P., James, P. & Severynse, J. (1997). A user’s guide to WesVarPC. (Version 2.11). Boulevard. MD: Westat, Inc.Google Scholar
  8. Elley, W. B. (1994). The IEA Study of Reading Literacy: Achievement and Instruction in Thirty-Two School Systems. Oxford: Pergamon Press.Google Scholar
  9. Foy, R., Rust, K. & Schleicher, A. (1996). Sample design. In M O Martin & D L Kelly (eds), Third International Mathematics and Science Study: Technical Report Vol 1: Design and Development, Boston: IEA, pp. 4-1 to 4-17.Google Scholar
  10. Garden, R. A. (1987). The second IEA mathematics study. Comparative Education Review, 31(1), 47–68.CrossRefGoogle Scholar
  11. Garden, R. A. & Orpwood, G. (1996). Development of the TIMSS achievement tests. In M O Martin & D L Kelly (eds), Third International Mathematics and Science Study Technical Report Volume 1: Design and Development, Boston: IEA, pp. 2-1 to 2-19.Google Scholar
  12. Hambleton, R. K.& Cook, L. L. (1977). Latent trait models and their use in the analysis of educational test data. Journal of educational measurement, 14(2), 75–96.Google Scholar
  13. Hambleton, R. K., Zaal, J. N.& Pieters, J. P. M. (1991). Computerized adaptive testing: theory, applications, and standards. In R.K Hambleton & J.N. Zaal (eds), Advances in Educational and Psychological Testing, Boston, Mass.: Kluwer Academic Publishers, pp. 341–366.Google Scholar
  14. Hanna, G. (1989). Mathematics achievement of girls and boys in grade eight: Results from twenty countries. Educational Studies in Mathematics, 20(2), 225–232.CrossRefGoogle Scholar
  15. Husén, T. (ed.), (1967). International Study of Achievement in Mathematics (vols 1 & 2). Stockholm: Almquist & Wiksell.Google Scholar
  16. Keeves, J. P. (1995). The World of School Learning: Selected Key Findings from 35 Years of IEA Research. The Hague, The Netherlands: The International Association for the Evaluation of Education.Google Scholar
  17. Keeves, J. P. (1968). Variation in Mathematics Education in Australia: Some Interstate Differences in the Organization, Courses of Instruction, Provision for and Outcomes of Mathematics Education in Australia. Hawthorn, Victoria: ACER.Google Scholar
  18. Keeves, J. P. & Kotte, D. (1996). The Measurement and reporting of key competencies. In Teaching and Learning the Key Competencies in the Vocational Education and Training sector, Adelaide: Flinders Institute for the Study of Teaching, pp. 139–168.Google Scholar
  19. Keeves, J. P. & Schleicher, A. (1992). Changes in Science Achievement: 1970–84. In J P Keeves (ed.), The IEA Study of Science III: Changes in Science Education and Achievement: 1970 to 1984, Oxford: Pergamon Press, pp. 141–151.Google Scholar
  20. Keeves, J. P. & Radford, W. C. (1969). Some Aspects of Performance in Mathematics in Australian schools. Hawthorn, Victoria: Australian Council for Educational Research.Google Scholar
  21. Kolen, M. J. & Whitney, D. R. (1981). Comparison of four procedures for equating the tests of general educational development. Paper presented at the annual meeting of thee American Educational Research Association. Los Angeles, California.Google Scholar
  22. Lietz, p. (1996). Changes in Reading Comprehension across Culture and Over Time. German: Waxman, Minister.Google Scholar
  23. Martin, M. O. (1996). Third international mathematics and science study: An overview. In M O Martin & D L Kelly (eds), Third International Mathematics and Science Study: Technical Report vol 1: Design and Development, Boston: IEA, pp. 1.1–1.19.Google Scholar
  24. Moss, J. D. (1982). Towards Equality: Progress by Girls in Mathematics in Australian Secondary Schools. Hawthorn, Victoria: ACER.Google Scholar
  25. Norusis, M. J.(1993). SPSS for Windows: Base System User’s Guide: Release 6.0, Chicago: SPSS Inc.Google Scholar
  26. Postlethwaite, T. N. (1967). School Organization and Student Achievement a Study Based on Achievement in Mathematics in Twelve Countries. Stockholm: Almqvist & Wiksell.Google Scholar
  27. Rentz, R. R. & Bashaw, W. L. (1975). Equating Reading tests with the Rasch model, Vol. I Final Report. Athens, Georgia: University of Georgia: Educational Research Laboratory, College of Education.Google Scholar
  28. Robitaille, D. F. (1990). Achievement comparisons between the first and second IEA studies of mathematics. Educational Studies in Mathematics, 21(5), 395–414.CrossRefGoogle Scholar
  29. Robitaille, D.F. and Beaton, A.E. (2002). TIMSS: A Brief Overview of the Study. In D.F. Robitaille and A.E. Beaton (ed.), Secondary Analysis of the TIMSS Data, Dordrecht, KLUWER, pp. 11–180.Google Scholar
  30. Robitaille, D. F. & Travers, K. J. (1992). International studies of achievement in mathematics. In D A Grouws, (ed.), Hand book of Research on Mathematics Teaching and Learning, New York: Macmillan, pp. 687–709.Google Scholar
  31. Rosier, M. J. (1980). Changes in Secondary School Mathematics in Australia. Hawthorn, Victoria: ACER.Google Scholar
  32. Smith, R. M. and Kramer, G. A. (1992). A comparison of two methods of test equating in the Rasch model. Educational and Psychological Measurement, 52(4), 835–846.Google Scholar
  33. Sontag, L. M. (1984). Vertical equating methods: A comparative study of their efficacy. DAI, 45-03B, page 1000.Google Scholar
  34. Tilahun Mengesha Afrassa. (2002). Changes in Mathematics Achievement Overtime in Australia and Ethiopia. Flinders University Institute of International Education, Research Collection, No 4, Adelaide.Google Scholar
  35. Tilahun Mengesha Afrassa (1996). Students’ Attitudes towards Mathematics and Schooling over time: A Rasch analysis. Paper presented in the Joint Conference of Educational Research Association, Singapore (ERA) and Australian Association for Research in Education (AARE), Singapore Polytechnic, Singapore. 25–29 November 1996.Google Scholar
  36. Tilahun Mengesha Afrassa and Keeves, J. P. (2001). Change in differences between the sexes in mathematics achievement at the lower secondary school level in Australia: Over Time. International Education Journal, 2(2). 96–107.Google Scholar
  37. Tilahun Mengesha Afrassa. and Keeves, J. P.(1997). Changes in Students’ Mathematics Achievement in Australian Lower Secondary Schools over Time: A Rasch analysis. Paper presented in 1997 Annual Conference of the Australian Association for Research in Education (AARE). Hilton Hotel, Brisbane, 30 November to 4 December 1997.Google Scholar
  38. Wright, B. D. (1995). 3PL or Rasch? Rasch Measurement Transactions, 9(1), 408–409.Google Scholar
  39. Wright, B. D., and Stone, M. H. (1979). Best Test Design: Rasch Measurement. Chicago: Mesa Press.Google Scholar
  40. Willett, J. B. (1997). Change, Measurement of. In J.P. Keeves (ed.), Educational Research, Methodology, and Measurement: An International Handbook, (second ed.), Oxford: Pergamon, pp. 327–334.Google Scholar
  41. Zammit, S.A, Routitsky, A. and Greenwood, L. (2002). Mathematics and Science Achievement of Junior Secondary School Students in Australia. Camberwell, Victoria: ACER.Google Scholar

Copyright information

© Springer 2005

Authors and Affiliations

  • Tilahun Mengesha Afrassa
    • 1
  1. 1.South Australian Department of Education and Children’s ServicesAustralia

Personalised recommendations