Using Large-scale Assessment Datasets for Research in Science and Mathematics Education: Programme for International Student Assessment (PISA)
- 1.6k Downloads
Large-scale assessments of student achievement provide a window into the broadly defined concepts of literacy and generate information about levels and types of student achievement in relation to some of the correlates of learning, such as student background, attitudes, and perceptions, and perhaps school and home characteristics. This paper provides an overview and outlines potential research opportunities of one such assessment—the Programme for International Student Assessment (PISA). In order to provide examples of the work that can be accomplished with these data, we describe and discuss the results generated from PISA 2000 and PISA 2003 in terms of international comparisons of achievement and the models of relational patterns of student, home, and school characteristics. We provide insight from the recent pilot testing conducted in Taiwan for PISA 2006, which has a focus on scientific literacy. This is followed by a discussion of the implications and potentials of the 2000 and 2003 datasets to facilitate research on scientific and mathematical literacy. The paper concludes with a look ahead to PISA 2006 and what researchers should be attending to in the research reports generated from the OECD and the research interests that they could follow given access to the datasets generated.
Key Wordsfuture opportunities large-scale assessments PISA results secondary analyses
Unable to display preview. Download preview PDF.
- Anderson, J.O., Rogers, W.T., Klinger, D.A., Ungerleider, C., Glickman, V. & Anderson, B. (2006). Student and school correlates of mathematics achievement: Models of school performance based on Pan-Canadian student assessment. Canadian Journal of Education, 29(3), 706–730.Google Scholar
- Central Intelligence Agency. (2003). The world factbook. Retrieved April 2006 from http://www.cia.gov/cia/publications/factbook/index.html.
- Chinn, P.W., Hand, B.M., & Yore, L.D. (2007). Culture, language, knowledge about nature and naturally occurring events, and science literacy for all: She says, he says, they say. L1-Educational Studies in Language and Literature (special issue, submitted).Google Scholar
- De Bortoli, L. & Cresswell, J. (2004). Australia’s indigenous students in PISA 2000: Results from an international study. ACER Research Monograph No 59. Camberwell, Victoria: Australian Council for Educational Research.Google Scholar
- Doig, B. (2001). Summing up: Australian numeracy performances, practices, programs and possibilities. Camberwell, Victoria: Australian Council on Educational Research.Google Scholar
- Donelly, K. (2005). PISA and TIMSS are like apples and oranges. ON-LINE opinion - Australia’s e-journal of social and political debate (posted 1 February 2005) http://www.onlineopinion.com.au/view.asp?article=2985.
- Ferrari, J. (2006). National syllabus ‘ a power grab’, The Weekend Australian, October 7–8, p. 4.Google Scholar
- Fertig, M. (2003). Who’s to blame? The determinants of German students’ achievement in the PISA 2000 study. Discussion paper 739, The Institute for the Study of Labor (IZA), Bonn, Germany. http://ftp.iza.org/dp739.pdf. Retrieved April 2007.
- Fraser, B.J. (1998). Science learning environments: Assessment, efforts and determinants. In B.J. Fraser & K.G. Tobin (Eds.), The international handbook of science education (pp. 527–564). Dordrecht, The Netherlands: Kluwer.Google Scholar
- Fraser, B.J. (2002). Learning environment research: Yesterday, today and tomorrow. In S.C. Goh & M.S. Khine (Eds.), Studies in educational learning environments: An international perspective (pp. 1–27). Singapore: World Scientific.Google Scholar
- Friedler, Y. & Tamir, P.J. (1986). Teaching basic concepts of scientific research to high school students. Journal of Biological Education, 20(4), 263–269.Google Scholar
- Gee, J.P. (2004). Language in the science classroom: Academic social languages as the heart of school-based literacy. In E.W. Saul (Ed.), Crossing borders in literacy and science instruction: Perspectives on theory and practices (pp. 13–32). Newark, DE: International Reading Association.Google Scholar
- Goh, M. (2006). A multilevel analysis of mathematics literacy: The effects of intrinsic motivation, teacher support and student-teacher relations. Master’s Thesis, University of Victoria, Victoria, British Columbia, Canada.Google Scholar
- Goh, S.C., & Khine, S.M. (Eds.). (2002). Studies in educational learning environments: An international perspective. Singapore: World Scientific.Google Scholar
- Gu, Z. (2006). A comparison of Canada and Hong Kong-China through hierarchical linear models: The relations among students’ self-beliefs in math, the learning environment at school, and math performance. Master’s Thesis, University of Victoria, Victoria, British Columbia, Canada.Google Scholar
- Hambleton, R.H. & Swaminathan, H. (1985). Item response theory: Principles and applications. Norwell, MA: Kluwer.Google Scholar
- LaFontaine, D. & Monseur, C. (2006). Impact of test characteristics on gender equity indicators in the assessment of reading comprehension. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, California, USA.Google Scholar
- Lokan, J., Greenwood, L. & Cresswell, J. (2001). 15-Up and counting, reading, writing, reasoning: How literate are Australian students? The PISA 2000 survey of students’ reading, mathematics and scientific literacy skills. Report for the OECD. Camberwell, Victoria: Australian Council for Educational Research.Google Scholar
- National Research Council. (1996). National science education standards. Washington, DC: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2001). Knowledge and skills for life: First report from the OECD programme for international student assessment. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2002). PISA 2000 technical report. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2003). The PISA 2003 assessment framework - mathematics, reading, science and problem solving: Knowledge and skills. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2004). Messages from PISA 2000. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2005a). Learning for tomorrow’s world: First results from PISA 2003. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2005b). PISA 2003 data analysis manual - SAS users. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2006a). Where immigrant students succeed - A comparative review of performance and engagement in PISA 2003. Paris: Author.Google Scholar
- Organisation for Economic Co-operation and Development. (2006b). School factors related to quality and equity: Results from PISA 2003. Paris: Author.Google Scholar
- Pimm, D., Tuan, H-L. & Yore, L.D. (2007). Language, mathematics literacy, and science literacy: Seeking convergence and cognitive symbiosis. International Journal of Science and Mathematics Education (special issue, in press).Google Scholar
- Walberg, H.J. (Ed.), (1979). Educational environments and effects: Evaluation, policy, and productivity. Berkeley, CA: McCutchan.Google Scholar
- Wubbels, T. & Levy, J. (Eds.) (1993). Do you know what you look like?: Interpersonal relationships in education. London: Falmer Press.Google Scholar
- Yore, L.D. (2007). Science literacy for all students: Language, culture, and knowledge about nature and naturally occurring events. L1-Educational Studies in Language and Literature (special issue, submitted).Google Scholar
- Zubrick, S.R., Silburn, S.R., Gurrin, L., Teoh, H., Shepherd, C., Carlton, J. & Lawrence, D. (1997). Western Australian child health survey: Education, health and competence. Perth, Western Australia: Australian Bureau of Statistics and the TVW Telethon Institute of Child Health Research.Google Scholar