Policy impact of PISA on mathematics education: the case of Norway
- 11 Downloads
Abstract
This article addresses the policy implications of participation in international large-scale assessments (ILSAs), particularly the Programme for International Student Assessment (PISA), and the ways in which such implications might influence mathematics education. Taking Norway as a special case, this discussion focuses on insights into teaching, learning and assessment practices that can be inferred from the PISA study, and how participation in ILSAs has contributed to educational policy and even changed policymakers’ perspectives on schools, teachers and students. Following publication of the PISA 2000 results, Norway experienced a ‘PISA shock’, leading to the implementation of a national quality assessment system and national tests. In addition, changes were made to the mathematics curriculum for compulsory school and to mathematics teacher education. More recently, public debate has focused less on rank and league tables, shifting instead to the high number of low-achieving students and the low number of high achievers. Moreover, there has been little uptake of policy advice provided by the Organisation for Economic Co-operation and Development (OECD), which focuses on strengthening accountability measures. Furthermore, although the Norwegian educational system in the past decade has undergone a decentralisation process, the educational system still follows the Nordic model, which focuses on equity and ‘education for all’. Analyses of the Norwegian case indicate that policymaking takes place in highly cultural contexts, and that international studies might be used merely to validate existing policy directions.
Keywords
International large-scale assessment PISA Policymaking Educational reform Norway Mathematics educationNotes
References
- Anderson, L. W., & Postlethwaite, T. N. (2007). Program evaluation: large-scale and small-scale studies. International Academy of Education: International Institute for Education Planning. www.unesco.org/iiep/PDF/Edpol8.pdf.
- Auld, E., & Morris, P. (2016). PISA, policy and persuasion: translating complex conditions into education ‘best practice’. Comparative Education, 52(2), 202–229.CrossRefGoogle Scholar
- Baird, J.-A., Johnson, S., Hopfenbeck, T. H., Isaacs, T., Sprague, T., Stobart, G., & Yu, G. (2016). On the supranational spell of PISA in policy. Educational Research, 58(2), 121–138.CrossRefGoogle Scholar
- Bergersen, H. O. (2005). Kampen om kunnskapsskolen [The battle for the knowledge-based school]. Oslo: Universitetsforlaget.Google Scholar
- Berliner, D. C. (2011). Rational responses to high stakes testing: the case of curriculum narrowing and the harm that follows. Cambridge Journal of Education., 41(3), 287–302.CrossRefGoogle Scholar
- Birkeland, P. A., & Breiteig, T. (2012). Norsk lærerutdanning i et internasjonalt perspektiv [Norwegian teacher education in an international perspective]. In L. S. Grønmo & T. Onstad (Eds.), Mange og store utfordringer. Et nasjonalt og internasjonalt perspektiv på utdanning av lærere i matematikk basert på data fra TEDS-M 2008 (pp. 35–60). Oslo: Unipub.Google Scholar
- Breakspear, S. (2012). The policy impact of PISA: an exploration of the normative effects of international benchmarking in school system performance (OECD Education Working Papers No. 71). https://doi.org/10.1787/5k9fdfqffr28-en.
- Breiteig, T. (2013). Preparing teachers of mathematics in Norway. In J. Schwille, L. Ingvarson, & R. Holdgreve-Resendez (Eds.), TEDS-M encyclopedia: a guide to teacher education context, structure, and quality assurance in 17 countries: findings from the IEA teacher education and development study in mathematics (TEDS-M) (pp. 131–148). Hamburg: IEA.Google Scholar
- Burkhardt, H. (2014). Curriculum design and curriculum change. In Y. Li & G. Lappan (Eds.), Mathematics curriculum in school education (pp. 13–33). Dordrecht: Springer.CrossRefGoogle Scholar
- Cai, J., Hwang, S., & Middleton, J. A. (2015). The role of large-scale studies in mathematics education. In J. A. Middleton, S. Hwang, & J. Cai (Eds.), Large-scale studies in mathematics education (pp. 405–414). Dordrecht: Springer.CrossRefGoogle Scholar
- Cai, J., Mok, I. A. C., Reddy, V., & Stacey, K. (2016). International comparative studies in mathematics: lessons for improving students’ learning. In ICME-13 topical surveys (pp. 1–36). Hamburg: ZDM.Google Scholar
- Clarke, D. (2013). The validity-comparability compromise in crosscultural studies in mathematics education. In B. Ubuz, Ç. Haser, & M. A. Mariotti (Eds.), Proceedings of the Eighth Congress of the European Society for Research in Mathematics Education (pp. 1855–1864). Antalya: ERME.Google Scholar
- De Lange, J. (2007). Large-scale assessment and mathematics education. In F. K. J. Lester (Ed.), Second handbook of research on mathematics teaching (Vol. 2, pp. 1111–1142). Charlotte: Information Age Publishing.Google Scholar
- Elstad, E., Nortvedt, G. A., & Turmo, A. (2009). The Norwegian assessment system: an accountability perspective. Cadmo, 17(2), 89–103.Google Scholar
- Frønes, T. S., Roe, A., & Vagle, W. (2012). Nasjonale prøver i lesing - utvikling, resultater og bruk [National tests in reading, development, results and use]. In T. H. Hopfenbeck, M. Kjærnsli, & R. V. Olsen (Eds.), Kvalitet i norsk skole: Internasjonale og nasjonale undersøkelser av læringsutbytte og undervisning (pp. 135–153). Oslo: Universitetsforlaget.Google Scholar
- Goldstein, H. (2017). Measurement and evaluation issues with PISA. In L. Volante (Ed.), The PISA effect on global educational governance (pp. 49–58). London: Routledge.Google Scholar
- Gorur, R., & Wu, M. (2015). Leaning too far? PISA, policy and Australia’s ‘top five’ ambitions. Discourse: Studies in the Cultural Politics of. Education, 36(5), 647–664.Google Scholar
- Grønmo, L. S., & Bergem, O. K. (2009). Prestasjoner i matematikk [Achievement in mathematics]. In L. S. Grønmo and T. Onstad (Eds.), Tegn til bedring. Norske elevers prestasjoner i matematikk og naturfag i TIMSS 2007 (pp. 49–111). Oslo: Unipub.Google Scholar
- Grønmo, L. S., Onstad, T., Nilsen, T., Hole, A., Aslaksen, H., & Borge, I. C. (2012). Framgang, men langt fram. Norske elevers prestasjoner i matematikk og naturfag i TIMSS 2011 [Progress but still a long way to go. Norwegian students’ achievement in mathematics and science in TIMSS 2011]. Oslo: Akademika Forlag.Google Scholar
- Helgøy, I., & Homme, A. (2006). Policy tools and institutional change: comparing education policies in Norway, Sweden and England. Journal of Public Policy, 26(2), 141–165.CrossRefGoogle Scholar
- Hiebert, J., Gallimore, R., Givvin, K.B. (2003). Teaching mathematics in seven countries: results from the TIMSS 1999 video study. Washington, DC: National Centre for Educational Statistics.Google Scholar
- Ho, E. C. H. (2016). The use of large-scale assessment (PISA): insights for policy and practice in the case of Hong Kong. Research Papers in Education, 31, 5516–5528.Google Scholar
- Hopfenbeck, T. H., & Görgen, K. (2017). The politics of PISA: the media, policy and public responses in Norway and England. European Journal of Education, 52(2), 195–205.CrossRefGoogle Scholar
- Hopfenbeck, T. H., Tolo, A., Florez, T., & El Mastri, Y. (2013). Balancing trust and accountability? The assessment for learning programme in Norway: a governing complex educational systems case study. Retrieved from http://www.oecd-ilibrary.org/education/balancing-trust-and-accountability-the-assessment-for-learning-programme-in-norway_5k3txnpqlsnn-en.
- Hopfenbeck, T. H., Lenkeit, J., El Mastri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2017). Lessons learned from PISA: a systemic review of peer-reviewed articles on the programme for international student achievement. Scandinavian Journal of Educational Research. [online first] 1–21. 62(3), 333- 353Google Scholar
- Imsen, G., Blossing, U., & Moos, L. (2016). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 1–16. https://doi.org/10.1080/00313831.2016.1172502.
- Jerrim, J. (2013). The reliability of trends over time in international education test scores: is the performance of England’s secondary school pupils really in relative decline? Journal of Social Policy, 42(2), 259–279.CrossRefGoogle Scholar
- Kilpatrick, J. (2014). Competency frameworks in mathematics education. In F. K. J. Lester (Ed.), Encyclopedia of mathematics education (pp. 85–87). Amsterdam: Springer.Google Scholar
- Klette, K., Bergem, O. K., & Roe, A. (2016). Teaching and learning in lower secondary schools in the era of PISA and TIMSS. Dordrecht: Springer.CrossRefGoogle Scholar
- Klieme, E. (2017). International large-scale assessments. Keynote presentation at the 18th annual conference for the Association for Educational Assessment Europe, Prague, November 9–11.Google Scholar
- Kreiner, S., & Christensen, K. B. (2014). Analyses of model fit and robustness. A new look at the PISA scaling model underlying ranking of countries according to reading literacy. Psychometrika, 79(2), 210–231.CrossRefGoogle Scholar
- Lesh, R. A., & Doerr, H. M. (2003). Beyond constructivism: models and modeling perspectives on mathematics problem solving, teaching, and learning. Mahwah: Lawrence Erlbaum.Google Scholar
- Lesh, R. A., & Zawojewski, J. (2007). Problem solving and modeling. In F. K. J. Lester (Ed.), Second handbook of research on mathematics teaching and learning (Vol. 2, pp. 763–804). Charlotte: Information Age.Google Scholar
- Lockheed, M. E. (2015). Why do countries participate in international large-scale assessments? The case of PISA (Policy Research Working Paper No. 7447). Washington, DC, World Bank Group.Google Scholar
- Martin, M. O., Mullis, I. V. S., & Hooper, M. (2016). Methods and procedures in TIMSS 2015. Retrieved from http://timssandpirls.bc.edu/publications/timss/2015-methods.html.
- Middleton, J. A., Cai, J., & Hwang, S. (2015). Why mathematics education needs large-scale research. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education (pp. 1–3). Heidelberg: Springer.Google Scholar
- Ministry of Education and Research. (2012). Oppdragsbrev 42–10. [Description of task 42–10]. Oslo.Google Scholar
- Ministry of Education and Research. (2015). Realfagstrategi - Tett på realfag. Nasjonal strategi for realfag i barnehagen og grunnopplæringen (2015–2019). [Strategy for mathematics and sciences. National strategy for mathematics and sciences in kindergarden and compulsory education (2015–2019)]. Oslo, Norway: Author.Google Scholar
- Ministry of Education and Research. (2016a). Slik blir den nye lærerutdanningen [This is how the new teacher education will be] (Press release). Retrieved from https://www.regjeringen.no/no/aktuelt/slik-blir-den-nye-larerutdanningen/id2503270/.
- Ministry of Education and Research. (2016b). Norske 15-åringer i toppsjiktet i lesing [Norwegian 15-year olds in the lead in reading]. (Press release) December 16, 2012. No: 107–116. Retrieved from https://www.regjeringen.no/no/aktuelt/norske-15-aringer-i-toppsjiktet-i-lesing/id2522863/.
- Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2016a). TIMSS 2015 international results in mathematics. Boston: Boston College, TIMSS and PIRLS International Study Center.Google Scholar
- Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2016b). TIMSS advanced 2015 international results in advanced mathematics and physics. Boston: Boston College, TIMSS and PIRLS International Study Center.Google Scholar
- NDET (2017). The education mirror. Retrieved from https://vimeo.com/239061112.
- Nilsen, T., Angell, C., & Grønmo, L. S. (2013). Mathematical competencies and the role of mathematics in physics education: a trend analysis of TIMSS advanced 1995 and 2008. Acta Didactica Norge, 7(1), 1–21.CrossRefGoogle Scholar
- Niss, M. (1996). Goals of mathematics teaching. In A. J. Bishop, K. Clements, C. Keitel, J. Kilpatrick, & C. Laborde (Eds.), International handbook on mathematics education (pp. 11–47). Amsterdam: Springer.Google Scholar
- Niss, M. (2007). Reflections on the state of and trends in research on mathematics teaching and learning. In F. K. J. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 1293–1312). Charlotte: Information Age.Google Scholar
- Niss, M., & Højgaard, T. (2011). Competencies and mathematical learning: ideas and inspiration for the development of mathematics teaching and learning in Denmark (English edition). Roskilde: IMFUMFA.Google Scholar
- Niss, M., & Jablonka, E. (2014). Mathematical literacy. In S. Lerman (Ed.), Encyclopedia of mathematics education (pp. 391–396). Dordrecht: Springer.Google Scholar
- Niss, M., Blum, W., & Galbraith, P. L. (2007). Introduction. In W. Blum, P. L. Galbraith, H.-W. Henn, & M. Niss (Eds.), Modelling and applications in mathematics education: the 14th ICMI study (pp. 3–32). Boston: Springer Science + Business Media.CrossRefGoogle Scholar
- Niss, M., Bruder, R., Planas, N., Turner, R., & Villa-Ochoa, J. A. (2016). Survey team on: conceptualisation of the role of competencies, knowing and knowledge in mathematics education research. ZDM Mathematics Education, 48(5), 611–632.CrossRefGoogle Scholar
- Nortvedt, G. A. (2013a). Matematikk i PISA - matematikkdidaktiske perspektiver [Mathematics in PISA]. In M. Kjærnsli & R. V. Olsen (Eds.), Fortsatt en vei å gå. Norske elevers kompetanse i matematikk, naturfag og lesing i PISA 2012 [The Norwegian PISA Report] (pp. 43–66). Oslo: Universitetsforlaget.Google Scholar
- Nortvedt, G. A. (2013b). Resultater i matematikk [Results in mathematics]. In M. Kjærnsli & R. V. Olsen (Eds.), Fortsatt en vei å gå. Norske elevers kompetanse i matematikk, naturfag og lesing i PISA 2012 [The Norwegian PISA Report] (pp. 67–95). Oslo: Universitetsforlaget.Google Scholar
- Nortvedt, G. A., & Pettersen, A. (2016). Matematikk [Mathematics]. In M. Kjærnsli & F. Jensen (Eds.), Stø kurs. Norske elevers kompetanse i naturfag, matematikk og lesing i PISA 2015 [Norwegians students competence in reading, mathematics and science in PISA 2015] (pp. 107–135). Oslo: Universitetsforlaget.Google Scholar
- Nortvedt, G. A., Santos, L., & Pinto, J. (2016). Assessment for learning in Norway and Portugal: the case of primary school mathematics teaching. Assessment in education: Principles, Policy & Practice, 23(3), 377–395.CrossRefGoogle Scholar
- Norwegian Directorate for Education and Training (NDET). (2015). Curriculum for the common core subject of mathematics. Retrieved from http://www.udir.no/kl06/MAT1-04/Hele/?lplang=eng.
- Nusche, D., Earl, N., Maxwell, W., & Shewbridge, C. (2011). OECD reviews of evaluation and assessment in education: Norway. Paris: OECD Publishing.CrossRefGoogle Scholar
- OECD. (2013a). PISA2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. Paris: OECD Publishing.Google Scholar
- OECD. (2013b). PISA 2012 results: student performance in mathematics, reading, science (Vol. 1). Paris: OECD Publishing.Google Scholar
- OECD. (2013c). PISA 2012 results: ready to learn. Students’ engagement, drive and self-beliefs (Vol. 3). Paris: OECD Publishing.Google Scholar
- OECD. (2016). PISA 2015 results: excellence and equity in education. Paris: OECD Publishing.Google Scholar
- OECD. (2017a). PISA: Programme for International Student Achievement. Retrieved from http://www.oecd.org/pisa/.
- OECD. (2017b). PISA 2015 technical report. Retrieved from http://www.oecd.org/pisa/data/2015-technical-report/.
- Olsen, R. V. (2013). Undervisning i matematikk [Mathematics teaching]. In M. Kjærnsli & R. V. Olsen (Eds.), Fortsatt en vei å gå. Norske elevers kompetanse i matematikk, naturfag og lesing i PISA 2012 (pp. 121–156). Oslo: Universitetsforlaget.Google Scholar
- Olsen, R. V., Hopfenbeck, T. N., & Lillejord, S. (2013). Elevenes læringssituasjon etter Kunnskapsløftet. [The conditions and situation for learning after the introduction of the knowledge promotion]. Norsk Pedagogisk Tidsskrift, 97(6), 355–369.Google Scholar
- Organisation for Economic Co-operation and Development (OECD). (2013). PISA2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. Paris: OECD Publishing.Google Scholar
- Pons, X. (2016). Tracing the French policy PISA debate: a policy configuration approach. European Educational Research Journal, 15(5), 580–597.CrossRefGoogle Scholar
- Postlethwaite, T. N. (1988). Encyclopedia of comparative education and national systems of education. Oxford: Pergamon.Google Scholar
- Ræder, H. G. (2017). Matematikk i fysikkoppgaver [Mathematics in physic tasks] (Master’s thesis). Department for Teacher Education and School Research. Norway: University of Oslo.Google Scholar
- Sälzer, C., & Prenzel, M. (2014). Looking back at five rounds of PISA: impacts on teaching and learning in Germany. Solsko Polje, 25(5/6), 53–72.Google Scholar
- Sjøberg, S. (2014). PISA-syndromet. Hvordan norsk skolepolitikk blir styrt av OECD [The PISA-syndrome. How Norwegian education policy is steered by OECD]. Nytt Norsk Tidsskrift, 31(1), 30–43.Google Scholar
- Steiner-Khamsi, G. (2003). The politics of league tables. Journal of Social Science Education, 1, 1–6.Google Scholar
- Stobart, G. (2008). Testing times: the uses and abuses of assessment. Oxford: Routledge.Google Scholar
- Turner, R., Dossey, J., Blum, W., & Niss, M. (2013). Using mathematical competencies to predict item difficulty in PISA: a MEG study. In M. Prenzel, M. Koberg, K. Schöps, & S. Rönnebeck (Eds.), Research on PISA: research outcomes of the PISA Research Conference 2009 (pp. 23–37). Dordrecht: Springer.CrossRefGoogle Scholar
- Tveit, S. (2014). Educational assessment in Norway. Assessment in education: Principles, policy and practice, 21(2), 221–237.CrossRefGoogle Scholar
- Välijärvi, J., Linnakylä, P., Kupari, P., Reinikainen, P., & Arffman, I. (2002). The Finnish success in PISA—and some reasons behind it: PISA 2000. Jyväskylä: Institute for Educational Research, University of Jyväskylä.Google Scholar
- Zhao, Y., & Meyer, H.-D. (2013). High on PISA, low on entrepreneurship? What PISA does not measure. In H.-D. Meyer & A. Benavot (Eds.), PISA, power and policy: the emergence of global educational governance (pp. 267–278). Oxford: Symposium Books.Google Scholar