Advertisement

PISA: A success story?

Global Educational Governance by standardization, rankings, comparisons and “successful” examples
  • Svein Sjøberg
Chapter
Part of the Educational Governance book series (EDUGOV, volume 43)

Zusammenfassung

Schooling and education are becoming increasingly globalized, and the OECD (Organization for Economic Cooperation and Development) has become the prime driver for global educational governance. PISA and its focus on league tables, country rankings and its celebration of “winners”; successful learners, successful schools and successful education systems influence educational debates and educational policy at a global scale. The role of PISA as an instrument of governance is currently expanded also to target schools and their teaching in a more direct way: A PISA-like instrument, “PISA for Schools” is developed for local use, for schools and school districts, enabling them to compare their own schools with “PISA winners”. Expansion of testing into adult life has also taken place (PIAAC), and OECD comparative initiatives for Kindergarten/preschool are also on its way. A special “PISA for development” is constructed for use in low- and middle income countries. At the same time, PISA is also expanding by including new domains in the test, like “Financial Literacy” and, for the PISA 2018 also “Global Competency Assessment.”

In these activities, the OECD now operates in close contact with different money-making interests, the most influential being the world’s largest commercial company in the education sector, Pearson Inc.

This chapter will present details of the development of PISA and critical points of two categories. The first relates to the PISA project as such. These problems are inherent in the PISA undertaking, and hence cannot be “fixed”. The main point here is that the quality of a nation’s education system cannot be reduced to a single, universal and global metric – independent of that nation’s history and culture, let alone the values and ideals of the school system.

The second category of critical points relates to some of the rather intriguing results that emerge from analysis of PISA data: It seems that pupils in high-scoring countries also develop the most negative attitudes to the subject. It also seems that PISA scores are unrelated to educational resources, funding, class size etc. PISA scores are also negatively related to the use of active teaching methods, inquiry based instruction and the use of ICT. Whether one “believes in PISA” or not, such intriguing results need to be discussed.

Th e chapter ends by more directly addressing PISA as an instrument for governance: how the OECD through PISA and PISA-related projects globally exert power and infl uence on educational debates, policy and governance. Th e most important is the implicit epistemic governance: how PISA redefi nes and narrows the meaning and value of education. More concretely, PISA and the OECD exerts its power through a range of modes: Policy governance by numbers, indicators, rankings and statistics, governance by comparisons, and celebrating “successful” learners, teachers, schools, education systems.

Schlüsselbegriffe

Comparative studies school governance educational policy globalization standardization OECD PISA 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Literatur

  1. Alexander, R. (2012). Moral Panic, Miracle Cures and Educational Policy: what can we really learn from international comparison? Scottish Educational Review, 44(1), 4–21.Google Scholar
  2. Alliance (2006). Joint Statement: National Groups Co-Host Briefing On 2006 PISA Results. Washington: alliance for Excellent Education https://all4ed.org/wp-content/uploads/2013/09/Joint-Statement_2006PISA.pdf.
  3. Arffman, I. (2007). The problem of equivalence in translating texts in international reading literacy studies. A text analytic study of three English and Finnish texts used in the PISA 2000 reading test (Research Reports 21). Jyväskylä: University of Jyväskylä, Institute for Educational Research.Google Scholar
  4. Arffman, I. (2010). Equivalence of Translations in International Reading Literacy Studies, scandinavian Journal of Educational Research, Vol. 54, No. 1, February 2010, 37–59.Google Scholar
  5. Ball, S. J. (2012). Global education Inc: New policy networks and the neo-liberal imaginary. London: Routledge.CrossRefGoogle Scholar
  6. Bergesen, O. H. (2006). Kampen om kunnskapsskolen (English: The fight for a knowledge-based school) Oslo: Universitetsforlaget.Google Scholar
  7. Bieber, T., & Martens, K. (2011). The OECD PISA study as a soft power in education? Lessons from Switzerland and the US. European Journal of Education, 46, 101–116.CrossRefGoogle Scholar
  8. Breakspear, S. (2012). The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance, OECD Education Working Papers, No. 71, OECD Publishing. http://dx.doi.org/10.1787/5k9fdfqffr28-en.
  9. Breakspear, S. (2014). How does PISA shape education policy making? Why how we measure learning determines what counts in education. Centre for Strategic Education. http://simonbreakspear.com/wp-content/uploads/2015/09/Breakspear-PISA-Paper.pdf.
  10. Bybee, R., & McRae, B. J. (2011). Scientific Literacy and Student Attitudes: Perspectives from PISA 2006 science, International Journal of Science Education, 33: 1, 7–26.CrossRefGoogle Scholar
  11. Education International (2016). Letter to the OECD: Pearson Stakeholders’ Report. http://download.ei-ie.org/Docs/WebDepot/Letter_Pearson_Report.pdf.
  12. Eide, K. (1995). OECD og norsk utdanningspolitikk. En studie av internasjonalt samspill, (OECD and Norwegian education policy. A study of international interaction). Oslo: NAVFs Utredningsinstitutt.Google Scholar
  13. El Masri, Y., Baird, J-A., & Graesser, A. (2016). Language effects in international testing: The case of PISA 2006 science items. Assessment in Education: Principles, Policy & Practice, 23. [Taylor & Francis Online]Google Scholar
  14. Ertl, H. (2006). Educational standards and the changing discourse on education: The reception and consequences of the PISA study in Germany. Oxford Review of Education, 32(5), 619–634.CrossRefGoogle Scholar
  15. EU (2007). Science Education Now: A renewed pedagogy for the future of Europe, (The Rocard report), Brussels: European Commission.Google Scholar
  16. Grek, S. (2009). Governing by numbers: the PISA ‘effect’ in Europe. Journal of Education Policy, 24: 1, 23–37CrossRefGoogle Scholar
  17. Grisay A., de Jong, J. H., Gebhardt, E., Berezner, A., & Halleux-Monseur, B. (2007). Translation equivalence across PISA countries. Journal of Applied Measurement. 2007; 8(3): 249–66.Google Scholar
  18. Hopmann, S. T., Brinek, G., & Retzl, M. (Eds.) (2007). PISA zufolge PISA – PISA According to PISA Berlin: LIT Verlag.Google Scholar
  19. ICSU (2011). Report of the ICSU Ad-hoc Review Panel on Science Education. Paris: International Council for Science.Google Scholar
  20. Kjærnsli, M., & Jensen, F. (Eds.) (2016). Stø kurs. Norske elevers kompetanse i naturfag, matematikk og lesing i PISA 2015. Oslo: Universitetsforlaget.Google Scholar
  21. Kjærnsli, M., & Lie, S. (2011). Students’ preference for science careers: International comparisons based on PISA 2006. International Journal of Science Education, 33(1), 121–144.CrossRefGoogle Scholar
  22. Komatsu, H., & Rappleye, J. (2017). A new global policy regime founded on invalid statistics? Hanushek, Woessmann, PISA, and economic growth, Comparative Education, 53: 2, 166–191.  https://doi.org/10.1080/03050068.2017.1300008.CrossRefGoogle Scholar
  23. Kreiner S., & Christensen, K. B. (2014). Analyses of model fit and robustness. A new look at the PISA scaling model underlying ranking of countries according to reading literacy. Psychometrika. 2014 Apr;79(2): 210–31.  https://doi.org/10.1007/s11336-013-9347-z.CrossRefGoogle Scholar
  24. Lundgren, U. P. (2011). PISA as a Political Instrument. In M. A. Pereyra, H. G. Kotthoff & R. Cowen (Eds.), PISA Under Examination. Changing Knowledge, Changing Tests, and Changing Schools. Rotterdam: Sense Publishers.Google Scholar
  25. Meyer, H. D., & Zahedi, K. (2014). Open letter to Andreas Schleicher on PISA. https://www.theguardian.com/education/2014/may/06/oecd-pisa-tests-damaging-education-academics , accessed 13. Dec. 2017).
  26. Meyer, H. D., & Benavot, A. (Eds.) (2013). PISA, Power and Policy: the emergence of global educational governance, Oxford: Symposium Books.Google Scholar
  27. Møller, J., & Skedsmo, G. (2013). Modernising education: New Public Management reform in the Norwegian education system, Journal of Educational Administration and History, 45: 4, 336–353.CrossRefGoogle Scholar
  28. OECD (1999). Measuring Student Knowedge and skills. A New Framework for Assessment. Paris: OECD Publications.Google Scholar
  29. OECD (2001). Knowedge and skills for life. First results from PISA 2000. Paris: OECD Publications.Google Scholar
  30. OECD (2005). PISA 2003 Technical Report. Paris: OECD Publishing.Google Scholar
  31. OECD (2006). Assessing Scientific, Reading and Mathematical Literacy, A framework for PISA 2006. Paris: OECD Publications.Google Scholar
  32. OECD (2007). Education at a Glance. Paris: OECD Publishing.Google Scholar
  33. OECD (2008). OECD Economic Surveys, Norway Volume 2008/13. Paris: OECD Publications.Google Scholar
  34. OECD (2009). PISA 2006 Technical Report. Paris: OECD Publications. http://www.oecd.org/dataoecd/0/47/42025182.pdf.
  35. OECD (2010a). PISA 2009 Results: What Makes a School Successful? Resources, Policies and Practices, Vol. 4. Paris: OECD Publications.Google Scholar
  36. OECD (2010b). (Hanushek and Woessman) The High Cost of Low Educational Performance: The long run Economic Impact of Improving PISA Outcomes. Paris: OECD ISBN 978-92-64-07748-5 (PDF) https://www.oecd.org/pisa/44417824.pdf.
  37. OECD (2012). Lessons from PISA for the United States, strong performers and successful reformers in education. Paris: OECD Publishing.Google Scholar
  38. OECD (2013). PISA 2012 Assessment and Analytical Framework: Mathematics, Reading, Science, Problem Solving and Financial Literacy. Paris: OECD Publishing.Google Scholar
  39. OECD (2015a). Students, Computers and Learning: Making the Connection. Paris, OECD Publishing. http://dx.doi.org/10.1787/9789264239555-en.
  40. OECD (2015b). OECD’s video PISA – Measuring student success around the world. Available at: http://www.oecd.org/pisa/aboutpisa.
  41. OECD (2016a). PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic and Financial Literacy. Paris: OECD Publishing.Google Scholar
  42. OECD (2016b). PISA 2015 Results (Volume I): Excellence and Equity in Education. Paris: OECD Publishing.Google Scholar
  43. OECD (2016c). PISA 2015 Results (Volume II): Policies and Practices for Successful Schools. Paris: OECD Publishing.Google Scholar
  44. OECD (2016d). Skills Matter: Further Results from the Survey of Adult Skills. Paris: OECD Publishing. http://dx.doi.org/10.1787/9789264258051-en.
  45. OECD (2017a). Starting Strong 2017: Key OECD Indicators on Early Childhood Education and Care. Paris: OECD Publishing. http://dx.doi.org/10.1787/9789264276116-en.
  46. OECD (2017b). Education at a Glance 2016: OECD Indicators. Paris: OECD Publishing http://dx.doi.org/10.1787/eag-2017-en.
  47. OECD (2018a). PISA for Development. Policy Briefs. Paris: OECD. http://www.oecd.org/pisa/aboutpisa/pisafordevelopment-documentation-briefs.htm.
  48. OECD (2018b). PISA in Focus. Policy Briefs. Paris: OECD http://dx.doi.org/10.1787/22260919.
  49. OECD (2018c). PISA-based test for schools http://www.oecd.org/pisa/aboutpisa/pisa-based-test-forschools.htm visited Feb 18. 2018.
  50. Pearson (2018). The Learning Curve. http://thelearningcurve.pearson.com/.
  51. Pereyra, M. A., Kotthoff, H.-G., & Cowan, R. (Eds.) (2011). PISA under examination: Changing knowledge, changing tests, and changing schools. Rotterdam: Sense.Google Scholar
  52. Pons X. (2017). Fifteen years of research on PISA effects on education governance: A critical review. Eur J Educ. 2017;52:131–144.  https://doi.org/10.1111/ejed.12213.CrossRefGoogle Scholar
  53. Popkewitz, T. (2011). PISA: Numbers, Standardizing Conduct, and the Alchemy of School Subjects. In M. A. Pereyra, H.-G. Kotthoff & R. Cowen (Eds.), PISA Under Examination. Changing Knowledge, Changing Tests, and Changing Schools. Rotterdam: Sense.Google Scholar
  54. Ravitch, D. (2011). The Death and Life of the Great American School System. How Testing and Choice Are Undermining Education. New York: Basic Books.Google Scholar
  55. Rinne, R. (2008). The growing supranational impacts of the OECD and the EU on national education policies and the case of Finland, Policy Futures in Education, 6, 665–680.CrossRefGoogle Scholar
  56. Rutkowski, L., & Rutkowski, D. (2016). A call for a more measured approach to reporting and interpreting PISA results. Educational Researcher, 45(4), 252–257.  https://doi.org/10.3102/0013189X16649961CrossRefGoogle Scholar
  57. Sahlberg, P. (2011). Finnish Lessons: what can the world learn from educational change in Finland? New York: Teachers College, pp. 99–105.Google Scholar
  58. Schleicher, A. (2013). Use data to build better schools. TEDGlobal http://www.ted.com/talks/andreas_schleicher_use_data_to_build_better_schools?language=en.
  59. Schleicher, A. (2015). Vietnam’s ‘stunning’ rise in school standards. BBC News 17 June 2015 http://www.bbc.com/news/business-33047924.
  60. Sellar, S., Thompson, G., & Rutkowski, D. (2017). The global education race: taking the measure of PISA and international testing. Brush Education Inc.Google Scholar
  61. Sjøberg, S. (2007). PISA and “Real Life Challenges”: Mission Impossible? In S. T. Hopmann, G. Brinek & M. Retzl (Eds.), PISA zufolge PISA – PISA According to PISA, Berlin: LIT Verlag.Google Scholar
  62. Sjøberg, S. (2016). OECD, PISA, and Globalization. The Influence of the International Assessment Regime. In C. H. Tienken & C. A. Mullen (Eds.), Education Policy Perils. Tackling the Tough Issues. New York, Routledge, pp. 102–133.Google Scholar
  63. Sjøberg, S. (2018). The power and paradoxes of PISA: Should we sacrifice Inquiry-Based Science Education (IBSE) to climb on the rankings? Nordic Studies in Science Education 14(2), p. 186–202.CrossRefGoogle Scholar
  64. Steffen B., & Hößle, C. (2014). Decision-making Competence in Biology Education: Implementation into German Curricula in Relation to International Approaches Eurasia Journal of Mathematics, Science & Technology Education, 2014, 10(4), 343–355.CrossRefGoogle Scholar
  65. Steiner-Khamsi, G. (2003). The politics of league tables. Journal of Social Science Education. Vol 1, 1–6 Online  https://doi.org/10.4119/UNIBI/jsse-v2-i1-470.
  66. Steiner-Khamsi, G. (2014). Cross-national policy borrowing: understanding reception and translation. Asia Pacific Journal of Education Vol 34/2, pp. 153–167.CrossRefGoogle Scholar
  67. Steiner-Khamsi, G. (Ed.) (2004). The global politics of educational borrowing and lending. New York, NY: Teachers College Press.Google Scholar
  68. UNESCO (2012). International Standard Classification of Education, ISCED 2011. Montreal: UNESCO Institute for Statistics http://uis.unesco.org/sites/default/files/documents/international-standard-classification-of-education-isced-2011-en.pdf.
  69. Verger, A., Lubienski, C., & Steiner-Khamsi, G. (2016). “The Emergence and Structuring of the Global Education Industry: Towards an Analytical Framework”. In A. Verger, C. Lubienski & G. Steiner-Khamsi (Eds.), World Yearbook of Education 2016: The Global Education Industry. New York: Routledge.Google Scholar
  70. Wuttke, J. (2007). Uncertainty and Bias in PISA. In S. Hopman, T. G. Brinek & M. Retzl (Eds.), PISA According to PISA — Does PISA Keep What It Promises? pp. 241–263. Berlin: Lit Verlag.Google Scholar
  71. Zhao, Y. (2017). What works may hurt: Side effects in education. Journal of Educational Change.doi:  https://doi.org/10.1007/s10833-016-9294-4.CrossRefGoogle Scholar

Copyright information

© Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature 2019

Authors and Affiliations

  1. 1.OsloNorwegen

Personalised recommendations