Abstract
As nations across the world have experienced globalization and an increasingly competitive economy, calls for governments to monitor public sector functions, including education systems, have grown. As a result, educational evidence-based policymaking and outcomes-based accountability have emerged in recent decades as global phenomena. Evidence-based policymaking is the use of information, such as program effectiveness or differential achievement of different groups of students, to make policy decisions. Outcomes-based accountability is a specific type of evidence-based policymaking that uses data on the effectiveness of each unit in a given system – such as each school in a school system or each teacher in a school – to make decisions about that particular unit. Though accountability systems have been a controversial approach for providing consumers – policymakers, parents, and the public – with information needed to determine how well public education systems are educating their students, they have a long-standing presence in many nations. In the United States, outcomes-based accountability has played a core role in federal education policies following the introduction of state accountability systems in the 1990s, and a host of other countries have had centralized reporting of national standardized exams for several decades (Mizala et al., J Dev Econ 84(1):61–75, 2007).
References
A Nation at Risk: The Imperative for Educational Reform. (1983). The National Commission on Excellence in Education. https://www.edreform.com/wp-content/uploads/2013/02/A_Nation_At_Risk_1983.pdf
Addey, C., & Sellar, S. (2017). A framework for analysing the multiple rationales for participating in international large-scale assessments. Compare. A Journal of Comparative and International Education. https://doi.org/10.1080/03057925.2017.1301399
Addey, C., Sellar, S., Steiner-Khamsi, G., Lingard, B., & Verger, A. (2017). The rise of international large-scale assessments and rationales for participation. Compare: A Journal of Comparative and International Education, 47, 1–19. https://doi.org/10.1080/03057925.2017.1301399
Baker, D., & LeTendre, G. (2005). National differences, global similarities: World culture and the future of schooling. Stanford University Press. https://www.sup.org/books/title/?id=7192
Baker, D., & Wiseman, A. (2005). Global trends in educational policy. http://Lst-Iiep.Iiep-Unesco.Org/Cgi-Bin/Wwwi32.Exe/[In=epidoc1.in]/?T2000=025023/(100), 6.
Baroutsis, A., & Lingard, B. (2018, February 18). PISA-shock: How we are sold the idea our PISA rankings are shocking and the damage it is doing to schooling in Australia. EduResearch Matters. https://www.aare.edu.au/blog/?p=2714
Bielefeldt, T. (2005). Computers and student learnings. Journal of Research on Technology in Education, 37(4), 339–347. https://doi.org/10.1080/15391523.2005.10782441
Bishop, J. (1997). The effect of national standards and curriculum-based examinations on achievement. American Economic Review, 87(2), 260–264.
Bishop, J. (2006). Drinking from the fountain of knowledge: Student incentive to study and learn – Externalities, information problems and peer pressure, ch. 15. In E. Hanushek & F. Welch (Eds.) (pp. 909–944). Elsevier. https://EconPapers.repec.org/RePEc:eee:educhp:2-15
Bloem, S. (2015). PISA for low- and middle-income countries. Compare: A Journal of Comparative and International Education, 45(3), 481–486. https://doi.org/10.1080/03057925.2015.1027513
Boyd, D., Lankford, H., Loeb, S., Rockoff, J., & Wyckoff, J. (2008). The narrowing gap in New York City teacher qualifications and its implications for student achievement in high-poverty schools. Journal of Policy Analysis and Management, 27(4), 793–818. https://doi.org/10.1002/pam.20377
Braun, H. I., & Singer, J. D. (2019). Assessment for monitoring of education systems: International comparisons. The Annals of the American Academy of Political and Social Science, 683(1), 75–92. https://doi.org/10.1177/0002716219843804
Brighouse, H., Ladd, H. F., Loeb, S., & Swift, A. (2018). Educational goods: Values, evidence, and decision-making. University of Chicago Press. https://www.press.uchicago.edu/ucp/books/book/chicago/E/bo27256234.html
Camminatiello, I., Paletta, A., & Speziale, M. T. (2006). The effects of school-based management and standards-based accountability on student achievement: Evidence from PISA 2006. Electronic Journal of Applied Statistical Analysis, 5(3), 6.
Carnoy, M. (1999). Globalization and educational reform: What planners need to know (Fundamentals of education planning). United Nations Educational, Scientific, and Cultural Organization. http://unesco.amu.edu.pl/pdf/Carnoy.pdf
Carnoy, M. (2015). International test score comparisons and educational policy: A review of the critiques. https://nepc.colorado.edu/publication/international-test-scores
Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross-state analysis. Educational Evaluation and Policy Analysis, 24(4), 305–331. https://doi.org/10.3102/01623737024004305
Carnoy, M., & Rhoten, D. (2002). What does globalization mean for educational change? A comparative approach. Comparative Education Review, 46(1), 1–9. https://doi.org/10.1086/324053
Carnoy, M., Garcia, E., & Khavenson, T. (2015). Bringing it back home: Why state comparisons are more useful than international comparisons for improving U.S. education policy (No. 410). Economic Policy Institute. https://www.epi.org/publication/bringing-it-back-home-why-state-comparisons-are-more-useful-than-international-comparisons-for-improving-u-s-education-policy/
Dale, R. (2005). Globalisation, knowledge economy and comparative education. Comparative Education, 41(2), 117–149.
Dee, T., & Jacob, B. (2009). The impact of no child left behind on student achievement. Working paper no. 15531, National Bureau of Economic Research. https://doi.org/10.3386/w15531.
Desa, D. (2014). Evaluating measurement invariance of TALIS 2013 complex scales: Comparison between continuous and categorical multiple-group confirmatory factor analyses. OECD Publishing.
Dorn, S. (2007). Accountability Frankenstein: Understanding and taming the monster. Information Age Pub.
Ertl, H. (2006). Educational standards and the changing discourse on education: The reception and consequences of the PISA study in Germany. Oxford Review of Education, 32(5), 619–634. JSTOR.
Eryilmaz, N., Rivera-Gutiérrez, M., & Sandoval-Hernández, A. (2020). Should different countries participating in PISA interpret socioeconomic background in the same way? A measurement invariance approach. Revista Iberoamericana de Educación, 84(1), 109–133.
Eurydice, E. (2009). Early childhood education and care in Europe: Tackling social and cultural inequalities. Brussels: Eurydice.
Ferrer, J. G. (2006). Educational assessment systems in Latin America: Current practice and future challenges. PREAL.
Feuer, M., Braun, H., Kober, N., & Berman, A. (2015). An agenda for understanding the impact of college rankings on various users and better meeting users’ information needs. Graduate School of Education and Human Development, George Washington University.
Figlio, D. N. (2006). Testing, crime and punishment. Journal of Public Economics, 90(4), 837–851. https://doi.org/10.1016/j.jpubeco.2005.01.003
Figlio, D., & Kenny, L. (2009). Public sector performance measurement and stakeholder support. Journal of Public Economics, 93(9–10), 1069–1077.
Figlio, D., & Loeb, S. (2011). School accountability. In Handbooks in economics (Vol. 3). Elsevier. https://doi.org/10.1016/S0169-7218(11)03008-5
Figlio, D. N., & Winicki, J. (2005). Food for thought: The effects of school accountability plans on school nutrition. Journal of Public Economics, 89(2–3), 381–394.
Froese-Germain, B. (2010). The OECD, PISA and the impacts on educational policy (p. 35). Canadian Teachers’ Federation. https://files.eric.ed.gov/fulltext/ED532562.pdf
Fuchs, T., & Wößmann, L. (2007). What accounts for international differences in student performance? A re-examination using PISA data. Empirical Economics, 32(2), 433–464. https://doi.org/10.1007/s00181-006-0087-0
Gandara, F., & Randall, J. (2015). Investigating the relationship between school-level accountability practices and science achievement. Education Policy Analysis Archives, 23, 112. https://doi.org/10.14507/epaa.v23.2013
Goldstein, D. (2019, December 3). ‘It just isn’t working’: PISA test scores cast doubt on U.S. education efforts. The New York Times. https://www.nytimes.com/2019/12/03/us/us-students-international-test-scores.html
Gunter, H. M., Grimaldi, E., Hall, D., & Serpieri, R. (Eds.). (2016). New public management and the reform of education (1st ed.). Routledge.
Hall, K. (2005). Science, globalization, and educational governance: The political rationalities of the new managerialism. 12 Indiana Journal of Global Legal Studies, 12(1), 153. https://www.repository.law.indiana.edu/ijgls/vol12/iss1/5
Hanushek, E. A., & Raymond, M. E. (2004). Does school accountability Lead to improved student performance?. Working paper no. 10591, National Bureau of Economic Research. https://doi.org/10.3386/w10591.
Hargreaves, A., & Braun, H. (2013). Data-driven improvement and accountability (p. 47). National Education Policy Center. https://www.education.nh.gov/essa/documents/data-driven-improvement.pdf
Horn, M. (2020). What may lurk behind Korea’s declining PISA scores. Forbes. https://www.forbes.com/sites/michaelhorn/2020/01/09/what-may-lurk-behind-koreas-declining-pisa-scores/#19c08d412f8d
Isac, M. M., Palmerio, L., & van der Werf, M. G. (2019). Indicators of (in) tolerance toward immigrants among European youth: An assessment of measurement invariance in ICCS 2016. Large-Scale Assessments in Education, 7(1), 6.
Jacob, B. (2005). Accountability, incentives and behavior: Evidence from school reform in Chicago. Journal of Public Economics, 89(5–6), 761–796.
Jacob, B. A. (2007). Test-based accountability and student achievement: An investigation of differential performance on NAEP and state assessments. Working paper no. 12817, National Bureau of Economic Research. https://doi.org/10.3386/w12817.
Jacob, B. A., & Levitt, S. D. (2003). Rotten apples: An investigation of the prevalence and predictors of teacher cheating. Working paper no. 9413, National Bureau of Economic Research. https://doi.org/10.3386/w9413.
Jacobson, L. (2019). Beyond NAEP: Experts seek ways to address US “reading crisis.” Education Dive. https://www.educationdive.com/news/beyond-naep-experts-look-for-ways-to-address-us-reading-crisis/567487/
Jennings, J. L., & Lauen, D. L. (2016). Accountability, inequality, and achievement: The effects of the no child left behind act on multiple measures of student learning. RSF, 2(5), 220–241. https://doi.org/10.7758/RSF.2016.2.5.11
Jiang, F., & McComas, W. F. (2015). The effects of inquiry teaching on student science achievement and attitudes: Evidence from propensity score analysis of PISA data. International Journal of Science Education, 37(3), 554–576. https://doi.org/10.1080/09500693.2014.1000426
Judson, E. (2012). When science counts as much as reading and mathematics: An examination of differing state accountability policies. Education Policy Analysis Archives, 20, 26.
Kamens, D. H., & McNeely, C. L. (2010). Globalization and the growth of international educational testing and national assessment. Comparative Education Review, 54(1), 5–25. JSTOR. https://doi.org/10.1086/648471
Kameshwara, K. K., Sandoval-Hernandez, A., Shields, R., & Dhanda, K. R. (2020). A false promise? Decentralization in education systems across the globe. International Journal of Educational Research, 104, 101669. https://doi.org/10.1016/j.ijer.2020.101669
Kellaghan, T. (2001). The globalisation of assessment in the 20th century. Assessment in Education: Principles, Policy & Practice, 8(1), 87–102. https://doi.org/10.1080/09695940120033270
Koretz, D. (2009). Measuring up: What educational testing really tells us (8/16/09 edition). Harvard University Press.
Ladd, H. F., & Lauen, D. L. (2010). Status versus growth: The distributional effects of school accountability policies. Journal of Policy Analysis and Management, 29(3), 426–450.
Lauen, D. L., & Gaddis, S. M. (2016). Accountability pressure, academic standards, and educational triage. Educational Evaluation and Policy Analysis, 38(1), 127–147.
Lee, J., & Reeves, T. (2012). Revisiting the impact of NCLB high-stakes school accountability, capacity, and resources: State NAEP 1990–2009 reading and math achievement gaps and trends. Educational Evaluation and Policy Analysis, 34(2), 209–231. https://doi.org/10.3102/0162373711431604
Lee, J., & Wong, K. K. (2004). The impact of accountability on racial and socioeconomic equity: Considering both school resources and achievement outcomes. American Educational Research Journal, 41(4), 797–832. JSTOR.
Leithwood, K., & Earl, L. (2000). Educational accountability effects: An international perspective. Peabody Journal of Education, 75(4), 1–18. https://doi.org/10.1207/S15327930PJE7504_1
Lingard, B., Martino, W., & Rezai-Rashti, G. (2013). Testing regimes, accountabilities and education policy: Commensurate global and national developments. Journal of Education Policy, 28(5), 539–556. https://doi.org/10.1080/02680939.2013.820042
Lockheed, M. E., & Wagemaker, H. (2013). International large-scale assessments: Thermometers, whips or useful policy tools? Research in Comparative and International Education, 8(3), 296–306. https://doi.org/10.2304/rcie.2013.8.3.296
Loeb, S., & Byun, E. (2019). Testing, accountability, and school improvement. The Annals of the American Academy of Political and Social Science, 683(1), 94–109. https://doi.org/10.1177/0002716219839929
Meyer, H.-D., & Benavot, A. (2013). PISA, power, and policy. Symposium Books. http://www.symposium-books.co.uk/bookdetails/85/
Mizala, A., Romaguera, P., & Urquiola, M. (2007). Socioeconomic status or noise? Tradeoffs in the generation of school quality information. Journal of Development Economics, 84(1), 61–75. https://doi.org/10.1016/j.jdeveco.2006.09.003
Mok, M. M. C. (2007). Quality assurance and school monitoring in Hong Kong. Educational Research for Policy and Practice, 6(3), 187–204. https://doi.org/10.1007/s10671-007-9027-9
Montoya, S. (2018, April 25). A sound investment: The benefits of large-scale learning assessments. UNESCO Institute of Statistics. http://uis.unesco.org/en/blog/sound-investment-benefits-large-scale-learning-assessments
National Testing of Pupils in Europe: Objectives, Organisation and Use of Results. (2009). Education, Audiovisual and Culture Executive Agency. https://op.europa.eu/en/publication-detail/-/publication/df628df4-4e5b-4014-adbd-2ed54a274fd9/language-en
Nutley, S., Walter, I., & Davies, H. (2007). Using evidence: How research can inform public services. The Policy Press. https://www.press.uchicago.edu/ucp/books/book/distributed/U/bo13441009.html
OECD. (2012). Does performance-based pay improve teaching? (PISA in focus). The Organisation for Economic Cooperation and Development. http://www.oecd.org/pisa/pisaproducts/pisainfocus/50328990.pdf
OECD. (2013a). PISA 2012 results: What makes schools successful? Resources, policies and practices: Vol. IV. OECD Publishing. https://doi.org/10.1787/9789264201156-8-en
OECD. (2013b). School governance, assessments and accountability. In OECD (Ed.), PISA 2012 results: What makes schools successful (volume IV) (pp. 127–164). OECD. https://doi.org/10.1787/9789264201156-8-en
OECD. (2018). PISA 2015: Results in focus. Organisation for Economic Cooperation and Development. https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf
Pawson, R. (2006). Evidence-based policy. Sage. https://doi.org/10.4135/9781849209120
Pizmony-Levy, O., & Bjorklund, J. (2014). International assessments of student achievement and public confidence in education: Evidence from a cross-national study. https://doi.org/10.7916/D8HH6XF4
Postlethwaite, N. (1967). School organization and student achievement. New York: Wiley.
Postlethwaite, T. N., & Ross, K. N. (1992). Effective schools in reading: Implications for educational planners. An exploratory study. https://eric.ed.gov/?id=ED360614
Powell, W. W., & Snellman, K. (2004). The knowledge economy. Annual Review of Sociology, 30(1), 199–220. https://doi.org/10.1146/annurev.soc.29.010202.100037
Principles of evidence-based policymaking. (2016). Evidence-Based Policymaking Collaborative. https://www.urban.org/sites/default/files/publication/99739/principles_of_evidence-based_policymaking.pdf
Rangvid, B. S. (2003). Educational peer effects quantile regression evidence from Denmark with PISA2000 data (p. 41). Institute of Local Government Studies. http://www.oecd.org/denmark/33684822.pdf
Rizvi, F. (2009). Globalizing education policy (1st ed.). Routledge.
Robertson, S., & Dale, R. (2015). Towards a ‘critical cultural political economy’ account of the globalising of education. Globalisation, 13. https://doi.org/10.1080/14767724.2014.967502
Robitaille, D. F., Garden, R. A., & International Association for the Evaluation of Educational Achievement. (1989). The IEA study of mathematics II: Contexts and outcomes of school mathematics. Pergamon Press.
Rosenkvist, M. A. (2010). Using student test results for accountability and improvement: A literature review. No. 54; OECD education working papers, Organisation for Economic Cooperation and Development. https://eric.ed.gov/?id=ED529582
Rothman, B. (2019). Inspection systems: How top-performing nations hold schools accountable [National Center on Education and the Economy]. http://ncee.org/2018/05/how-top-performing-nations-hold-schools-accountable/
Rouse, C. E., Hannaway, J., Goldhaber, D., & Figlio, D. (2007). Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure. Working paper no. 13681, National Bureau of Economic Research. https://doi.org/10.3386/w13681.
Rutkowski, L., & Rutkowski, D. (2018). Improving the comparability and local usefulness of international assessments: A look back and a way forward. Scandinavian Journal of Educational Research, 62(3), 354–367.
Rutkowski, L., & Svetina, D. (2017). Measurement invariance in international surveys: Categorical indicators and fit measure performance. Applied Measurement in Education, 30(1), 39–51.
Sahlberg, P. (2016). The global educational reform movement and its impact on schooling. In The handbook of global education policy (pp. 128–144). Wiley. https://doi.org/10.1002/9781118468005.ch7
Sanderson, I. (2006). Complexity, “practical rationality,” and evidence-based policy making. Policy and Politics, 34, 115–132.
Sandoval-Hernandez, A., Rutkowski, D., Matta, T., & Miranda, D. (2019). Back to the drawing board: Can we compare socioeconomic background scales? Revista de Educación, 383, 37–61.
Schutz, G., West, M., & Wößmann, L. (2007). School accountability, autonomy, choice, and the equity of student achievement: International evidence from PISA 2003. No. 14; OECD education working papers series, Economic Cooperation and Development. http://www.oecd.org/education/39839422.pdf
Singer, J. D., & Braun, H. I. (2018). Testing international education assessments. Science, 360(6384), 38–40. https://doi.org/10.1126/science.aar4952
Singer, J., Braun, H., & Chudowsky, N. (Eds.). (2018). International education assessments: Cautions, conundrums, and common sense. National Academy of Education. https://naeducation.org/methods-and-policy-uses-of-international-large-scale-assessments/
Smith, W. C. (2014). The global transformation toward testing for accountability. Education Policy Analysis Archives, 22(0), 116. https://doi.org/10.14507/epaa.v22.1571
Smith, S. S., & Mickelson, R. A. (2016). All that glitters is not gold: School reform in Charlotte-Mecklenburg. Educational Evaluation and Policy Analysis. https://doi.org/10.3102/01623737022002101
Steiner-Khamsi, G. (2010). The politics and economics of comparison. Comparative Education Review, 54(3), 323–342. JSTOR. https://doi.org/10.1086/653047
Teltemann, J., & Jude, N. (2019). Assessments and accountability in secondary education: International trends. Research in Comparative and International Education, 14(2), 249–271. https://doi.org/10.1177/1745499919846174
Torney-Purta, J., & Amadeo, J. A. (2013). International large-scale assessments: Challenges in reporting and potentials for secondary analysis. Research in Comparative and International Education, 8(3), 248–258. https://doi.org/10.2304/rcie.2013.8.3.248
Verger, A. (2017). Theorising ILSA participation. Compare: A Journal of Comparative and International Education. https://doi.org/10.1080/03057925.2017.1301399
Verger, A., Fontdevila, C., & Zancajo, A. (2016). The privatization of education: A political economy of global education reform. Teachers College Press. https://www.researchgate.net/publication/305302937_The_Privatization_of_Education_A_Political_Economy_of_Global_Education_Reform
von Davier, M. (2013). In E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The role of international large-scale assessments: Perspectives from technology, economy, and educational research. Springer Netherlands. https://www.springer.com/gp/book/9789400746282
Wagemaker, H. (2020). Reliability and validity of international large-scale assessment: Understanding IEA’s comparative studies of student achievement. Springer. https://library.oapen.org/handle/20.500.12657/41740
Willis, J., Krausen, K., Byun, E., & Caparas, R. (2018). In the era of the local control funding formula: The shifting role of California’s chief business officers (Getting down to facts II). Policy Analysis for California Education. https://www.gettingdowntofacts.com/sites/default/files/2018-09/GDTFII_Report_Willis.pdf
Wiseman, A. W. (2010). The uses of evidence for educational policymaking: Global contexts and international trends. Review of Research in Education. https://doi.org/10.3102/0091732X09350472
Wiseman, A. W., & Baker, D. P. (2005). The worldwide explosion of internationalized education policy. In D. P. Baker, & A. W. Wiseman (Eds.), Global trends in educational policy (International Perspectives on Education and Society, Vol. 6) (pp. 1–21). Emerald Group Publishing Limited, Bingley. https://doi.org/10.1016/S1479-3679(04)06001-3.
Wößmann, L. (2001). Why students in some countries do better: International evidence on the importance of education policy. Education Matters, 2(2), 67–74.
Wößmann, L. (2003). Schooling resources, educational institutions and student performance: The international evidence. Oxford Bulletin of Economics and Statistics, 65(2), 117–170. https://doi.org/10.1111/1468-0084.00045
Wößmann, L. (2005). The effect heterogeneity of central examinations: Evidence from TIMSS, TIMSS-repeat and PISA. Education Economics, 13(2), 143–169. https://doi.org/10.1080/09645290500031165
Woessmann, L. (2001). Why students in some. Peabody Journal of Education, 82(2–3), 473–497.
Woessmann, L. (2007). International evidence on school competition, autonomy and accountability: A review. Peabody Journal of Education, 82(2–3), 473–497.
Yi, P. (2015). Do school accountability and autonomy affect PISA achievement? Evidence from South Korea. Korean Educational Development Institute. https://www.researchgate.net/publication/290457410_Do_school_accountability_and_autonomy_affect_pisa_achievement_Evidence_from_South_Korea
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this entry
Cite this entry
Loeb, S., Byun, E. (2021). Educational Accountability and the Role of International Large-Scale Assessments. In: Nilsen, T., Stancel-Piątak, A., Gustafsson, JE. (eds) International Handbook of Comparative Large-Scale Studies in Education. Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-38298-8_6-1
Download citation
DOI: https://doi.org/10.1007/978-3-030-38298-8_6-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-38298-8
Online ISBN: 978-3-030-38298-8
eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education