• Todd MilfordEmail author
  • Shelley P. Ross
  • John O. Anderson


The Programme for International Student Assessment (PISA) has been developed by the Organisation for Economic Co-operation and Development to provide participating nations with internationally comparative mean literacy scores in reading, mathematics, and science for students nearing the end of compulsory schooling. The number of nations from the Americas that are participating in PISA has been increasing over the past 4 administrations. This 2-part paper (a) outlines the reaction to PISA within the media of both North and South America and (b) presents an Americas-specific example of the ways in which the PISA dataset can be used for more exploratory analysis through the lens of policy and curriculum suggestions, rather than just league table comparisons. We used multilevel modeling of scientific literacy predicted on a number of school-level background variables. Results point to the importance of socioeconomic background of the student as well as the school in predicting scientific literacy across all nations in the study; however, other school-level significant predictors were more nation-specific. Interpretations of these models as well as next steps are discussed.


hierarchical linear models Latin America PISA test scores 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Adams, R. J. (2003). Response to “Cautions on OECD’s recent educational survey (PISA)”. Oxford Review of Education, 29(3), 277–292.CrossRefGoogle Scholar
  2. Anderson, J. O., Lin, H.-S., Treagust, D. F., Ross, S. P., & Yore, L. D. (2007). Using large-scale assessment datasets for research in science and mathematics education: Programme for International Student Assessment (PISA). International Journal of Science and Mathematics Education, 5(4), 591–614.CrossRefGoogle Scholar
  3. Anderson, J. O., George, J., & Herbert, S. (2009). Factors impacting on student learning: A preliminary look at the national test of Trinidad and Tobago. Caribbean Curriculum, 16(2), 99–126.Google Scholar
  4. Araujo, M. D. (2009). The influence of performance based incentives on the quality of the Chilean education system. Documento de Trabajo CPCE Nº 4, Centro de Politicas Comparada Educación. Santiago, Chile: Universidad Diego Portales.Google Scholar
  5. Bentancur, N. (2007). Education reform and school performance. Some thoughts on the experiences of Argentina, Chile and Uruguay. Cuadernos DEL CLAEH, 93, 9–25.Google Scholar
  6. Bybee, R., McCrae, B., & Laurie, R. (2009). PISA 2006: An assessment of scientific literacy. Journal of Research in Science Teaching, 46(8), 865–883.CrossRefGoogle Scholar
  7. Dolin, J. (2007). PISA—An example of the use and misuse of large-scale comparative tests. In S. T. Hopmann, G. Brinek, & M. Retzl (Eds.), PISA zufolge PISA—Halt Pisa, was es verspricht? [PISA according to PISA: Does PISA keep what it promises?] (pp. 93–126). Berlin, Germany: Lit Verlag.Google Scholar
  8. Duru-Bellant, M., & Suchaut, B. (2005). Organization and context, efficiency and equity of educational systems: what PISA tells us. European Educational Research Journal, 4(3), 181–195.CrossRefGoogle Scholar
  9. Fukuyama, F. (2008). The Latin American experience. Journal of Democracy, 19(4), 69–79.CrossRefGoogle Scholar
  10. Gallart, M. A. (2008). Skills, productivity and employment growth: The case of Latin America. Montevideo, Chile: ILO/Cinterfor.Google Scholar
  11. Godard, S. & Smith, E. (2004). An international comparison of equity in education systems. Comparative Education, 40(1), 15–31.CrossRefGoogle Scholar
  12. Government of Canada (2008). PISA Canada homepage. Retrieved August 11, 2009, from
  13. Hanushek, E. A., & Woessman, L. (2009). Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation (NBER Working Paper Series No. 14633). Cambridge, MA: National Bureau of Economic Research.Google Scholar
  14. Hattie, J. A. C. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. New York: Routledge.Google Scholar
  15. Hopkins, D., Ahtaridou, E., Matthews, P., & Posner, C. (2007). An analysis of the Mexican school system in light of PISA 2006. London: London Centre for Leadership in Learning, University of London.Google Scholar
  16. Kerstenetzky, C. L. (2008). Development and redistribution: The case of the Bolsa Familia program in Brazil. Rio de Janeiro, Brazil: UFF/Economia, Universidade Federal Fluminense.Google Scholar
  17. Koretz, D. (2009). How do American students measure up? Making sense of international comparisons. Future of Children, 19(1), 37–51.CrossRefGoogle Scholar
  18. Kyriakides, L. (2006a). Introduction international studies in educational effectiveness. Educational Research and Evaluation, 12(6), 489–497.CrossRefGoogle Scholar
  19. Kyriakides, L. (2006b). Using international comparative studies to develop the theoretical framework of educational effectiveness research: A secondary analysis of TIMSS 1999 data. Educational Research and Evaluation, 12(6), 513–534.CrossRefGoogle Scholar
  20. Luke, D. A. (2004). Multilevel modeling. Thousand Oaks, CA: Sage.Google Scholar
  21. McGaw, B. (2008). The role of the OECD in international comparative studies of achievement. Assessment in Education: Principles, Policy & Practice, 15(3), 223–243.CrossRefGoogle Scholar
  22. Milne, A., & Plourde, L. A. (2006). Factors of a low-SES household: What aids academic achievement? Journal of Instructional Psychology, 33(3), 183–193.Google Scholar
  23. No Child Left Behind Act of 2001. (2002). Pub. L. No. 107–110, 115 Stat. 1425.Google Scholar
  24. O’Connell, A. A., & McCoach, D. B. (2008). Multilevel modeling of educational data. Charlotte, NC: Information Age Publishing.Google Scholar
  25. OECD/INES/Network A (2005). Media coverage of PISA 2003 and TIMSS 2003. Review of Assessment Activities, 18, 1–20. Available from
  26. Organisation for Economic Co-operation and Development (2000). Measuring student knowledge and skill: The PISA 2000 assessment of reading, mathematical and scientific literacy. Paris: Author.Google Scholar
  27. Organisation for Economic Co-operation and Development (2005). PISA 2003 technical report. Paris: Author.Google Scholar
  28. Organisation for Economic Co-operation and Development (2006). Assessing scientific, reading and mathematical literacy. A framework for PISA 2006. Paris: Author.Google Scholar
  29. Organisation for Economic Co-operation and Development (2007). Education at a glance. Paris: Author.Google Scholar
  30. Puryear, J. (2007). Six Latin American nations’ test scores near bottom—again. Washington, DC: Inter-American Dialogue Latin American Advisor. Retrieved August 10, 2009, from
  31. Roberts, J. (2007, December 5). Chile tops Latin America in PISA education scores. The Santiago Times. Retrieved August 12, 2009, from
  32. Sammons, P. (2006). The contribution of international studies on educational effectiveness: Current and future directions. Educational Research and Evaluation, 12(6), 583–593.CrossRefGoogle Scholar
  33. Santos, M. E. (2007). Quality of education in Argentina: Determinants and distribution using PISA 2000 test scores. Well-Being and Social Policy, 3(1), 69–95.Google Scholar
  34. Schneider, M. (2009, June). International benchmarking. Paper presented at the Fourth Annual Institute of Education Sciences Research Conference, Washington, DC. Abstract retrieved from
  35. Stack, M. (2006). Testing, testing, read all about it: Canadian press coverage of the PISA results. Canadian Journal of Education, 29(1), 49–69.Google Scholar
  36. Stack, M. (2007). Representing school success and failure: Media coverage of international test. Policy Futures in Education, 5(1), 100–111.CrossRefGoogle Scholar
  37. Turmo, A. (2004). Scientific literacy and socio-economic background among 15-year-olds—A Nordic perspective. Scandinavian Journal of Educational Research, 48(3), 287–305.CrossRefGoogle Scholar
  38. Turner, R. & Adams, R. J. (2007). The Programme for International Student Assessment: An overview. Journal of Applied Measurement, 8(3), 237–248.Google Scholar
  39. Vegas, E., & Petrow, J. (2008). Raising student learning in Latin America: The challenge for the 21st century. Washington, DC: The World Bank.Google Scholar
  40. Wolff, L. (2004). Educational assessment in Latin America: The state of the art. Applied Psychology: An International Review, 53(2), 192–214.CrossRefGoogle Scholar
  41. World Bank, The (2007). Toward high-quality education in Peru: Standards, accountability, and capacity building. Washington, DC: Author.CrossRefGoogle Scholar
  42. Zoido, P. (2008). Public spending on education in Latin America: Does it pay? Policy Insights (No. 80). Retrieved August 12, 2009, from

Copyright information

© National Science Council, Taiwan 2010

Authors and Affiliations

  • Todd Milford
    • 1
    Email author
  • Shelley P. Ross
    • 2
  • John O. Anderson
    • 1
  1. 1.Faculty of EducationUniversity of VictoriaVictoriaCanada
  2. 2.Department of Family MedicineUniversity of AlbertaEdmontonCanada

Personalised recommendations