Skip to main content

Using ILSAs to Promote Quality and Equity in Education: The Contribution of the Dynamic Model of Educational Effectiveness

  • Reference work entry
  • First Online:
International Handbook of Comparative Large-Scale Studies in Education

Abstract

This chapter argues that during the past 50 years, International Large-Scale Assessment studies (ILSAs) in education and Educational Effectiveness Research (EER) have contributed to each other in significant ways. It is also claimed that in the future, stronger links can be established between these domains which can help advance work in both, while at the same time better serve their common agenda in promoting quality and equity in education. To support these arguments, we trace the historical roots of both strands of work and point to ways in which each has contributed to the other. It is shown that ILSAs have mobilized the resources for conducting educational effectiveness studies and afforded EER scholars the opportunity to capitalize on rich international datasets to conduct secondary analyses which have facilitated the theoretical and methodological development of EER. Additionally, by conducting both across- and within-country analyses, researchers have examined whether specific factors at the classroom and/or the school level are generic while others are more country-specific. On the other hand, EER has afforded theoretical constructs and frameworks to inform the design of ILSAs. For example, due to the influence of recent meta-analyses of effectiveness studies pointing to the importance of attending to teaching behaviors in the classroom, ILSAs are gradually making a step toward incorporating more such investigations. Forging stronger links between the two domains can advance work in each. We argue that from a theoretical perspective, ILSAs can be informed by the gradual shift currently witnessed in EER to move from a static to a more dynamic conceptualization of the process of teaching/schooling/learning. Specifically, the dynamic model of educational effectiveness could be a foundation upon which ILSAs could be based, both in terms of their design and in terms of secondary data analysis which can help better understand what contributes to student learning and through that develop reform policies to promote quality and equity in education.

This chapter builds on and extends a previous work of the first two authors Kyriakides and Charalambous (Educational effectiveness research and international comparative studies: Looking back and looking forward. In R. Strietholt, W. Bos, J.-E. Gustafsson, & M. Rosén (Eds.), Educational policy evaluation through international comparative assessments (pp. 33–50). Waxmann, 2014).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 379.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Anderson, L. W. (1987). The classroom environment study: Teaching for learning. Comparative Education Review, 31(1), 69–87.

    Article  Google Scholar 

  • Azigwe, J. B., Kyriakides, L., Panayiotou, A., & Creemers, B. P. M. (2016). The impact of effective teaching characteristics in promoting student achievement in Ghana. International Journal of Educational Development, 51, 51–61.

    Article  Google Scholar 

  • Azkiyah, S. N., Doolaard, S., Creemers, B. P. M., & Van Der Werf, M. P. C. (2014). The effects of two intervention programs on teaching quality and student achievement. Journal of Classroom Interaction, 49(1), 4–11.

    Google Scholar 

  • Bandura, A. (1989). Regulation of cognitive processes through perceived self-efficacy. Developmental Psychology, 25(5), 729–735. https://doi.org/10.1037/0012-1649.25.5.729

    Article  Google Scholar 

  • Bates, R. (2010). The dynamics of educational effectiveness. British Educational Research Journal, 36(1), 166–167.

    Google Scholar 

  • Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., … Tsai, Y. M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180.

    Article  Google Scholar 

  • Becker, G. (1975). Human capital: A theoretical and empirical analysis (2nd ed.). Columbia University Press.

    Google Scholar 

  • Black, P., & Wiliam, D. (2009). Developing a theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31.

    Article  Google Scholar 

  • Blömeke, S., Gustafsson, J. E., & Shavelson, R. (2015). Beyond dichotomies competence viewed as a continuum. Zeitschrift für Psychologie, 223(1), 3–13.

    Article  Google Scholar 

  • Brekelmans, M., Sleegers, P., & Fraser, B. (2000). Teaching for active learning. In P. R. J. Simons, J. L. van der Linden, & T. Duffy (Eds.), New learning (pp. 227–242). Kluwer Academic Publishers.

    Chapter  Google Scholar 

  • Brookover, W. B., Beady, C., Flood, P., Schweitzer, J., & Wisenbaker, J. (1979). School systems and student achievement: Schools make a difference. Praeger.

    Google Scholar 

  • Brophy, J., & Good, T. L. (1986). Teacher behaviour and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). Macmillan.

    Google Scholar 

  • Brown, B. W., & Saks, D. H. (1986). Measuring the effects of instructional time on student learning: Evidence from the beginning teacher evaluation study. American Journal of Education, 94(4), 480–500. https://doi.org/10.1086/443863

    Article  Google Scholar 

  • Campbell, R. J., Kyriakides, L., Muijs, R. D., & Robinson, W. (2004). Assessing teacher effectiveness: A differentiated model. RoutledgeFalmer.

    Google Scholar 

  • Caro, D. H. (2011). Parent-child communication and academic performance: Associations at the within- and between-country level. Journal for Educational Research Online, 3, 15–37.

    Google Scholar 

  • Caro, D. H., Kyriakides, L., & Televantou, I. (2018). Addressing omitted prior achievement bias in international assessments: An applied example using PIRLS-NPD matched data. Assessment in Education: Principles, Policy & Practice, 25(1), 5–27.

    Google Scholar 

  • Caro, D. H., Lenkeit, J., & Kyriakides, L. (2016). Teaching strategies and differential effectiveness across learning contexts: Evidence from PISA 2012. Studies in Educational Evaluation, 49, 30–41.

    Article  Google Scholar 

  • Charalambous, C. Y. (2016). Investigating the knowledge needed for teaching mathematics: An exploratory validation study focusing on teaching practices. Journal of Teacher Education, 67(3), 220–237.

    Article  Google Scholar 

  • Charalambous, C. Y., & Kyriakides, E. (2017). Working at the nexus of generic and content-specific teaching practices: An exploratory study based on TIMSS secondary analyses. The Elementary School Journal, 117(3), 423–454.

    Article  Google Scholar 

  • Charalambous, C. Y., Kyriakides, E., Kyriakides, L., & Tsangaridou, N. (2019). Are teachers consistently effective across subject matters? Revisiting the issue of differential teacher effectiveness. School Effectiveness and School Improvement, 30(4), 353–379. https://doi.org/10.1080/09243453.2019.1618877

    Article  Google Scholar 

  • Charalambous, C. Y., & Praetorius, A. K. (2018). Studying mathematics instruction through different lenses: Setting the ground for understanding instructional quality more comprehensively. ZDM Mathematics Education, 50(3), 355–366. https://doi.org/10.1007/s11858-018-0914-8

    Article  Google Scholar 

  • Christoforidou, M., & Xirafidou, E. (2014). Using the dynamic model to identify stages of teacher skills in assessment. Journal of Classroom Interaction, 49(1), 12–25.

    Google Scholar 

  • Coleman, J. S., Campbell, E. Q., Hobson, C. F., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1966). Equality of educational opportunity. US Government Printing Office.

    Google Scholar 

  • Collins, J. (2009). Social reproduction in classrooms and schools. Annual Review of Anthropology, 38, 33–48. https://doi.org/10.1146/annurev.anthro.37.081407.085242.

  • Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Routledge.

    Google Scholar 

  • Creemers, B. P. M., & Kyriakides, L. (2010). School factors explaining achievement on cognitive and affective outcomes: Establishing a dynamic model of educational effectiveness. Scandinavian Journal of Educational Research, 54(1), 263–294.

    Article  Google Scholar 

  • Creemers, B. P. M., Kyriakides, L., & Sammons, P. (2010). Methodological advances in educational effectiveness research. Routledge.

    Book  Google Scholar 

  • Döhrmann, M., Kaiser, G., & Blömeke, S. (2012). The conceptualisation of mathematics competencies in the international teacher education study TEDS-M. ZDM, 44(3), 325–340.

    Article  Google Scholar 

  • Elberts, R. W., & Stone, J. A. (1988). Student achievement in public schools: Do principles make a difference? Economics of Education Review, 7(3), 291–299.

    Article  Google Scholar 

  • Gustafsson, J. E. (2013). Causal inference in educational effectiveness research: A comparison of three methods to investigate effects of homework on student achievement. School Effectiveness and School Improvement, 24(3), 275–295.

    Article  Google Scholar 

  • Hamre, B. K., Pianta, R. C., Burchinal, M., Field, S., LoCasale-Crouch, J., et al. (2012). A course on effective teacher-child interactions: Effects on teacher beliefs, knowledge, and observed practice. American Educational Research Journal, 49(1), 88–123.

    Article  Google Scholar 

  • Harker, R., & Tymms, P. (2004). The effects of student composition on school outcomes. School Effectiveness and School Improvement, 15, 177–199.

    Article  Google Scholar 

  • Hiebert, J., Gallimore, R., Garnier, H., Givvin, K. B., Hollingsworth, H., Jacobs, J., & Stigler, J. (2003). Teaching mathematics in seven countries: Results from the TIMSS 1999 video study. Education Statistics Quarterly, 5(1), 7–15.

    Google Scholar 

  • Hill, H. C., Ball, D. L., & Schilling, S. G. (2008). Unpacking pedagogical content knowledge: Conceptualizing and measuring teachers’ topic-specific knowledge of students. Journal for Research in Mathematics Education, 39(4), 372–400.

    Google Scholar 

  • Hox, J. J., & Roberts, J. K. (Eds.). (2011). Handbook of advanced multilevel analysis. Routledge.

    Google Scholar 

  • Husén, T. (Ed.). (1967). International study of achievement in mathematics: A comparison of twelve countries (Vol. 1–2). Almqvist & Wiksell.

    Google Scholar 

  • Jencks, C., Smith, M., Acland, H., Bane, M. J., Cohen, D., Gintis, H., Heyns, B., & Michelson, S. (1972). Inequality: A reassessment of the effects of family and schooling in America. Basic Books.

    Google Scholar 

  • Joyce, B. R., Weil, M., & Calhoun, E. (2000). Models of teaching. Allyn & Bacon.

    Google Scholar 

  • Kyriakides, L., Anthimou, M., & Panayiotou, A. (2020). Searching for the impact of teacher behavior on promoting students’ cognitive and metacognitive skills. Studies in Educational Evaluation, 64. https://doi.org/10.1016/j.stueduc.2019.100810

  • Kyriakides, L., & Charalambous, C. Y. (2014). Educational effectiveness research and international comparative studies: Looking back and looking forward. In R. Strietholt, W. Bos, J.-E. Gustafsson, & M. Rosén (Eds.), Educational policy evaluation through international comparative assessments (pp. 33–50). Waxmann.

    Google Scholar 

  • Kyriakides, L., Christoforou, C., & Charalambous, C. Y. (2013). What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching. Teaching and Teacher Education, 36, 143–152.

    Article  Google Scholar 

  • Kyriakides, L., Creemers, B., Antoniou, P., & Demetriou, D. (2010). A synthesis of studies searching for school factors: Implications for theory and research. British Educational Research Journal, 36(5), 807–830.

    Article  Google Scholar 

  • Kyriakides, L., Creemers, B. P. M., Antoniou, P., Demetriou, D., & Charalambous, C. (2015). The impact of school policy and stakeholders’ actions on student learning: A longitudinal study. Learning and Instruction, 36, 113–124.

    Article  Google Scholar 

  • Kyriakides, L., Creemers, B. P. M., & Charalambous, E. (2018). Equity and quality dimensions in educational effectiveness. Springer.

    Book  Google Scholar 

  • Kyriakides, L., Creemers, B. P. M., & Charalambous, E. (2019). Searching for differential teacher and school effectiveness in terms of student socioeconomic status and gender: Implications for promoting equity. School Effectiveness and School Improvement, 30(3), 286–308.

    Article  Google Scholar 

  • Kyriakides, L., Creemers, B. P. M., Panayiotou, A., Vanlaar, G., Pfeifer, M., Gašper, C., & McMahon, L. (2014). Using student ratings to measure quality of teaching in six European countries. European Journal of Teacher Education, 37(2), 125–143.

    Article  Google Scholar 

  • Kyriakides, L., Georgiou, M. P., Creemers, B. P. M., Panayiotou, A., & Reynolds, D. (2018). The impact of national educational policies on student achievement: A European study. School Effectiveness and School Improvement, 29(2), 171–203.

    Article  Google Scholar 

  • Le Donné, N., Fraser, P., & Bousquet, G. (2016). Teaching strategies for instructional quality: Insights from the TALIS-PISA link data (OECD education working paper no. 148). OECD Directorate for Education and Skills. https://doi.org/10.1787/5jln1hlsr0lr-en

  • Lelei, H. (2019). A case study of policy and actions of Rivers state, Nigeria to improve teaching quality and the school learning environment (Unpublished doctoral dissertation). School of Education.

    Google Scholar 

  • Levin, B. (2005). Governing education. University of Toronto Press.

    Book  Google Scholar 

  • Lingard, B., & Grek, S. (2008). The OECD, indicators and PISA: An exploration of events and theoretical perspectives (ESRC/ESF research project on fabricating quality in education. Working paper 2).

    Google Scholar 

  • Madaus, G. G., Kellagham, T., Rakow, E. A., & King, D. (1979). The sensitivity of measures of school effectiveness. Harvard Educational Review, 49(2), 207–230.

    Article  Google Scholar 

  • Marsh, H. (2008). Big-fish-little-pond-effect: Total long-term negative effects of school-average ability on diverse educational outcomes over 8 adolescent/early adult years. International Journal of Psychology, 43(3–4), 53–54.

    Google Scholar 

  • Marshall, B., & Drummond, M. J. (2006). How teachers engage with assessment for learning: Lessons from the classroom. Research Papers in Education, 21(2), 133–149.

    Article  Google Scholar 

  • Maslowski, R., Scheerens, J., & Luyten, H. (2007). The effect of school autonomy and school internal decentralization on students’ reading literacy. School Effectiveness and School Improvement, 18(3), 303–334.

    Article  Google Scholar 

  • Monk, D. H. (1992). Education productivity research: An update and assessment of its role in education finance reform. Educational Evaluation and Policy Analysis, 14(4), 307–332.

    Article  Google Scholar 

  • Muijs, R. D., Kyriakides, L., van der Werf, G., Creemers, B. P. M., Timperley, H., & Earl, L. (2014). State of the art-teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25(2), 231–256.

    Article  Google Scholar 

  • Musthafa, H. S. (2020). A longitudinal study on the impact of instructional quality on student learning in primary schools of Maldives (Unpublished doctoral dissertation). University of Cyprus, Nicosia, Cyprus.

    Google Scholar 

  • OECD. (2009). PISA 2006 data analysis manual. OECD Publications.

    Google Scholar 

  • OECD. (2016). PISA 2015 assessment and analytical framework: Science, reading, mathematic and financial literacy. PISA, OECD Publishing.

    Book  Google Scholar 

  • OECD. (2017). PISA 2015 Assessment and analytical framework: Science, reading, mathematic, financial literacy and collaborative problem solving. OECD Publishing. https://doi.org/10.1787/9789264281820-en.

  • Olmsted, P. P., & Weikart, D. P. (Eds.). (1995). The IEA preprimary study: Early childhood care and education in 11 countries. Elsevier Science.

    Google Scholar 

  • Opdenakker, M. C., & Van Damme, J. (2006). Differences between secondary schools: A study about school context, group composition, school practice, and school effects with special attention to public and Catholic schools and types of schools. School Effectiveness and School Improvement, 17(1), 87–117.

    Article  Google Scholar 

  • Paget, C. (2018). Exploring school resource and teacher qualification policies, their implementation and effects on schools and students’ educational outcomes in Brazil (Unpublished doctoral dissertation). University of Oxford, UK.

    Google Scholar 

  • Panayiotou, A., Kyriakides, L., Creemers, B. P. M., McMahon, L., Vanlaar, G., Pfeifer, M., Rekalidou, G., & Bren, M. (2014). Teacher behavior and student outcomes: Results of a European study. Educational Assessment, Evaluation and Accountability, 26, 73–93.

    Article  Google Scholar 

  • Pianta, R., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119.

    Article  Google Scholar 

  • Postlethwaite, N. (1967). School organization and student achievement: A study based on achievement in mathematics in twelve countries. Almqvist & Wiksell.

    Google Scholar 

  • Purves, A. C. (1987). The evolution of the IEA: A memoir. Comparative Education Review, 31(1), 10–28.

    Article  Google Scholar 

  • Reynolds, D. (2006). World class schools: Some methodological and substantive findings and implications of the international school effectiveness research project (ISERP). Educational Research and Evaluation, 12(6), 535–560.

    Article  Google Scholar 

  • Reynolds, D., Sammons, P., De Fraine, B., Van Damme, J., Townsend, T., Teddlie, C., & Stringfield, S. (2014). Educational effectiveness research (EER): A state-of-the-art review. School Effectiveness and School Improvement, 25(2), 197–230.

    Article  Google Scholar 

  • Rowan, B., & Correnti, R. (2009). Studying reading instruction with teacher logs: Lessons from the study of instructional improvement. Educational Researcher, 38(2), 120–131.

    Article  Google Scholar 

  • Rutter, M., Maughan, B., Mortimore, P., Ouston, J., & Smith, A. (1979). Fifteen thousand hours: Secondary schools and their effects on children. Harvard University Press.

    Google Scholar 

  • Sammons, P. (2009). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. School Effectiveness and School Improvement, 20(s1), 123–129.

    Article  Google Scholar 

  • Scheerens, J. (2013). School leadership effects revisited: Review and meta-analysis of empirical studies. Springer.

    Google Scholar 

  • Scheerens, J. (2016). Educational effectiveness and ineffectiveness: A critical review of the knowledge base. Springer.

    Book  Google Scholar 

  • Schmidt, W., & Valverde, G. A. (1995). National policy and cross national research: United States participation in the third international and science study. Michigan State University.

    Google Scholar 

  • Schmidt, W. H., Jorde, D., Cogan, L. S., Barrier, E., Gonzalo, I., Moser, U., et al. (1996). Characterizing pedagogical flow. Kluwer Academic Publishers.

    Google Scholar 

  • Schulz, W., Carstens, R., Losito, B., & Fraillon, J. (2018). ICCS 2016 technical report – IEA international civic and citizenship education study 2016. International Association for the Evaluation of Educational Achievement (IEA). Retrieved from https://www.iea.nl/sites/default/files/2019-07/ICCS%202016_Technical%20Report_FINAL.pdf

  • Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis research. Review of Educational Research, 77, 454–499.

    Article  Google Scholar 

  • Shechtman, N., Roschelle, J., Haertel, G., & Knudsen, J. (2010). Investigating links from teacher knowledge, to classroom practice, to student learning in the instructional system of the middle-school mathematics classroom. Cognition and Instruction, 28(3), 317–359.

    Article  Google Scholar 

  • Stigler, J., & Hiebert, J. (1999). The teaching gap. The Free Press.

    Google Scholar 

  • Tatto, M. T., Schwille, J., Senk, S. L., Ingvarson, L., Rowley, G., Peck, R., et al. (2012). Policy, practice, and readiness to teach primary and secondary mathematics in 17 countries: Findings from the IEA teacher education and development study in mathematics (TEDS-M). International Association for Educational Achievement (IEA).

    Google Scholar 

  • van der Werf, G., Opdenakker, M.-C., & Kuyper, H. (2008). Testing a dynamic model of student and school effectiveness with a multivariate multilevel latent growth curve approach. School Effectiveness and School Improvement, 19(4), 447–462.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Leonidas Kyriakides .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Kyriakides, L., Charalambous, C.Y., Charalambous, E. (2022). Using ILSAs to Promote Quality and Equity in Education: The Contribution of the Dynamic Model of Educational Effectiveness. In: Nilsen, T., Stancel-Piątak, A., Gustafsson, JE. (eds) International Handbook of Comparative Large-Scale Studies in Education. Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-88178-8_13

Download citation

Publish with us

Policies and ethics