Abstract
In this chapter results of a research synthesis and quantitative meta-analyses of three facets of time effects in education are presented, namely time at school during regular lesson hours, homework, and extended learning time. The number of studies for these three facets of time that could be used for a qualitative synthesis (so-called vote counting on the basis of significant and non-significant associations) was 31 for learning time at school, 52 for homework, and 15 for out of school learning. Effect sizes were available for 16 studies on learning time at school and 45 studies concerning the effects of homework. The number of studies on out of school learning was too small to conduct a quantitative meta-analysis. The average effect size for the meta-analyses on time at school and homework were .05 (Fisher Z coefficient) for both time facets. These results are considerably lower than those that could be obtained by averaging results of other meta-analyses; as these averages amounted to .18 for time at school, and .15 for homework.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Following Cooper et al. (2009), “vote counting” is still seen as meta-analysis, since it involves statistically describing study outcomes.
- 2.
For extended learning time the number of samples included in the vote-counting procedure is 22. The number of samples that might have been included for quantitative meta-analysis is 6.
- 3.
As mentioned earlier, the unit of analysis in the quantitative meta-analysis was the independent sample. As we averaged multiple effect size estimates reported for the sample, for each sample only one effect size estimate of the relationship between time and achievement was used in the analyses.
References
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy and Practice, 18(1), 5–25.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
Bushman, B. J. (1994). Vote-Counting procedures in meta-analysis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis. New York: Russell Sage Foundation.
Bushman, B. J., & Wang, M. C. (2009). Vote-counting procedures in meta-analysis. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage Foundation.
Cooper, H. (1989). Homework. White Plains, NY: Longman.
Cooper, H., Robinson, J. C., & Patall, E. A. (2006). Does homework improve academic achievement? A synthesis of research, 1987–2003. Review of Educational Research, 76, 1–62.
Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage Foundation.
De Jong, R., Westerhof, K. J., & Creemers, B. P. M. (2000). Homework and student math achievement in junior high schools. Educational Research and Evaluation, 6(2), 130–157.
Dettmers, S., Trautwein, U., & Lüdtke, O. (2009a). The relationship between homework time and achievement is not universal: Evidence from multilevel analyses in 40 countries. School Effectiveness and School Improvement, 20, 375–405.
Hox, J. J. (1995). Applied multilevel analysis (2nd ed.). Amsterdam: TT-publikaties.
Hox, J. J. (n.d.) Meta-analysis: Models, estimation and testing. Amsterdam: Presentation Utrecht University.
Hox, J. (2002). Multilevel analysis techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
Hungi, N., & Postlethwaite, N. T. (2009a). The key factors affecting grade 5 achievement in laos: Emerging policy issues. Educational Research for Policy and Practice, 8(3), 211–230.
Hungi, N., & Thuku, F. W. (2010a). Variations in reading achievement across 14 Southern African school systems: Which factors matter? International Review of Education, 56(1), 63–101.
Kohn, A. (2006). Abusing research: The study of homework and other examples. Phi Delta Kappan, 88(1), 8–22.
Kyriakides, L., & Creemers, B. P. M. (2008a). A longitudinal study on the stability over time of school and teacher effects on student outcomes. Oxford Review of Education, 34(5), 521–545.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
Peterson, R. A., & Brown, S. P. (2005). On the use of beta coefficients in meta-analysis. Journal of Applied Psychology, 90, 175–181.
Scheerens, J., & Bosker, R. J. (1997). The foundations of educational effectiveness. Oxford: Elsevier Science Ltd.
Scheerens, J., Seidel, T., Witziers, B., Hendriks, M., & Doornekamp G. (2005). Positioning and validating the supervision framework. Enschede. Enschede: University of Twente, Department of Educational Organization and Management.
Scheerens, J., Luyten, H., Steen, R., & Luyten-de Thouars, Y. (2007). Review and meta-analyses of school and teaching effectiveness. Enschede: Department of Educational Organisation and Management, University of Twente.
Taylor, B. M., Pearson, P. D., Peterson, D. S., & Rodriguez, M. C. (2003a). Reading growth in high-poverty classrooms: The influence of teacher practices that encourage cognitive engagement in literacy learning. The Elementary School Journal, 104, 3–28.
Trautwein, U. (2007a). The homework-achievement relation reconsidered: Differentiating homework time, homework frequency, and homework effort. Learning and Instruction, 17, 372–388.
Trautwein, U., & Koller, O. (2003). The relationship between homework and achievement - Still much of a mystery. Educational Psychology Review, 15(2), 115–145.
Trautwein, U., Koller, O., Schmitz, B., & Baumert, J. (2002a). Do homework assignments enhance achievement? A multilevel analysis in 7th-grade mathematics. Contemporary Educational Psychology, 27(1), 26–50.
Trautwein, U., Ludtke, O., Schnyder, I., & Niggli, A. (2006a). Predicting homework effort: Support for a domain-specific, multilevel homework model. Journal of Educational Psychology, 98(2), 438–456.
Trautwein, U., Schnyder, I., Niggli, A., Neumann, M., & Ludtke, O. (2009a). Chameleon effects in homework research: The homework-achievement association depends on the measures used and the level of analysis chosen. Contemporary Educational Psychology, 34(1), 77–88.
van Ewijk, R., & Sleegers, P. (2010). Peer ethnicity and achievement: A meta-analysis into the compositional effect. School Effectiveness and School Improvement, 21(3), 237–265.
Studies used for vote count and meta-analysis, References marked with an asterisk indicate studies included in the quantitative meta-analysis
Aslam, M., & Kingdon, G. (2011). What can teachers do to raise pupil achievement? Economics of Education Review, 30(3), 559–574.
Borman, G. D., Benson, J., & Overman, L. T. (2005). Families, schools, and summer learning. Elementary School Journal, 106(2), 131–150.
Bosker, R. J., Kremers, E. J. J., & Lugthart, E. (1990). School and instruction effects on mathematics achievement. School Effectiveness and School Improvement, 1(4), 233–248.
Burkam, D. T., Lee, V. E., & Smerdon, B. A. (1997). Gender and science learning early in high school: Subject matter and laboratory experiences. American Educational Research Journal, 34(2), 297–331.
Cameron, C. E., Connor, C. M., Morrison, F. J., & Jewkes, A. M. (2008). Effects of classroom organization on letter-word reading in first grade. Journal of School Psychology, 46(2), 173–192.
*Chen, S. Y., & Lu, L. (2009). After-school time use in Taiwan: effects on educational achievement and well-being. Adolescence, 44(176), 891–909.
Chubb, J. E., & Moe, T. M. (1990). Politics. Markets and America’s schools: The Brookings Institution.
D’Agostino, J. V. (2000). Instructional and school effects on students’ longitudinal reading and mathematics achievements. School Effectiveness and School Improvement, 11(2), 197–235.
Dettmers, S., Trautwein, U., & Ludtke, O. (2009b). The relationship between homework time and achievement is not universal: Evidence from multilevel analyses in 40 countries. School Effectiveness and School Improvement, 20(4), 375–405.
Dettmers, S., Trautwein, U., Ludtke, O., Kunter, M., & Baumert, J. (2010). Homework works if homework quality Is high: Using multilevel modeling to predict the development of achievement in mathematics. Journal of Educational Psychology, 102(2), 467–482.
Driessen, G., & Sleegers, P. (2000). Consistency of teaching approach and student achievement: An empirical test. School Effectiveness and School Improvement, 11(1), 57–79.
de Jong, R., Westerhof, K. J., & Kruiter, J. H. (2004). Empirical evidence of a comprehensive model of school effectiveness: A multilevel study in mathematics in the 1st year of junior general education in the Netherlands. School Effectiveness and School Improvement, 15(1), 3–31.
Engin-Demir, C. (2009). Factors influencing the academic achievement of the Turkish urban poor. International Journal of Educational Development, 29(1), 17–29.
Eren, O., & Henderson, D. J. (2008). The impact of homework on student achievement. Econometrics Journal, 11(2), 326–348.
Eren, O., & Millimet, D. L. (2007). Time to learn? The organizational structure of schools and student achievement. Empirical Economics, 32(2–3), 301–332.
Fehrmann, P. G., Keith, T. Z., & Reimers, T. M. (1987). Home influence on school learning: direct and indirect effects of parental involvement on high school grades. Journal of educational research, 80(6), 330–337.
Flowers, T. A., & Flowers, L. A. (2008). Factors affecting urban African American high school students’ achievement in reading. Urban Education, 43(2), 154–171.
Fuchs, Th, & Woessman, L. (2007). What accounts for international differences in student performance? A re-examination using PISA data. Empirical Economics, 32, 433–464.
Gustavsson, J. E. (2010). Causal inference in educational effectiveness research: A comparison of three methods to investigate effects of homework on student achievement. Invited key-note address of the second meeting of EARLI SIG 18. Centre for Evaluation and Educational Effectiveness, University of Leuven, 25–27 Aug, 2010.
Harn, B. A., Linan-Thompson, S., & Roberts, G. (2008). Intensifying instruction: Does additional instructional time make a difference for the most at-risk first graders? Journal of Learning Disabilities, 41(2), 115–125.
Hofman, R. H., Hofman, W. H. A., & Guldemond, H. (1999). Social and cognitive outcomes: A comparison of contexts of learning. School Effectiveness and School Improvement, 10(3), 352–366.
Hong, G., & Raudenbush, S. W. (2008). Causal inference for time-varying instructional treatments. Journal of Educational and Behavioral Statistics, 33(3), 333–362.
House, J. D. (2005). Classroom instruction and science achievement in Japan, Hong Kong, and Chinese Taipei: results from the TIMSS 1999 assessment. International Journal of Instructional Media, 32(3), 295.
Hungi, N. (2008). Examining differences in mathematics and reading achievement among grade 5 pupils in Vietnam. Studies in Educational Evaluation, 34(3), 155–164.
Hungi, N., & Postlethwaite, N. T. (2009b). The key factors affecting grade 5 achievement in laos: emerging policy issues. Educational Research for Policy and Practice, 8(3), 211–230.
Hungi, N., & Thuku, F. W. (2010b). Variations in reading achievement across 14 Southern African school systems: Which factors matter? International Review of Education, 56(1), 63–101.
Iturre, R. A. C. (2005). The relationship between School composition, School process and mathematics achievement in secondary education in Argentina. International Review of Education, 51(2–3), 173–200.
Jenner, E., & Jenner, L. W. (2007). Results from a first-year evaluation of academic impacts of an after-school program for at-risk students. Journal of Education for Students Placed at Risk, 12(2), 213–237.
Kalender, I., & Berberoglu, G. (2009). An assessment of factors related to science achievement of Turkish students. International Journal of Science Education, 31(10), 1379–1394.
Kitsantas, A., Cheema, J., & Ware, H. W. (2011). Mathematics achievement: The role of homework and self-efficacy beliefs. Journal of Advanced Academics, 22(2), 310–339.
Kotte, D., Lietz, P., & Lopez, M. M. (2005). Factors influencing reading achievement in Germany and Spain: evidence from PISA 2000. International Education Journal, 6(1), 113–124.
Kupermintz, H., Ennis, M., Hamilton, L. S., Talbert, J. E., & Snow, R. E. (1995). Enhancing the validity and usefulness of large-scale educational assessments. 1. Nels-88 mathematics achievement. American Educational Research Journal, 32(3), 525–554.
Kyriakides, L., Campbell, R. J., & Gagatsis, A. (2000). The significance of the classroom effect in primary schools: An application of Creemers’ comprehensive model of educational effectiveness. School Effectiveness and School Improvement, 11(4), 501–529.
Kyriakides, L., & Creemers, B. P. M. (2008b). A longitudinal study on the stability over time of school and teacher effects on student outcomes. Oxford Review of Education, 34(5), 521–545.
Lavy, V. (2010). Do differences in school’s instruction time explain international achievement gaps in math, science, and reading? Evidence from developed and developing countries. NBER Working Paper No. 16227: National Bureau of Economic Research.
Leseman, P. P. M., Sijsling, F. F., & de Vries, E. M. (1992). Zorgbreedte en instructiekenmeken: aanknopingspunten voor de preventie van functioneel analfabetisme in het LBO. Pedagogische Studiën, 69(5), 371–387.
Li, Y., Alfeld, C., Kennedy, R. P., & Putallaz, M. (2009). Effects of summer academic programs in middle school on high school test scores, course-taking, and college major. Journal of Advanced Academics, 20(3), 404–436.
Lin, Y-H., Chang, C-T. & Lin, H-F. (2007). Multilevel analysis of PISA 2003 with influence on achievement from education index of countries and time studying of students. Paper presented at 6th WSEAS International Conference on Education and Educational Technology, Italy, November 21–23, 2007.
Liu, Y., Wu, A. D., & Zumbo, B. D. (2006). The relation between outside of school factors and mathematics achievement: A cross-country study among the U.S. and five top-performing Asian countries. Journal of Educational Research and Policy Studies, 6(1), 1–35.
Lockheed, M. E., & Komenan, A. (1989). Teaching quality and student achievement in Africa: the case of Nigeria and Swaziland. Teaching and Teacher Education, 5(2), 93–115.
Lockheed, M. E., & Longford, N. (1999). School effects on mathematics gain in Thailand. In S. W. Raudenbush & J. D. Willms (Eds.), Schools, classrooms and pupils: international studies from a multi-level perspective. San Diego, CA: Academic Press.
Lubbers, M. J., Van der Werf, M. P. C., Kuyper, H., & Hendriks, A. A. J. (2010). Does homework behavior mediate the relation between personality and academic performance? Learning and Individual Differences, 20(3), 203–208.
Lubienski, S. T., Lubienski, C., & Crane, C. C. (2008). Achievement differences and school school climate, teacher certification, and instruction.”. American Journal of Education, 115(1), 97–138.
Luyten, H., & de Jong, R. (1998). Parallel classes: Differences and similarities. Teacher effects and school effects in secondary schools. School Effectiveness and School Improvement, 9(4), 437–473.
Ma, X., & Crocker, R. (2007). Provincial effects on reading achievement. Alberta Journal of Educational Research, 53(1), 87–109.
Matsudaira, J. D. (2008). Mandatory summer school and student achievement. Journal of Econometrics, 142(2), 829–850.
McDonald Connor, C., Son, S.-H., Hindman, A. H., & Morrison, F. J. (2005). Teacher qualifications, classroom practices, family characteristics, and preschool experience: Complex effects on first graders’ vocabulary and early reading outcomes. Journal of School Psychology, 43, 343–375.
Meijnen, G. W., Lagerweij, N. W., & Jong, P. F. (2003). Instruction characteristics and cognitive achievement of young children in elementary schools. School Effectiveness and School Improvement, 14(2), 159–187.
Muijs, D., & Reynolds, D. (2000). School effectiveness and teacher effectiveness in mathematics: Some preliminary findings from the evaluation of the mathematics enhancement programme (primary). School Effectiveness and School Improvement, 11(3), 273–303.
Natriello, G., & McDill, E. L. (1986). Performance standards, student effort on homework and academic achievement. Sociology of Education, 59(1), 18–30.
Pugh, G., & Telhaj, S. (2003). 17–20 September). Attainment effects of school enmeshment with external communities: Community policy, church/religious influence, and TIMSS-R mathematics scores in Flemish secondary schools. Paper presented at the European Conference on Educational Research, Hamburg.
Reezigt, G. J. (1993). Effecten van differentiatie op de basisschool. Groningen: RION.
Reezigt, G. J., Guldemond, H., & Creemers, B. P. M. (1999). Empirical validity for a comprehensive model on educational effectiveness. School effectiveness and school improvement, 10(2), 193–216.
*Rossmiller, R. A. (1986). School resources, home environment, and student achievement gains in grades 3–5. Paper presented at AERA, San Francisco, April 16–20, 1986. Madison: Wisconsin Center for Education Research.
Sabah, S., & Hammouri, H. (2010). Does subject matter matter? Estimating the impact of instructional practices and resources on student achievement in science and mathematics: Findings from timss 2007. Evaluation and Research in Education, 23(4), 287–299.
Schacter, J., & Jo, B. (2005). Learning when school is not in session: A reading summer day-camp intervention to improve the achievement of exiting First-Grade students who are economically disadvantaged. Journal of Research in Reading, 28(2), 158–169.
Smyth, E. (2008). The more, the better? Intensity of involvement in private tuition and examination performance. Educational Research and Evaluation, 14(5), 465–476.
Taylor, B. M., Pearson, P. D., Peterson, D. S., & Rodriguez, M. C. (2003b). Reading growth in high-poverty classrooms: The influence of teacher practices that encourage cognitive engagement in literacy learning. Elementary School Journal, 104(1), 3–28.
Teodorović, J. (2011). Classroom and school factors related to student achievement: What works for students? School Effectiveness and School Improvement, 22(2), 215–236.
Teodorović, J. (2012). Student background factors influencing student achievement in Serbia. Educational Studies, 38(1), 89–110.
Trautwein, U. (2007b). The homework-achievement relation reconsidered: Differentiating homework time, homework frequency, and homework effort. Learning and Instruction, 17, 372–388.
Trautwein, U., Koller, O., Schmitz, B., & Baumert, J. (2002b). Do homework assignments enhance achievement? A multilevel analysis in 7th-grade mathematics. Contemporary Educational Psychology, 27(1), 26–50.
Trautwein, U., Ludtke, O., Schnyder, I., & Niggli, A. (2006b). Predicting homework effort: Support for a domain-specific, multilevel homework model. Journal of Educational Psychology, 98(2), 438–456.
Trautwein, U., Schnyder, I., Niggli, A., Neumann, M., & Ludtke, O. (2009b). Chameleon effects in homework research: The homework-achievement association depends on the measures used and the level of analysis chosen. Contemporary Educational Psychology, 34(1), 77–88.
Unal, H., Ozkan, E. M., Milton, S., Price, K., & Curva, F. (2010). The effect of private tutoring on performance in mathematics in Turkey: A comparison across occupational types. In H. Uzunboylu (Ed.), Innovation and creativity in education. Procedia—Social and Behavioral Sciences, 2(2), 5512–5517.
Uguroglu, M., & Walberg, H. J. (1986). Predicting achievement and motivation. Journal of Research and Development in Education, 19(3), 1–12.
Wagner, P., Schober, B., & Spiel, C. (2008). Time students spend working at home for school. Learning and Instruction, 18(4), 309–320.
van der Werf, M. P. C. (1994). School and instruction characteristics and pupils’ arithmetic achievements at the end of primary education. Tijdschrift voor Onderwijsresearch, 18(2), 26–38.
van der Werf, G., Creemers, B., & Guldemond, H. (2001). Improving parental involvement in primary education in Indonesia: Implementation, effects and costs. School Effectiveness and School Improvement, 12(4), 447–466.
van der Werf, M. P. C., & Weide, M. G. (1993). Effectieve voorrangskenmerken in de school en klas. Pedagogische Studiën, 70, 108–221.
Won, S. J., & Han, S. (2010). Out-of-school activities and achievement among middle school students in the U.S. and South Korea. Journal of Advanced Academics, 21(4), 628–661.
Yu, G., & Thomas, S. M. (2008). Exploring school effects across Southern and eastern African school systems and in Tanzania. Assessment in Education: Principles, Policy and Practice, 15(3), 283–305.
Zhu, Y., & Leung, F. K. S. (2012). Homework and mathematics achievement in Hong Kong: Evidence from the TIMSS 2003. International Journal of Science and Mathematics Education, 10(4), 907–925.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 The Author(s)
About this chapter
Cite this chapter
Hendriks, M., Luyten, H., Scheerens, J., Sleegers, P. (2014). Meta-Analyses. In: Scheerens, J. (eds) Effectiveness of Time Investments in Education. SpringerBriefs in Education. Springer, Cham. https://doi.org/10.1007/978-3-319-00924-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-00924-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-00923-0
Online ISBN: 978-3-319-00924-7
eBook Packages: Humanities, Social Sciences and LawEducation (R0)