Large-Scale Studies in Mathematics Education pp 405-415 | Cite as

# The Role of Large-Scale Studies in Mathematics Education

## Abstract

The goal for this monograph has been to present the state of the art in large-scale studies in mathematics education. Although the chapters collected here are not intended to be a comprehensive compendium of such research, this selection of work does serve both to represent large-scale studies in the field of mathematics education and to raise awareness of the issues that arise in conducting such studies. As can be seen from the studies included in this volume, the term “large-scale study” can cover a wide variety of research endeavors. Indeed, as we indicated in the introductory chapter, the IES and NSF Common Guidelines (U.S. Department of Education & National Science Foundation, 2013) recognize many different types of research, and large-scale studies can fall into more than one of these categories. The different types of research have correspondingly different purposes which require different sample sizes and methods of analysis. Moreover, the findings from different types of research have different degrees of generalizability. Despite these many differences, there are common features that large-scale studies share. For example, large-scale studies require large sample sizes, although exactly how large “large” depends on the design of the study. In contrast to small-scale studies, large-scale studies usually employ complex statistical analysis and have the potential to produce more readily generalizable results than small-scale studies.

## References

- Banilower, E. R., Smith, P. S., Weiss, I. R., Malzahn, K. A., Campbell, K. M., & Weis, A. M. (2013).
*Report of the 2012 national survey of science and mathematics education*. Chapel Hill, NC: Horizon Research, Inc.Google Scholar - Bracey, G. W. (1997). More on TIMSS.
*Phi Delta Kappan, 78*(8), 656–657.Google Scholar - Braswell, J. S., Lutkus, A. D., Grigg, W. S., Santapau, S. L., Tay-Lim, B. S.-H., & Johnson, M. S. (2001).
*The nation’s report card: Mathematics 2000*. Washington, DC: U.S. Department of Education, National Center for Education Statistics.Google Scholar - Cai, J., Wang, N., Moyer, J. C., Wang, C., & Nie, B. (2011). Longitudinal investigation of the curricular effect: An analysis of student learning outcomes from the LieCal project in the United States.
*International Journal of Educational Research, 50*, 117–136.CrossRefGoogle Scholar - Cai, J. (2014). Searching for evidence of curricular effect on the teaching and learning of mathematics: Some insights from the LieCal project.
*Mathematics Education Research Journal, 26*, 811–831.CrossRefGoogle Scholar - Cai, J., Ni, Y., & Hwang, S. (2015). Measuring change in mathematics learning with longitudinal studies: Conceptualization and methodological issues. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Confrey, J., & Maloney, A. (2015). Engineering [for] effectiveness in mathematics education: Intervention at the instructional core in an era of the common core standards. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Ebby, C. B., & Sirinides, P. M. (2015). Conceptualizing teachers’ capacity for learning trajectory-oriented formative assessment in mathematics. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Givvin, K. B., Jacobs, J., Hollingsworth, H., & Hiebert, J. (2009). What is effective mathematics teaching? International educators’ judgments of mathematics lessons from the TIMSS 1999 video study. In J. Cai, G. Kaiser, B. Perry, & N.-Y. Wong (Eds.),
*Effective mathematics teaching from teachers’ perspectives: National and cross-national studies*(pp. 37–69). Rotterdam, The Netherlands: Sense Publishers.Google Scholar - Hanna, G. (2000). Declining gender differences from FIMS to TIMSS.
*Zentralblatt fur Didaktik der Mathematik, 32*, 11–17.CrossRefGoogle Scholar - Hart, L. C., Smith, S. Z., Swars, S. L., & Smith, M. E. (2008). An examination of research methods in mathematics education (1995–2005).
*Journal of Mixed Methods Research, 3*, 26–41.CrossRefGoogle Scholar - Heppen, J. B., Clements, M., & Walters, K. (2015). Turning to online courses to expand access: A rigorous study of the impact of online algebra I for eighth graders. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Hiebert, J., Gallimore, R., Garnier, H., Givvin, K. B., Hollingsworth, H., Jacobs, J., et al. (2003).
*Teaching mathematics in seven countries: Results from the TIMSS 1999 video study. NCES (2003-013)*. Washington, DC: National Center for Education Statistics, U.S. Department of Education.Google Scholar - Husén, T. (1967).
*International study of achievement in mathematics: A comparison of twelve countries*. New York: Wiley.Google Scholar - Hwang, S., Cai, J., Shih, J., Moyer, J. C., Wang, N., & Nie, B. (2015). Longitudinally investigating the impact of curricula and classroom emphases on the algebra learning of students of different ethnicities. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Kloosterman, P. (2010). Mathematics skills of 17-year-olds in the United States: 1978 to 2004.
*Journal for Research in Mathematics Education, 41*, 20–51.Google Scholar - Kloosterman, P., Walcott, C., Brown, N. J. S., Mohr, D., Perez, A., Dai, S., et al. (2015). Using NAEP to analyze 8
^{th}-grade students’ ability to reason algebraically. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Kramer, S., Cai, J., & Merlino, J. (2015). A lesson for the common core standards era from the NCTM standards era: The importance of considering school-level buy-in when implementing and evaluating standards-based instructional materials. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Lewis, C. C., & Perry, R. R. (2015). A randomized trial of lesson study with mathematical resource kits: Analysis of impact on teachers’ beliefs and learning community. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Lubienski, S. T., & Crockett, M. (2007). NAEP mathematics achievement and race/ethnicity. In P. Kloosterman & F. Lester (Eds.),
*Results from the ninth mathematics assessment of NAEP*(pp. 227–260). Reston, VA: National Council of Teachers of Mathematics.Google Scholar - Middleton, J., Helding, B., Megowan-Romanowicz, C., Yang, Y., Yanik, B., Kim, A., et al. (2015). A longitudinal study of the development of rational number concepts and strategies in the middle grades. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.CrossRefGoogle Scholar - Moyer, J. C., Cai, J., Wang, N., & Nie, B. (2011). Impact of curriculum reform: Evidence of change in classroom practice in the United States.
*International Journal of Educational Research, 50*, 87–99.CrossRefGoogle Scholar - Mujtaba, T., Reiss, M. J., Rodd, M., & Simon, S. (2015). Methodological issues in mathematics education research when exploring issues around participation and engagement. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Mullis, I. V. S., Martin, M. O., Beaton, A. E., Gonzalez, E. J., Kelly, D. L., & Smith, T. A. (1997).
*Mathematics achievement in the primary school years: IEA’s third international mathematics and science study (TIMSS)*. Chestnut Hill, MA: Center for the Study of Testing, Evaluation, and Educational Policy, Boston College.Google Scholar - National Center for Education Statistics. (2013).
*The nation’s report card: Trends in academic progress 2012 (NCES 2013 456)*. Washington, DC: IES, U.S. Department of Education.Google Scholar - Orletsky, D., Middleton, J. A., & Sloane, F. (2015). A review of three large-scale datasets critiquing item design, data collection, and the usefulness of claims. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Raudenbush, S. W., & Bryk, A. S. (2002).
*Hierarchical linear models*(2nd ed.). Thousand Oaks, CA: Sage.Google Scholar - Robitaille, D. F., & Garden, R. A. (Eds.). (1989).
*The IEA study of mathematics II: Contexts and outcomes of school mathematics*. Oxford, England: Pergamon Press.Google Scholar - Shih, J., Ing, M., & Tarr, J. (2015). Addressing measurement issues in two large-scale mathematics classroom observation protocols. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Tarr, J. E., & Soria, V. (2015). Challenges in conducting large-scale studies of curricular effectiveness: Data collection and analyses in the COSMIC project. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - U.S. Department of Education, & National Science Foundation. (2013).
*Common guidelines for education research and development.*Retrieved from National Science Foundation website www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf13126 - Vig, R., Star, J. R., Dupuis, D. N., Lein, A. E., & Jitendra, A. K. (2015). Exploring the impact of knowledge of multiple strategies on students’ learning about proportions. In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar - Weiss, I. R., Smith, P. S., & O’Kelley, S. K. (2009). The presidential award for excellence in mathematics teaching: Setting the standard. In J. Cai, G. Kaiser, B. Perry, & N.-Y. Wong (Eds.),
*Effective mathematics teaching from teachers’ perspectives: National and cross-national studies*(pp. 281–304). Rotterdam, The Netherlands: Sense Publishers.Google Scholar - Zhu, Y. (2015). Homework and mathematics learning: What can we learn from the TIMSS series studies in the last two decades? In J. A. Middleton, J. Cai, & S. Hwang (Eds.),
*Large-scale studies in mathematics education*. New York: Springer.Google Scholar