Advertisement

The Role of Large-Scale Studies in Mathematics Education

  • Jinfa Cai
  • Stephen Hwang
  • James A. Middleton
Part of the Research in Mathematics Education book series (RME)

Abstract

The goal for this monograph has been to present the state of the art in large-scale studies in mathematics education. Although the chapters collected here are not intended to be a comprehensive compendium of such research, this selection of work does serve both to represent large-scale studies in the field of mathematics education and to raise awareness of the issues that arise in conducting such studies. As can be seen from the studies included in this volume, the term “large-scale study” can cover a wide variety of research endeavors. Indeed, as we indicated in the introductory chapter, the IES and NSF Common Guidelines (U.S. Department of Education & National Science Foundation, 2013) recognize many different types of research, and large-scale studies can fall into more than one of these categories. The different types of research have correspondingly different purposes which require different sample sizes and methods of analysis. Moreover, the findings from different types of research have different degrees of generalizability. Despite these many differences, there are common features that large-scale studies share. For example, large-scale studies require large sample sizes, although exactly how large “large” depends on the design of the study. In contrast to small-scale studies, large-scale studies usually employ complex statistical analysis and have the potential to produce more readily generalizable results than small-scale studies.

References

  1. Banilower, E. R., Smith, P. S., Weiss, I. R., Malzahn, K. A., Campbell, K. M., & Weis, A. M. (2013). Report of the 2012 national survey of science and mathematics education. Chapel Hill, NC: Horizon Research, Inc.Google Scholar
  2. Bracey, G. W. (1997). More on TIMSS. Phi Delta Kappan, 78(8), 656–657.Google Scholar
  3. Braswell, J. S., Lutkus, A. D., Grigg, W. S., Santapau, S. L., Tay-Lim, B. S.-H., & Johnson, M. S. (2001). The nation’s report card: Mathematics 2000. Washington, DC: U.S. Department of Education, National Center for Education Statistics.Google Scholar
  4. Cai, J., Wang, N., Moyer, J. C., Wang, C., & Nie, B. (2011). Longitudinal investigation of the curricular effect: An analysis of student learning outcomes from the LieCal project in the United States. International Journal of Educational Research, 50, 117–136.CrossRefGoogle Scholar
  5. Cai, J. (2014). Searching for evidence of curricular effect on the teaching and learning of mathematics: Some insights from the LieCal project. Mathematics Education Research Journal, 26, 811–831.CrossRefGoogle Scholar
  6. Cai, J., Ni, Y., & Hwang, S. (2015). Measuring change in mathematics learning with longitudinal studies: Conceptualization and methodological issues. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  7. Confrey, J., & Maloney, A. (2015). Engineering [for] effectiveness in mathematics education: Intervention at the instructional core in an era of the common core standards. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  8. Ebby, C. B., & Sirinides, P. M. (2015). Conceptualizing teachers’ capacity for learning trajectory-oriented formative assessment in mathematics. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  9. Givvin, K. B., Jacobs, J., Hollingsworth, H., & Hiebert, J. (2009). What is effective mathematics teaching? International educators’ judgments of mathematics lessons from the TIMSS 1999 video study. In J. Cai, G. Kaiser, B. Perry, & N.-Y. Wong (Eds.), Effective mathematics teaching from teachers’ perspectives: National and cross-national studies (pp. 37–69). Rotterdam, The Netherlands: Sense Publishers.Google Scholar
  10. Hanna, G. (2000). Declining gender differences from FIMS to TIMSS. Zentralblatt fur Didaktik der Mathematik, 32, 11–17.CrossRefGoogle Scholar
  11. Hart, L. C., Smith, S. Z., Swars, S. L., & Smith, M. E. (2008). An examination of research methods in mathematics education (1995–2005). Journal of Mixed Methods Research, 3, 26–41.CrossRefGoogle Scholar
  12. Heppen, J. B., Clements, M., & Walters, K. (2015). Turning to online courses to expand access: A rigorous study of the impact of online algebra I for eighth graders. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  13. Hiebert, J., Gallimore, R., Garnier, H., Givvin, K. B., Hollingsworth, H., Jacobs, J., et al. (2003). Teaching mathematics in seven countries: Results from the TIMSS 1999 video study. NCES (2003-013). Washington, DC: National Center for Education Statistics, U.S. Department of Education.Google Scholar
  14. Husén, T. (1967). International study of achievement in mathematics: A comparison of twelve countries. New York: Wiley.Google Scholar
  15. Hwang, S., Cai, J., Shih, J., Moyer, J. C., Wang, N., & Nie, B. (2015). Longitudinally investigating the impact of curricula and classroom emphases on the algebra learning of students of different ethnicities. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  16. Kloosterman, P. (2010). Mathematics skills of 17-year-olds in the United States: 1978 to 2004. Journal for Research in Mathematics Education, 41, 20–51.Google Scholar
  17. Kloosterman, P., Walcott, C., Brown, N. J. S., Mohr, D., Perez, A., Dai, S., et al. (2015). Using NAEP to analyze 8th-grade students’ ability to reason algebraically. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  18. Kramer, S., Cai, J., & Merlino, J. (2015). A lesson for the common core standards era from the NCTM standards era: The importance of considering school-level buy-in when implementing and evaluating standards-based instructional materials. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  19. Lewis, C. C., & Perry, R. R. (2015). A randomized trial of lesson study with mathematical resource kits: Analysis of impact on teachers’ beliefs and learning community. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  20. Lubienski, S. T., & Crockett, M. (2007). NAEP mathematics achievement and race/ethnicity. In P. Kloosterman & F. Lester (Eds.), Results from the ninth mathematics assessment of NAEP (pp. 227–260). Reston, VA: National Council of Teachers of Mathematics.Google Scholar
  21. Middleton, J., Helding, B., Megowan-Romanowicz, C., Yang, Y., Yanik, B., Kim, A., et al. (2015). A longitudinal study of the development of rational number concepts and strategies in the middle grades. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.CrossRefGoogle Scholar
  22. Moyer, J. C., Cai, J., Wang, N., & Nie, B. (2011). Impact of curriculum reform: Evidence of change in classroom practice in the United States. International Journal of Educational Research, 50, 87–99.CrossRefGoogle Scholar
  23. Mujtaba, T., Reiss, M. J., Rodd, M., & Simon, S. (2015). Methodological issues in mathematics education research when exploring issues around participation and engagement. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  24. Mullis, I. V. S., Martin, M. O., Beaton, A. E., Gonzalez, E. J., Kelly, D. L., & Smith, T. A. (1997). Mathematics achievement in the primary school years: IEA’s third international mathematics and science study (TIMSS). Chestnut Hill, MA: Center for the Study of Testing, Evaluation, and Educational Policy, Boston College.Google Scholar
  25. National Center for Education Statistics. (2013). The nation’s report card: Trends in academic progress 2012 (NCES 2013 456). Washington, DC: IES, U.S. Department of Education.Google Scholar
  26. Orletsky, D., Middleton, J. A., & Sloane, F. (2015). A review of three large-scale datasets critiquing item design, data collection, and the usefulness of claims. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  27. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.Google Scholar
  28. Robitaille, D. F., & Garden, R. A. (Eds.). (1989). The IEA study of mathematics II: Contexts and outcomes of school mathematics. Oxford, England: Pergamon Press.Google Scholar
  29. Shih, J., Ing, M., & Tarr, J. (2015). Addressing measurement issues in two large-scale mathematics classroom observation protocols. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  30. Tarr, J. E., & Soria, V. (2015). Challenges in conducting large-scale studies of curricular effectiveness: Data collection and analyses in the COSMIC project. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  31. U.S. Department of Education, & National Science Foundation. (2013). Common guidelines for education research and development. Retrieved from National Science Foundation website www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf13126
  32. Vig, R., Star, J. R., Dupuis, D. N., Lein, A. E., & Jitendra, A. K. (2015). Exploring the impact of knowledge of multiple strategies on students’ learning about proportions. In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar
  33. Weiss, I. R., Smith, P. S., & O’Kelley, S. K. (2009). The presidential award for excellence in mathematics teaching: Setting the standard. In J. Cai, G. Kaiser, B. Perry, & N.-Y. Wong (Eds.), Effective mathematics teaching from teachers’ perspectives: National and cross-national studies (pp. 281–304). Rotterdam, The Netherlands: Sense Publishers.Google Scholar
  34. Zhu, Y. (2015). Homework and mathematics learning: What can we learn from the TIMSS series studies in the last two decades? In J. A. Middleton, J. Cai, & S. Hwang (Eds.), Large-scale studies in mathematics education. New York: Springer.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.University of DelawareNewarkUSA
  2. 2.Arizona State UniversityTempeUSA

Personalised recommendations