Abstract
This paper presents a reflection on the importance of replication studies in the development of the field of mathematics education. Based on a literature review, it explains what replication studies are, and why they are important for our field. It also addresses the issue of why, despite their apparent importance, replication studies remain scarce. Some open discussions about replication studies in mathematics education are pointed out, and a couple of issues related to replication studies whose empirical exploration could help to advance our research field are identified. Additionally, a typology of fundamental questions and modes of exploration that could guide a replication study in mathematics education is proposed. The paper closes with a discussion about the necessary conditions to promote and further develop replication studies in mathematics education.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aguilar, M. S., Kuzle, A., Wæge, K., & Misfeldt, M. (2019). Introduction to the papers of TWG23: Implementation of research findings in mathematics education. In U. T. Jankvist, M. van den Heuvel-Panhuizen, & M. Veldhuis (Eds.), Proceedings of the Eleventh Congress of the European Society for Research in Mathematics Education. Utrecht, The Netherlands: Freudenthal Group & Freudenthal Institute, Utrecht University and ERME. Retrieved from https://hal.archives-ouvertes.fr/hal-02429749. Accessed 28 Feb 2020.
Andrá, C., Lindström, P., Arzarello, F., Holmqvist, K., Robutti, O., & Sabena, C. (2015). Reading mathematics representations: An eye-tracking study. International Journal of Science and Mathematics Education, 13(2, Supplement), 237–259. https://doi.org/10.1007/s10763-013-9484-y.
Artigue, M. (1986). Etude de la dynamique d’une situation de classe: Une approche de la reproductibilité [Study of the dynamics of a classroom situation: An approach to reproducibility]. Recherches en Didactique des Mathématiques, 7(1), 5–62.
Bonnet, D. G. (2012). Replication-extension studies. Current Directions in Psychological Science, 21(6), 409–412. https://doi.org/10.1177/0963721412459512.
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, J., . . . van’t Veer, A. (2014). The Replication Recipe: What makes for a convincing replication? Journal of Experimental Social Psychology, 50, 217–224. https://doi.org/10.1016/j.jesp.2013.10.005.
Brown, A. N., & Wood, B. D. K. (2018). Which tests not witch hunts: A diagnostic approach for conducting replication research. Economics: The Open-Access, Open-Assessment E-Journal, 12(2018–53), 1–26. https://doi.org/10.5018/economics-ejournal.ja.2018-53.
Burkhardt, H. (2013). Methodological issues in research and development. In Y. Li & J. N. Moschkovich (Eds.), Proficiency and beliefs in learning and teaching mathematics: Learning from Alan Schoenfeld and Günter Törner (pp. 203–236). Rotterdam, The Netherlands: Sense.
Cai, J., Morris, A., Hohensee, C., Hwang, S., Robison, V., & Hiebert, J. (2017). Making classroom implementation an integral part of research. Journal for Research in Mathematics Education, 48(4), 342–347. https://doi.org/10.5951/jresematheduc.48.4.0342.
Cai, J., Morris, A., Hohensee, C., Hwang, S., Robison, V., & Hiebert, J. (2018). The role of replication studies in educational research. Journal for Research in Mathematics Education, 49(1), 2–8. https://doi.org/10.5951/jresematheduc.49.1.0002.
Century, J., & Cassata, A. (2016). Implementation research: Finding common ground on what, how, why, where, and who. Review of Research in Education, 40(1), 169–215. https://doi.org/10.3102/0091732X16665332.
Chhin, C. S., Taylor, K. A., & Wei, W. S. (2018). Supporting a culture of replication: An examination of education and special education research grants funded by the institute of education sciences. Educational Researcher, 47(9), 594–605. https://doi.org/10.3102/0013189X18788047.
Clemens, M. A. (2015). The meaning of failed replications: A review and proposal. Journal of Economic Surveys, 31(1), 326–342. https://doi.org/10.1111/joes.12139.
de Freitas, E., Lerman, S., & Parks, A. N. (2018). Qualitative methods. In J. Cai (Ed.), Compendium for research in mathematics education (pp. 159–182). Reston, VA: NCTM.
Drijvers, P., Godino, J. D., Font, V., & Trouche, L. (2013). One episode, two lenses. A reflective analysis of student learning with computer algebra from instrumental and onto-semiotic perspectives. Educational Studies in Mathematics, 82(1), 23–49. https://doi.org/10.1007/s10649-012-9416-8.
Eastman, P. M. (1975). Replication studies: Why so few? Journal for Research in Mathematics Education, 6(2), 67–68. https://doi.org/10.2307/748607.
Education Committee of the European Mathematics Society. (2011). “Solid findings” in mathematics education. Newsletter of the European Mathematical Society, 81, 46–48.
Evanschitzky, H., & Armstrong, J. S. (2013). Research with in-built replications: Comment and further suggestions for replication research. Journal of Business Research, 66(9), 1406–1408. https://doi.org/10.1016/j.jbusres.2012.05.006.
Firmin, M. W. (2008). Replication. In L. M. Given (Ed.), The sage encyclopedia of qualitative research methods (pp. 754–755). USA: Sage.
Hinnant, J. B., O’Brien, M., & Ghazarian, S. R. (2009). The longitudinal relations of teacher expectations to achievement in the early school years. Journal of Educational Psychology, 101(3), 662–670. https://doi.org/10.1037/a0014306.
Hüffmeier, J., Mazei, J., & Schultze, T. (2016). Reconceptualizing replication as a sequence of different studies: A replication typology. Journal of Experimental Social Psychology, 66, 81–92. https://doi.org/10.1016/j.jesp.2015.09.009.
Inglis, M., Schukajlow, S., Van Dooren, W., & Hannula, M. S. (2018a). Replication in mathematics education. In E. Bergqvist, M. Österholm, C. Granberg, & L. Sumpter (Eds.), Proceedings of the 42nd Conference of the International Group for the Psychology of Mathematics Education (Vol. 1, pp. 195–196). Ume, Sweden: PME.
Inglis, M., Schukajlow, S., Van Dooren, W., & Hannula, M. S. (2018b). Working group report: Replication in mathematics education. In M. Vollstedt, I. Kontorovich, K. Jones, & D. Sommerhoff (Eds.), PME Newsletter (p. 7). PME: International Group for the Psychology of Mathematics Education. Retrieved from http://www.igpme.net/wp-content/uploads/2019/05/PME-Newsletter-2018-Issue-2.pdf. Accessed 28 Feb 2020.
Jacobson, E., & Simpson, A. (2019). Prospective elementary teachers’ conceptions of multidigit number: Exemplifying a replication framework for mathematics education. Mathematics Education Research Journal, 31(1), 67–88. https://doi.org/10.1007/s13394-018-0242-x.
Jamil, F. M. (2018). A reflection on the evolution of a replication study. Journal for Research in Mathematics Education, 49(1), 111–115. https://doi.org/10.5951/jresematheduc.49.1.0111.
Jamil, F. M., Larsen, R. A., & Hamre, B. K. (2018). Exploring longitudinal changes in teacher expectancy effects on children’s mathematics achievement. Journal for Research in Mathematics Education, 49(1), 57–90. https://doi.org/10.5951/jresematheduc.49.1.0057.
Leinhardt, G., Zaslavsky, O., & Stein, M. K. (1990). Functions, graphs, and graphing: Tasks, learning, and teaching. Review of Educational Research, 60(1), 1–64. https://doi.org/10.2307/1170224.
Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43(6), 304–316. https://doi.org/10.3102/0013189X14545513.
Maxwell, S. E., Lau, M., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? American Psychologist, 70(6), 487–498. https://doi.org/10.1037/a0039400.
Melhuish, K. (2018). Three conceptual replication studies in group theory. Journal for Research in Mathematics Education, 49(1), 9–38. https://doi.org/10.5951/jresematheduc.49.1.0009.
Melhuish, K., & Thanheiser, E. (2018). Reframing replication studies as studies of generalizability: A response to critiques of the nature and necessity of replication. Journal for Research in Mathematics Education, 49(1), 104–110. https://doi.org/10.5951/jresematheduc.49.1.0104.
Niss, M. (2019). The very multi-faceted nature of mathematics education research. For the Learning of Mathematics, 39(2), 2–7.
Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2), 90–100. https://doi.org/10.1037/a0015108.
Schoenfeld, A. H. (2000). Purposes and methods of research in mathematics education. Notices of the AMS, 47(6), 641–649.
Schoenfeld, A. H. (2018). On replications. Journal for Research in Mathematics Education, 49(1), 91–97. https://doi.org/10.5951/jresematheduc.49.1.0091.
Star, J. R. (2018). When and why replication studies should be published: Guidelines for mathematics education research journals. Journal for Research in Mathematics Education, 49(1), 98–103. https://doi.org/10.5951/jresematheduc.49.1.0098.
Thanheiser, E. (2018). The effects of preservice elementary school teachers’ accurate self-assessments in the context of whole number. Journal for Research in Mathematics Education, 49(1), 39–56. https://doi.org/10.5951/jresematheduc.49.1.0039.
The National Science Foundation, & The Institute of Education Sciences (2018). Companion guidelines on replication & reproducibility in education research. Alexandria, VA: National Science Foundation. Retrieved from https://www.nsf.gov/pubs/2019/nsf19022/nsf19022.pdf. Accessed 28 Feb 2020.
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016). Contextual sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences of the United States of America, 113(23), 6454–6459. https://doi.org/10.1073/pnas.1521897113.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Aguilar, M.S. Replication Studies in Mathematics Education: What Kind of Questions Would Be Productive to Explore?. Int J of Sci and Math Educ 18 (Suppl 1), 37–50 (2020). https://doi.org/10.1007/s10763-020-10069-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10763-020-10069-7