Abstract
Since statistical inference is a probabilistic generalization about a population analyzed on the basis of a sample, inferential reasoning demands producing reasons (statistical and contextual) to substantiate and validate generalizations. To convey an understanding of students’ inferential reasoning, we present a proposal—based on Toulmin’s argumentation model—in which the production of statistical and contextual reasons serve as fundamental components of students’ inferential reasoning by providing supporting arguments that can be expressed as a sequence of statements. We analyze the inferential reasoning of university students asked to work in teams on an inferential activity in the context of environmental pollution. Results show that they integrated informal and formal methods to produce statistical reasons, complemented by contextual reasons to support their conclusions. Their reasoning model allowed us to identify (a) a potential transition from informal to formal inferential reasoning; and (b) ambiguity, or an absence of expressions of uncertainty, about generalizations regarding the population, possibly related to their confidence in using formal methods (e.g., hypothesis testing). We conclude that our proposal helps encourage and analyze students’ inferential reasoning. Future research will require clearer definitions of the characteristics of the argumentation model in the field of statistical inferential reasoning because arguments depend on their disciplinary context.
Similar content being viewed by others
Data availability
The authors declare that the data supporting the findings of this study are available within the article and its supplementary information provided in Tobías Lara’s (2019) reference.
References
Bakker, A., & Derry, J. (2011). Lessons from inferentialism for statistics education. Mathematical Thinking and Learning, 13(1–2), 5–26. https://doi.org/10.1080/10986065.2011.538293
Bakker, A., Kent, P., Derry, J., Noss, R., & Hoyles, C. (2008). Statistical inference at work: Statistical process control as an example. Statistics Education Research Journal, 7(2), 130–145.
Batanero, C. (2000). Controversies around the role of statistical tests in experimental research. Mathematical Thinking and Learning, 2(1–2), 75–97. https://doi.org/10.1207/S15327833MTL0202_4
Ben-Zvi, D. (2006). Scaffolding students’ informal inference and argumentation. In A. Rossman & B. Chance (Eds.), Proceedings of the Seventh International Conference on Teaching Statistics (ICOTS7, July 2006) Salvador, Bahia, Brazil. International Statistical Institute. https://iase-web.org/documents/papers/icots7/2D1_BENZ.pdf?1402524964
Ben-Zvi, D., Aridor, K., Makar, K., & Bakker, A. (2012). Students’ emergent articulations of uncertainty while making informal statitical inferences. ZDM-Mathematics Education, 44(7), 913–925. https://doi.org/10.1007/s11858-012-0420-3
Ben-Zvi, D., Gil, E., & Apel, N. (2007). What is hidden beyond the data? Young students reason and argue about some wider universe. In D. Pratt & J. Ainley (Eds.), Proceedings of the Fifth International Research Forum on Statistical Reasoning, Thinking and Literacy (SRTL-5, August 2007). University of Warwick.
Castro Sotos, A. E., Vanhoof, S., Van den Noortgate, W., & Onghena, P. (2007). Students’ misconceptions of statistical inference: A review of the empirical evidence from research on statistics education. Educational Research Review, 2(2), 98–113. https://doi.org/10.1016/j.edurev.2007.04.001
Castro Sotos, A. E., Vanhoof, S., Van den Noortgate, W., & Onghena, P. (2009). How confident are students in their misconceptions about hypothesis tests? Journal of Statistics Education, 17(2). https://doi.org/10.1080/10691898.2009.11889514
Cobb, G. W., & Moore, D. S. (1997). Mathematics, statistics, and teaching. The American Mathematical Monthly, 104(9), 801–823.
de Freitas, E., Lerman, S., & Noelle-Parks, A. (2017). Qualitative methods. In J. Cai (Ed.), Compendium for Research in Mathematics Education (pp. 159–182). National Council of Teachers of Mathematics.
delMas, R., Garfield, J., Ooms, A., & Chance, B. (2007). Assessing students’ conceptual understanding after a first course in statistics. Statistics Education Research Journal, 6(2), 28–58.
Devore, J. L. (2016). Probabilidad y estadística para ingeniería y ciencias [Probability and statistics for engineering and science]. Cengage Learning.
Freeman, J. B. (2005). Systematizing Toulmin’s warrants: An epistemic approach. Argumentation, 19(3), 331–346. https://doi.org/10.1007/s10503-005-4420-0
Garfield, J., & Ben-Zvi, D. (Eds.). (2008). Developing students’ statistical reasoning: Connecting research and teaching practice. Springer. https://doi.org/10.1007/978-1-4020-8383-9
Garfield, J., Le, L., Zieffler, A., & Ben-Zvi, D. (2015). Developing students’ reasoning about samples and sampling variability as a path to expert statistical thinking. Educational Studies in Mathematics, 88(3), 327–342. https://doi.org/10.1007/s10649-014-9541-7
Gil, E., & Ben-Zvi, D. (2011). Explanations and context in the emergence of students’ informal inferential reasoning. Mathematical Thinking and Learning, 13(1–2), 87–108. https://doi.org/10.1080/10986065.2011.538295
Gómez-Blancarte, A., & Tobías-Lara, M. G. (2018). Using the Toulmin model of argumentation to validate students’ inferential reasoning. In M. A. Sorto, A. White, & L. Guyot (Eds.), Proceedings of the Tenth International Conference on Teaching Statistics (ICOTS10, July 2018), Kyoto, Japan. International Statistical Institute. http://iase-web.org/Conference_Proceedings.php?p=ICOTS_10_2018
Hitchcock, D. (2017). On reasoning and argument: Essays in informal logic and on critical thinking. Springer. https://doi.org/10.1007/978-3-319-53562-3
Hitchcock, D., & Verheij, B. (Eds.). (2006). Arguing on the Toulmin model: New essays in argument analysis and evaluation (Vol. 10). Springer. https://doi.org/10.1007/978-1-4020-4938-5
Inzunsa Cazares, S., & Jiménez Ramírez, J. V. (2013). Caracterización del razonamiento estadístico de estudiantes universitarios acerca de las pruebas de hipótesis [The characteristics of college students’ statistical reasoning on hypothesis testing]. Revista Latinoamericana de Investigación en Matemática Educativa, 16(2), 179–211. https://doi.org/10.12802/relime.13.1622
Kass, R. E., Caffo, B. S., Davidian, M., Meng, X.-L., Yu, B., & Reid, N. (2016). Ten simple rules for effective statistical practice. PLOS Computacional Biology, 12(6), 1–8. https://doi.org/10.1371/journal.pcbi.1004961
Kibiswa, N. K. (2019). Directed qualitative content analysis (DQlCA): A tool for conflict analysis. The Qualitative Report, 24(8), 2059–2079. https://doi.org/10.46743/2160-3715/2019.3778
Konold, C., Madden, S., Pollatsek, A., Pfannkuch, M., Wild, C., Ziedins, I., Finzer, W., Horton, N., & Kazak, S. (2011). Conceptual challenges in coordination theoretical and data-centered estimates of probability. Mathematical Thinking and Learning, 13(1–2), 68–86. https://doi.org/10.1080/10986065.2011.538299
Kula, F., & Koçer, R. G. (2020). Why is it difficult to understand statistical inference? Reflections on the opposing directions of construction and application of inference framework. Teaching Mathematics & Its Applications, 39(4), 248–265. https://doi.org/10.1093/teamat/hrz014
LeMire, S. D. (2010). An argument framework for the application of null hypothesis statistical testing in support of research. Journal of Statistics Education, 18(2), 1–24. https://doi.org/10.1080/10691898.2010.11889492
Makar, K., & Rubin, A. (2014). Informal statistical inference revisited. In K. Makar, B. de Sousa, & R. Gould (Eds.), Proceedings of the Ninth International Conference on Teaching Statistics (ICOTS9, July 2014) Flagstaff, Arizona, USA. International Statistical Institute. https://iase-web.org/icots/9/proceedings/pdfs/ICOTS9_8C1_MAKAR.pdf?1405041723
Makar, K., & Rubin, A. (2018). Learning about statistical inference. In D. Ben-Zvi, K. Makar, & J. Garfield, (Eds.), International Handbook of Research in Statistics Education (pp. 261–294). Springer. https://doi.org/10.1007/978-3-319-66195-7_8
Makar, K., & Rubin, A. (2009). A framework for thinking about informal statistical inference. Statistics Education Research Journal, 8(1), 82–105.
Nor, N. M., & Idris, N. (2010). Assessing students’ informal inferential reasoning using SOLO Taxonomy based framework. Procedia Social and Behavioral Sciences, 2(2), 4805–4809. https://doi.org/10.1016/j.sbspro.2010.03.774
Osana, H. P., Leath, E. P., & Thompson, S. E. (2004). Improving evidential argumentation through statistical sampling: Evaluating the effects of a classroom intervention for at-risk 7th-graders. Journal of Mathematical Behavior, 23(3), 351–370. https://doi.org/10.1016/j.jmathb.2004.06.005
Park, J. (2013). Designing an assessment to measure students’ inferential reasoning in statistics: The first study, development of a test blueprint. Research in Mathematical Education, 17(4), 243–266. https://doi.org/10.7468/jksmed.2013.17.4.243
Pfannkuch, M. (2011). The role of context in developing informal statistical inferential reasoning: A classroom study. Mathematical Thinking and Learning, 13(1–2), 27–46. https://doi.org/10.1080/10986065.2011.538302
Pfannkuch, M., Regan, M., Wild., C., & Horton N. J. (2010). Telling data stories: Essential dialogues for comparative reasoning. Journal of Statistics Education, 18(1), 1–38. https://doi.org/10.1080/10691898.2010.11889479
Pfannkuch, M., Wild, C. J., & Parsonage, R. (2012). A conceptual pathway to confidence intervals. ZDM-Mathematics Education, 44(7), 899–911. https://doi.org/10.1007/s11858-012-0446-6
Pfannkuch, M. (2005). Probability and statistical inference: How can teachers enable learners to make the connection? In Graham A. Jones (Ed.), Exploring Probability in School: Challenges for Teaching and Learning (pp. 267–294). Springer. https://doi.org/10.1007/0-387-24530-8_12
Pfannkuch, M. (2006). Informal inferential reasoning. In A. Rossman & B. Chance (Eds.), Proceedings of the Seventh International Conference on Teaching Statistics (ICOTS7, July 2006) Salvador, Bahia, Brazil. International Statistical Institute. https://iase-web.org/documents/papers/icots7/6A2_PFAN.pdf?1402524965
Reaburn, R. (2014). Students’ understanding of confidence intervals. In K. Makar, B. de Sousa & R. Gould (Eds.), Proceedings of the Ninth International Conference on Teaching Statistics (ICOTS9, July 2014) Flagstaff, Arizona, USA. International Statistical Institute. https://iase-web.org/icots/9/proceedings/pdfs/ICOTS9_C122_REABURN.pdf?1405041809
Reading, C. (2009). Cognitive development of informal inferential reasoning. 57th Session of the International Statistical Institute, Durban, South Africa. https://www.isi-web.org/isi.cbs.nl/iamamember/CD8-Durban2009/A5%20Docs/0112.pdf
Sardà, J. A., & Sanmartí, P. N. (2000). Enseñar a argumentar científicamente: Un reto de las clases de ciencias [Teaching scientific argumentation: A challenge for science classes]. Enseñanza De Las Ciencias, 18(3), 405–422.
Steffe, L. P., & Thompson, P. W. (2000). Teaching experiment methodology: Underlying principles and essential elements. In R. Lesh & A. E. Kelly (Eds.), Handbook of Research Design in Mathematics and Science Education (pp. 267–307). Erlbaum.
Tobías Lara, M. G. (2019). Uso del modelo de argumentación de Toulmin para analizar el razonamiento inferencial estadística de estudiantes universitarios [Use of Toulmin's argumentation model to analyze the statistical inferential reasoning of university students] [Doctoral dissertation, Instituto Politécnico Nacional]. CICATA-IPN Repository. https://www.cicata.ipn.mx/assets/files/cicata/ProME/docs/tesis/tesis_doctorado/2019/tobias_2019.pdf
Tobías-Lara, M. G., & Gómez-Blancarte, A. L. (2019). Assessment of informal and formal inferential reasoning: A critical research review. Statistics Education Research Journal, 18(1), 8–25. https://doi.org/10.52041/serj.v18i1.147
Toulmin, S. (2003). The uses of argument (updated edition). Cambridge University Press. (Original work published 1958)
Toulmin, S., Rieke, R., & Janik, A. (1984). An introduction to reasoning (2nd ed.). Macmillan Publishing Company.
Vallecillos Jiménez, A. (1995). Comprensión de la lógica del contraste de hipótesis en estudiantes universitarios [Understanding the logic of hypothesis testing in university students]. Recherches En Didactique Des Mathématiques, 15(3), 53–81.
Vallecillos Jiménez, A., & Batanero Bernabeu, M. C. (1997). Aprendizaje y enseñanza del contraste de hipótesis: Concepciones y errores [Learning and teaching hypothesis testing: Conceptions and errors]. Enseñanza De Las Ciencias, 15, 189–197.
van Dijke-Droogers, M., Drijvers, P., & Bakker, A. (2021). Introducing statistical inference: Design of a theoretically and empirically based learning trajectory. International Journal of Science and Mathematics Education. https://doi.org/10.1007/s10763-021-10208-8
Watson, J., Fitzallen, N., Fielding-Wells, J., & Madden, S. (2018). The practice of statistics. In D. Ben-Zvi, K. Makar, & J. Garfield (Eds.), International Handbook of Research in Statistics Education (pp. 105–137). Springer. https://doi.org/10.1007/978-3-319-66195-7_4
Watson, J. M., & Moritz, J. B. (1999). The beginning of statistical inference: Comparing two data sets. Educational Studies in Mathematics, 37(2), 145–168. https://doi.org/10.1023/A:1003594832397
Weber, K., Maher, C., Powell, A., & Lee, H. S. (2008). Learning opportunities from group discussions: Warrants become the objects of debate. Educational Studies in Mathematics, 68(3), 247–261. https://doi.org/10.1007/s10649-008-9114-8
Weinberg, A., Wiesner, E., & Pfaff, T. J. (2010). Using informal inferential reasoning to develop formal concepts: Analyzing an Activity. Journal of Statistics Education, 18(2), 1–24. https://doi.org/10.1080/10691898.2010.11889494
Wild, C. J., Pfannkuch, M., Regan, M., & Horton, N. J. (2010). Inferential reasoning: Learning to “make a call” in theory. In C. Reading (Ed.), Proceedings of the Eighth International Conference on Teaching Statistics (ICOTS8, July 2010) Ljubljana, Slovenia. International Statistical Institute. https://iase-web.org/documents/papers/icots8/ICOTS8_8B1_WILD.pdf?1402524971
Wild, C. J., Pfannkuch, M., Regan, M., & Horton, N. J. (2011). Towards more accessible conceptions of statistical inference. Journal of the Royal Statistical Society, 174(2), 247–295. https://doi.org/10.1111/j.1467-985X.2010.00678.x
Woodard V., Lee, H., & Woodard, R. (2020). Writing assignments to assess statistical thinking. Journal of Statistics Education, 28(1), 32–44. https://doi.org/10.1080/10691898.2019.1696257
Zieffler, A., Garfield, J., delMas, R., & Reading, C. (2008). A framework to support research on informal inferential reasoning. Statistics Education Research Journal, 7(2), 40–58.
Acknowledgements
The authors acknowledge the translation support of the Writing Lab, Institute for the Future of Education, Monterrey Technology, Mexico.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gómez-Blancarte, A.L., Tobías-Lara, M.G. The integration of undergraduate students’ informal and formal inferential reasoning. Educ Stud Math 113, 251–269 (2023). https://doi.org/10.1007/s10649-022-10205-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10649-022-10205-w