, Volume 50, Issue 7, pp 1295–1309 | Cite as

Statistics students’ identification of inferential model elements within contexts of their own invention

  • Matthew D. BeckmanEmail author
  • Robert delMas
Original Article


Statistical thinking partially depends upon an iterative process by which essential features of a problem setting are identified and mapped onto an abstract model or archetype, and then translated back into the context of the original problem setting (Wild and Pfannkuch, Int Stat Rev 67(3):223–248, 1999). Assessment in introductory statistics often relies on tasks that present students with data in context and expects them to choose and describe an appropriate model. This study explores post-secondary student responses to an alternative task that prompts students to clearly identify a sample, population, statistic, and parameter using a context of their own invention. The data include free-text narrative responses of a random sample of 500 students from a sample of more than 1600 introductory statistics students. Results suggest that students’ responses often portrayed sample and population accurately. Portrayals of statistic and parameter were less reliable and were associated with descriptions of a wide variety of other concepts. Responses frequently attributed a variable of some kind to the statistic, or a study design detail to the parameter. Implications for instruction and research are discussed, including a call for emphasis on a modeling paradigm in introductory statistics.


Statistics education Statistical modeling Statistical inference Assessment Parameter 



The authors wish to express their sincere gratitude to Joan Garfield for her thoughtful direction and influence on development of early research leading to this work. The authors are also grateful for the thoughtful feedback and constructive suggestions of colleagues during the SRTL-10 forum.


  1. Allmond, S., & Makar, K. (2010). Developing primary students’ ability to pose questions in statistical investigations. In C. Reading (Ed.), Data and context in statistics education: Towards an evidence-based society. Proceedings of the 8th international conference on teaching statistics. Voorburg: International Statistical Institute.Google Scholar
  2. Beckman, M. D. (2015). Assessment of cognitive transfer outcomes for students of introductory statistics (Doctoral dissertation, University of Minnesota—Twin Cities). Retrieved from Accessed 1 Dec 2016.
  3. Ben-Zvi, D., & Garfield, J. (2004). Statistical literacy, reasoning, and thinking: Goals, definitions, and challenges. In D. Ben-Zvi & J. Garfield (Eds.), The challenge of developing statistical literacy, reasoning and thinking (pp. 3–15). Dordrecht: Kluwer Academic Publishers.CrossRefGoogle Scholar
  4. Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How people learn: Brain, mind, experience, and school: Expanded edition. Washington, DC: National Academies.Google Scholar
  5. Chance, B. (2002). Components of statistical thinking and implications for instruction and assessment. Journal of Statistics Education, 10(3). Retrieved from Accessed 1 Dec 2016.
  6. delMas, R., Garfield, J., Ooms, A., & Chance, B. (2007). Assessing students’ conceptual understanding after a first course in statistics. Statistics Education Research Journal, 6(2), 28–58.Google Scholar
  7. Garfield, J., & Ben-Zvi, D. (2008). Developing studentsstatistical reasoning: Connecting research and teaching practice. Berlin: Springer Science & Business Media.Google Scholar
  8. Graham, A. (2006). Developing thinking in statistics. London: Paul Chapman.Google Scholar
  9. Haller, H., & Krauss, S. (2002). Misinterpretations of significance: A problem students share with their teachers? Methods of Psychological Research, 7(1), 1–20.Google Scholar
  10. Kaplan, J. J., Fisher, D. G., & Rogness, N. T. (2009). Lexical ambiguity in statistics: What do students know about the words association, average, confidence, random and spread? Journal of Statistics Education, 17(3). Retrieved from Accessed 17 Nov 2017.
  11. Kaplan, J. J., Fisher, D. G., & Rogness, N. T. (2010). Lexical ambiguity in statistics: How students use and define the words: Association, average, confidence, random and spread. Journal of Statistics Education, 18(2). Retrieved from Accessed 17 Nov 2017.
  12. Kaplan, J. J., & Rogness, N. (2018). Increasing statistical literacy by exploiting lexical ambiguity of technical terms. Numeracy, 18(1), 1–14.Google Scholar
  13. Lavigne, N. C., & Lajoie, S. P. (2007). Statistical reasoning of middle school children engaging in survey inquiry. Contemporary Educational Psychology, 23(4), 630–666.CrossRefGoogle Scholar
  14. Makar, K., & Rubin, A. (2009). A framework for thinking about informal statistical inference. Statistics Education Research Journal, 8(1), 82–105.Google Scholar
  15. McCullagh, P. (2002). What is a statistical model? The Annals of Statistics, 30(5), 1225–1267.CrossRefGoogle Scholar
  16. Meletiou-Mavrotheris, M., & Paparistodemou, E. (2015). Developing students’ reasoning about samples and sampling in the context of informal inferences. Educational Studies in Mathematics, 88(3), 385–404.CrossRefGoogle Scholar
  17. Pfannkuch, M. (2006). Informal inferential reasoning. In A. Rossman & B. Chance (Eds.), Working cooperatively in statistics education. Proceedings of the 7th international conference on teaching statistics. Voorburg: International Statistical Institute.Google Scholar
  18. Pfannkuch, M., Ben-Zvi, D., & Budgett, S. (2018). Innovations in statistical modeling to connect data, chance, and context. ZDM Mathematics Education. (this issue).CrossRefGoogle Scholar
  19. R Core Team. (2017). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Accessed 10 June 2017.
  20. Reed, S. K., Dempster, A., & Ettinger, M. (1985). Usefulness of analogous solutions for solving algebra word problems. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11(1), 106–125.Google Scholar
  21. Rossman, A. J., & Chance, B. L. (2001). Workshop statistics: Discovery with data (2nd ed.). Emeryville: Key College Publishing.Google Scholar
  22. Singley, M. K., & Anderson, J. R. (1989). The transfer of cognitive skill. Cambridge: Harvard University Press.Google Scholar
  23. Vallecillos, A. (1999). Some empirical evidence on learning difficulties about testing hypotheses. Bulletin of the International Statistical Institute: Bulletin of the 52nd Session of the International Statistical Institute, 58, 201–204.Google Scholar
  24. Watson, J. M., & Kelly, B. A. (2005). Cognition and instruction: Reasoning about bias in sampling. Mathematics Education Research Journal, 17(1), 25–27.CrossRefGoogle Scholar
  25. Watson, J. M., & Moritz, J. B. (2000). Development of understanding of sampling for statistical literacy. The Journal of Mathematical Behavior, 19(1), 109–136.CrossRefGoogle Scholar
  26. Well, A. D., Pollatsek, A., & Boyce, S. J. (1990). Understanding the effects of sample size on the variability of the mean. Organizational Behavior and Human Decision Processes, 47, 289–312.CrossRefGoogle Scholar
  27. Wild, C. J., & Pfannkuch, M. (1999). Statistical thinking in empirical enquiry. International Statistical Review, 67(3), 223–248.CrossRefGoogle Scholar
  28. Williams, A. M. (1999). Novice students’ conceptual knowledge of statistical hypothesis testing. In J. M. Truran, & K. M. Truran (Eds.), Making the difference: Proceedings of the twenty-second annual conference of the mathematics education research group of Australasia (pp. 554–560). Adelaide: MERGA.Google Scholar

Copyright information

© FIZ Karlsruhe 2018

Authors and Affiliations

  1. 1.Pennsylvania State UniversityUniversity ParkUSA
  2. 2.University of MinnesotaMinneapolisUSA

Personalised recommendations