Abstract
This article presents the results of our analysis of a sample of 254 Calculus I final exams (collectively containing 4,167 individual items) administered at U.S. colleges and universities. We characterize the specific meanings of foundational concepts the exams assessed, identify features of exam items that assess productive meanings, distinguish categories of items for which students’ responses are not likely to reflect their understanding, and suggest associated modifications to these items that would assess students’ possession of more productive understandings. The article concludes with a discussion of what our findings indicate about the standards and expectations for students’ learning of calculus at institutions of higher education in the United States. We also discuss implications for calculus assessment design and suggest areas for further research.
Similar content being viewed by others
Notes
Operations are reversible mental actions that can be applied to a generalized class of objects without regard to an initial state.
College and university designations are based on the university classifications of U.S. News & World Report (www.usnews.com/education).
A student who engages in static shape thinking makes associations between mathematical terms or inscriptions and visual properties of (or actions on) a graph as an object so that these perceptual associations constitute one’s meaning for such terms and inscriptions.
References
Bergqvist, E. (2007). Types of reasoning required in university exams in mathematics. Journal of Mathematical Behavior, 26, 348–370.
Bergqvist, E. (2012). University mathematics teachers’ views on the required reasoning in calculus exams. The Mathematics Enthusiast, 9(3), 371–408.
Boesen, J., Lithner, J., & Palm, T. (2006). The relation between test task requirements and the reasoning used by students. Umeå, Sweeden: Department of Mathematics, Umeå University.
Breidenbach, D., Dubinsky, E., Hawks, J., & Nichols, D. (1992). Development of the process conception of function. Educational Studies in Mathematics, 23(3), 247–285.
Byerley, C., & Thompson, P. W. (2017). Secondary teachers’ meanings for measure, slope, and rate of change. Journal of Mathematical Behavior, 48, 168–193.
Carlson, M., Jacobs, S., Coe, E., Larsen, S., & Hsu, E. (2002). Applying covariational reasoning while modeling dynamic events: A framework and a study. Journal for Research in Mathematics Education, 33(5), 352–378.
Chhetri, K., & Oehrtman, M. (2015). The equation has particles! How calculus students construct definite integral models. Proceedings of the 18th Annual Conference on Research in Undergraduate Mathematics Education, Pittsburgh, Pennsylvania.
Dubinsky, E., & Harel, G. (1992). The nature of the process conception of function. In E. Dubinsky & G. Harel (Eds.), The concept of function: Aspects of epistemology and pedagogy (pp. 85–106). Washington D.C.: Mathematical Association of America.
Eichler, A., & Erens, R. (2014). Teachers’ beliefs towards teaching calculus. ZDM - The International Journal on Mathematics Education, 46(4), 647–659.
Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378–382.
Gierl, M. J. (1997). Comparing cognitive representations of test developers and students on a mathematics test with Bloom’s taxonomy. The Journal of Educational Research, 91(1), 26–32.
Johnson, H. L., McClintock, E., & Hornbeing, P. (2017). Ferris wheels and filling bottles: a case of students’ transfer of covariaitonal reasoning across tasks with different backgrounds and features. ZDM Mathemaitcs Education, 49, 851–864.
Jones, S. R. (2013). Understanding the integral: Students’ symbolic forms. Journal of Mathematical Behavior, 32, 122–141.
Jones, S. R. (2015). Areas, anti-derivatives, and adding up pieces: Definite integrals in pure mathematics and applied science contexts. The Journal of Mathematical Behavior, 38, 9–28.
Kaput, J. J. (1997). Rethinking calculus: Learning and thinking. The American Mathematical Monthly, 104(8), 731–737.
Kouropatov, A., & Dreyfus, T. (2014). Learning the integral concept by constructing knowledge about accumulation. ZDM - The International Journal on Mathematics Education, 46(4), 533–548.
Liang, B., & Moore, K. C. (2020). Figurative and operative partitioning activity: Students’ meanings for amounts of change in covarying quantities. Mathematical Thinking and Learning. https://doi.org/10.1080/10986065.2020.1789930.
Marso, R. N., & Pigge, F. L. (1991). An analysis of teacher-made tests: Item types, cognitive demands, and item construction errors. Contemporary Educational Psychology, 16, 279–286.
Moore, K. C., & Carlson, M. P. (2012). Students’ images of problem contexts when solving applied problems. Journal of Mathematical Behavior, 31(1), 48–59.
Moore, K. C. & Thompson, P. W. (2015). Shape thinking and students’ graphing activity. In T. Fukawa-Connelly, N. Infante, K. Keene, & M. Zandieh (Eds.), Proceedings of the 18th Annual Conference on Research in Undergraduate Mathematics Education (pp. 782–789). Pittsburgh, PA: RUME.
Müller, U. (2009). Infancy. In U. Müller, J. Carpendale, & L. Smith (Eds.), The Cambridge Companion to Piaget (Cambridge Companions to Philosophy (Cambridge Companions to Philosophy (pp. 200–228). Cambridge: Cambridge University Press.
Oehrtman, M. (2008). Layers of abstraction: Theory and design for the instruction of limit concepts. In Making the connection: Research and teaching in undergraduate mathematics education (pp. 65-80). Mathematical Association of America Washington, DC.
Oehrtman, M. (2009). Collapsing dimensions, physical limitation, and other student metaphors for limit concepts. Journal for Research in Mathematics Education, 40(4), 396–426. https://doi.org/10.5951/jresematheduc.40.4.0396.
Oehrtman, M. C., Carlson, M. P., & Thompson, P. W. (2008). Foundational reasoning abilities that promote coherence in students’ function understanding. In M. P. Carlson & C. Rasmussen (Eds.), Making the connection: Research and practice in undergraduate mathematics (pp. 27–42). Washington, D.C.: Mathematical Association of America.
Oehrtman, M., Wilson, M., Tallman, M., & Martin, J. (2016). Changes in assessment practices of calculus instructors while piloting research-based curricular activities. In T. Fukawa-Connelly, N. Engelke Infante, M. Wawro, & S. Brown (Eds.), Proceedings of the 19th Annual Conference on Research in Undergraduate Mathematics Education. pp. 355–367. Pittsburgh, PA: West Virginia University.
Palm, T., Boesen, J., & Lithner, J. (2005). The requirements of mathematical reasoning in upper secondary level assessments. Umeå, Sweeden: Departmetn of Mathematics, Umeå University.
Piaget, J. (1970). Genetic epistemology. New York, NY: W. W. Norton & Company Inc.
Piaget, J., & Inhelder, B. (1969). The psychology of the child. New York, NY: Basic Books.
Rasmussen, C., Marrongelle, K., & Borba, M. C. (2014). Research on calculus: What do we know and where do we need to go? ZDM - The International Journal on Mathematics Education, 46(4), 507–515.
Sealey, V. (2014). A framework for characterizing student understanding of Riemann sums and definite integrals. The Journal of Mathematical Behavior, 33, 230–245.
Saldanha, L., & Thompson, P. W. (1998). Re-thinking covariation from a quantitative perspective: Simultaneous continuous variation. Paper presented at the Annual Meeting of the Psychology of Mathematics Education-North America, Raleigh, NC: North Carolina State University.
Senk, S. L., Beckman, C. E., & Thompson, D. R. (1997). Assessment and grading in high school mathematics classrooms. Journal for Research in Mathematics Education, 28(2), 187–215.
Simmons, C. & Oehrtman, M. (2017). Beyond the product structure for definite integrals. Proceedings of the 20th Annual Conference on Research in Undergraduate Mathematics Education, San Diego, CA, pp. 912–919.
Simon, M. A. (2013). The need for theories of conceptual learning and teaching of mathematics. In K. Leatham (Ed.), Vital directions for research in mathematics education (pp. 95–118). New York: Springer.
Smith, J., & Thompson, P. W. (2007). Quantitative reasoning and the development of algebraic reasoning. In J. J. Kaput, D. W. Carraher, & M. L. Blanton (Eds.), Algebra in the early grades (pp. 95–132). New York: Erlbaum.
Tallman, M., Carlson, M. P., Bressoud, D., & Pearson, M. (2016). A characterization of calculus I final exams in US colleges and universities. International Journal of Research in Undergraduate Mathematics Education, 2(1), 105–133.
Thompson, P. W. (1990). A theoretical model of quantity-based reasoning in arithmetic and algebra. Center for Research in Mathematics & Science Education: San Diego State University
Thompson, P. W. (1994). The development of the concept of speed and its relationship to concepts of rate. In G. Harel & J. Confrey (Eds.), The development of multiplicative reasoning in the learning of mathematics (pp. 181–234). Albany, NY: SUNY Press.
Thompson, P. W. (2011). Quantitative reasoning and mathematical modeling. In L. L. Hatfield, S. Chamberlain, & S. Belbase (Eds.), New perspectives and directions for collaborative research in mathematics education (pp. 33–57). Laramie, WY: University of Wyoming.
Thompson, P. W. (2013). In the absence of meaning. In K. Leatham (Ed.), Vital Directions for Research in Mathematics Education (pp. 57–90). New York, NY: Springer.
Thompson, P. W. (2016). Researching teachers’ mathematical meanings for teaching mathematics. In L. English & D. Kirshner (Eds.), Third Handbook of International Research in Mathematics Education (pp. 435–461). New York: Taylor and Francis.
Thompson, P. W., Carlson, M. P., Byerley, C., & Hatfield, N. (2014). Schemes for thinking with magnitudes An hypothesis about foundational reasoning abilities in algebra. In : K. C. Moore, L. P. Steffe, & L. L. Hatfield (Eds.), Epistemic algebra students: Emerging models of students' algebraic knowing., WISDOMe Monographs (pp 1–24). Laramie, University of Wyoming.
von Glaserseld, E. (1995). Radical Constructivism: A Way of Knowing and Learning. New York: RoutledgeFalmer.
White, N., & Mesa, V. (2014). Describing cognitive orientation of Calculus I tasks across different types of coursework. ZDM - The International Journal on Mathematics Education, 46(4), 675–690.
Funding
This research was supported by National Science Foundation Grant DRL-0910240. Any recommendations or conclusions stated here are those of the authors and do not necessarily reflect official positions of the NSF.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tallman, M.A., Reed, Z., Oehrtman, M. et al. What meanings are assessed in collegiate calculus in the United States?. ZDM Mathematics Education 53, 577–589 (2021). https://doi.org/10.1007/s11858-020-01212-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11858-020-01212-3