Skip to main content
Log in

What meanings are assessed in collegiate calculus in the United States?

  • Original Paper
  • Published:
ZDM – Mathematics Education Aims and scope Submit manuscript

Abstract

This article presents the results of our analysis of a sample of 254 Calculus I final exams (collectively containing 4,167 individual items) administered at U.S. colleges and universities. We characterize the specific meanings of foundational concepts the exams assessed, identify features of exam items that assess productive meanings, distinguish categories of items for which students’ responses are not likely to reflect their understanding, and suggest associated modifications to these items that would assess students’ possession of more productive understandings. The article concludes with a discussion of what our findings indicate about the standards and expectations for students’ learning of calculus at institutions of higher education in the United States. We also discuss implications for calculus assessment design and suggest areas for further research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Operations are reversible mental actions that can be applied to a generalized class of objects without regard to an initial state.

  2. College and university designations are based on the university classifications of U.S. News & World Report (www.usnews.com/education).

  3. A student who engages in static shape thinking makes associations between mathematical terms or inscriptions and visual properties of (or actions on) a graph as an object so that these perceptual associations constitute one’s meaning for such terms and inscriptions.

References

  • Bergqvist, E. (2007). Types of reasoning required in university exams in mathematics. Journal of Mathematical Behavior, 26, 348–370.

    Article  Google Scholar 

  • Bergqvist, E. (2012). University mathematics teachers’ views on the required reasoning in calculus exams. The Mathematics Enthusiast, 9(3), 371–408.

    Google Scholar 

  • Boesen, J., Lithner, J., & Palm, T. (2006). The relation between test task requirements and the reasoning used by students. Umeå, Sweeden: Department of Mathematics, Umeå University.

    Google Scholar 

  • Breidenbach, D., Dubinsky, E., Hawks, J., & Nichols, D. (1992). Development of the process conception of function. Educational Studies in Mathematics, 23(3), 247–285.

    Article  Google Scholar 

  • Byerley, C., & Thompson, P. W. (2017). Secondary teachers’ meanings for measure, slope, and rate of change. Journal of Mathematical Behavior, 48, 168–193.

    Article  Google Scholar 

  • Carlson, M., Jacobs, S., Coe, E., Larsen, S., & Hsu, E. (2002). Applying covariational reasoning while modeling dynamic events: A framework and a study. Journal for Research in Mathematics Education, 33(5), 352–378.

    Article  Google Scholar 

  • Chhetri, K., & Oehrtman, M. (2015). The equation has particles! How calculus students construct definite integral models. Proceedings of the 18th Annual Conference on Research in Undergraduate Mathematics Education, Pittsburgh, Pennsylvania.

  • Dubinsky, E., & Harel, G. (1992). The nature of the process conception of function. In E. Dubinsky & G. Harel (Eds.), The concept of function: Aspects of epistemology and pedagogy (pp. 85–106). Washington D.C.: Mathematical Association of America.

    Google Scholar 

  • Eichler, A., & Erens, R. (2014). Teachers’ beliefs towards teaching calculus. ZDM - The International Journal on Mathematics Education, 46(4), 647–659.

    Article  Google Scholar 

  • Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378–382.

    Article  Google Scholar 

  • Gierl, M. J. (1997). Comparing cognitive representations of test developers and students on a mathematics test with Bloom’s taxonomy. The Journal of Educational Research, 91(1), 26–32.

    Article  Google Scholar 

  • Johnson, H. L., McClintock, E., & Hornbeing, P. (2017). Ferris wheels and filling bottles: a case of students’ transfer of covariaitonal reasoning across tasks with different backgrounds and features. ZDM Mathemaitcs Education, 49, 851–864.

    Article  Google Scholar 

  • Jones, S. R. (2013). Understanding the integral: Students’ symbolic forms. Journal of Mathematical Behavior, 32, 122–141.

    Article  Google Scholar 

  • Jones, S. R. (2015). Areas, anti-derivatives, and adding up pieces: Definite integrals in pure mathematics and applied science contexts. The Journal of Mathematical Behavior, 38, 9–28.

    Article  Google Scholar 

  • Kaput, J. J. (1997). Rethinking calculus: Learning and thinking. The American Mathematical Monthly, 104(8), 731–737.

    Article  Google Scholar 

  • Kouropatov, A., & Dreyfus, T. (2014). Learning the integral concept by constructing knowledge about accumulation. ZDM - The International Journal on Mathematics Education, 46(4), 533–548.

    Article  Google Scholar 

  • Liang, B., & Moore, K. C. (2020). Figurative and operative partitioning activity: Students’ meanings for amounts of change in covarying quantities. Mathematical Thinking and Learning. https://doi.org/10.1080/10986065.2020.1789930.

    Article  Google Scholar 

  • Marso, R. N., & Pigge, F. L. (1991). An analysis of teacher-made tests: Item types, cognitive demands, and item construction errors. Contemporary Educational Psychology, 16, 279–286.

    Article  Google Scholar 

  • Moore, K. C., & Carlson, M. P. (2012). Students’ images of problem contexts when solving applied problems. Journal of Mathematical Behavior, 31(1), 48–59.

    Article  Google Scholar 

  • Moore, K. C. & Thompson, P. W. (2015). Shape thinking and students’ graphing activity. In T. Fukawa-Connelly, N. Infante, K. Keene, & M. Zandieh (Eds.), Proceedings of the 18th Annual Conference on Research in Undergraduate Mathematics Education (pp. 782–789). Pittsburgh, PA: RUME.

  • Müller, U. (2009). Infancy. In U. Müller, J. Carpendale, & L. Smith (Eds.), The Cambridge Companion to Piaget (Cambridge Companions to Philosophy (Cambridge Companions to Philosophy (pp. 200–228). Cambridge: Cambridge University Press.

    Chapter  Google Scholar 

  • Oehrtman, M. (2008). Layers of abstraction: Theory and design for the instruction of limit concepts. In Making the connection: Research and teaching in undergraduate mathematics education (pp. 65-80). Mathematical Association of America Washington, DC.

  • Oehrtman, M. (2009). Collapsing dimensions, physical limitation, and other student metaphors for limit concepts. Journal for Research in Mathematics Education, 40(4), 396–426. https://doi.org/10.5951/jresematheduc.40.4.0396.

    Article  Google Scholar 

  • Oehrtman, M. C., Carlson, M. P., & Thompson, P. W. (2008). Foundational reasoning abilities that promote coherence in students’ function understanding. In M. P. Carlson & C. Rasmussen (Eds.), Making the connection: Research and practice in undergraduate mathematics (pp. 27–42). Washington, D.C.: Mathematical Association of America.

    Chapter  Google Scholar 

  • Oehrtman, M., Wilson, M., Tallman, M., & Martin, J. (2016). Changes in assessment practices of calculus instructors while piloting research-based curricular activities. In T. Fukawa-Connelly, N. Engelke Infante, M. Wawro, & S. Brown (Eds.), Proceedings of the 19th Annual Conference on Research in Undergraduate Mathematics Education. pp. 355–367. Pittsburgh, PA: West Virginia University.

  • Palm, T., Boesen, J., & Lithner, J. (2005). The requirements of mathematical reasoning in upper secondary level assessments. Umeå, Sweeden: Departmetn of Mathematics, Umeå University.

    Google Scholar 

  • Piaget, J. (1970). Genetic epistemology. New York, NY: W. W. Norton & Company Inc.

    Book  Google Scholar 

  • Piaget, J., & Inhelder, B. (1969). The psychology of the child. New York, NY: Basic Books.

    Google Scholar 

  • Rasmussen, C., Marrongelle, K., & Borba, M. C. (2014). Research on calculus: What do we know and where do we need to go? ZDM - The International Journal on Mathematics Education, 46(4), 507–515.

    Article  Google Scholar 

  • Sealey, V. (2014). A framework for characterizing student understanding of Riemann sums and definite integrals. The Journal of Mathematical Behavior, 33, 230–245.

    Article  Google Scholar 

  • Saldanha, L., & Thompson, P. W. (1998). Re-thinking covariation from a quantitative perspective: Simultaneous continuous variation. Paper presented at the Annual Meeting of the Psychology of Mathematics Education-North America, Raleigh, NC: North Carolina State University.

  • Senk, S. L., Beckman, C. E., & Thompson, D. R. (1997). Assessment and grading in high school mathematics classrooms. Journal for Research in Mathematics Education, 28(2), 187–215.

    Article  Google Scholar 

  • Simmons, C. & Oehrtman, M. (2017). Beyond the product structure for definite integrals. Proceedings of the 20th Annual Conference on Research in Undergraduate Mathematics Education, San Diego, CA, pp. 912–919.

  • Simon, M. A. (2013). The need for theories of conceptual learning and teaching of mathematics. In K. Leatham (Ed.), Vital directions for research in mathematics education (pp. 95–118). New York: Springer.

    Chapter  Google Scholar 

  • Smith, J., & Thompson, P. W. (2007). Quantitative reasoning and the development of algebraic reasoning. In J. J. Kaput, D. W. Carraher, & M. L. Blanton (Eds.), Algebra in the early grades (pp. 95–132). New York: Erlbaum.

    Google Scholar 

  • Tallman, M., Carlson, M. P., Bressoud, D., & Pearson, M. (2016). A characterization of calculus I final exams in US colleges and universities. International Journal of Research in Undergraduate Mathematics Education, 2(1), 105–133.

    Article  Google Scholar 

  • Thompson, P. W. (1990). A theoretical model of quantity-based reasoning in arithmetic and algebra. Center for Research in Mathematics & Science Education: San Diego State University

  • Thompson, P. W. (1994). The development of the concept of speed and its relationship to concepts of rate. In G. Harel & J. Confrey (Eds.), The development of multiplicative reasoning in the learning of mathematics (pp. 181–234). Albany, NY: SUNY Press.

    Google Scholar 

  • Thompson, P. W. (2011). Quantitative reasoning and mathematical modeling. In L. L. Hatfield, S. Chamberlain, & S. Belbase (Eds.), New perspectives and directions for collaborative research in mathematics education (pp. 33–57). Laramie, WY: University of Wyoming.

    Google Scholar 

  • Thompson, P. W. (2013). In the absence of meaning. In K. Leatham (Ed.), Vital Directions for Research in Mathematics Education (pp. 57–90). New York, NY: Springer.

    Chapter  Google Scholar 

  • Thompson, P. W. (2016). Researching teachers’ mathematical meanings for teaching mathematics. In L. English & D. Kirshner (Eds.), Third Handbook of International Research in Mathematics Education (pp. 435–461). New York: Taylor and Francis.

    Google Scholar 

  • Thompson, P. W., Carlson, M. P., Byerley, C., & Hatfield, N. (2014). Schemes for thinking with magnitudes An hypothesis about foundational reasoning abilities in algebra. In : K. C. Moore, L. P. Steffe, & L. L. Hatfield (Eds.), Epistemic algebra students: Emerging models of students' algebraic knowing., WISDOMe Monographs (pp 1–24). Laramie, University of Wyoming.

  • von Glaserseld, E. (1995). Radical Constructivism: A Way of Knowing and Learning. New York: RoutledgeFalmer.

    Google Scholar 

  • White, N., & Mesa, V. (2014). Describing cognitive orientation of Calculus I tasks across different types of coursework. ZDM - The International Journal on Mathematics Education, 46(4), 675–690.

    Article  Google Scholar 

Download references

Funding

This research was supported by National Science Foundation Grant DRL-0910240. Any recommendations or conclusions stated here are those of the authors and do not necessarily reflect official positions of the NSF.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael A. Tallman.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tallman, M.A., Reed, Z., Oehrtman, M. et al. What meanings are assessed in collegiate calculus in the United States?. ZDM Mathematics Education 53, 577–589 (2021). https://doi.org/10.1007/s11858-020-01212-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11858-020-01212-3

Keywords

Navigation