Skip to main content
Log in

Measuring the mathematical quality of instruction

  • Published:
Journal of Mathematics Teacher Education Aims and scope Submit manuscript

Abstract

In this article, we describe a framework and instrument for measuring the mathematical quality of mathematics instruction. In describing this framework, we argue for the separation of the mathematical quality of instruction (MQI), such as the absence of mathematical errors and the presence of sound mathematical reasoning, from pedagogical method. We argue that conceptualizing this key aspect of mathematics classrooms will enable more clarity in mathematics educators’ research questions and will facilitate study of the mechanisms by which teacher knowledge shapes instruction and subsequent student learning. The instrument we have developed offers an important first step in demonstrating the viability of the construct.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. Atweh et al. (2003) observe that during the last two decades reform ideas in the U.S. and England travelled as far as Australia and some East Asian countries. Other scholars also trace the impact of reform ideas—and particularly the four process standards outlined in the NCTM 1989 document (i.e., problem solving, communication, reasoning, and connections)—on the mathematics education of countries in Europe and the Middle East (cf. Amit and Fried 2002; Boaler 2002; Christou et al. 2009; Jones et al. 2002; Tirosh and Graeber 2003).

  2. The glossary, giving the criteria for our codes, can be found at: www.sitemaker.umich.edu/lmt.

  3. In the measurement community, constructs refer to the underlying trait or phenomena one wishes to measure; scales are the tools for measuring constructs.

  4. We are currently piloting a set of codes that capture student’s interactions with mathematical content—for instance, whether they provide mathematical explanations, ask mathematical questions, or make mathematical claims.

  5. The explicit talk about the meaning and use of mathematical language code only has two options: “present” or “not present.”

References

  • Adler, J. (2001). Lessons from and in curriculum reform across contexts? The Mathematics Educator, 12, 2–5.

    Google Scholar 

  • Amit, M., & Fried, M. N. (2002). Research, reform, and times of change. In L. D. English (Ed.), Handbook of international research in mathematics education (pp. 355–381). New Jersey: Lawrence Erlbaum Associates.

    Google Scholar 

  • Atweh, B., Clarkson, P., & Nebres, B. (2003). Mathematics education in international and global contexts. In A. Bishop, M. A. Clements, C. Keitel, J. Kilpatrick, & F. K. S. Leung (Eds.), Second international handbook of mathematics education (pp. 185–229). Dordrecht, The Netherlands: Kluwer Academic Publishers.

    Google Scholar 

  • Ball, D. L., & Bass, H. (2003). Toward a practice-based theory of mathematical knowledge for teaching. In B. Davis & E. Simmt (Eds.), Proceedings of the 2002 annual meeting of the Canadian Mathematics Education Study Group (pp. 3–14). Edmonton, AB: CMESG/GDEDM.

  • Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59(5), 389–407.

    Article  Google Scholar 

  • Blunk, M., & Hill, H. C. (2007). The mathematical quality of instruction (MQI) video coding tool: Results from validation and scale-building. Paper presented at the 2007 American Educational Association Annual Conference, Chicago, IL.

  • Boaler, J. (2002). Experiencing school mathematics: Traditional and reform approaches to teaching and their impact on student learning. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Borko, H., Eisenhart, M., Brown, C., Underhill, R., Jones, D., & Agard, P. C. (1992). Learning to teach hard mathematics: Do novice teachers and their instructors give up too easily? Journal for Research in Mathematics Education, 23(3), 194–222.

    Article  Google Scholar 

  • Brophy, J. E., & Good, T. L. (1986). Teacher behaviour and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (pp. 328–375). New York: MacMillan.

    Google Scholar 

  • Charalambous, C. Y. (2008). Mathematical knowledge for teaching and the unfolding of tasks in mathematics lessons: Integrating two lines of research. In O. Figueras, J. L. Cortina, S. Alatorre, T. Rojano, & A. Sepúlveda (Eds.), Proceedings of the joint meeting of PME 32 and PME-NA XXX (Vol. 2, pp. 281–288). México: Cinvestav-UMSNH.

  • Christou, C., Eliophotou-Menon, M., & Philippou, G. (2009). Beginning teachers’ concerns regarding the adoption of new mathematics curriculum materials. In J. T. Remillard, B. A. Herbel-Eisenmann, & G. M. Lloyd (Eds.), Mathematics teachers at work: Connecting curriculum materials and classroom instruction (pp. 223–244). New York: Routledge.

    Google Scholar 

  • Cohen, D. (1990). A revolution in one classroom: The case of Mrs. Oublier. Educational Evaluation and Policy Analysis, 12(3), 311–329.

    Google Scholar 

  • Cohen, D., & Ball, D. L. (2001). Making change: Instruction and its improvement. Phi Delta Kappan, 83(1), 73–77.

    Google Scholar 

  • Delpit, L. (1986). Skills and other dilemmas of a progressive black educator. Harvard Educational Review, 56(4), 379–385.

    Google Scholar 

  • Gearhardt, M., Saxe, G. B., Seltzer, M., Schlackman, J., Ching, C. C., Nasir, N., et al. (1999). Opportunities to learn fractions in elementary classrooms. Journal for Research in Mathematics Education, 30(3), 286–315.

    Article  Google Scholar 

  • Glaser, B., & Strauss, A. (1967). The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine.

    Google Scholar 

  • Good, T., Grouws, D., & Ebmeier, H. (1983). Active mathematics teaching. New York: Longman.

    Google Scholar 

  • Henningsen, M., & Stein, M. K. (1997). Mathematical tasks and student cognition: Classroom-based factors that support and inhibit high-level mathematical thinking and reasoning. Journal for Research in Mathematics Education, 28(5), 524–549.

    Article  Google Scholar 

  • Hill, H. C., Blunk, M., Charalambous, C., Lewis, J., Phelps, G. C., Sleep, L., et al. (2008). Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study. Cognition and Instruction, 26(4), 430–511.

    Article  Google Scholar 

  • Hill, H. C., Schilling, S. G., & Ball, D. L. (2004). Developing measures of teachers’ mathematics knowledge for teaching. Elementary School Journal, 105, 11–30.

    Article  Google Scholar 

  • Horizon Research. (2000). Inside the classroom observation and analytic protocol. Chapel Hill, NC: Horizon Research, Inc.

    Google Scholar 

  • Jones, G., Langrall, C., Thornton, C., & Nisbet, S. (2002). Elementary students’ access to powerful mathematical ideas. In L. D. English (Ed.), Handbook of international research in mathematics education (pp. 113–141). New Jersey: Lawrence Erlbaum Associates.

    Google Scholar 

  • Kunter, M., Klusmann, U., Dubberke, T., Baumert, J., Blum, W., & Brunner, M. (2007). Linking aspects of teacher competence to their instruction: Results from the COACTIV project. In M. Prenzel, et al. (Eds.), Studies on educational quality of schools: The final report on the DFG Priority programme (pp. 39–59). Munster, Germany: Waxmann.

    Google Scholar 

  • Ladson-Billings, G. (1995). Making mathematics meaningful in multicultural contexts. In W. G. Secada, E. Fennema, & L. B. Adajian (Eds.), New directions for equity in mathematics education (pp. 126–145). Cambridge: Cambridge University Press.

    Google Scholar 

  • Leinhardt, G., & Smith, D. A. (1985). Expertise in mathematics instruction: Subject matter knowledge. Journal of Educational Psychology, 77(3), 247–271.

    Article  Google Scholar 

  • Leung, F. K. S. (2005). Some characteristics of East Asian mathematics classrooms based on data from the TIMSS 1999 video study. Educational Studies in Mathematics, 60, 199–215.

    Article  Google Scholar 

  • Muijs, D., & Reynolds, D. (2000). School effectiveness and teacher effectiveness in mathematics: Some preliminary findings from the evaluation of the mathematics enhancement programme (primary). School Effectiveness and School Improvement, 11(3), 273–303.

    Article  Google Scholar 

  • National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

    Google Scholar 

  • National Council of Teachers of Mathematics. (1991). Professional standards for teaching mathematics. Reston, VA: NCTM.

    Google Scholar 

  • National Council of Teachers of Mathematics. (2000). Principles and standards for school mathematics. Reston, VA: Author.

    Google Scholar 

  • Office for Standards in Education. (2009). Mathematics: Understanding the scoreimproving practice in mathematics (primary). London: Author. Retrieved March 5, 2009 from http://www.ofsted.gov.uk/Ofsted-home/Publications-and-research/Browse-all-by/Documents-by-type/Thematic-reports?query=mathematics&SearchSectionID=12.

  • Powell, A. B., Francisco, J. M., & Maher, C. A. (2003). An analytical model for studying the development of learners’ mathematical ideas and reasoning using videotape data. Journal of Mathematical Behavior, 22, 405–435.

    Article  Google Scholar 

  • RAND Mathematics Study Panel (D. L. Ball, Chair). (2003). Mathematical proficiency for all students: Toward a strategic research and development program in mathematics education. Arlington: RAND.

  • Reynolds, D., & Muijs, D. (1999). The effective teaching of mathematics: A review of research. School Leadership and Management, 19(3), 273–288.

    Article  Google Scholar 

  • Rosenshine, B., & Furst, N. (1986). The use of direct observation to study teaching. In M. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 122–183). New York: Macmillan.

    Google Scholar 

  • Rowland, T. (2008). Researching teachers’ mathematics disciplinary knowledge. In P. Sullivan & T. Wood (Eds.), The international handbook of mathematics teacher education, Vol. 1: Knowledge and beliefs in mathematics teaching and teaching development (pp. 273–300). Rotterdam, The Netherlands: Sense Publishers.

    Google Scholar 

  • Rowland, T., Huckstep, T., & Thwaites, A. (2005). Elementary teachers’ mathematics subject knowledge: The knowledge quartet and the case of Naomi. Journal of Mathematics Teacher Education, 8, 255–281.

    Article  Google Scholar 

  • Sawada, D., & Pilburn, M. (2000). Reformed teaching observation protocol (RTOP). Arizona State University: Arizona Collaborative for Excellence in the Preparation of Teachers.

    Google Scholar 

  • Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Education Researcher, 15(2), 4–14.

    Google Scholar 

  • Spillane, J. P., & Zeuli, J. S. (1999). Reform and teaching: Exploring patterns of practice in the context of national and state mathematics reforms. Educational Evaluation and Policy Analysis, 21(1), 1–27.

    Google Scholar 

  • Tirosh, D., & Graeber, A. (2003). Challenging and changing mathematics teaching classroom practices. In A. Bishop, M. A. Clements, C. Keitel, J. Kilpatrick, & F. K. S. Leung (Eds.), Second international handbook of mathematics education (pp. 643–687). Dordrecht, The Netherlands: Kluwer Academic Publishers.

    Google Scholar 

  • Weaver, D., Dick, T., Higgins, K., Marrongelle, K., Foreman, L., Miller, N., et al. (2005). OMLI classroom observation protocol. Portland, OR: RMC Research Corporation.

    Google Scholar 

  • Zebian, S. (2004). Sociomathematical norms in Lebanese classrooms and their relationship to higher order critical thinking in students: Some different conceptual starting points for mathematics teaching and learning. Paper presented at the annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education, Delta Chelsea Hotel, Toronto, ON, Canada.

Download references

Acknowledgments

This research was funded by NSF grants REC-0207649, EHR-0233456, and EHR-0335411.

Author information

Authors and Affiliations

Consortia

Additional information

During the time this article was written, the Learning Mathematics for Teaching project consisted of Heather C. Hill, Deborah Loewenberg Ball, Hyman Bass, Merrie Blunk, Katie Brach, Charalambos Y. Charalambous, Yaa Cole, Carolyn Dean, Seán Delaney, Sam Eskelson, Imani Masters Goffney, Jennifer M. Lewis, Geoffrey Phelps, Laurie Sleep, Mark Thames and Deborah Zopf.

Appendix A

Appendix A

  1. 1.

    Imagine that you are working with your class on multiplying large numbers. Among your students’ papers, you notice that some have displayed their work in the following ways:

Which of these students would you judge to be using a method that could be used to multiply any two whole numbers? (Fig. 2).

Fig. 2
figure 2

Three solutions to 35 × 25

 

 

Method would work for all whole numbers

Method would NOT work for all whole numbers

I’m not sure

(a) Student A

1

2

3

(b) Student B

1

2

3

(c) Student C

1

2

3

Rights and permissions

Reprints and permissions

About this article

Cite this article

Learning Mathematics for Teaching Project. Measuring the mathematical quality of instruction. J Math Teacher Educ 14, 25–47 (2011). https://doi.org/10.1007/s10857-010-9140-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10857-010-9140-1

Keywords

Navigation