Skip to main content

Studying mathematics instruction through different lenses: setting the ground for understanding instructional quality more comprehensively

ZDM volume 50, pages 355–366 (2018)Cite this article

Abstract

Researchers from different fields have developed different observational instruments to capture instructional quality with a focus on generic versus content-specific dimensions or a combination of both. As this work is fast accumulating, the need to explore synergies and complementarities among existing work on instruction and its quality becomes imperative, given the complexity of instruction and the increasing realization that different frameworks illuminate certain instructional aspects but leave others less visible. This special issue makes a step toward exploring such synergies and complementarities, drawing on the analysis of the same 3 elementary-school lessons by 11 groups using 12 different frameworks. The purpose of the current paper is to provide an up-to-date overview of prior attempts made to work at the intersection of different observational frameworks. The paper also serves as the reference point for the other papers included in the special issue, by defining the goals and research questions driving the explorations presented in each paper, outlining the criteria for selecting the frameworks included in the special issue, describing the sampling approaches for the selected lessons, presenting the content of these lessons, and providing an overview of the structure of each paper.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1

Notes

  1. Lindorff and Sammons (this issue) have not developed the frameworks utilized in their work but combine existing frameworks to better understand instructional quality. Similarly, Berlin and Cohen (this issue) are not amongst the original developers of the CLASS instrument.

  2. We would like to thank Heather C. Hill from the Harvard Graduate School of Education for generously giving access to these videotaped lessons to all researchers contributing to the special issue.

References

  • Ball, D. L. (1992). Magical hopes: Manipulatives and the reform of math education. American Educator, 16(2), 14–18, 46–47.

    Google Scholar 

  • Ball, D. L., Lewis, J., & Thames, M. H. (2008). Making mathematics work in school. In A. J. Schoenfeld & N. Pateman (Eds.), A study of teaching: Multiple lenses, multiple views: Journal for research in mathematics education, monograph #14 (pp. 13–44). Reston: NCTM.

    Google Scholar 

  • Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2–3), 62–87. https://doi.org/10.1080/10627197.2012.71501.

    Article  Google Scholar 

  • Blazar, D., Braslow, D., Charalambous, C. Y., & Hill, H. C. (2017). Attending to general and mathematics-specific dimensions of teaching: Exploring factors across two observation instruments. Educational Assessment, 22(2), 71–94. https://doi.org/10.1080/10627197.2017.1309274.

    Article  Google Scholar 

  • Blazar, D., & Kraft, M. A. (2017). Teacher and teaching effects on students’ attitudes and behaviors. Educational Evaluation and Policy Analysis, 39(1), 146–170. https://doi.org/10.3102/0162373716670260.

    Article  Google Scholar 

  • Blazar, D., Litke, E., & Barmore, J. (2016). What does it mean to be ranked a “high” or “low” value-added teacher? Observing differences in instructional quality across districts. American Educational Research Journal, 53(2), 324–359. https://doi.org/10.3102/0002831216630407.

    Article  Google Scholar 

  • Booker, L. N. (2014). Examining the development of beginning middle school math teachers’ practices and their relationship with the teachers’ effectiveness. Unpublished doctoral dissertation, Vanderbilt University, Nashville, Tennessee, USA.

  • Boston, M., Bostic, J., Lesseig, K., & Sherman, M. (2015). A comparison of mathematics classroom observation protocols. Mathematics Teacher Educator, 3(2), 154–175. https://doi.org/10.5951/mathteaceduc.3.2.0154.

    Article  Google Scholar 

  • Cantrell, S., & Kane, T. J. (2013). Ensuring fair and reliable measures of effective teaching. Seattle: Bill & Melinda Gates Foundation. http://www.metproject.org/reports.php. Accessed 19 Feb 2015.

  • Charalambous, C. Y., & Kyriakides, E. (2017). Working at the nexus of generic and content-specific teaching practices: An exploratory study based on TIMSS secondary analyses. The Elementary School Journal, 117(3), 423–454. https://doi.org/10.1086/690221.

    Article  Google Scholar 

  • Cohen, D. K. (2011). Teaching and its predicaments. Cambridge: Harvard University Press.

    Book  Google Scholar 

  • Common Core State Standards Initiative [CCSSI] (2014). Mathematics Standards. http://www.corestandards.org/Math/. Accessed 20 Feb 2014.

  • Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice, and theory in contemporary schools. London & New York: Routledge.

    Google Scholar 

  • Cuoco, A. A., & Curcio, F. R. (Eds.). (2001). The roles of representation in school mathematics (NCTM 2001 Yearbook). Reston: NCTM.

    Google Scholar 

  • Danielson, C. (2013). Enhancing professional practice: A framework for teaching (2nd edn.). Alexandria: Association for Supervision and Curriculum Development.

    Google Scholar 

  • Dignath-van Ewijk, C., Dickhäuser, O., & Büttner, G. (2013). Assessing how teachers enhance self-regulated learning–A multi-perspective approach. Journal of Cognitive Education and Psychology, Special Issue of Self-Regulated Learning, 12(3), 338–358. https://doi.org/10.1891/1945-8959.12.3.338.

    Article  Google Scholar 

  • Doabler, C. T., Baker, S. K., Kosty, D. B., Clarke, B., Miller, S. J., & Fien, H. (2015). Examining the association between explicit mathematics instruction and student mathematics achievement. Elementary School Journal, 115(3), 303–333. https://doi.org/10.1086/679969.

    Article  Google Scholar 

  • Doyle, W. (1986). Classroom organization and management. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd edn., pp. 392–431). London: Macmillan.

    Google Scholar 

  • Dubinski, W. N., Waxman, H. C., Brown, D. B., & Kelly, L. J. (2016). Informing teacher education through the use of multiple classroom observation instruments. Teacher Education Quarterly, 43(1), 91–106.

    Google Scholar 

  • Gibbons, C. J. (2016). Variations of mathematics in college algebra instruction: An investigation through the lenses of three observation protocols. Unpublished Master’s thesis, Oregon State University, Corvallis, Oregon, USA.

  • Grossman, P., & McDonald, M. (2008). Back to the future: Directions for research in teaching and teacher education. American Educational Research Journal, 45(1), 184–205. https://doi.org/10.3102/0002831207312906.

    Article  Google Scholar 

  • Henry, M. A., Murray, K. S., & Phillips, K. A. (2007). Meeting the challenge of STEM classroom observation in evaluating teacher development projects: A comparison of two widely used instruments. http://sirc.mspnet.org/index.cfm/19945. Accessed 12 Feb 2013.

  • Hiebert, J., Gallimore, R., Garnier, H., Givvin, K. B., Hollingsworth, H., Jacobs, J., … & Stigler, J. (2003). Teaching mathematics in seven countries: Results from the TIMSS 1999 video study. U.S. Department of Education. Washington DC: National Center for Education Statistics.

  • Hill, H. C., Blunk, M., Charalambous, C. Y., Lewis, J., Phelps, G. C., Sleep, L., & Ball, D. L. (2008). Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study. Cognition and Instruction, 26(4), 430–511. https://doi.org/10.1080/07370000802177235.

    Article  Google Scholar 

  • Hill, H. C., Charalambous, C. Y., & Kraft, M. (2012). When rater reliability is not enough: Teacher observation systems and a case for the G-study. Educational Researcher, 41(2), 56–64. https://doi.org/10.3102/0013189X12437203.

    Article  Google Scholar 

  • Horizon Research, I. (2000). Inside the classroom observation and analytic protocol. Chapel Hill: Horizon Research, Inc. http://www.horizon-research.com/instruments/clas/cop.pdf. Accessed 18 Sep 2008.

  • Horn, I. S. (2008). Accountable argumentation as a participation structure to support learning through disagreement. In A. J. Schoenfeld & N. Pateman (Eds.), A study of teaching: Multiple lenses, multiple views: Journal for Research in Mathematics Education, Monograph #14 (pp. 97–126). Reston: NCTM.

    Google Scholar 

  • Kane, T. J., & Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle: Bill & Melinda Gates Foundation. http://www.metproject.org/reports.php. Accessed 30 Nov 2012.

  • Kane, T. J., Taylor, E. S., Tyler, J. H., & Wooten, A. L. (2011). Identifying effective classroom practices using student achievement data. Journal of Human Resources, 46(3), 587–613. https://doi.org/10.3386/w15803.

    Article  Google Scholar 

  • Kilday, C. R., & Kinzie, M. B. (2009). An analysis of instruments that measure the quality of mathematics teaching in early childhood. Early Childhood Education Journal, 36(4), 365–372. https://doi.org/10.1007/s10643-008-0286-8.

    Article  Google Scholar 

  • Klieme, E., Pauli, C., & Reusser, K. (2009). The Pythagoras study: Investigating effects of teaching and learning in Swiss and German mathematics classrooms. In T. Janik & T. Seidel (Eds.), The power of video studies in investigating teaching and learning in the classroom (pp. 137–160). Münster: Waxmann.

    Google Scholar 

  • Lampert, M. (2001). Teaching problems and the problems of teaching. New Haven and London: Yale University Press.

    Google Scholar 

  • Learning Mathematics for Teaching Project. (2011). Measuring the mathematical quality of instruction. Journal of Mathematics Teacher Education, 14(1), 25–47. https://doi.org/10.1007/s10857-010-9140-1.

    Article  Google Scholar 

  • Leinhardt, G. (1993). On teaching. In R. Glaser (Ed.), Advances in instructional psychology (pp. 1–54). Hillsdale: Lawrence Erlbaum Associates.

    Google Scholar 

  • Litke, E. G. (2015). The state of the gate: A description of instructional practice in algebra in five urban districts. Unpublished doctoral dissertation, Harvard University, Cambridge, MA.

  • Lockwood, J. R., Savitsky, T. D., & McCaffrey, D. F. (2015). Inferring constructs of effective teaching from classroom observations: An application of Bayesian exploratory factor analysis without restrictions. The Annals of Applied Statistics, 9(3), 1484–1509. https://doi.org/10.1214/15-AOAS833.

    Article  Google Scholar 

  • Marder, M., & Walkington, C. (2014). Classroom observation and value-added models give complementary information about quality of mathematics teaching. In T. Kane, K. Kerr & R. Pianta (Eds.), Designing teacher evaluation systems: New guidance from the measuring effective teaching project (pp. 234–277). New York: Wiley.

    Google Scholar 

  • Martin-Raugh, M., Tannenbaum, R. J., Tocci, C. M., & Resse, C. (2016). Behaviorally anchored rating scales: an application for evaluating teaching practice. Teaching and Teacher Education, 59, 414–419. https://doi.org/10.1016/j.tate.2016.07.026.

    Article  Google Scholar 

  • Matsumura, L. C., Garnier, H., Slater, S. C., & Boston, M. (2008). Toward measuring instructional interactions ‘at-scale.’. Educational Assessment, 13(4), 267–300. https://doi.org/10.1080/10627190802602541.

    Article  Google Scholar 

  • McGuire, P. R., Kinzie, M., Thunder, K., & Berry, R. (2016). Methods of analysis and overall mathematics teaching quality in at-risk prekindergarten classrooms. Early Education and Development, 27(1), 89–109. https://doi.org/10.1080/10409289.2015.968241.

    Article  Google Scholar 

  • Mihaly, K., McCaffrey, D., Staiger, D., & Lockwood, J. R. (2013). A composite estimator of effective teaching (MET Project). The RAND Corporation. http://www.rand.org/pubs/external_publications/EP50155.html. Accessed 21 March 2015.

  • Mitchell, R., Charalambous, C. Y., & Hill, C. H. (2014). Examining the task and knowledge demands needed to teach with representations. Journal of Mathematics Teacher Education, 17(1), 37–60. https://doi.org/10.1007/s10857-013-9253-4.

    Article  Google Scholar 

  • Muijs, D., Kyriakides, L., van der Werf, G., Creemers, B., Timperley, H., & Earl, L. (2014). State of the art–teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25(2), 231–256. https://doi.org/10.1080/09243453.2014.885451.

    Article  Google Scholar 

  • National Council of Teachers of Mathematics [NCTM] (2000). Principles and standards for school mathematics. Reston: NCTM.

    Google Scholar 

  • Nowińska, E., & Praetorius, A. K. (2017). Evaluation of a rating system for the assessment of metacognitive-discursive instructional quality. In Proceedings of the tenth congress of the European Society for Research in Mathematics Education. https://keynote.conference-services.net/resources/444/5118/pdf/CERME10_0379.pdf. Accessed 30 Sept 2017.

  • Pianta, R., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119. https://doi.org/10.3102/0013189X09332374.

    Article  Google Scholar 

  • Pinter, H. H. (2013). Patterns of teacher’s instructional moves: What makes mathematical instructional practices unique? Unpublished Doctoral Dissertation. University of Virginia, Charlottesville, USA.

  • Posner, T. (2008). Equity in a mathematics classroom: An exploration. In A. J. Schoenfeld & N. Pateman (Eds.), A study of teaching: Multiple lenses, multiple views: Journal for research in mathematics education, MONOGRAPH #14 (pp. 127–172). Reston: NCTM.

    Google Scholar 

  • Praetorius, A. K., Pauli, C., Reusser, K., Rakoczy, K., & Klieme, E. (2014). One lesson is all you need? Stability of instructional quality across lessons. Learning and Instruction, 31, 2–12. https://doi.org/10.1016/j.learninstruc.2013.12.002.

    Article  Google Scholar 

  • Sammons, P., Lindorff, A. M., Ortega, L., & Kington, A. (2016). Inspiring teaching: Learning from exemplary practitioners. Journal of Professional Capital and Community, 1(2), 124–144. https://doi.org/10.1108/JPCC-09-2015-0005.

    Article  Google Scholar 

  • Sawada, D., Piburn, M. D., Judson, E., Turley, J., Falconer, K., Benford, R., & Bloom, I. (2002). Measuring reform practices in science and mathematics classrooms: The reformed teaching observation protocol. School Science and Mathematics, 102(6), 245–253. https://doi.org/10.1111/j.1949-8594.2002.tb17883.

    Article  Google Scholar 

  • Schaffer, E., Muijs, D., Reynolds, D., & Kitson, K. (1998). The mathematics enhancement classroom observation recording system, MECORS). Newcastle: University of Newcastle, School of Education.

    Google Scholar 

  • Schlesinger, L., & Jentsch, A. (2016). Theoretical and methodological challenges in measuring instructional quality in mathematics education using classroom observations. ZDM Mathematics Education, 48(1–2), 29–40. https://doi.org/10.1007/s11858-016-0765-0.

    Article  Google Scholar 

  • Schlesinger, L., Jentsch, A., Kaiser, G., König, J., & Blömeke, S. (2018). Subject-specific characteristics of instructional quality in mathematics education. ZDM Mathematics Education, 50(3). (this issue).

  • Schoenfeld, A. H. (2008). On modeling teachers’ in-the-moment decision making. In A. J. Schoenfeld & N. Pateman (Eds.), A study of teaching: Multiple lenses, multiple views: Journal for research in mathematics education, monograph #14 (pp. 45–96). Reston, VA: NCTM.

    Google Scholar 

  • Schoenfeld, A. H. (2013). Classroom observations in theory and practice. ZDM—The International Journal on Mathematics Education, 45(4), 607–621. https://doi.org/10.1007/s11858-012-0483-1.

    Article  Google Scholar 

  • Schoenfeld, A. J., & Pateman, N. (2008). (Eds.). A study of teaching: Multiple lenses, multiple views: Journal for research in mathematics education. Monograph #14. Reston: NCTM.

    Google Scholar 

  • Smith, M. S., & Stein, M. K. (2011). 5 practices for orchestrating productive mathematics discussions. Reston: NCTM.

    Google Scholar 

  • Strong, M. (2011). The highly qualified teacher: What is teacher quality and how do we measure it? New York: Teachers College Press.

    Google Scholar 

  • Teddlie, C., Creemers, B. M. P., Kyriakides, L., Muijs, D., & Fen, Y. (2006). The international system for teacher observation and feedback: Evolution of an international study of teacher effectiveness constructs. Educational Research and Evaluation, 12(6), 561–582. https://doi.org/10.1080/13803610600874067.

    Article  Google Scholar 

  • Thompson, C. J., & Davis, S. B. (2014). Classroom observation data and instruction in primary mathematics education: Improving design and rigour. Mathematics Education Research Journal, 26(2), 301–323. https://doi.org/10.1007/s13394-013-0099-y.

    Article  Google Scholar 

  • Tsamir, P., Tirosh, D., Tabach, M., & Levenson, E. (2010). Multiple solution methods and multiple outcomes—is it a task for kindergarten children? Educational Studies in Mathematics, 73(3), 217–231. https://doi.org/10.1007/s10649-009-9215-z.

    Article  Google Scholar 

  • Van de Grift, W. (2007). Quality of teaching in four European countries: A review of the literature and application of an assessment instrument. Educational Research, 49(2), 127–152. https://doi.org/10.1080/00131880701369651.

    Article  Google Scholar 

  • Walkowiak, T. A., Berry, R. Q., Meyer, J. P., Rimm-Kaufman, S. E., & Ottmar, E. R. (2014). Introducing an observational measure of standards-based mathematics teaching practices: Evidence of validity and score reliability. Educational Studies in Mathematics, 85(1), 109–128. https://doi.org/10.1007/s10649-013-9499-x.

    Article  Google Scholar 

  • Wragg, E. C. (2012). An introduction to classroom observation. NY: Routledge.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Education, University of Cyprus, Theophanides Building, Rm 508, 11-13 Dramas Str., 1077, Nicosia, Cyprus

    Charalambos Y. Charalambous

  2. Department of Education, University of Zurich, Freiestrasse 36, 8032, Zurich, Switzerland

    Anna-Katharina Praetorius

Authors
  1. Charalambos Y. Charalambous
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anna-Katharina Praetorius
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Charalambos Y. Charalambous.

Appendix A

Appendix A

Our literature search was based on the search engines Scopus, Web of Science, and Google Scholar, using the following search terms:

  • Classroom observation AND mathematics.

  • Multiple observation instruments AND mathematics.

  • Multiple observation instruments AND mathematics instruction.

  • Multiple lenses for classroom observations.

  • Multiple lenses for lesson observations.

  • Multiple lenses for observations.

  • Different lenses to capture teaching AND mathematics.

  • Generic teaching practices AND mathematics.

  • Content specific teaching practices AND mathematics.

  • Integrat* generic and content-specific practices.

  • Teacher observations AND mathematics.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Charalambous, C.Y., Praetorius, AK. Studying mathematics instruction through different lenses: setting the ground for understanding instructional quality more comprehensively. ZDM Mathematics Education 50, 355–366 (2018). https://doi.org/10.1007/s11858-018-0914-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11858-018-0914-8

Keywords

  • Content-specific dimensions
  • Generic dimensions
  • Instructional quality
  • Mathematics instruction
  • Observation
  • Teaching quality