Large-Scale Studies in Mathematics Education pp 133-158 | Cite as

# A Randomized Trial of Lesson Study with Mathematical Resource Kits: Analysis of Impact on Teachers’ Beliefs and Learning Community

## Abstract

We report on a randomized, controlled trial of an intervention that had a significant impact on teachers’ and students’ mathematical knowledge: lesson study supported by mathematical resource kits (Lewis & Perry, under review). In lesson study, teachers engage in collaborative study-plan-act-reflect cycles centered around classroom research lessons. This report focuses on outcomes related to teachers’ beliefs and learning community, potentially important mediators of teachers’ continued effort to improve instruction. Groups of 4–9 educators (87 % elementary teachers) were randomly assigned to the intervention (lesson study with fractions resource kit) or one of two control conditions; resource kits were mailed out to groups, who locally managed their lesson study in scattered locations across the USA. HLM analyses indicate that the intervention significantly increased two of the six measures of teachers’ beliefs and teacher learning community–Expectations for Student Achievement and Collegial Learning Effectiveness. When examined as mediators of knowledge change in the overall sample, increases in Collegial Learning Effectiveness and Professional Community both significantly predicted teachers’ gain in fractions knowledge and increase in teachers’ collegial learning effectiveness significantly predicted students’ gain in fractions knowledge. Findings suggest the power of lesson study supported by mathematical resources to impact teachers’ beliefs likely to support teachers’ continued learning from practice over time. Findings also suggest the potential of scale-up strategies that couple high-quality mathematical resources with practice-based learning strategies such as lesson study, as a solution to the conundrum of faithful implementation of high-quality materials versus teacher “ownership” of professional learning.

## Keywords

Lesson study Teacher learning Professional development Fractions Mathematics learning Teachers’ beliefs Teacher community## References

- Akiba, M., Chiu, Y.-F., Zhuang, Y.-L., & Mueller, H. E. (2008). Standards-based mathematics reforms and mathematics achievement of American Indian/Alaska native eighth graders.
*Education Policy Analysis Archives, 16*(20), 1–31.Google Scholar - Beckmann, S. (2005).
*Mathematics for elementary teachers*. Boston: Pearson.Google Scholar - Birman, B. F., Boyle, A., Le Floch, K., Elledge, A., Holtzman, D., Song, M., et al. (2009).
*State and local implementation of the no child left behind act: Volume VIII–teacher quality under NCLB: Final report*. Washington, DC: U.S. Department of Education.Google Scholar - Bloom, H. S., Richburg-Hayes, L., & Black, A. R. (2007). Using covariates to improve precision for studies that randomize schools to evaluate educational interventions.
*Educational Evaluation and Policy Analysis, 29*(1), 30–59.CrossRefGoogle Scholar - Borko, H., Davinroy, K. H., Bliem, C. L., & Cumbo, K. B. (2000). Exploring and supporting teacher change: Two third-grade teachers’ experiences in a mathematics and literacy staff development project.
*The Elementary School Journal, 100*(4), 273–306.CrossRefGoogle Scholar - Britt, M. S., Irwin, K. C., & Ritchie, G. (2001). Professional conversations and professional growth.
*Journal of Mathematics Teacher Education, 4*(1), 29–53.CrossRefGoogle Scholar - California Department of Education. (2005). CST released test questions—standardized testing and reporting (STAR). From http://www.cde.ca.gov/ta/tg/sr/css05rtq.asp
- Campbell, P. F., & Malkus, N. N. (2011). The impact of elementary mathematics coaches on student achievement.
*The Elementary School Journal, 11*(3), 430–454.CrossRefGoogle Scholar - Carpenter, T. P., Fennema, E., Franke, M. L., Levi, L., & Empson, S. B. (1999).
*Children’s mathematics: Cognitively guided instruction*. Porthsmouth, NH: Hienemann.Google Scholar - Center for Research in Mathematics and Science Teacher Development. (2005). Diagnostic teacher assessment in mathematics and science, elementary mathematics, rational numbers assessment, version 1.2 and middle school mathematics, number and computation assessment, version 2. From http://louisville.edu/education/research/centers/crmstd/diag_math_assess_elem_teachers.html
- Chazan, D., Ben-Chaim, D., & Gormas, J. (1998). Shared teaching assignments in the service of mathematics reform: Situated professional development.
*Teaching and Teacher Education, 14*(7), 687–702.CrossRefGoogle Scholar - Clarke, D., & Hollingsworth, H. (2002). Elaborating a model of teacher professional growth.
*Teaching and Teacher Education, 18*(8), 947–967.CrossRefGoogle Scholar - CRC (Center for Research on the Context of Teaching). (1994).
*Survey of elementary mathematics education in California: Teacher questionnaire*. Stanford, CA: Stanford University School of Education.Google Scholar - Desimone, L. M., Smith, T. M., & Ueno, K. (2006). Are teachers who need sustained, content-focused professional development getting it? An administrator’s dilemma.
*Educational Administration Quarterly, 42*(2), 179–215.CrossRefGoogle Scholar - Fernandez, C., & Yoshida, M. (2004).
*Lesson study: A case of a Japanese approach to improving instruction through school-based teacher development*. Mahwah, NJ: Lawrence Erlbaum.Google Scholar - Fisler, J. L., & Firestone, W. A. (2006). Teacher learning in a school-university partnership: Exploring the role of social trust and teaching efficacy beliefs.
*Teachers College Record, 108*(6), 1155–1185.CrossRefGoogle Scholar - Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers.
*American Educational Research Journal, 38*(4), 304–313.CrossRefGoogle Scholar - Gersten, R., Taylor, M. J., Keys, T. D., Rolfhus, E., & Newman-Gonchar, R. (2014).
*Summary of research on the effectiveness of math professional development approaches.*(No. REL 2014-010). Washington, DC: US Department of Education, Institute of Education Sciences, National Center for Educational Evaluation and Regional Assistance, Regional Educational Laboratory Southeast.Google Scholar - Goldsmith, L. T., Doerr, H. M., & Lewis, C. C. (2014). Mathematics teachers’ learning: A conceptual framework and synthesis of research.
*Journal of Mathematics Teacher Education, 17*(1), 5–36.CrossRefGoogle Scholar - Grandau, L. (2005). Learning from self-study: Gaining knowledge about how fourth graders move from relational description to algebraic generalization.
*Harvard Educational Review, 75*(2), 202–221.Google Scholar - Hackenberg, A., Norton, A., Wilkins, J., & Steffe, L. (2009).
*Testing hypotheses about students’ operational development of fractions*. Paper presented at the NCTM Research Pre-Session.Google Scholar - Hill, H. C. (2010). The nature and predictors of elementary teachers’ mathematical knowledge for teaching.
*Journal for Research in Mathematics Education, 41*(5), 513–545.Google Scholar - Hironaka, H., & Sugiyama, Y. (2006).
*Mathematics for elementary school, grades 1-6*. Tokyo: Tokyo Shoseki. English language version available at http://www.globaledresources.com.Google Scholar - Horizon Research, Inc. (2000). 2000 National Survey of Science and Mathematics Education Mathematics Teacher Questionnaire. http://www.horizon-research.com/horizonresearchwp/wp-content/uploads/2013/04/math_teacher.pdf.
- Institute of Education Sciences/National Center for Education Statistics (IES/NCES). (2007). NAEP questions tool. Retrieved from http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx
- Kazemi, E., & Franke, M. L. (2004). Teacher learning in mathematics: Using student work to promote collective inquiry.
*Journal of Mathematics Teacher Education, 7*(3), 203–235.CrossRefGoogle Scholar - Lampert, M. (2001).
*Teaching problems and the problems of teaching*. New Haven, CT: Yale University Press.Google Scholar - Learning Mathematics for Teaching. (2007).
*Survey of teachers of mathematics, winter 2007, form LMT PR-07*. Ann Arbor, MI: University of Michigan, School of Education.Google Scholar - Lewis, C., & Hurd, J. (2011).
*Lesson study step by step: How teacher learning communities improve instruction*. Portsmouth, NH: Heinneman.Google Scholar - Lewis, C., & Perry, R. (2014). Lesson study with mathematical resources: A sustainable model for locally led teacher professional learning.
*Mathematics Teacher Education and Development, 16*(1), 22–42.Google Scholar - Lewis, C., & Perry, R. (under review).
*Scale-up of instructional improvement through lesson study.*Unpublished manuscript.Google Scholar - Lewis, C., Perry, R., & Friedkin, S. (2011). Using Japanese curriculum materials to support lesson study outside Japan: Toward coherent curriculum.
*Educational Studies in Japan: International Yearbook, 6*, 5–19.Google Scholar - Lewis, C., Perry, R., & Hurd, J. (2009). Improving mathematics instruction through lesson study: A theoretical model and North American case.
*Journal of Mathematics Teacher Education, 12*(4), 285–304.CrossRefGoogle Scholar - Lewis, C., Perry, R., & Murata, A. (2006). How should research contribute to instructional improvement? The case of lesson study.
*Educational Researcher, 35*(3), 3–14.CrossRefGoogle Scholar - Lewis, C., & Tsuchida, I. (1997). Planned educational change in Japan: The case of elementary science instruction.
*Journal of Educational Policy, 12*(5), 313–331.CrossRefGoogle Scholar - Lewis, C., & Tsuchida, I. (1998). A lesson is like a swiftly flowing river: Research lessons and the improvement of Japanese education.
*American Educator*, Winter, 14–17 & 50–52.Google Scholar - Lin, X. (2001). Reflective adaptation of a technology artifact: A case study of classroom change.
*Cognition and Instruction, 19*(4), 395–440.CrossRefGoogle Scholar - Lin, P. (2002). On enhancing teachers’ knowledge by constructing cases in the classrooms.
*Journal of Mathematics Teacher Education, 5*(4), 317–349.CrossRefGoogle Scholar - Manouchehri, A. (2001). Collegial interaction and reflective practice.
*Action in Teacher Education, 22*(4), 86–97.CrossRefGoogle Scholar - McLaughlin, M. W., & Talbert, J. E. (2001).
*Professional communities and the work of high school teaching*. University of Chicago Press.Google Scholar - McLaughlin, M. W., & Talbert, J. E. (2006).
*Building school-based teacher learning communities*. New York: Teachers College Press.Google Scholar - Michigan State University. (2003).
*Teacher learning through professional development, 2003 SVMI teacher survey*. East Lansing, MI: Michigan State University.Google Scholar - Murata, A. (2003).
*Teacher learning and lesson study: Developing efficacy through experiencing student learning.*Paper presented at the annual meeting of the School Science and Mathematics Association, Columbus, OH.Google Scholar - Newton, K. J. (2008). An extensive analysis of preservice elementary teachers’ knowledge of fractions.
*American Educational Research Journal, 45*(4), 1080–1110.CrossRefGoogle Scholar - Noffke, S., & Somekh, B. (Eds.). (2009).
*The SAGE handbook of educational action research*. London: Sage.Google Scholar - Norton, A. H., & McCloskey, A. V. (2008). Modeling students’ mathematics using Steffe’s fraction schemes.
*Teaching Children Mathematics, 15*(1), 48–54.Google Scholar - Perry, R., & Lewis, C. (2010). Building demand for research through lesson study. In C. E. Coburn & M. K. Stein (Eds.),
*Research and practice in education: Building alliances, bridging the divide*(pp. 131–145). Lanham, MD: Rowman & Littlefield.Google Scholar - Post, T. R., Harel, G., Behr, M. J., & Lesh, R. A. (1988). Intermediate teachers’ knowledge of rational number concepts. In E. Fennema (Ed.),
*Papers from the First Wisconsin Symposium for Research on Teaching and Learning Mathematics*(pp. 194–219). Madison, WI: Wisconsin Center for Education Research.Google Scholar - Puchner, L. D., & Taylor, A. R. (2006). Lesson study, collaboration and teacher efficacy: Stories from two school-based math lesson study groups.
*Teaching and Teacher Education, 22*(7), 922–934.CrossRefGoogle Scholar - Raudenbush, S., & Bryk, A. (2002).
*Hierarchical linear models: Applications and data analysis methods*. Thousand Oaks, CA: Sage.Google Scholar - Remillard, J. T., & Bryans, M. B. (2004). Teachers’ orientations toward mathematics curriculum materials: Implications for teacher learning.
*Journal for Research in Mathematics Education, 35*(5), 352–388.CrossRefGoogle Scholar - Saxe, G. B. (2007). Learning about fractions as points on a number line. In W. G. Martin, M. E. Strutchens, & P. C. Elliott (Eds.),
*The Learning of Mathematics*(Vol. 69th Yearbook, pp. 221–237). Reston, VA: The National Council of Teachers of Mathematics.Google Scholar - Schifter, D. (1998). Learning mathematics for teaching: From the teachers’ seminar to the classroom.
*Journal of Mathematics Teacher Education, 1*(1), 55–87.CrossRefGoogle Scholar - Schorr, R. Y., & Koellner-Clark, K. (2003). Using a modeling approach to analyze the ways in which teachers consider new ways to teach mathematics.
*Mathematical Thinking and Learning, 5*(2), 191–210.CrossRefGoogle Scholar - Seymour, J. R., & Lehrer, R. (2006). Tracing the evolution of pedagogical content knowledge as the development of interanimated discourses.
*The Journal of the Learning Sciences, 15*(4), 549–582.CrossRefGoogle Scholar - Sherer, J., & Spillane, J. (2011). Constancy and change in work practice in schools: The role of organizational routines.
*Teachers College Record, 113*(3), 611–657.Google Scholar - Sherin, M. G., & Han, S. Y. (2004). Teacher learning in the context of a video club.
*Teaching and Teacher Education, 20*(2), 163–183.CrossRefGoogle Scholar - Sherin, M. G., & van Es, E. A. (2009). Effects of video club participation on teachers’ professional vision.
*Journal of Teacher Education, 60*, 20–37.CrossRefGoogle Scholar - Smith, T., & Desimone, L. M. (2003). Do changes in patterns of participation in teachers’ professional development reflect the goals of standards-based reforms?
*Educational Horizons, 81*(3), 119–129.Google Scholar - Song, M., & Herman, R. (2010). Critical issues and common pitfalls in designing and conducting impact studies in education lessons learned from the what works clearinghouse (Phase I).
*Educational Evaluation and Policy Analysis, 32*(3), 351–371.CrossRefGoogle Scholar - Spillane, J. P. (2000). A fifth-grade teacher’s reconstruction of mathematics and literacy teaching: Exploring interactions among identity, learning, and subject matter.
*The Elementary School Journal, 100*(4), 307–330.CrossRefGoogle Scholar - Steinberg, R. M., Empson, S. B., & Carpenter, T. P. (2004). Inquiry into children’s mathematical thinking as a means to teacher change.
*Journal of Mathematics Teacher Education, 7*(3), 237–267.CrossRefGoogle Scholar - Stigler, J. W., & Hiebert, J. (1999).
*The teaching gap: Best ideas from the world’s teachers for improving education in the classroom*. New York: Summit Books.Google Scholar - Takahashi, A., Watanabe, T., Yoshida, M., & Wang-Iverson, P. (2005). Improving content and pedagogical knowledge through kyozaikenkyu. In P. Wang-Iverson & M. Yoshida (Eds.),
*Building our understanding of lesson study*(pp. 77–84). Philadelphia: Research for Better Schools.Google Scholar - Taylor, A. R., Anderson, S., Meyer, K., Wagner, M. K., & West, C. (2005). Lesson study: A professional development model for mathematics reform.
*Rural Educator, 26*(2), 17–22.Google Scholar - Thijs, A., & van den Berg, E. (2002). Peer coaching as part of a professional development program for science teachers in Botswana.
*International Journal of Educational Development, 22*, 55–68.CrossRefGoogle Scholar - Ticha, M., & Hospesova, A. (2006). Qualified pedagogical reflection as a way to improve mathematics education.
*Journal of Mathematics Teacher Education, 9*(2), 129–156.CrossRefGoogle Scholar - Tobin, K., & Espinet, M. (1990). Teachers as peer coaches in high school mathematics. School Science and Mathematics, 90(3), 232–244.CrossRefGoogle Scholar
- Van de Walle, J. A. (2007).
*Elementary and middle school mathematics: Teaching developmentally*(6th ed.). Boston, MA: Pearson.Google Scholar - van Es, E. A., & Sherin, M. G. (2008). Mathematics teachers’ “learning to notice” in the context of a video club.
*Teaching and Teacher Education, 24*(2), 244–276.CrossRefGoogle Scholar - Wang-Iverson, P., & Yoshida, M. (2005).
*Building our understanding of lesson study*. Philadelphia: Research for Better Schools.Google Scholar - Ward, J., & Thomas, G. (2009). From presentation on teaching scenarios. Retrieved June 1, 2009, from http://www.nzmaths.co.nz/fractions
- Zech, L. K., Gause-Vega, C. L., Bray, M. H., Secules, T., & Goldman, S. R. (2000). Content-based collaborative inquiry: A professional development model for sustaining educational reform.
*Educational Psychologist, 35*(3), 207–217.CrossRefGoogle Scholar - Zhou, Z., Peverly, S. T., & Xin, T. (2006). Knowing and teaching fractions: A cross-cultural study of American and Chinese mathematics teachers.
*Contemporary Educational Psychology, 31*(4), 438–457.CrossRefGoogle Scholar