Classroom observation and mathematics education research
- 156 Downloads
Classroom observations have become an integral part of research related to mathematics education. In this qualitative study, we describe the current state of the mathematics education field with regard to the use of classroom observation. The research question was: How is classroom observation being used to measure instructional quality in mathematics education research? In all, 114 peer-reviewed manuscripts published between 2000 and 2015 that involved classroom observation as part of an empirical study were examined using a cross-comparative methodology. Seventy (61%) did not use a formalized classroom observation protocol (COP), 21 (18%) developed their own COP, and 23 (20%) used a previously developed COP. Of the implemented COPs, 44% have published validity evidence in a peer-reviewed journal. We perceive the great variety of research approaches for classroom observation as necessary and potentially challenging in moving mathematics education forward with respect to research on instructional contexts.
KeywordsClassroom observation Instruction Qualitative Validity
We would like to share our sincere appreciation to Timothy Folger, Maria Nielsen, and Davis Gerber at Bowling Green State University, and Dan Chibnall at Drake University for their assistance throughout this project.
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
- American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational and Psychological Testing (US). (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
- Berry, III, R. Q., Rimm-Kaufman, S. E., Ottmar, E. M., Walkowiak, T. A., & Merritt, E. (2010). The Mathematics Scan (M-Scan): A measure of mathematics instructional quality. Unpublished measure, University of Virginia.Google Scholar
- Blank, R. K., Porter, A., & Smithson, J. (2001). New tools for analyzing teaching, curriculum and standards in Mathematics & Science. Results from Survey of Enacted Curriculum Project. Final Report. Council of Chief State School Officers, Attn: Publications, One Massachusetts Avenue, NW, Suite 700, Washington, DC 20001-1431.Google Scholar
- Bostic, J. (2018). Improving test development reporting practices. In L. Venenciano & A. Sanogo (Eds.), Proceedings of the 45th Annual Meeting of the Research Council on Mathematics Learning (pp. 57–64). Baton Rouge, LA.Google Scholar
- Bostic, J., Lesseig, K., Sherman, M., & Boston, M. (2017). Classroom observation protocols: Choose your own tool. Research report presented at the National Council of Teachers of Mathematics Research Conference, San Antonio, TX.Google Scholar
- Boston, M. D., & Smith, M. S. (2009). Transforming secondary mathematics teaching: Increasing the cognitive demands of instructional tasks used in teachers’ classrooms. Journal for Research in Mathematics Education, 40, 119–156.Google Scholar
- Briars, D. J., & Resnick, L. B. (2000). Standards, assessments… and what else? The essential elements of standards-based school improvement. Center for the Study of Evaluation, National Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education & Information Studies, University of California, Los Angeles.Google Scholar
- Brigham Young University Department of Mathematics Education. (2008). Report on venue study. Retrieved from https://nctm.confex.com/nctm/…/BYU%20Study%20for%20Journal%20Rankings.pdf.
- Danielson, C. (2013). The framework for teaching: Evaluation instrument. Princeton, NJ: Danielson Group.Google Scholar
- Donovan, M. S., & Bransford, J. D. (2005). How students learn: History, mathematics, and science in the classroom. Committee on How People Learn: A Targeted Report for Teachers National Research Council. Washington, DC: National Academies Press.Google Scholar
- Franke, M., Kazemi, E., & Battey, D. (2007). Understanding teaching and classroom practice in mathematics. In F. Lester Jr. (Ed.), Second handbook of research on mathematics teaching and learning (pp. 225–256). Charlotte, NC: Information Age Publishing.Google Scholar
- Good, T., & Brophy, J. (1994). Looking in classrooms (6th ed., pp. 209–262). New York: Harper Collins College Publishers.Google Scholar
- Hill, H., & Shih, J. (2009). Examining the quality of statistical mathematics education research. Journal of Research in Mathematics Education, 40(3), 241–250.Google Scholar
- Jackson, K., Garrison, A., Wilson, J., Gibbons, L., & Shahan, E. (2013). Exploring relationships between setting up complex tasks and opportunities to learn in concluding whole-class discussions in middle-grades mathematics instruction. Journal for Research in Mathematics Education, 44(4), 646–682.CrossRefGoogle Scholar
- Kane, M. T. (2006). Valildation. In R. L. Brennan, National Council on Measurement in Education, & American Council on Education (Eds.), Educational measurement. Westport, CT: Praeger Publishers.Google Scholar
- Kane, M. T. (2016). Validation strategies: Delineating and validating proposed interpretations and uses of test scores. In S. Lane, M. Raymond, & T. M. Haladyna (Eds.), Handbook of test development (Vol. 2nd). New York, NY: Routledge.Google Scholar
- Kane, T. J. & Staiger, D. O. (2012). Gathering Feedback for Teaching: Combining high-quality observations with student surveys and achievement gains. Research paper. MET Project. Bill and Melinda Gates Foundation.Google Scholar
- Kersting, N. B., Sutton, T., Kalinec-Craig, C., Stoehr, K. J., Heshmati, S., Lozano, G., et al. (2016). Further exploration of the classroom video analysis (CVA) instrument as a measure of usable knowledge for teaching mathematics: Taking a knowledge system perspective. ZDM Mathematics Education, 48(1–2), 97–109.CrossRefGoogle Scholar
- Khan, S., & VanWynsberghe, R. (2008). Cultivating the under-mined: Cross-case analysis as knowledge mobilization. Forum: Qualitative Social Research, 9, 1–21.Google Scholar
- Le, V., Lockwood, J. R., Stecher, B. M., Hamilton, L. S., & Martinez, J. F. (2009). A longitudinal investigation of the relationship between teachers’ self-reports of reform-oriented instruction and mathematics and science achievement. Educational Evaluation and Policy Analysis, 31, 200–220.CrossRefGoogle Scholar
- Lubienski, S. T. (2008). On” gap gazing” in mathematics education: The need for gaps analyses. Journal for Research in Mathematics Education, 39, 350–356.Google Scholar
- McCaffrey, D. F., Hamilton, L. S., Stecher, B. M., Klein, S. P., Bugliari, D., & Robyn, A. (2001). Interactions among instructional, practices, curriculum, and student achievement: The case of Standards-based high school mathematics. Journal for Research in Mathematics Education, 32, 493–517.CrossRefGoogle Scholar
- National Council of Teachers of Mathematics. (2014). Principles to actions: Ensuring mathematical success for all. Reston, VA: Author.Google Scholar
- Ross, S. M., Smith, L. J., & Alberg, M. (1998). The school observation measure (SOM VC). Memphis: Center for Research in Educational Policy, The University of Memphis.Google Scholar
- Tarr, J. E., Reys, R. E., Reys, B. J., Chavez, O., Shih, J., & Osterlind, S. (2008). The impact of middle grades mathematics curricula on student achievement and the classroom learning environment. Journal for Research in Mathematics Education, 39, 247–280.Google Scholar
- Toerner, G., & Arzarello, F. (2012). Grading mathematics education research journals. Newletter of the European Mathematical Society, 86, 52–54.Google Scholar
- U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2012, February). High School Math intervention report: I CAN Learn ®. Retrieved from http://whatworks.ed.gov.
- U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2013, January). High School Mathematics intervention report: Carnegie Learning Curricula and Cognitive Tutor ®. Retrieved from http://whatworks.ed.gov.
- Valli, L., & Croninger, R. (2002). High quality teaching of foundational skills in mathematics and reading (# 0115389). Washington: National Science Foundation Interdisciplinary Educational Research Initiative.Google Scholar
- Walkington, C., Arora, P., Ihorn, S., Gordon, J., Walker, M., Abraham, L., & Marder, M. (2012). Development of the UTeach observation protocol: A classroom observation instrument to evaluate mathematics and science teachers from the UTeach preparation program. Unpublished paper. Southern Methodist University.Google Scholar
- Wasserman, N., & Walkington, C. (2014). Exploring links between beginning UTeachers’ beliefs and observed classroom practices. Teacher Education & Practice, 27(2/3), 376–401.Google Scholar