Abstract
Classroom observation research and research on teacher expertise are similar in their reliance on observational data with high-inference procedure to assess the quality of instruction. Expertise research usually uses low-inference measures like eye tracking to identify qualitative difference between expert and novice behaviors and cognition. In this study, we used mobile eye-tracking technology to create a low inference quality indicator for the comparison of experienced and student teachers. The distribution of visual fixations on students was measured using Gini coefficients based on the observation of van den Bogert, van Bruggen, Kostons, and Jochems (Teacher and Teacher Education, 37, 208–216, 2014) that expert teachers show better classroom monitoring. Results confirm that student teachers have a higher Gini coefficient than experienced teachers indicating weaker classroom monitoring. However, the Gini coefficient did not correlate in the predicted way with trained observer coding of video footage of the same classrooms using the Classroom Assessment Scoring System (CLASS) (Pianta, Hamre, Haynes, Mintz, & La Paro, 2007) although the mean differences in behavioral management were higher for the experienced teachers as expected. The CLASS dimension Quality of Feedback was significantly related to the Gini coefficient as an interaction with expertise: Only for novice teachers that a high quality of feedback was negatively associated with monitoring of the classroom.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aiken, L. S. & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
Allen, J. P., Pianta, R. C., Gregory, A., Mikami, A. Y. & Lun, J. (2011). An interaction-based approach to enhancing secondary school instruction and student achievement. Science, 333, 1034–1037.
Ben-Chaim, D. & Zoller, U. (2001). Self-perception versus students’ perception of teachers’ personal style in college science and mathematics courses. Research in Science Education, 31(3), 437–454. doi:10.1023/A:1013172329170.
Berliner, D. C. (2001). Learning about and learning from expert teachers. International Journal of Educational Research, 35, 463–482.
Blömeke, S., Felbrich, A., Müller, C., Kaiser, G. & Lehmann, R. (2008). Effectiveness of teacher education. ZDM Mathematics Education, 40, 719–734.
Borko, H. & Livingston, C. (1989). Cognition and improvisation: Differences in mathematics instruction by expert and novice teachers. American Educational Research Journal, 26, 473–498.
Brophy, J. E & Good, T. L. (1969). Teacher–child dyadic interaction: A manual for coding classroom behavior. Report Series No. 27. Retrieved from ERIC database. (ED042688)
Brophy, J. E. & Good, T. L. (1974). Teacher-student relationships: Causes and consequences. New York, NY: Holt, Rinehart and Winston.
Brophy, J. E. & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). New York, NY: MacMillan.
Bromme, R. (2001). Teacher expertise. In N. J. Smelser, P. B. Baltes & F. E. Weinert (Eds.), International encyclopedia of the behavioral sciences: Education (pp. 15459–15465). London, England: Pergamon.
Bromme, R. & Dobslaw, G. (2003). Teachers’ instructional quality and their explanation of students’ understanding. In M. Kompf & P. Denicolo (Eds.), Teacher thinking twenty years on: Revisiting persisting problems and advances in education (pp. 25–36). Liss, NL: Swets & Zeitlinger.
Campbell, R. J., Kyriakides, L., Muijs, R. D. & Robinson, W. (2003). Differential teacher effectiveness: Towards a model for research and teacher appraisal. Oxford Review of Education, 29, 347–362.
Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K. & Pianta, R. B. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73(5), 757–783. doi:10.1177/0013164413486987.
Curby, T. W., Rimm-Kaufman, S. E. & Abry, T. (2013). Do emotional support and classroom organization earlier in the year set the stage of higher quality instruction? Journal of School Psychology, 51, 557–569.
Doyle, W. (1983). Academic work. Review of Educational Research, 53, 159–199.
Duchowski, A. T. (2007). Eye tracking methodology: Theory and practice. London, England: Springer.
Ericsson, K. A. (2006). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. Cambridge, UK: Cambridge University Press.
Flanders, N. A. (1970). Analyzing teaching behavior. Reading, MA: Addison-Wesley.
Fraser, B. J. (1991). Two decades of classroom environment research. In B. J. Fraser & H. J. Walberg (Eds.), Educational environments: Evaluation, antecedents and consequences (pp. 3–27). Elmsford, NY: Pergamon Press.
Gegenfurtner, A., Lehtinen, E. & Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23, 523–552.
Hafen, C. A., Allen, J. P., Mikami, A. Y., Gregory, A., Hamre, B. & Pianta, R. C. (2012). The pivotal role of adolescent autonomy in secondary school classrooms. Journal of Youth and Adolescence, 41, 245–255.
Hill, H. C., Rowan, B. & Ball, D. B. (2005). Effect of teachers’ mathematical knowledge for teaching on student achievement. Americal Educational Research Journal, 42, 371-406. Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20, 146–154.
Kunter, M. & Baumert, J. (2006). Who is the expert? Construct and criteria validity of student and teacher ratings of instruction. Learning Environments Research, 9, 231–251.
Miller, K. F. & Zhou, X. (2007). Learning from classroom video: What makes it compelling and what makes it hard. In R. Goldman, R. Pea, B. Barron & S. J. Derry (Eds.), Video research in the learning sciences (pp. 321–334). Mahwah, NJ: Lawrence Erlbaum.
Miller, K. F. & Correa, C. (2010, June). Attention in the classroom. Teacher eye movements as an index of situation awareness. Poster presented at the 5. IES research conference, National Harbor, MD.
Muijs, D. & Reynolds, D. (2001). Effective teaching: Evidence and practice. London, England: Sage.
Pianta, R. C., Hamre, B. K., Haynes, N. J., Mintz, S. L. & La Paro, K. M. (2007). Classroom assessment scoring system manual, middle/secondary version. Charlottesville, VA: University of Virginia.
Pianta, R. C., La Paro, K. M. & Hamre, B. K. (2008). Classroom assessment scoring system, manual, K–3. Baltimore, MD: Brookes.
Polikoff, M. S. & Porter, A. C. (2014). Instructional alignment as a measure of teaching quality. Educational Evaluation and Policy Analysis. Advance online publication. doi:10.3102/0162373714531851.
Sabers, D. S., Cushing, K. S. & Berliner, D. C. (1991). Differences among teachers in a task characterized by simultaneity, multidimensionality, and immediacy. American Educational Research Journal, 28(1), 63–88.
Sadler, T. D. (2006). “I won’t last three weeks”: Preservice science teachers reflect on their student-teaching experiences. Journal of Science Teacher Education, 17(3), 217–241.
Seidel, T. & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77, 454–499.
Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15, 4-14.
van Gog, T., Kester, L., Nievelstein, F., Giesbers, B. & Paas, F. (2009). Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction. Computers in Human Behavior, 25, 325–331.
van den Bogert, N., van Bruggen, J., Kostons, D. & Jochems, W. (2014). First steps into understanding teachers’ visual perception of classroom events. Teacher and Teacher Education, 37, 208–216.
Wang, Z., Miller, K. F., & Cortina, K. S. (2013). Using the LENA in teacher training: promoting student involvement through automated feedback. Unterrichtswissenschaft, 41, 290-305.
Yamamoto, T. & Imai-Matsumura, K. (2012). Teachers’ gaze and awareness of students’ behavior: Using an eye tracker. Innovative Teaching, 2. Retrieved from http://www.amsciepub.com/doi/full/10.2466/01.IT.2.6.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cortina, K.S., Miller, K.F., McKenzie, R. et al. Where Low and High Inference Data Converge: Validation of CLASS Assessment of Mathematics Instruction Using Mobile Eye Tracking with Expert and Novice Teachers. Int J of Sci and Math Educ 13, 389–403 (2015). https://doi.org/10.1007/s10763-014-9610-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10763-014-9610-5