Investigating the “black box” of effective teaching: the relationship between teachers’ perception and student achievement in a large urban district

  • Marco A. Muñoz
  • Julie R. Scoskie
  • Diana L. French
Article

Abstract

Given the international need to improve student learning, there is nothing more important than classroom teachers. Obtaining a deeper understanding of effective classrooms is a priority if educational reform efforts are to succeed in any educational system around the world. In the last decade, educational researchers have expanded the knowledge base about the impact of teachers, but far less is known about what effective teachers do that make such a positive difference. This investigation focuses on the relationship between attributes of effective teaching, as perceived by both more and less effective teachers, and fourth grade reading achievement results of their students. This investigation used value-added modeling methods as the first step for identifying the more and less effective fourth grade teachers (N = 261) and their students (N = 6,962). Survey research methods were used to compare the perceptions about characteristics of effective teaching for teachers previously identified—in the value-added model—as (a) more effective and (b) less effective. Findings indicated that the more effective teachers value classroom management and organization as the number one characteristic of effective teaching; that, in turn, enables the more effective teachers to focus classroom time on student learning. Implications for theory and practice are discussed.

Keywords

Teacher effectiveness Teacher quality Value-added assessment Classroom management Instructional practices Student achievement 

References

  1. American Recovery and Reinvestment Act (2009). Race to the top program executive summary. Retrieved from www.ed.gov/recovery.
  2. Ballou, D., Sanders, W., & Wright, P. (2004). Controlling for student background in value-added assessments for teachers. Journal of Educational and Behavioral Statistics, 29(1), 37–65.CrossRefGoogle Scholar
  3. Bembry, K., & Schumacker, R. (2002). Establishing the utility of a classroom effectiveness index as a teacher accountability measure. Journal for Effective Schools, 1(1), 61–79.Google Scholar
  4. Berends, M. (2000). Teacher reported effects of new American school designs: exploring relationships to teacher background and school context. Educational Evaluation and Policy Analysis, 22(1), 65–82.CrossRefGoogle Scholar
  5. Berliner, D. C. (2005). The near impossibility of testing teacher quality. Journal of Teacher Education, 56, 205–231. doi:10.11770022487105275904.CrossRefGoogle Scholar
  6. Blum, R. W. (2005). A case for school connectedness. Educational Leadership, 62(7), 16–20.Google Scholar
  7. Borman, G., & Dowling, M. (2010). Schools and inequality: a multilevel analysis of Coleman’s equality of educational opportunity data. Teachers College Record, 112(5), 1201–1246.Google Scholar
  8. Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed.). New York, NY: Macmillan.Google Scholar
  9. Burchinal, M. R., Peisner-Feinberg, E., Pianta, R., & Howes, C. (2002). Development of academic skills from pre-school through second grade: family and classroom predictors of developmental trajectories. Journal of School Psychology, 40, 415–436. doi:10.1016/S0022-4405(02)00107-3.CrossRefGoogle Scholar
  10. Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., et al. (1966). Equality of educational opportunity. Washington, DC: Government Printing Office.Google Scholar
  11. Cotton, K. (2001). Expectations and student outcomes. Retrieved from http://www.nwrel.org/scpd/sirs/4/cu7.html.
  12. Danielson, C. (2007). Enhancing professional practice: a framework for teaching (2nd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  13. Darling-Hammond, L. (2000). Teacher quality and student achievement: a review of state policy evidence. Education Policy Analysis Archives, 8(1), 1–44.Google Scholar
  14. Desimone, L. M., Porter, A. C., Garet, M. S., Yoon, K. S., & Birman, B. F. (2002). Effects of professional development on teachers’ instruction: results from a three-year longitudinal study. Educational Evaluation and Policy Analysis, 24(2), 81–112.CrossRefGoogle Scholar
  15. Early, D. M., Maxwell, K. L., Burchinal, M., Bender, R. H., Ebanks, C., Henry, G. T., et al. (2007). Teachers’ education, classroom quality, and young children’s academic skills: results from seven studies of preschool programs. Child Development, 78(2), 558–580.CrossRefGoogle Scholar
  16. Ellett, C. D., & Teddlie, C. (2003). Teacher evaluation, teacher effectiveness and school effectiveness: perspectives from the USA. Journal of Personnel Evaluation in Education, 17(1), 101–128.CrossRefGoogle Scholar
  17. Emmer, E. T., Evertson, C. M., & Worsham, M. E. (2003). Classroom management for secondary teachers. Boston, MA: Allyn & Bacon.Google Scholar
  18. Ferguson, R. F. (2012). Can student surveys measure teaching quality? Phi Delta Kappan, 94(3), 24–28.Google Scholar
  19. Geithman, B. W. (2009). Examining principal perceptions, and teacher and school effectiveness through a value-added accountability model (Doctoral dissertation). Retrieved from ProQuest database. (UMI No. 3355255).Google Scholar
  20. Goe, L. (2007). The link between teacher quality and student outcomes: a research synthesis. Retrieved from http://secc.sedl.org/orc/resources/LinkBetweenTQandStudentOutcomes.pdf.
  21. Good, T. L., & Brophy, J. E. (1997). Looking in classrooms (7th ed.). New York, NY: Addison-Wesley.Google Scholar
  22. Hamre, B. K., & Pianta, R. C. (2005). Can instruction and emotional support in the first-grade classroom make a difference for children at risk of school failure? Child Development, 76(5), 949–967.CrossRefGoogle Scholar
  23. Hanushek, E., & Lindseth, A. (2009). Schoolhouses, courthouses, and statehouses: solving the funding-achievement puzzle in America’s public schools. Princeton, NJ: Princeton University Press.Google Scholar
  24. Hanushek, E., & Rivkin, S. G. (2012). The distribution of teacher quality and implications for policy. Annual Review of Economics, 4, 131–157.CrossRefGoogle Scholar
  25. Hattie, J. (2003). Teachers make a difference: what is the research evidence? Retrieved from http://www.aiceonline.com/Resources/RC2003_HattieTeachersMakeA-Difference.pdf.
  26. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research. doi:10.3102/003465430298487.Google Scholar
  27. Hinkle, D. E., Wiersma, W., & Jurs, S. G. (2003). Applied statistics for the behavioral sciences (5th ed.). Boston, MA: Houghton Mifflin Company.Google Scholar
  28. Jensen, E., Dabney, M., Markowitz, K., & Selsor, K. (2006). Environments for learning. Cheltenham:VIC: Hawker Brownlow Education.Google Scholar
  29. Kentucky Department of Education (2008). Kentucky core content test. Retrieved from www.education.ky.gov.
  30. Kupermintz, H. (2003). Teacher effects and teacher effectiveness: a validity investigation of the Tennessee value added assessment system. Educational Evaluation and Policy Analysis, 25(3), 287–298.CrossRefGoogle Scholar
  31. Kyriakides, L., Demetriou, D., & Charalambous, C. (2006). Generating criteria for evaluating teachers through teacher effectiveness research. Educational Research, 48(1), 1–20.CrossRefGoogle Scholar
  32. Lee, V. E. (2000). Using hierarchical linear modeling to study social contexts: the case of school effects. Educational Psychologist, 35(2), 125–141.CrossRefGoogle Scholar
  33. Leonard, L. J. (2001). From indignation to indifference: teacher concerns about externally imposed classroom interruptions. The Journal of Educational Research, 95(2), 103–109.CrossRefGoogle Scholar
  34. Lumpkin, A. (2007). Caring teachers: the key to student learning. Kappa Delta Pi Record, 43(4), 158–160.CrossRefGoogle Scholar
  35. Marsh, H. W., Hau, K., & Kong, C. (2002). Multilevel causal ordering of academic self-concept and achievement: influence of language of instruction (English compared with Chinese) for Hong Kong students. American Educational Research Journal, 39(3), 727–763.CrossRefGoogle Scholar
  36. Marshall, K. (2009). Rethinking teacher supervision and evaluation: how to work smart, build collaboration, and close the achievement gap. San Francisco, CA: Jossey-Bass.Google Scholar
  37. Marzano, R. J. (2003). What works in schools. Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  38. Marzano, R. J. (2007). The art and science of teaching: a comprehensive framework for effective instruction. Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  39. Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50, 370–396.CrossRefGoogle Scholar
  40. Muñoz, M. A. (2005). Black box. Encyclopedia of evaluation. Thousand Oaks, CA: Sage.Google Scholar
  41. Muñoz, M. A., & Chang, F. C. (2007). The elusive relationship between teacher characteristics and student academic growth: a longitudinal multilevel model for change. Journal of Personnel Evaluation in Education, 20, 147–164. doi:10.1007/s11092_008_9054-y.CrossRefGoogle Scholar
  42. Muñoz, M. A., & Dossett, D. (2001). Equity and excellence: the effect of school and socio-demographic variables on student achievement. Journal of School Leadership, 11, 120–134.Google Scholar
  43. Muñoz, M. A., & Vanderhaar, J. E. (2006). Literacy-embedded character education in a large urban district: effects of the child development project on elementary school students and teachers. Journal of Research in Character Education, 4(1&2), 27–44.Google Scholar
  44. Muñoz, M. A., Prather, J. R., & Stronge, J. H. (2011). Exploring teacher effectiveness using hierarchical linear models: student- and classroom-level predictors and cross-year stability in elementary school reading. Planning and Changing, 42(3–4), 241–273.Google Scholar
  45. Nettles, S. M., Mucherah, W., & Jones, D. (2000). Understanding resilience: the role of social resources. Journal of Education for Students Placed at Risk, 5(1&2), 47–60.CrossRefGoogle Scholar
  46. Noddings, N. (2001). Care and coercion in school reform. Journal of Educational Change, 2(1), 35–43. doi:10.1023/A:1011514928048.CrossRefGoogle Scholar
  47. Noddings, N. (2006). Educational leaders as caring leaders. School Leadership and Management, 26(4), 339–345.CrossRefGoogle Scholar
  48. Nye, B., Konstantopoulos, S., & Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26(3), 237–257. doi:10.3102/01623737026003237.CrossRefGoogle Scholar
  49. Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: applications and data analysis methods. Thousand Oaks, CA: Sage.Google Scholar
  50. Rivkin, S. G., Hanushek, E., & Kain, J. (2005). Teachers, schools, and academic achievement. Econometrica, 417–458.Google Scholar
  51. Rockoff, J. E., Jacob, B. A., Kane, T. J., & Staiger, D. O. (2008). Can you recognize an effective teacher when you recruit one? Cambridge, MA: National Bureau of Economic Research.CrossRefGoogle Scholar
  52. Rowan, B., Correnti, R., & Miller, R. J. (2002). What large-scale, survey research tells us about teacher effects on student achievement: insights from the prospects study elementary schools. Teacher College Record, 104(8), 1525–1567.CrossRefGoogle Scholar
  53. Sanders, W. L., & Rivers, J. C. (1996). Cumulative and residual effects of teachers on future student academic achievement. Knoxville, TN: University of Tennessee Value-Added Research and Assessment Center.Google Scholar
  54. Stiggins, R. (2004). New assessment beliefs for a new school mission. Phi Delta Kappan, 80(2), 22–28.Google Scholar
  55. Stronge, J. H. (2007). Qualities of effective teachers (2nd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  56. Stronge, J. H. (2010). Effective teachers = student achievement: what the research says. Larchmont, NY: Eye On Education.Google Scholar
  57. Stronge, J. H., Ward, T. J., Tucker, P. D., & Hindman, J. L. (2008). What is the relationship between teacher quality and student achievement? An exploratory study. Journal of Personnel Evaluation in Education, 20(3–4), 165–184. doi:10.1007/s11092-008-9053-2.Google Scholar
  58. Stronge, J. H., Ward, T. J., & Grant, L. W. (2011). What makes good teachers good? A cross-case analysis of the connections between teacher effectiveness and student achievement. Journal of Teacher Education, 62(4), 339–355. doi:10.1777/0022487111404241.CrossRefGoogle Scholar
  59. Teddlie, C., & Liu, S. (2008). Examining teacher effectiveness with differentially effective primary schools in the People’s Republic of China. School Effectiveness and School Improvement, 19(4), 387–407.CrossRefGoogle Scholar
  60. Teddlie, C., & Reynolds, D. (2005). Contemporary issues in school effectiveness research, with emphasis on applications (Part one). Educational Administration Research, 5, 22–33.Google Scholar
  61. Trochim, W. M., & Donnelly, J. P. (2008). The research methods knowledge base (3rd ed.). Mason, OH: Atomic Dog/Cengage Learning.Google Scholar
  62. Webster, W., & Mendro, R. (1997). The Dallas value-added accountability system. In J. Millman (Ed.), Grading teachers, grading schools. Is student achievement a valid evaluation measure? (pp. 81–99). Thousand Oaks, CA: Corwin.Google Scholar
  63. Wenglinsky, H. (2000). How teaching matters: bringing the classroom back into the discussion of teacher quality. Princeton, NJ: Educational Testing Service.Google Scholar
  64. Wilkins, J. L. M., & Ma, X. (2002). Predicting student growth in mathematical content knowledge. The Journal of Educational Research, 95(5), 288–292.CrossRefGoogle Scholar
  65. Williams, R. E. (2010). Administrator and teacher perceptions of the qualities of effective teachers (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3438556).Google Scholar
  66. Willms, J. D. (2010). School composition and contextual effects on student outcomes. Teachers College Record, 112(4), 1008–1037.Google Scholar
  67. Zins, J. E., Weissberg, R. P., Wang, M. C., & Walberg, H. J. (2004). Building academic success on social and emotional learning: what does the research say? New York, NY: Teachers College Press.Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Marco A. Muñoz
    • 1
  • Julie R. Scoskie
    • 1
  • Diana L. French
    • 1
  1. 1.Data Management, Planning, and Program Evaluation Services DivisionJefferson County Public SchoolsLouisvilleUSA

Personalised recommendations