Advertisement

Developing and assessing beginning teacher effectiveness: the potential of performance assessments

  • Linda Darling-Hammond
  • Stephen P. Newton
  • Ruth Chung Wei
Article

Abstract

The Performance Assessment for California Teachers (PACT) is an authentic tool for evaluating prospective teachers by examining their abilities to plan, teach, assess, and reflect on instruction in actual classroom practice. The PACT seeks both to measure and develop teacher effectiveness, and this study of its predictive and consequential validity provides information on how well it achieves these goals. The research finds that teacher candidates’ PACT scores are significant predictors of their later teaching effectiveness as measured by their students’ achievement gains in both English language arts (ELA) and mathematics. Several subscales of the PACT are also influential in predicting later effectiveness: These include planning, assessment, and academic language development in ELA, and assessment and reflection in mathematics. In addition, large majorities of PACT candidates report that they acquired additional knowledge and skills for teaching by virtue of completing the assessment. Candidates’ feelings that they learned from the assessment were the strongest when they also felt well-supported by their program in learning to teach and in completing the assessment process.

Keywords

Performance assessment for California teachers  Construct and consequential validity 

Notes

Acknowledgments

The research reported in this article was funded by a generous grant from the Carnegie Corporation of New York. The authors would like to thank individuals in the PACT consortium who assisted in the facilitation of the data collection process and in the research divisions of the three school districts that provided teacher and student data: Los Angeles, San Diego, and San Francisco Unified School Districts. We would also like to thank colleagues Kendyll Stansbury and Ray Pecheone, who assisted in securing and organizing data for the analyses.

References

  1. Andrews, J. W., Blackmon, C. R., & Mackey, J. A. (1980). Preservice performance and the National Teacher Examinations. Phi Delta Kappan, 61(5), 358–359.Google Scholar
  2. Athanases, S. Z. (1994). Teachers’ reports of the effects of preparing portfolios of literacy instruction. The Elementary School Journal, 94, 421–439.CrossRefGoogle Scholar
  3. Ayers, J. B., & Qualls, G. S. (1979). Concurrent and predictive validity of the National Teacher Examinations. The Journal of Educational Research, 73(2), 86–92.Google Scholar
  4. Buday, M., & Kelly, J. (1996). National Board certification and the teaching professions commitment to quality assurance. Phi Delta Kappan, 78, 215–219.Google Scholar
  5. Cantrell, S., Fullerton, J., Kane, T. J., and Staiger., D. O. (2008). National board certification and teacher effectiveness: evidence from a random assignment experiment. NBER Working Paper 14608. Downloaded 19 May 2009 from http://www.nber.org/papers/w14608.
  6. Cavaluzzo, L. (2004). Is National Board Certification an effective signal of teacher quality? (National Science Foundation No. REC-0107014). Alexandria: The CNA Corporation.Google Scholar
  7. Chung, R. R. (2008). Beyond assessment: performance assessments in teacher education. Teacher Education Quarterly, 35(1).Google Scholar
  8. Clotfelter, C., Ladd, H., & Vigdor, J. (2006). Teacher-student matching and the assessment of teacher effectiveness (NBER working paper 11936). Cambridge: National Bureau of Economic Research.CrossRefGoogle Scholar
  9. Clotfelter, C., Ladd, H., & Vigdor, J. (2007). How and why do teacher credentials matter for student achievement? (NBER working paper 12828). Cambridge: National Bureau of Economic Research.CrossRefGoogle Scholar
  10. Darling-Hammond, L. (2010). Evaluating teacher effectiveness: how teacher performance assessments can measure and improve teaching. Washington, DC: Center for American Progress.Google Scholar
  11. Darling-Hammond, L. (2013). Getting teacher evaluation right: What really matters for effectiveness and improvement. New York: Teachers College Press.Google Scholar
  12. Goldhaber, D., & Anthony, E. (2007). Can teacher quality be effectively assessed? National Board certification as a signal of effective teaching. The Review of Economics and Statistics, 89(1), 134–150.CrossRefGoogle Scholar
  13. Haney, W., Madaus, G., & Kreitzer, A. (1987). Charms talismanic: testing teachers for the improvement of American education. In E. Z. Rothkopf (Ed.), Review of research in education, 14 (pp. 169–238). Washington, DC: American Educational Research Association.Google Scholar
  14. Harris, D., and Sass, T.R. (2007). The effects of NBPTS-certified teachers on student achievement. Downloaded 10 October, 2010 from http://www.nbpts.org/userfiles/file/harris_sass_final_2007.pdf.
  15. Lustick, D., & Sykes, G. (2006). National Board Certification as professional development: what are teachers learning? Education Policy Analysis Archives, 14(5). Retrieved June 10, 2008, from http://epaa.asu.edu/epaa/v14n5/
  16. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education/Macmillan.Google Scholar
  17. Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Research, 23(2), 13–23.Google Scholar
  18. Mitchell, K. J., Robinson, D. Z., Plake, B. S., & Knowles, K. T. (Eds.). (2001). Testing teacher candidates: the role of licensure tests in improving teacher quality. Washington, DC: National Academy.Google Scholar
  19. National Board for Professional Teaching Standards (NBPTS). (2001). “I am a better teacher:” What candidates for National Board certification say about the assessment process. Arlington: NBPTS.Google Scholar
  20. Newton, S. P. (2010). Predictive validity of the performance assessment for California teachers. Stanford: Stanford Center for Opportunity Policy in Education. Retrieved from http://scale.stanford.edu/
  21. Pecheone, R. L., & Chung, R. R. (2006). Evidence in teacher education: the performance assessment for California teachers. Journal of Teacher, 57(1), 22–36.CrossRefGoogle Scholar
  22. Pecheone, R., & Chung, R. (2007). Technical report of the Performance Assessment for California Teachers (PACT): summary of validity and reliability studies for the 2003–04 pilot year. Stanford: Stanford University.Google Scholar
  23. Peck, C., Galluci, C., & Sloan, T. (2010). Negotiating implementation of high-stakes performance assessment policies in teacher education: from compliance to inquiry. Journal of Teacher Education, 61(5), 451–463.CrossRefGoogle Scholar
  24. Peck, C. & McDonald, M., (2010, January). Creatingcultures of evidencein teacher education: context, policy and practice in three high data use programs. Report submitted to the Agency for Education DevelopmentGoogle Scholar
  25. Sanders, W. L., Ashton, J. J., & Wright, S. P. (2005). Comparison of the effects of NBPTS [National Board for Professional Teaching Standards] certified teachers with other teachers on the rate of student academic progress]. Arlington: National Board for Professional Teaching Standards. Downloaded 19 May 2009 from: http://www.nbpts.org/UserFiles/File/SAS_final_NBPTS_report_D_-_Sanders.pdf
  26. Sato, M., Chung Wei, R., & Darling-Hammond, L. (2008). Improving teachers’ assessment practices through professional development: the case of National Board Certification. American Educational Research Journal, 45, 669–7000.CrossRefGoogle Scholar
  27. Sloan, T., Cavazos, L., & Lippincott, A. (2007, April). A holistic approach to assessing teacher competency: Can one assessment do it all? Paper presented at the Annual Meeting of the American Educational Research Association, ChicagoGoogle Scholar
  28. Smith, T., Gordon, B., Colby, S., & Wang, J. (2005). An examination of the relationship between the depth of student learning and National Board certification status. Boone: Appalachian State University, Office for Research on Teaching.Google Scholar
  29. Tracz, S. M., Daughtry, J., Henderson-Sparks, J., Newman, C., & Sienty, S. (2005). The impact of NBPTS participation on teacher practice: learning from teacher perspectives. Educational Research Quarterly, 28(3), 35–50.Google Scholar
  30. Vandevoort, L. G., Amrein-Beardsley, A., & Berliner, D. C. (2004). National Board Certified teachers and their students' achievement. Education Policy Analysis Archives, 12(46), 1–117.Google Scholar
  31. Wilson, M., Hallam, P. J., Pecheone, R., & Moss, P. (2007). Using student achievement test scores as evidence of external validity for indicators of teacher quality: Connecticut’s Beginning Educator Support and Training program. Berkeley: Berkeley Evaluation and Research Center.Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Linda Darling-Hammond
    • 1
  • Stephen P. Newton
    • 1
  • Ruth Chung Wei
    • 1
  1. 1.Stanford UniversityStanfordUSA

Personalised recommendations