Advertisement

Higher Education Policy

, Volume 28, Issue 3, pp 315–332 | Cite as

Institutional Policies on Assessment of Pedagogy and Faculty Classroom Practices: Evidence from 4-Year Colleges and Universities in the United States

  • Carrie B Myers
  • Scott M Myers
  • Tammy Stewart
  • Suzette Nynas
Article
  • 105 Downloads

Abstract

This study used a multi-theoretical approach to examine the associations between institutional policies on the assessment of faculty pedagogy and faculty’s use of learner-centred assessment (LCA) practices in their undergraduate classrooms in the United States. We found strong evidence that it was not the number of methods but the types of methods used by institutions to evaluate teaching that were significantly associated with the extent to which faculty use LCA practices in their undergraduate courses. Our results returned conflicting patterns: Assessments that were conducted top-down — those by deans and department heads — were associated with a reduced rate of LCA use in classrooms, whereas assessments that relied on data from students, peers, or faculty themselves were associated with a greater rate of LCA use. Yet, most student-centric methods to evaluate teaching, including the popular use of student evaluations of teaching, were unrelated to the incorporation of effective pedagogy. The pattern of results did not vary significantly across different types of higher education institutions.

Keywords

faculty evaluation educational policy classroom techniques student-centered curriculum 

References

  1. Andrade, M.S. (2011) ‘Managing change — Engaging faculty in assessment opportunities’, Innovative Higher Education 36 (4): 217–233.CrossRefGoogle Scholar
  2. Andrews, T.M., Leonard, M.J., Colgrove, C.A. and Kalinowski, S.T. (2011) ‘Active learning not associated with student learning in a random sample of college biology courses’, CBE Life Sciences Education 10 (4): 394–405.CrossRefGoogle Scholar
  3. Armbruster, P., Patel, M., Johnson, E. and Weiss, M. (2009) ‘Active learning and student-centered pedagogy improve student attitudes and performance in introductory Biology’, CBE-Life Sciences Education 8 (3): 203–213.CrossRefGoogle Scholar
  4. Arum, R. and Roksa, J. (2010) Academically Adrift: Limited Learning on College Campuses, Chicago: University of Chicago Press.CrossRefGoogle Scholar
  5. Atkinson, D.J. and Bolt, S. (2010) ‘Using teaching observations to reflect upon and improve teaching practice in higher education’, Journal of the Scholarship of Teaching and Learning 10 (3): 1–19.Google Scholar
  6. Banta, T.W., Jones, E.A. and Black, K.E. (2009) Designing Effective Assessment: Principles and Profiles of Good Practice, San Francisco, CA: Jossey-Bass.Google Scholar
  7. Becker, W.E., Bosshardt, W. and Watts, M. (2012) ‘How departments of economics evaluate teaching’, Journal of Economic Education 43 (3): 325–333.CrossRefGoogle Scholar
  8. Bogue, E.G. and Johnson, B.D. (2010) ‘Performance incentives and public college accountability in the United States: A quarter century policy audit’, Higher Education Management and Policy 22 (2): 1–22.CrossRefGoogle Scholar
  9. Braxton, J.M. (2008) ‘Toward a Theory of Faculty Professional Choices in Teaching that Foster College Student Success’, in J.C. Smart (ed.) Higher Education: Handbook of Theory and Research, New York: Springer, pp. 181–207.CrossRefGoogle Scholar
  10. Carey, K. and Schneider, M. (2010) Accountability in Higher Education, New York: Palgrave Macmillan.CrossRefGoogle Scholar
  11. Clogg, C.C., Petkova, E. and Haritou, A. (1995) ‘Statistical methods for comparing regression coefficients between models’, American Journal of Sociology 100 (5): 1261–1293.CrossRefGoogle Scholar
  12. Cox, B.E., McIntosh, K.L., Reason, R.D. and Terenzini, P.T. (2011) ‘A culture of teaching: Policy, perception, and practice in higher education’, Research in Higher Education 52 (8): 808–829.CrossRefGoogle Scholar
  13. D’Andrea, V. and Gosling, D. (2005) Improving Teaching and Learning in Higher Education, New York: Open University Press.Google Scholar
  14. David, M. (2010) Effective Learning and Teaching in UK Higher Education, London: TLRP.Google Scholar
  15. Duncan, T. and Buskirk-Cohen, A.A. (2011) ‘Exploring learner-centered assessment: A cross-disciplinary approach’, International Journal of Teaching and Learning in Higher Education 23 (2): 246–259.Google Scholar
  16. Ewell, P.T. (2009) Assessment, Accountability, and Improvement: Revisiting the Tension, Champaign: National Institute for Learning Outcomes Assessment.Google Scholar
  17. Ewell, P.T., Paulson, K. and Kinzie, J. (2011) Down and Out: Assessment Practices at the Program Level, Champaign: National Institute for Learning Outcomes Assessment.Google Scholar
  18. Filetti, J., Wright, M. and King, W.M. (2010) ‘Grades and ranking: When tenure affects assessment’, Practical Assessment, Research and Evaluation 15 (14): 1–6.Google Scholar
  19. Gappa, J.M., Austin, A.E. and Trice, A.G. (2007) Rethinking Faculty Work: Higher Education’s Strategic Imperative, San Francisco: Wiley and Sons.Google Scholar
  20. Gasiewski, J.A., Eagan, M.K., Garcia, G.A., Hurtado, S. and Chang, M.J. (2012) ‘From gatekeeping to engagement: A multicontextual, mixed method study of student academic engagement in introductory STEM courses’, Research in Higher Education 53 (2): 229–261.CrossRefGoogle Scholar
  21. Graves, G.H., Sulewski, C.A., Dye, H.A., Deveans, T.M., Agras, N.M. and Pearson, M. (2009) ‘How are you doing? Effectiveness in teaching mathematics’, PRIMUS 19 (2): 174–193.CrossRefGoogle Scholar
  22. Guba, E.G. and Lincoln, Y.S. (1989) Fourth Generation Evaluation, Newbury Park: Sage Publications.Google Scholar
  23. Haak, D.C., HilleRisLambers, J., Pitre, E. and Freeman, S. (2011) ‘Increased structure and active learning reduce the achievement gap in introductory biology’, Science 332 (6034): 1213–1216.CrossRefGoogle Scholar
  24. Hesli, V.L. and Lee, J.M. (2011) ‘Faculty research productivity: Why do some of our colleagues publish more than others?’, PS: Political Science and Politics 44 (2): 393–408.Google Scholar
  25. Hu, S. and McCormick, A.C. (2012) ‘An engagement-based student typology and its relationship to college outcomes’, Research in Higher Education 53 (7): 738–754.CrossRefGoogle Scholar
  26. Hutchings, P. (2010) Opening Doors to Faculty Involvement in Assessment, Champaign: National Institute for Learning Outcomes Assessment.Google Scholar
  27. Jaquette, O. (2013) ‘Why do colleges become universities? Mission drift and the enrollment economy’, Research in Higher Education 54 (5): 514–563.CrossRefGoogle Scholar
  28. Kezar, A. (2014) How Colleges Change: Understanding, Leading, and Enacting Change, New York: Routledge.Google Scholar
  29. Kuh, G.D. (2008) High-Impact Educational Practices: What They Are, Who Has Access to Them, and Why They Matter, Washington DC: Association of American Colleges and Universities.Google Scholar
  30. Kuh, G. and Ikenberry, S. (2009) More Than You Think, Less Than We Need: Learning Outcomes Assessment in American Higher Education, Champaign: National Institute for Learning Outcomes Assessment.Google Scholar
  31. Langbein, L. (2008) ‘Management by results: Student evaluation of faculty teaching and the mis-measurement of performance’, Economics of Education Review 27 (4): 417–428.CrossRefGoogle Scholar
  32. Light, G., Calkins, S., Luna, M. and Drane, M. (2009) ‘Assessing the impact of a year-long faculty development program on faculty approaches to teaching’, International Journal of Teaching and Learning in Higher Education 20 (2): 168–181.Google Scholar
  33. Lyons, N., Halton, C. and Freidus, H. (2013) ‘Reflective inquiry as transformative self-study for professional education and learning’, Studying Teacher Education 9 (2): 163–174.CrossRefGoogle Scholar
  34. Luke, D.A. (2004) Multilevel Modeling, Thousand Oaks: Sage.CrossRefGoogle Scholar
  35. Nelson Laird, T.F., Garver, A.K. and Niskode-Dossett, A.S. (2011) ‘Gender gaps in collegiate teaching style: Variations by course characteristics’, Research in Higher Education 52 (3): 261–277.CrossRefGoogle Scholar
  36. OECD (2012) Fostering Quality Teaching in Higher Education: Policies and Practices, Paris: OECD Publishing.Google Scholar
  37. Papadimitriou, A. (2011) ‘Reforms, leadership, and quality management in Greek higher education’, Tertiary Education and Management 17 (4): 355–372.CrossRefGoogle Scholar
  38. Prince, M. (2004) ‘Does active learning work: A review of the research’, Journal of Engineering Education 93 (3): 223–231.CrossRefGoogle Scholar
  39. Read, W.J., Rama, D.V. and Raghunandan, K. (2001) ‘The relationship between student evaluations of teaching and faculty evaluations’, Journal of Education for Business 76 (4): 189–192.CrossRefGoogle Scholar
  40. Reindl, T. and Reyna, R. (2011) From Information to Action: Revamping Higher Education Accountability Systems, Washington DC: National Governors Association.Google Scholar
  41. Rothgeb, J.M. and Burger, B. (2009) ‘Tenure standards in political science departments: Results from a survey of department chairs’, PS: Political Science and Policy 42 (3): 513–519.Google Scholar
  42. Sawyer, K.R., Johnson, J. and Holub, M. (2009) ‘Decline in academe’, International Journal for Educational Integrity 5 (2): 10–28.Google Scholar
  43. Seldin, P. Associates. (eds.) (2006) Evaluating Faculty Performance: A Practical Guide to Assessing Teaching, Research, and Service, Boston: Anker.Google Scholar
  44. Schmitt, E.M., Hu, A.C. and Bachrach, P.S. (2008) ‘Course evaluation and assessment: Examples of a learner-centered approach’, Gerontology and Geriatrics Education 29 (3): 290–300.CrossRefGoogle Scholar
  45. Suskie, L. (2009) Assessing Student Learning: A Common Sense Guide, San Francisco: Jossey-Bass.Google Scholar
  46. Toth, K.E. and McKey, C.A. (2010) ‘Identifying the potential organizational impact of an educational peer review program’, International Journal for Academic Development 15 (1): 73–83.CrossRefGoogle Scholar
  47. Umbach, P.D. (2007) ‘Faculty Cultures and College Teaching’, in R.P. Perry and J.C. Smart (eds.) The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective, New York: Springer, pp. 263–317.CrossRefGoogle Scholar
  48. US Department of Education (2006) A Test of Leadership: Charting the Future of U.S. Higher Education, Washington DC: US Department of Education.Google Scholar
  49. Wainwright, S. (2009) ‘Using self-assessment to assess the effectiveness of learner centered instructional design and delivery’, The Journal of Faculty Development 23 (3): 23–29.Google Scholar
  50. Wolverton, M., Ackerman, R. and Holt, S. (2005) ‘Preparing for leadership: What academic department chairs need to know’, Journal of Higher Education Policy and Management 27 (2): 227–238.CrossRefGoogle Scholar

Copyright information

© International Association of Universities 2014

Authors and Affiliations

  • Carrie B Myers
    • 1
  • Scott M Myers
    • 2
  • Tammy Stewart
    • 1
  • Suzette Nynas
    • 3
  1. 1.Department of EducationAdult & Higher Education Program, Montana State UniversityBozemanUSA
  2. 2.Department of SociologyMontana State UniversityBozemanUSA
  3. 3.Montana State University-BillingsBillingsUSA

Personalised recommendations