Research in Higher Education

, Volume 46, Issue 3, pp 251–276

An Approach to Measuring Cognitive Outcomes Across Higher Education Institutions

  • Stephen P. Klein
  • George Kuh
  • Marc Chun
  • Laura Hamilton
  • Richard Shavelson
Article

DOI: 10.1007/s11162-004-1640-3

Cite this article as:
Klein, S.P., Kuh, G., Chun, M. et al. Res High Educ (2005) 46: 251. doi:10.1007/s11162-004-1640-3

Abstract

Over the past decade, state legislatures have experienced increasing pressure to hold higher education accountable for student learning. This pressure stems from several sources, such as increasing costs and decreasing graduation rates. To explore the feasibility of one approach to measuring student learning that emphasizes program improvement, we administered several open-ended tests to 1365 students from 14 diverse colleges. The strong correspondence between hand and computer assigned scores indicates the tests can be administered and graded cost effectively on a large scale. The scores were highly reliable, especially when the college is the unit of analysis; they were sensitive to years in college; and they correlated highly with college GPAs. We also found evidence of “value added” in that scores were significantly higher at some schools than at others after controlling on the school’s mean SAT score. Finally, the students said the tasks were interesting and engaging.

Keywords

value addedassessmentmeasuring student outcomes

Copyright information

© Springer Science+Business Media, Inc. 2005

Authors and Affiliations

  • Stephen P. Klein
    • 1
  • George Kuh
    • 2
  • Marc Chun
    • 3
  • Laura Hamilton
    • 4
  • Richard Shavelson
    • 5
  1. 1.The RAND CorporationSanta MonicaUSA.
  2. 2.Indiana University Center for Postsecondary ResearchBloomington
  3. 3.Council for Aid to EducationNew York City
  4. 4.The RAND CorporationPittsburgh
  5. 5.Graduate School of Education and Department of PsychologyStanford UniversityStanford