Higher Education

, Volume 49, Issue 4, pp 495–533 | Cite as

Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems

Article

Abstract

The global expansion of access to higher education has increased demand for information on academic quality and has led to the development of university ranking systems or league tables in many countries of the world. A recent UNESCO/CEPES conference on higher education indicators concluded that cross-national research on these ranking systems could make an important contribution to improving the international market for higher education. The comparison and analysis of national university ranking systems can help address a number of important policy questions. First, is there an emerging international consensus on the measurement of academic quality as reflected in these ranking systems? Second, what impact are the different ranking systems having on university and academic behavior in their respective countries? Finally, are there important public interests that are thus far not reflected in these rankings? If so, is there a needed and appropriate role for public policy in the development and distribution of university ranking systems and what might that role be? This paper explores these questions through a comparative analysis of university rankings in Australia, Canada, the UK, and the US.

Keywords

academic quality higher education policy league tables organizational report cards university rankings 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Astin, A.W. 1985Achieving Educational Excellence: A Critical Assessment of Priorities and Practices in Higher EducationJossey-Bass PublishersSan Francisco, LondonGoogle Scholar
  2. Astin, A.W. 1991Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher EducationAmerican Council on Education/MacmillanNew YorkGoogle Scholar
  3. Astin, A.W. 1996‘Involvement in learning revisited’Journal of College Student Development.40587597Google Scholar
  4. Becker, G.S. 1964Human CapitalColumbia University PressNew YorkGoogle Scholar
  5. Bowden, R. 2000‘Fantasy higher education: University and college league tables’Quality in Higher Education.64160CrossRefGoogle Scholar
  6. Brennan, J., Shah, T. 2000Managing Quality in Higher Education: An International Perspective on Institutional Assessment and ChangeOECD, SRHE & Open University PressBuckingham UKGoogle Scholar
  7. Brewer, D., Gates, S.M., Goldman, C.A. 2002In Pursuit of Prestige: Strategy and Competition in US Higher EducationTransaction PressNew Brunswick, NJGoogle Scholar
  8. Carrico, C.S., Hogan, S.M., Dyson, R.G., Athanassopoulos, A.D. 1997‘Data envelope analysis and university selection’The Journal of the Operational Research Society.4811631177CrossRefGoogle Scholar
  9. Clarke, M. 2002‘Some guidelines for academic quality rankings’Higher Education in Europe.27443459CrossRefGoogle Scholar
  10. Connor, H., Burton, R., Pearson, R., Pollard, E., Regan, J. 1999Making the Right Choice: How Students Choose Universities and CollegesUniversities UKLondonGoogle Scholar
  11. Department for EducationSkills, (DfES). 2003The Future of Higher EducationHMSOLondonGoogle Scholar
  12. Dill, D.D. 1999

    ‘Student learning and academic choice: The rule of coherence

    Brennan, J.Fedrowitz, J.Huber, M.Shah, T. eds. What Kind of University? International Perspectives on Knowledge, Participation and Governance.Open University Press and Society for Research into Higher EducationBuckingham5670
    Google Scholar
  13. Dill, D.D. 2000‘Designing academic audit: Lessons learned in Europe and Asia’Quality in Higher Education.6187207CrossRefGoogle Scholar
  14. Dill, D.D. 2003‘Allowing the market to rule: The case of the United States’Higher Education Quarterly.57136157CrossRefGoogle Scholar
  15. Drennan, L.T., Beck, M. 2001‘Teaching quality performance indicators – Key influences on the UK universities’ scores’Quality Assurance in Education.992102Google Scholar
  16. Eccles, C. 2002‘The use of university rankings in the United Kingdom’Higher Education in Europe.27423432CrossRefGoogle Scholar
  17. Ehrenberg, R.G. 2002‘Reaching for the brass ring: The U.S. News & World Report rankings and competition’The Review of Higher Education.26145162Google Scholar
  18. Ehrenberg, R.G. 2002Tuition Rising: Why College Costs so MuchHarvard University PressCambridgeGoogle Scholar
  19. Ehrenberg R.G. (2003). ‘Method or madness?: Inside the USNWR college rankings’, Paper presented at the Wisconsin Center for the Advancement of Postsecondary Education Forum on The Abuse of College Rankings, Madison, Wisconsin, 20–21 NovemberGoogle Scholar
  20. Ehrenberg, R.G., Hurst, P.J. 1996‘A hedonic model’Change.284651Google Scholar
  21. Gormley, W.T.,Jr., Weimer, D.L. 1999Organizational Report CardsHarvard University PressCambridge MassGoogle Scholar
  22. Graham, A., Thompson, N. 2001‘Broken ranks: US News’ college rankings measure everything but what mattersAnd most universities don’t seem to mind’. Washington Monthly.33914Google Scholar
  23. Grunig, S.G. 1997‘Research, reputation, and resources: The effect of research activity on perceptions of undergraduate education and institutional resource acquisition’Journal of Higher Education.681752Google Scholar
  24. Higher Education Division, Australia (2001). Characteristics and Performance Indicators of Australian Higher Education Institutions. Occasional Paper Series 01-B, Department of Education, Science and Training: http://www.dest.gov.au/highered/statistics/characteristics/characteristics00.pdfGoogle Scholar
  25. Higher Education Funding Council for England (HEFCE) (1999). Performance Indicators in Higher Education: First Report of the Performance Indicators Steering Group (PISG). Report 99/11, Higher Education Funding Council for England: http://www.hefce.ac.uk/pubs/hefce/1999/99%5F11.htmGoogle Scholar
  26. Higher Education Funding Council for England (HEFCE) (2003). Performance Indicators in Higher Education: 2000–2001 and 2001–2002. Report 2003/59, Higher Education Funding Council for England: http://www.hefce.ac.uk/learning/perfind/2003/default.aspGoogle Scholar
  27. Henkel, M. 2000Academic Identities and Policy Change in Higher EducationJessica KingsleyLondonGoogle Scholar
  28. Hossler, D., Braxton, J., Coopersmith, G. 1989

    ‘Understanding student college choice’

    Smart, J.C. eds. Higher Education: Handbook of Theory and Research, Vol.V.Agathon PressNew York231288
    Google Scholar
  29. Hossler, D., Litten, L.H. 1993Mapping the Higher Education LandscapeCollege Entrance Examination BoardNew YorkGoogle Scholar
  30. James, R., Baldwin, G., McInnis, C. 1999Which University? The Factors Influencing the Choices of Prospective UndergraduatesAustralian Government Publishing ServiceCanberraGoogle Scholar
  31. Koelman, J., Venniker, R. 2001

    ‘Public funding of academic research: The research assessment exercise in the UK’

    CPB., CHEPS,  eds. Higher Education Reform: Getting the Incentives Right.Sdu UitgeversDen Haag The Netherlands101117
    Google Scholar
  32. Kuh, G. 2003‘What we’re learning about student engagement from NSSE’Change.352432Google Scholar
  33. Larsen K., Martin J.P., Morris R. (2002). ‘Trade in educational services: Trends and emerging issues’. Paper Presented at the OECD Forum on Trade In Educational Services, May 23–24, Washington DCGoogle Scholar
  34. McDonough, P.M., Antonio, A.L., Perez, L.X. 1998‘College rankings: democratized college knowledge for whom?’Research in Higher Education.39513537CrossRefGoogle Scholar
  35. Manski, C.F., Wise, D.A. 1983College choice in AmericaHarvard University PressCambridge, MAGoogle Scholar
  36. Merisotis, J.P. 2002‘Summary report of the invitational roundtable on statistical indicators for the quality assessment of higher/tertiary education institutions: Ranking and league table methodologies’Higher Education in Europe.27475480CrossRefGoogle Scholar
  37. Monks, J., Ehrenberg, R.G. 1999‘U.S. News & World Report’s college rankings: Why they do matter’Change.314251Google Scholar
  38. Moogan, Y.J., Baron, S., Harris, K. 1999‘Decision-making behaviour of potential higher education students’Higher Education Quarterly.53211228CrossRefGoogle Scholar
  39. Morrison, H.G., Magennis, S.P., Carey, L.J. 1995‘Performance indicators and league tables: A call for standards’Higher Education Quarterly.49128145Google Scholar
  40. National Association of Scholars1996The Dissolution of General Education: 1914–1993National Association of ScholarsPrincetonGoogle Scholar
  41. National Opinion Research Center (1997). A Review of the Methodology for the US News and World Report’s Rankings of Undergraduate Colleges and Universities. Washington Monthly: http://www.washingtonmonthly.com/features/2000/norc.htmlGoogle Scholar
  42. Page, S. 1999‘Rankings of Canadian universities and help to students’Guidance & Counseling.141114Google Scholar
  43. Pascarella, E.T. 2001‘Identifying excellence in undergraduate education: Are we even close?’Change.331923Google Scholar
  44. Pascarella, E.T., Terenzini, P.T. 1991How College Affects Students: Findings and Insights from Twenty Years of ResearchJossey-BassSan FranciscoGoogle Scholar
  45. Pascarella, E.T., Terenzini, P.T. 1998‘Studying college students in the 21st century: Meeting new challenges’The Review of Higher Education.21151165Google Scholar
  46. Paulsen M.B. (1990). College Choice: Understanding Student Enrollment Behavior. ASHE-ERIC Higher Education Report No 6. The George Washington University, School of Education and Human Development, Washington DCGoogle Scholar
  47. Provan, D., Abercromby, K. (2000). University League Tables and Rankings: A Critical Analysis. Commonwealth Higher Education Management Service (CHEMS) Paper No. 30: htpp://www.acu.ac.uk/chems/onlinepublications/976798333.pdfGoogle Scholar
  48. Ramsden, P. 1991‘A Performance indicator of teaching quality in higher education: The course experience questionnaire’Studies in Higher Education.16129149Google Scholar
  49. Rosovsky, H., Hartley, M. 2002Evaluation and the Academy: Are We Doing the Right Thing?American Academy of Arts and SciencesCambridge MassGoogle Scholar
  50. Smith, J., McKnight, A., Naylor, R. 2000‘Graduate employability: Policy and␣performance in higher education in the UK’The Economic Journal.110382411CrossRefGoogle Scholar
  51. Stecklow S. (1995). ‘Colleges inflate SAT’s and graduation rates in popular guidebooks’, Wall Street Journal 5 AprilGoogle Scholar
  52. Terenzini, P.T., Pascarella, E.T. 1994‘Living with myths: Undergraduate education in America’Change.262832Google Scholar
  53. Thompson, N. 2000‘Playing with numbers: How US News mismeasures higher education and what we can do about it’Washington Monthly321623Google Scholar
  54. Tight, M. 2000‘Do league tables contribute to the development of a quality culture? Football and higher education compared’Higher Education Quarterly.542242CrossRefGoogle Scholar
  55. Trow M. (1999). ‘Biology at Berkeley: A case study of reorganization and its costs and benefits’, Center for Studies in Higher Education: Research and Occasional Papers Series, CSHE.1.99: htpp://ibb.berkeley.edu/cshe/Google Scholar
  56. Trow, M.A. 1983‘Organizing the biological sciences at Berkeley’Change.15284453Google Scholar
  57. Wilson, K., Lizzio, A., Ramsden, P. 1997‘The development, validation and application of the course experience questionnaire’Studies in Higher Education.22325Google Scholar
  58. Winston G.C., Zimmerman D.J. (2003). ‘Peer effects in higher education’, NBER Working Paper 9501: http://www.nber.org/papers/w9501Google Scholar
  59. Yorke, M. 1997‘A good league table guide?’Quality Assurance in Education.56172CrossRefGoogle Scholar
  60. Yorke, M. 1998‘The Times “League Table” of universities, 1997: A statistical appraisal’Quality in Education.65860CrossRefGoogle Scholar
  61. Yorke, M., Barnett, G., Bridges, P., Evanson, P., Haines, C., Jenkins, D., Knight, P., Scurry, D., Stowell, M., Woolf, H. 2002‘Does grading method influence honours degree classification?’Assessment & Evaluation in Higher Education.27269279Google Scholar
  62. Zemsky, R., Oedel, P. 1983The Structure of College ChoiceCollege Entrance Examination BoardNew YorkGoogle Scholar

Copyright information

© Springer 2005

Authors and Affiliations

  1. 1.Research Program on Public Policy for Academic Quality (PPAQ), Department of Public PolicyUniversity of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations