Skip to main content
SpringerLink
Log in

Internationale Hochschulrankings

Ein methodenkritischer Vergleich

International University Rankings

A Critical Review of the Methodology

  • Schwerpunkt
  • Published:
Zeitschrift für Erziehungswissenschaft Aims and scope Submit manuscript

Zusammenfassung

Trotz ihrer umstrittenen Validität, Zuverlässigkeit und Wirkung, werden internationale Universitätsrankings immer häufiger von Studierenden und Universitäten als Informationsquellen genutzt. Dieser Artikel vergleicht drei internationale Hochschulrankings und analysiert, basierend auf der wissenschaftlichen Literatur, inwiefern sie relevante Aspekte von Forschung oder Lehre erheben und diese adäquat und verlässlich messen. Untersucht wurden das Academic Ranking of World Universities (ARWU Ranking), das World University Ranking und das vom deutschen Centrum für Hochschulentwicklung (CHE) entwickelte Excellence Ranking für Master- und Doktorandenprogramme. Die Analyse basiert auf den Publikationen der Herausgeber der Rankings und auf wissenschaftlichen Artikeln über diese internationalen Rankings. Basierend auf der Analyse werden Schlussfolgerungen für die Gestaltung internationaler Rankings abgeleitet und weiterführende Forschungsfragen formuliert.

Abstract

Despite disagreement about their validity, reliability and effects, international rankings of universities have become widely used by students and higher education institutions. This article compares three international rankings of universities and analyzes, based on the academic literature, the extent to which they assess relevant aspects of teaching and research and whether these aspects are measured adequately. We study the Academic Ranking of World Universities published by Shanghai Jiao Tong University, the World University Ranking published by the British magazine Times Higher Education Supplement and the Excellence Ranking published by the German Centre for Higher Education Development (CHE). The analysis is based on the academic literature about these international rankings and the publications by the rankings’ publishers. We draw conclusions about the design of rankings and develop further research questions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Notes

  1. Die Literaturdatenbank Web of Knowledge von Thomson Reuters umfasst unter anderem die Datenbanken Web of Science, Journal Citation Reports und Highly Cited Researchers.

Literatur

  • ACE 2008 = American Council on Education (2008): ACE Urges Caution Moving Forward with Proposed OECD International Student Learning Outcomes Proposal. URL: http://www.acenet.edu (Download: 22.09.2008).

  • Aguillo, I. F/Ortega, J. L./Fernández, M. (2008): Webometric ranking of world universities: Introduction, methodology, and future developments. In: Higher Education in Europe, Vol. 33(2/3), pp. 233–244.

    Article  Google Scholar 

  • Altbach, P. G. (2006): The dilemmas of rankings. In: International Higher Education, No. 42, pp. 1–2.

    Google Scholar 

  • Berghoff, S. /Brandenburg, U./Müller-Böling, D. (2008): Identifying the best: The CHE excellence ranking of European graduate programmes in the natural sciences and mathematics. In: Higher Education in Europe, Vol. 33(2/3), pp. 273–283.

    Article  Google Scholar 

  • Bornmann, L./Daniel, H. D. (2008): What do citation counts measure? A review of studies on citing behavior. In: Journal of Documentation, Vol. 64(1), pp. 45–80.

    Article  Google Scholar 

  • Braun, T./Szabadi-Peresztegi, Z./Kovács-Németh, É. (2003): No-bells for ambiguous lists of ranked Nobelists as science indicators of national merit in physics, chemistry and medicine, 1901-2001. In: Scientometrics, Vol. 56(1), pp. 3–28.

    Article  Google Scholar 

  • Braun et al. 2007 = Braun, T./Dióspatonyi, I./Zádor, E./Zsindely, S. (2007): Journal gatekeepers indicator based top universities of the world, of Europe and of 29 countries. A pilot study. In: Scientometrics, Vol. 71(2), pp. 155–178.

  • CHE 2007 = Center for Higher Education Development (2007): CHE Excellence Ranking. Indentifying the Best: The CHE Ranking of Excellent European Graduate Programmes in the Natural Sciences and Mathematics. – Gütersloh.

  • CHE/UNESCO/IHEP (2006): Berlin Principles on Ranking of Higher Education Institutions. URL: http://www.che.de/downloads/Berlin_Principles_IREG_534.pdf (Download: 22.09.2008).

  • CWTS (2007): The Leiden Ranking. URL: http://www.cwts.nl/cwts/LeidenRankingWebSite.html (Download: 22.09.2008).

  • Cybermetrics Lab (2007): Webometrics Ranking of World Universities. URL: http://www.webometrics.info/ (Download: 22.09.2008).

  • Daniel, H. D. (2001): Was bewirken Hochschul-Rankings? Wer orientiert sich an ihnen? In: Müller-Böling, D./Hornbostel. S./Berghoff, S. (Hrsg.): Hochschulranking. Aussagekraft, Methoden, Probleme. – Gütersloh, S. 121–124.

  • Dill, D./Soo, M. (2005): Academic quality, league tables, and public policy: A cross-national analysis of university rankings. In: Higher Education, Vol. 49, pp. 495–533.

    Article  Google Scholar 

  • Ehrenberg, R. G. (2002): Reaching for the brass ring: The U.S. News & World Report rankings and competition. In: The Review of Higher Education, Vol. 26(2), pp. 145–162.

    Article  Google Scholar 

  • Espeland, W. N./Sauder, M. (2007): Ranking and Reactivity: How Public Measures Recreate Social Worlds. In: American Journal of Sociology, Vol. 113(1), pp. 1–40.

    Article  Google Scholar 

  • European Commission (2004): Mapping of Excellence in Economics. Office for Official Publications of the European Commission. – Luxembourg.

  • Financial Times (2008): Financial Times Global MBA Ranking. URL: http://rankings.ft.com/global-mba-rankings (Download 22.09.2008).

  • Florian, R. V. (2007): Irreproducibility of the results of the Shanghai academic ranking of world universities. In: Scientometrics, Vol. 72(1), pp. 25–32.

    Article  Google Scholar 

  • Guarino et al. 2005 = Guarino, C./Ridgeway, G./Chun, M./Buddin, R. (2005): Latent variable analysis: A new approach to university ranking. In: Higher Education in Europe, Vol. 30(2), pp. 147–165.

  • Hattendorf Westney, L. C. (2006): Educational Rankings Annual 2006: Over 4600 Rankings and Lists on Education, Compiled from Educational and General Interest Published Sources. – Gale Cengage.

  • Hazelkorn, E. (2007): The Impact of League Tables and Ranking Systems on Higher Education Decision-Making. In: Higher Education Management and Policy, Vol. 19(2), pp. 81–05.

    Article  Google Scholar 

  • HEFCE (2008): Counting What is Measured or Measuring What Counts? League Tables and Their Impact on Higher Education in England. Report to HEFCE by CHERI, Open University and Hobsons Research. Issues Paper 2008/14. – London.

  • Holmes, R. (2006): The THES university rankings: Are they really world class? In: Asian Journal of University Education, Vol. 1, pp. 1–14.

    Google Scholar 

  • Jobbins, D. (2005): Moving to a global stage: a media view. In: Higher Education in Europe, Vol. 20(2), pp. 137–145.

    Article  Google Scholar 

  • Liu, N. C./Cheng, Y. (2005a): The academic ranking of world universities. In: Higher Education in Europe, Vol. 30(2), pp. 217–228.

    Article  Google Scholar 

  • Liu, N. C./Cheng, Y. (2005b): Academic ranking of world universities using scientometrics: A comment to the “Fatal Attraction”. In: Scientometrics, Vol. 64(1), pp. 101–109.

    Article  Google Scholar 

  • Marginson, S. (2007): Global university rankings: Implications in general and for Australia. In: Journal of Higher Education Policy and Management. Vol. 29(2), pp. 131–142.

    Article  Google Scholar 

  • Marginson, S./Van der Wende, M. (2007): To rank or to be ranked: The impact of global rankings in higher education. In: Journal of Studies in International Education, Vol. 11(3/4), pp. 306–329.

    Article  Google Scholar 

  • Marsh, H. W./Hattie, J. (2002): The relation between research productivity and teaching effectiveness: Complementary, antagonistic or independent constructs? In: Journal of Higher Education, Vol. 73(5), pp. 603–633.

    Article  Google Scholar 

  • Newsweek (2006): The world’s most global universities, 13.08.06.

  • OECD (2008): Proposed OECD Feasibility Study for the International Assessment of Higher Education Learning Outcomes (AHELO). URL: http://www.oecd.org/document/22/0,3343,fr_2649_37455_40624662_1_1_1_37455,00.html (Download: 22.09.2008).

  • Shadish, W. R./Cook, T. D./Campell, D. T. (2002): Experimental and Quasi-Experimental Designs for Generalized Causal Inference. – Boston.

  • SJTU 2007 = Shanghai Jiao Tong University Institute of Higher Education (2007): Academic Ranking of World Universities 2007. URL: http://ed.sjtu.edu.cn/ranking.htm. (Download: 22.09.2008).

  • SJTU 2008 = Shanghai Jiao Tong University Institute of Higher Education (2008): Academic Ranking of World Universities by Broad Subject Fields 2008. URL: http://ed.sjtu.edu.cn/ARWU-FIELD2008.htm (Download: 22.09.2008).

  • Strathern, M. (Ed.) (2000): Audit Cultures: Anthropological Studies in Accountability, Ethics and the Academy. – New York.

  • Taylor, P./Braddock, R. (2007): International University Ranking Systems and the Idea of University Excellence. In: Journal of Higher Education Policy and Management. Vol. 29(3), pp. 245–260.

    Article  Google Scholar 

  • THES 2007 = Times Higher Education Supplement (2007): Guide to the World’s Top Universities. – London.

  • Thomson ISI (2008): About ISI Highly Cited. URL: http://www.isihighlycited.com (Download: 22.09.2008].

  • UNITE (2007): The Student Experience Reports. – Bristol. URL: http://www.unite-group.co.uk/Attachments/000171/Student %20Experience %20Report %202007.pdf (Download: 5.7.2008).

  • Usher, A./Savino, M. (2006): A World of Difference: A Global Survey of University League Tables. Educational Policy Institute – Toronto.

  • Van Raan, A. F. J. (2005): Fatal Attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. In: Scientometrics, Vol. 62(1), pp. 133–143.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ETH Zürich, Sozialpsychologie und Hochschulforschung, ZAE H 3, Zähringerstr. 24, CH-8092, Zürich, Schweiz

    Anna Kroth &  H. -D. Daniel

Authors
  1. Anna Kroth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. H. -D. Daniel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Anna Kroth or H. -D. Daniel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kroth, A., Daniel, HD. Internationale Hochschulrankings. ZfE 11, 542–558 (2008). https://doi.org/10.1007/s11618-008-0052-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11618-008-0052-0

Schlüsselwörter

Keywords

Search

Navigation