Skip to main content

Irreproducibility of the results of the Shanghai academic ranking of world universities

Abstract

I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.

This is a preview of subscription content, access via your institution.

References

  1. http://ed.sjtu.edu.cn/rank/2005/ARWU2005Main.htm

  2. R. Florian, Universităţile din România şi clasamentul Shanghai [Romanian universities and the Shanghai ranking; in Romanian]. Ad Astra 5, 2006, http://www.ad-astra.ro/journal/8/florian_shanghai_romania.pdf

  3. http://ed.sjtu.edu.cn/rank/2005/ARWU2005Methodology.htm; another document presenting a slightly different methodology is also linked from the ranking homepage and is available at http://ed.sjtu.edu.cn/rank/file/ARWU-M&P.pdf, but this latter one presents the methodology of the 2004 ranking, not of concern to us.

  4. http://ed.sjtu.edu.cn/rank/2005/ARWU2005.xls

  5. http://rai.ijs.si/mezi/iassatena/shanghai-relative.html

  6. http://scientific.thomson.com/mjl

  7. http://www.ucop.edu/ucophome/uwnews/stat

  8. Van Raan, A. F. J., Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1) (2005) 133–143.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Răzvan V. Florian.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Florian, R.V. Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics 72, 25–32 (2007). https://doi.org/10.1007/s11192-007-1712-1

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-007-1712-1

Keywords

  • Academic Staff
  • Social Science Citation Index
  • Article Type
  • Size Indicator
  • Author Affiliation