Scientometrics

, Volume 72, Issue 1, pp 25–32

Irreproducibility of the results of the Shanghai academic ranking of world universities

Article

Abstract

I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
    R. Florian, Universităţile din România şi clasamentul Shanghai [Romanian universities and the Shanghai ranking; in Romanian]. Ad Astra 5, 2006, http://www.ad-astra.ro/journal/8/florian_shanghai_romania.pdf
  3. 3.
    http://ed.sjtu.edu.cn/rank/2005/ARWU2005Methodology.htm; another document presenting a slightly different methodology is also linked from the ranking homepage and is available at http://ed.sjtu.edu.cn/rank/file/ARWU-M&P.pdf, but this latter one presents the methodology of the 2004 ranking, not of concern to us.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
    Van Raan, A. F. J., Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1) (2005) 133–143.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2007

Authors and Affiliations

  1. 1.Ad Astra Association of Romanian ScientistsCluj-NapocaRomania
  2. 2.Center for Cognitive and Neural Studies (Coneural)Cluj-NapocaRomania

Personalised recommendations