Irreproducibility of the results of the Shanghai academic ranking of world universities
I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.
Unable to display preview. Download preview PDF.
- 2.R. Florian, Universităţile din România şi clasamentul Shanghai [Romanian universities and the Shanghai ranking; in Romanian]. Ad Astra 5, 2006, http://www.ad-astra.ro/journal/8/florian_shanghai_romania.pdf
- 3.http://ed.sjtu.edu.cn/rank/2005/ARWU2005Methodology.htm; another document presenting a slightly different methodology is also linked from the ranking homepage and is available at http://ed.sjtu.edu.cn/rank/file/ARWU-M&P.pdf, but this latter one presents the methodology of the 2004 ranking, not of concern to us.