Abstract
I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.
Similar content being viewed by others
References
R. Florian, Universităţile din România şi clasamentul Shanghai [Romanian universities and the Shanghai ranking; in Romanian]. Ad Astra 5, 2006, http://www.ad-astra.ro/journal/8/florian_shanghai_romania.pdf
http://ed.sjtu.edu.cn/rank/2005/ARWU2005Methodology.htm; another document presenting a slightly different methodology is also linked from the ranking homepage and is available at http://ed.sjtu.edu.cn/rank/file/ARWU-M&P.pdf, but this latter one presents the methodology of the 2004 ranking, not of concern to us.
Van Raan, A. F. J., Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1) (2005) 133–143.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Florian, R.V. Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics 72, 25–32 (2007). https://doi.org/10.1007/s11192-007-1712-1
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-007-1712-1