Scientometrics

, Volume 101, Issue 2, pp 1309–1324 | Cite as

An insight into the importance of national university rankings in an international context: the case of the I-UGR rankings of Spanish universities

  • Nicolás Robinson-García
  • Daniel Torres-Salinas
  • Emilio Delgado López-Cózar
  • Francisco Herrera
Article

Abstract

The great importance international rankings have achieved in the research policy arena warns against many threats consequence of the flaws and shortcomings these tools present. One of them has to do with the inability to accurately represent national university systems as their original purpose is only to rank world-class universities. Another one has to do with the lack of representativeness of universities’ disciplinary profiles as they usually provide a unique table. Although some rankings offer a great coverage and others offer league tables by fields, no international ranking does both. In order to surpass such limitation from a research policy viewpoint, this paper analyzes the possibility of using national rankings in order to complement international rankings. For this, we analyze the Spanish university system as a study case presenting the I-UGR Rankings for Spanish universities by fields and subfields. Then, we compare their results with those obtained by the Shanghai Ranking, the QS Ranking, the Leiden Ranking and the NTU Ranking, as they all have basic common grounds which allow such comparison. We conclude that it is advisable to use national rankings in order to complement international rankings, however we observe that this must be done with certain caution as they differ on the methodology employed as well as on the construction of the fields.

Keywords

Universities Spain International rankings National rankings Research evaluation 

References

  1. Abramo, G., Cicero, T., & D’Angelo, C. A. (2011). The Dangers of performance -based research funding in non-competitive higher education systems. Scientometrics, 87(3), 641–654.CrossRefGoogle Scholar
  2. Aguillo, I., Bar-Ilan, J., Levene, M., & Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243–256.CrossRefGoogle Scholar
  3. Bornmann, L., Mutz, R., & Daniel, H.-D. (2013). Multilevel-statistical reformulation of citation-based university rankings: The Leiden ranking 2011/2012. Journal of the American Society for Information Science and Technology, 64(8), 1649–1658.CrossRefGoogle Scholar
  4. Cabezas-Clavijo, Á., Robinson-García, N., Escabias, M., & Jiménez-Contreras, E. (2013). Reviewers’ ratings and bibliometric indicators: Hand in hand when assessing over research proposals? PLoS ONE, 8(6), e68258.CrossRefGoogle Scholar
  5. Collini, S. (2011). What are universities for?. London, UK: Penguin Books.Google Scholar
  6. Delgado López-Cózar, E. (2012). Cómo se cocinan los rankings universitarios. Dendra médica. Revista de Humanidades, 11(1), 43–58.Google Scholar
  7. Docampo, D. (2011). On the use of the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1), 77–92.CrossRefGoogle Scholar
  8. García, J. A., Rodríguez-Sánchez, R., Fdez-Valdivia, J., Robinson-García, N., & Torres-Salinas, D. (2012). Mapping institutions according to their journal publication profile: Spanish universities as a case study. Journal of the American Society for Information Science and Technology, 63(11), 2328–2340.CrossRefGoogle Scholar
  9. Hazelkorn, E. (2011). Rankings and the reshaping of higher education: The battle for world-class excellence. Houndmills, UK: Palgrave MacMillan.CrossRefGoogle Scholar
  10. Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences USA, 102(46), 16569–16572.CrossRefGoogle Scholar
  11. Leydesdorff, L., & Rafols, I. (2009). A global map of science based on the ISI subject categories. Journal of the American Society for Information Science and Technology, 63(11), 2239–2253.CrossRefGoogle Scholar
  12. Liu, N. C., & Cheng, Y. (2005). The academic ranking of world universities. Higher Education in Europe, 30(2), 127–136.CrossRefGoogle Scholar
  13. Marginson, S., & van der Wende, M. (2007). To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education, 11(3–4), 306–329.CrossRefGoogle Scholar
  14. Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer.Google Scholar
  15. Moed, H. F., Moya-Anegón, F., López-Illescas, C., & Visser, M. (2011). Is concentration of university research associated with better research performance? Journal of Informetrics, 5(4), 649–658.CrossRefGoogle Scholar
  16. Orduña-Malea, E. (2012). Propuesta de un modelo de análisis redinformétrico multinivel para el estudio sistémico de las universidades [Doctoral Thesis]. Valencia, Spain: Universidad Politécnica de Valencia.Google Scholar
  17. Rafols, I., Ciarli, T., van Zwanenberg, P. & Stirling, A. (2012). Towards indicators ‘opening up’ science and technology policy. In E. Archaumbault & V. Larivière (eds.), Proceedings of 17th International Conference on Science and Technology Indicators, 675–682.Google Scholar
  18. Shin, J. C., & Toutkoushian, R. K. (2011). The past, present, and future of university rankings. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University rankings: Theoretical basis, methodology and impacts on global higher education (pp. 1–18). Dordrecht, Netherlands: Springer.CrossRefGoogle Scholar
  19. Torres-Salinas, D., Delgado López-Cózar, E., Moreno-Torres, J. G., & Herrera, F. (2011a). Rankings ISI de las universidades españolas según campos científicos: descripción y resultados. ElProfesional de la Información, 20(1), 111–118.CrossRefGoogle Scholar
  20. Torres-Salinas, D., Moreno-Torres, J. G., Delgado López-Cózar, E., & Herrera, F. (2011b). A methodology for institution-field ranking based on a bidimensional analysis: The IFQ2A index. Scientometrics, 88(3), 771–786.CrossRefGoogle Scholar
  21. Torres-Salinas, D., Moreno-Torres, J. G., Robinson-García, N., Delgado López-Cózar, E., & Herrera, F. (2011c). Rankings ISI de las Universidades Españolas según Campos y Disciplinas Científicas (2ª ed. 2011). El Profesional de la Información, 20(6), 701–709.CrossRefGoogle Scholar
  22. Toutkoushian, R. K., & Webber, K. (2011). Measuring the research performance of postsecondary institutions. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University ranking: Theoretical basis, methodology and impacts on global higher education (pp. 123–144). Dordrecht, Netherlands: Springer.CrossRefGoogle Scholar
  23. Usher, A., & Savino, M. (2007). A global survey of university rankings and league tables. Higher Education in Europe, 32(1), 5–15.CrossRefGoogle Scholar
  24. Van Raan, A. F. J. (2005). Fatal attraction: conceptual and methodological problems in the ranking of universities in the global scientific communication system. Scientometrics, 62(1), 133–143.CrossRefGoogle Scholar
  25. Visser, M. S., Calero-Medina, C. M. &Moed, H. F. (2007). Beyond Rankings: The Role of Large Research Universities in the Global Scientific Communication System. In D. Torres-Salinas & H.F. Moed, Proceedings of 11th Conference of the International Society for Scientometrics and Informetrics (pp. 761–765). Madrid, Spain: CINDOC-CSIC.Google Scholar
  26. Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J., van Eck, N. J., et al. (2012). The Leiden ranking 2011/2012: Data collection, indicators and interpretation. Journal of the American Society for Information Science and Technology, 63(12), 2419–2432.CrossRefGoogle Scholar

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2014

Authors and Affiliations

  • Nicolás Robinson-García
    • 1
  • Daniel Torres-Salinas
    • 2
  • Emilio Delgado López-Cózar
    • 1
  • Francisco Herrera
    • 3
  1. 1.EC3: Evaluación de la Ciencia y de la Comunicación Científica, Departamento de Biblioteconomía y DocumentaciónUniversidad de GranadaGranadaSpain
  2. 2.EC3: Evaluación de la Ciencia y de la Comunicación Científica, Centro de Investigación Biomédica AplicadaUniversidad de NavarraNavarraSpain
  3. 3.Department of Computer Science and Artificial IntelligenceUniversidad de GranadaGranadaSpain

Personalised recommendations