A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ2A index
The problem of comparing academic institutions in terms of their research production is nowadays a priority issue. This paper proposes a relative bidimensional index that takes into account both the net production and the quality of it, as an attempt to provide a comprehensive and objective way to compare the research output of different institutions in a specific field, using journal contributions and citations. The proposed index is then applied, as a case study, to rank the top Spanish universities in the fields of Chemistry and Computer Science in the period ranging from 2000 until 2009. A comparison with the top 50 universities in the ARWU rankings is also made, showing the proposed ranking is better suited to distinguish among non-elite universities.
KeywordsRankings Universities Higher education Bibliometrics Shanghai ranking Bidimensional analysis Evaluation models Research performance assessment h-index
- Bornmann, L., & Daniel, H.-D. (2008). Selecting manuscripts for a high-impact journal through peer review: A citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere. Journal of the American Society for Information Science and Technology, 59(11), 1841–1852.CrossRefGoogle Scholar
- Bornmann, L., Mutz, R., & Daniel, H.-D. (2010). The h index research output measurement: Two approaches to enhance its accuracy. Journal of Informetrics, 4(3), 407–414.Google Scholar
- Dill, D. D., & Soo, M. (2005). Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems. Higher Education 49, 495–533. doi:10.1007/s10734-004-1746-8.
- Elsevier B.V. Scopus. (2010). See http://www.scopus.co. Accessed Oct 2010.
- ISI Web of Science. Science Citation Index. See http://isiknowledge.co. Accessed Oct 2010.
- Leydesdorff, L., & Opthof, T. (2010). Normalization, CWTS indicators, and the Leiden Rankings: Differences in citation behavior at the level of fields. http://www.leydesdorff.net/reply2cwts/reply2cwts.pd. Accessed Oct 2010.
- Liu, N. C., & Cheng, Y. (2005). Academic ranking of world universities: Methodologies and problems. Higher Education in Europe 30(2), 127–136.Google Scholar
- Moed, H. F. (2005). Citation analysis in research evaluation. New York: Springer.Google Scholar
- Moed, H. F. (2010). CWTS crown indicator measures citation impact of a research group’s publication oeuvre. CoRR, abs/1003.5884.Google Scholar
- QS World University Rankings. (2010). http://www.topuniversities.com/university-rankings/world-university-rankings/hom. Accessed Oct 2010.
- SCImago Institutions Rankings. (2007). http://www.scimagoir.co. Accessed Oct 2010.
- Shanghai Jiao Tong University. ( 2009). Academic ranking of world universities (ARWU). http://www.arwu.org/index.js. Accessed Oct 2010.
- Universiteit Leiden. (2010). Leiden university rankings. http://www.socialsciences.leiden.edu/cwts/products-services/leiden-ranking-2010-cwts. Accessed Oct 2010.