Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups
- 856 Downloads
In this paper we present characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators, as well as with the results of peer review judgment. We use the results of a large evaluation study of 147 university chemistry research groups in the Netherlands covering the work of about 700 senior researchers during the period 1991–2000. Thus, we deal with research groups rather than individual scientists, as we consider the research group as the most important work floor unit in research, particularly in the natural sciences. Furthermore, we restrict the citation period to a three-year window instead of ‘life time counts’ in order to focus on the impact of recent work and thus on current research performance. Results show that the h-index and our bibliometric ‘crown indicator’ both relate in a quite comparable way with peer judgments. But for smaller groups in fields with ‘less heavy citation traffic’ the crown indicator appears to be a more appropriate measure of research performance.
KeywordsBibliometric Indicator Individual Scientist Article Type Citation Period Crown Indicator
Unable to display preview. Download preview PDF.
- Batista, P. D., M. G. Campiteli, O. Kinouchi, A. S. Martinez (2005), Is it possible to compare researchers with different scientific interests? ArXiv.physics/0509048, accessible via http://arxiv.org/abs/physics/0509048Google Scholar
- Braun, T., W. Glänzel, A. Schubert (2005), A Hirsch-type index for journals. The Scientist, 19 (22): 8.Google Scholar
- Hirsch, J. E. (2005), An index to quantify an individual’s scientific research output, Proceedings of the National Academy of Sciences of the United States of America, 102(46): 16569–16572. (also available at: arXiv:physics/0508025, accessible via http://arxiv.org/abs/physics/0508025).CrossRefGoogle Scholar
- Moed, H. F. (2005), Citation Aanalysis in Research Evaluation. Dordrecht: Springer. Nature (2005), Rating games (Editorial), Nature, 436: 889-890.Google Scholar
- Popov, S. B. (2005), A parameter to quantify dynamics of a researcher’s scientific activity. ArXiv:physics/0508113, accessible via http://arxiv.org/abs/physics/0508113Google Scholar
- Van Leeuwen, T. N., M. S. Visser, H. F. Moed, A. J. Nederhof (2002), The third bibliometric study on chemistry research associated with the council for chemical sciences of the Netherlands Organization for Scientific Research (NWO-CW) 1991–2000. Report CWTS 2002-01. Leiden: CWTS.Google Scholar
- Van Raan, A. F. J. (2004), Measuring science. Capita selecta of current main issues. In: H. F. Moed, W. Glänzel, U. Schmoch (Eds), Handbook of Quantitative Science and Technology Research. Dordrecht: Kluwer Academic Publishers, pp. 19–50.Google Scholar
- VSNU (2002). Chemistry and Chemical Engineering. VSNU Series ‘Assessment of Research Quality’. Utrecht: VSNU (ISBN 90 5588 4979).Google Scholar