Abstract
In this paper we present characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators, as well as with the results of peer review judgment. We use the results of a large evaluation study of 147 university chemistry research groups in the Netherlands covering the work of about 700 senior researchers during the period 1991–2000. Thus, we deal with research groups rather than individual scientists, as we consider the research group as the most important work floor unit in research, particularly in the natural sciences. Furthermore, we restrict the citation period to a three-year window instead of ‘life time counts’ in order to focus on the impact of recent work and thus on current research performance. Results show that the h-index and our bibliometric ‘crown indicator’ both relate in a quite comparable way with peer judgments. But for smaller groups in fields with ‘less heavy citation traffic’ the crown indicator appears to be a more appropriate measure of research performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ball, P. (2005), Index aims for fair ranking of scientists. Nature, 436: 900.
Batista, P. D., M. G. Campiteli, O. Kinouchi, A. S. Martinez (2005), Is it possible to compare researchers with different scientific interests? ArXiv.physics/0509048, accessible via http://arxiv.org/abs/physics/0509048
Bornmann, L., H.-D. Daniel (2005), Does the h-index for ranking of scientists really work? Scientometrics, 65(3): 391–392.
Braun, T., W. Glänzel, A. Schubert (2005), A Hirsch-type index for journals. The Scientist, 19 (22): 8.
Hirsch, J. E. (2005), An index to quantify an individual’s scientific research output, Proceedings of the National Academy of Sciences of the United States of America, 102(46): 16569–16572. (also available at: arXiv:physics/0508025, accessible via http://arxiv.org/abs/physics/0508025).
Moed, H. F. (2005), Citation Aanalysis in Research Evaluation. Dordrecht: Springer. Nature (2005), Rating games (Editorial), Nature, 436: 889-890.
Popov, S. B. (2005), A parameter to quantify dynamics of a researcher’s scientific activity. ArXiv:physics/0508113, accessible via http://arxiv.org/abs/physics/0508113
Van Leeuwen, T. N., M. S. Visser, H. F. Moed, A. J. Nederhof (2002), The third bibliometric study on chemistry research associated with the council for chemical sciences of the Netherlands Organization for Scientific Research (NWO-CW) 1991–2000. Report CWTS 2002-01. Leiden: CWTS.
Van Raan, A. F. J. (1996), Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises. Scientometrics, 36: 397–420.
Van Raan, A. F. J. (2004), Measuring science. Capita selecta of current main issues. In: H. F. Moed, W. Glänzel, U. Schmoch (Eds), Handbook of Quantitative Science and Technology Research. Dordrecht: Kluwer Academic Publishers, pp. 19–50.
Van Raan, A. F. J. (2005), Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1): 133–143.
Van Raan, A. F. J. (2006), Statistical properties of bibliometric indicators: Research group indicator distributions and correlations. Journal of the American Society for Information Science and Technology (JASIST) 57(3): 408–430.
VSNU (2002). Chemistry and Chemical Engineering. VSNU Series ‘Assessment of Research Quality’. Utrecht: VSNU (ISBN 90 5588 4979).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
van Raan, A.F.J. Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics 67, 491–502 (2006). https://doi.org/10.1556/Scient.67.2006.3.10
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1556/Scient.67.2006.3.10