Scientometrics

, Volume 27, Issue 2, pp 157–178 | Cite as

Research performance indicators for university departments: A study of an agricultural university

  • A. J. Nederhof
  • R. F. Meijer
  • H. F. Moed
  • A. F. J. van Raan
Article

Abstract

The present bibliometric study extends previous work by focusing on the research performance of departments in the natural and life sciences, the social and behavioral sciences, and the humanities. The present study covers all 70 departments from one agricultural university, and several veterinary departments of a second university. The impact analysis was extended by including other types of documents than journal articles. For about a third of the departments, publications not covered in citation indexes accounted for at least 30% of the citations to their total oeuvre. To deal with different citation and publication habits in the various fields, both short-term and medium-term impact assessments were made. The commonly used three year window is not universally applicable, as our results show. The inclusion of self-citations forms an important source of error in the ratio of actual/expected impact. To cope with this, the trend and level of self-citations was compared at university level with that in a matched sample of publications. Moreover, at a departmental level, self-citation rates were used to detect departments with divergent levels of self-citation. The expected impact of journals accounted for only 18% of the variance in actual impact. Comparison of bibliometric indicators with two peer evaluations showed that the bibliometric impact analyses provided important additional information.

Keywords

Impact Assessment Research Performance Journal Article Citation Index Behavioral Science 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Davis, P., G. F. Papanek, Faculty ratings of major economic departments by citations,American Economic Review, 74 (1984) 225–230.Google Scholar
  2. Harnad, S., (Ed.),Peer Commentary on Peer Review, Cambridge, Cambridge University Press, 1982.Google Scholar
  3. Martin, B. R., J. Irvine, Assessing basic research: some partial indicators of scientific progress in radio astronomy,Research Policy, 12 (1983) 61–90.Google Scholar
  4. Meijer, R. F., Nederhof, A. J., van Raan, A. F. J.,Aspects of Knowledge Transfer in Agriculture in in the Netherlands, Research report to the National Council for Agricultural Research (NRLO). Leiden: CWTS, 1991.Google Scholar
  5. Moed, H. F., Burger, W. J. M., Frankfort, J. G., Van Raan, A. F. J., The use of bibliometric data for the measurement of university research performance,Research Policy, 14 (1985a) 131–149.Google Scholar
  6. Moed, H. F., Burger, W. J. M., Frankfort, J. G., Van Raan, A. F. J., A comparative study of bibliometric past performance analysis and peer judgement,Scientometrics, 8 (1985b) 149–159.Google Scholar
  7. Moed, H. F.,The Use of Bibliometric Indicators for the Assessment of Research Performance in the Natural and Life Sciences, Leiden, DSWO Press, 1989.Google Scholar
  8. Nederhof, A. J., The validity and reliability of evaluation of scholarly performance, In:A. F. J. van Raan,op. cit. pp. 193–228.Google Scholar
  9. Nederhof, A. J., Books and chapters are not to be neglected in measuring research productivity,American Psychologist, 44 (1989) 734–735.Google Scholar
  10. Nederhof, A. J., Noyons, E. C. M., International comparison of departments' research performance in the humanities,Journal of the American Society for Information Science, 43 (1992) 249–256.Google Scholar
  11. Nederhof, A. J., Noyons, E. C. M., Assessment of the international standing of university departments' research: A comparison of bibliometric methods,Scientometrics, 24 (1992) 393–404.Google Scholar
  12. Nederhof, A. J., A. F. J. Van Raan, A validation study of bibliometric indicators: the comparative performance of cum laude doctorates in chemistry,Scientometrics, 17 (1989) 427–435.Google Scholar
  13. Nederhof, A. J., A. F. J. Van Raan, A bibliometric analysis of six economics research groups: A comparison with peer review,Research Policy, (in press).Google Scholar
  14. Nederhof, A. J., R. A. Zwaan, R. E. de Bruin, P. J. Dekker, Assessing the usefulness of bibliometric indicators in the humanities and the social sciences: A comparative study,Scientometrics, 15 (1989) 423–437.Google Scholar
  15. Price, D. J. deS,Little Science, Big Science, Columbia University Press, New York, 1963.Google Scholar
  16. Seglen, P. O., From bad to worse: evaluation by journal impact,Trends in Biochemical Science, 14 (1989) 326–327.Google Scholar
  17. Spangenberg, J. F. A., W. Buijink, W. Alfenaar, Some incentives and constraints of scientific performance in departments of economics,Scientometrics, 18 (1990) 241–268.Google Scholar
  18. Van Raan, A. F. J. (Ed.),Handbook of Quantitative Studies of Science and Technology, Amsterdam, North-Holland/Elsevier Science Publishers, 1988.Google Scholar

Copyright information

© Akadémiai Kiadó 1993

Authors and Affiliations

  • A. J. Nederhof
    • 1
  • R. F. Meijer
    • 1
  • H. F. Moed
    • 1
  • A. F. J. van Raan
    • 1
  1. 1.Centre for Science and Technology Studies (CWTS)University of LeidenLeiden(The Netherlands)

Personalised recommendations