Skip to main content

The use of bibliometric techniques for institutional research evaluation: A study of avian virology research

Abstract

A bibliometric analysis was made of an area of veterinary research, avian virology, in the context of seeking quantitative indicators to assist research evaluation for the UK Agricultural and Food Research Council (AFRC). In one approach, a list was made of world publications in avian virology using the CAB database which is the most appropriate literature source in terms of subject specificity and breadth of coverage. Means were sought to minimise the labour input required for citation studies of this kind; results based on peak-year citations only were similar to those from the more widely used four-year count, in terms of country-ranking and time trends. In the second method, the publication outputs of several avian virology research groups were assessed in terms of ‘expected’ citations i.e. the average number of citations per paper received by the journals in which the groups published, as compared to the actual citations received. The rankings of the groups were the same in both methods. This second approach, while giving only approximate citation rates, has the advantage of requiring only in-house data. It seems more appropriate for the ex-post evaluation of the output of research groups in the context of agricultural and food research, and it is suggested that further studies on journal-based indicators are warranted.

This is a preview of subscription content, access via your institution.

References

  1. B. R. MARTIN, J. IRVINE, Assessing basic research: Some partial indicators of scientific progress in radio astronomy,Research Policy, 12 (1983) 61.

    Google Scholar 

  2. D. HICKS, B. R. MARTIN, J. IRVINE, Bibliometric techniques for monitoring performance in strategic research: The case of integrated optics,R&D Management, 16 (3) (1986) 211.

    Google Scholar 

  3. D. CROUCH, J. IRVINE, B. R. MARTIN, Bibliometric analysis for science policy: an evaluation of the United Kingdom's research performance in ocean currents and protein crystallography,Scientometrics, 9 (1986) 239.

    Google Scholar 

  4. ABRC,Evaluation of national performance in basic research: a review of techniques for evaluating national performance in basic research, with case studies in genetics and solid state physics. Advisory Board to the Research Councils, Science Policy Studies No. 1, London, 1986.

    Google Scholar 

  5. H. F. MOED, W. J. M. BURGER, J. G. FRANKFORT, A. F. J. Van RAAN, The use of bibliometric data for the measurement of university research performance,Research Policy, 14 (1985) 131.

    Google Scholar 

  6. H. ROTHMAN,ABRC Science Policy Study: further studies on the evaluation and measurement of scientific research, Report for the ESRC, Bristol Polytechnic, 1985.

  7. AFRC, Report on a study of bibliometric techniques for research evaluation, Agricultural and Food Research Council (1987) (in preparation).

  8. N. DESAELERS, The necessity for closer cooperation among secondary agricultural information services: an analysis of AGRICOLA, AGRIS and CAB,IAALD Quarterly Bulletin, 31 (1) (1986) 19.

    Google Scholar 

  9. K. BROOKS, A comparison of the coverage of agricultural and forestry literature on AGRICOLA, BIOSIS, CAB and SCISEARCH,Database, 3 (1) (1980) 38.

    Google Scholar 

  10. H. F. MOED, W. J. M. BRGER, J. G. FRANKFORT, A. F. J. Van RAAN, On the measurement of research performance: The use of bibliometric indicators, Research Policy Unit of the University of Leiden, Leiden, 1983.

    Google Scholar 

  11. J. KING, A review of bibliometric and other science indicators and their role in research evaluation,Journal of Information Science: Principles and Practice, 13 (4) (1987) 261.

    Google Scholar 

  12. B. R. MARTIN, J. IRVINE, Evaluating the evaluators: A reply to our critics,Social Studies of Science, 15 (1985) 558.

    Google Scholar 

  13. E. NOMA, Subject classification and influence weights for 3000 journals, Report prepared by C. H. I. for N. I. H. (USA) and A. B. R. C. (U. K.), Computer Horizons Inc, New Jersey, USA, (1986).

    Google Scholar 

  14. P. HASSANALY, H. DOU, Information systems and scientometric study in chemical oceanography, in: C. S. GIAM, H. J.-M. DOU, (Eds),Strategies and Advanced Techniques for Marine Pollution Studies: Mediterranean Sea NATO AS1 Series, Vol G9, Springer-Verlag, Berlin/Heidelberg, 1986, pp. 9–31.

    Google Scholar 

  15. M. P. CARPENTER, F. GIBB, M. HARRIS, J. IRVINE, B. R. MARTIN, F. NARIN, Bibliometric profiles for British academic institutions: an experiment to develop research output indicators,Scientometrics, (this issue).

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

King, J. The use of bibliometric techniques for institutional research evaluation: A study of avian virology research. Scientometrics 14, 295–313 (1988). https://doi.org/10.1007/BF02020081

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02020081

Keywords

  • Subject Specificity
  • Time Trend
  • Research Evaluation
  • Labour Input
  • Literature Source