Publication, cooperation and productivity measures in scientific research
- 454 Downloads
The literature on publication counting demonstrates the use of various terminologies and methods. In many scientific publications, no information at all is given about the counting methods used. There is a lack of knowledge and agreement about the sort of information provided by the various methods, about the theoretical and technical limitations for the different methods and about the size of the differences obtained by using various methods. The need for precise definitions and terminology has been expressed repeatedly but with no success.
Counting methods for publications are defined and analysed with the use of set and measure theory. The analysis depends on definitions of basic units for analysis (three chosen for examination), objects of study (three chosen for examination) and score functions (five chosen for examination). The score functions define five classes of counting methods. However, in a number of cases different combinations of basic units of analysis, objects of study and score functions give identical results. Therefore, the result is the characterization of 19 counting methods, five complete counting methods, five complete-normalized counting methods, two whole counting methods, two whole-normalized counting methods, and five straight counting methods.
When scores for objects of study are added, the value obtained can be identical with or higher than the score for the union of the objects of study. Therefore, some classes of counting methods, including the classes of complete, complete-normalized and straight counting methods, are additive, others, including the classes of whole and whole-normalized counting methods, are non-additive.
An analysis of the differences between scores obtained by different score functions and therefore the differences obtained by different counting methods is presented. In this analysis we introduce a new kind of objects of study, the class of cumulative-turnout networks for objects of study, containing full information on cooperation. Cumulative-turnout networks are all authors, institutions or countries contributing to the publications of an author, an institute or a country. The analysis leads to an interpretation of the results of score functions and to the definition of new indicators for scientific cooperation.
We also define a number of other networks, internal cumulative-turnout networks, external cumulative-turnout networks, underlying networks, internal underlying networks and external underlying networks. The networks open new opportunities for quantitative studies of scientific cooperation.
KeywordsBasic Unit Score Function Counting Method Productivity Measure Underlying Network
Unable to display preview. Download preview PDF.
- Anderson, J., Collins, P. M. D., Irvine, J., Isard, P. A., Martin, B. R., Narin, F., Stevens, K. (1988), On-line approaches to measuring national scientific output: a cautionary tale, Science and Public Policy, 15: 153–161.Google Scholar
- CEST (2002), La Suisse et la Champions League internationale des institutions de recherche 1994–1999. Contribution au benchmarking international des institutions de recherche. CEST 2002/6. Centre d’études de la science et de la technologie, Berne.Google Scholar
- CEST (2003), Place scientifique suisse 2001. Développements de la recherche en comparaison internationale sur la base d’indicateurs bibliométriques 1981–2001. CEST 2003/2. Centre d’études de la science et de la technologie, Berne.Google Scholar
- CEST (2004a), Annexe: aspects méthodologiques. http://www.cest.ch/Publikationen/2004/method_2003.pdf
- CEST (2004b), CEST Scientometrics Scoreboard. Indicateurs-clés de la place scientifique suisse (1981–2002). http://www.cest.ch/Publikationen/2004/scoreboard_juillet_2004.pdf
- CEST (2004c), CEST Scientometrics Research Portfolios. Universities and colleges participating in the Champions League: Diagrams and Profiles (1998–2002). http://www.cest.ch/Publikationen/2004/Portfolios_2004/all_countries
- Cole, J. R., Cole, S. (1973), Social Stratification in Science, University of Chicago Press.Google Scholar
- Moed, H. F. (2005), Citation Analysis in Research Evaluation, Springer, Dordrecht.Google Scholar
- Moed, H. F., Glänzel, W., Schmock, U. (Eds), (2004), Handbook of Quantitative Science and Technology Research. The Use of Publication and Patent Statistics in Studies of S&T Systems, Kluwer Academic Publishers, Dordrecht (The Netherlands).Google Scholar
- Narin, F., Whitlow, E. S. (1990). Measurement of Scientific Cooperation and Coauthorship in CEC-related Areas of Science. Report EUR 12900, Office for Official Publications of the European Communities, Luxembourg. Volume 1 and 2.Google Scholar
- Persson, O., Danell, R. (2004), Decomposing national trends in acitivity and impact. A study of Swedish neuroscience papers. In: H. F. Moed, W. Glänzel, U. Schmoch (Eds), Handbook of Quantitative Science and Technology Research. The Use of Publication and Patent Statistics in Studies of S&T System, Kluwer Academic Publishers. Dordrecht (The Netherlands), pp. 514–526.Google Scholar
- Tijssen, R. J. W., van Leeuwen, T. N. (2003), Bibliometric Analyses of World Science. Extended technical annex to chapter 5 of the Third European Report on S&T Indicators. ftp://ftp.cordis.europa.eu/pub/indicators/docs/3rd_report_biblio_ext_methodology.pdf. Last accessed July 18th, 2006.
- van Raan, A. F. J. (1997), Science as an international enterprise, Science and Public Policy, 24: 290–300.Google Scholar