Impact of bibliometric studies on the publication behaviour of authors
It has been widely discussed how individuals change the way they act and react in studies just because they are under observation. In this paper, we try to analyse how this so-called Hawthorne effect applies to researchers that are the subject of bibliometric investigations. This encompasses individual assessments as well as international performance comparisons. We test various bibliometric indicators for notable changes in the last decade from a world-wide perspective and deduce explanations for changes from the observations. We then concentrate on the behaviour of German authors in particular, to show national trends. The German publication behaviour is evaluated in regard to citation rates and collaborations in publications and size, publisher country and impact of the journals chosen for publication. We can conclude that authors adapt their publication behaviour to aim for journals that are more internationally known and have a US publisher. Also, a trend from more specialized journals to journals with a broader scope can be observed that raises the question whether the implicit penalization of specialized fields in the bibliometrics leads to undesired shifts in conducted research.
KeywordsBibliometrics National studies Research evaluation Author behaviour Hawthorne effect
- Ltd, Evidence. (2007). The use of bibliometrics to measure research quality in UK higher education institutions. London: Universities UK.Google Scholar
- Michels, C., & Schmoch, U. (2011), Growth of science and database coverage (Full paper) paper presented at the 13th conference of the international society for scientometrics and informetrics (ISSI), 4–7 July 2011, Durban, South Africa.Google Scholar
- Moed, H. (2005). Citation analysis in research evaluation. Dordrecht: Springer. (Information Science and Knowledge Management, 9).Google Scholar
- Mueller, P. S., Murali, N. S., Cha, S. S., Erwin, P. J., & Ghosh, A. K. (2006). The association between impact factors and language of general internal medicine journals. Swiss Medical Weekly, 136, 441–443.Google Scholar
- Schmoch, U., Michels, C., Neuhäusler, P., & Schulze, N. (2012). Performance and Structure of the German Science System 2011. Germany in an international comparison, China’s profile, behaviour of German authors, comparison of the Web of Science and Scopus. Berlin: Commission of Expert on Research and Innovation (www.e-fi.de).
- van Raan, A. J. F. (2004). Measuring science. Capita selecta of current main issues. In W. Glänzel, H. Moed, & U. Schmoch (Eds.), Handbook of quantitative science and technology research. The use of publication and patent statistics in studies on R&D systems (pp. 19–50). Dodrecht: Kluwer Academic Publishers.Google Scholar
- Waltman, L, & Van Eck, N.J. (2013): Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison. Scientometrics in press.Google Scholar