Which role do non-source items play in the social sciences? A case study in political science in Germany
Publications that are not indexed by citation indices such as Web of Science (WoS) or Scopus are called “non-source items”. These have so far been neglected by most bibliometric analyses. The central issue of this study is to investigate the characteristics of non-source items and the effect of their inclusion in bibliometric evaluations in the social sciences, specifically German political science publications. The results of this study show that non-source items significantly increase the number of publications (+1,350 %) and to a lesser extent the number of citations from SCIE, SSCI, and A&HCI (+150 %) for evaluated political scientists. 42 % of non-source items are published as book chapters. Edited books and books are cited the most among non-source items. About 40 % of non-source items are in English, while 80 % of source items are in English. The citation rates of researchers taking non-source items into account are lower than those from source items, partially as a result of the limited coverage of WoS. In contrast, the H-indices of researchers taking only non-source items into account are higher than those from source items. In short, the results of this study show that non-source items should be included in bibliometric evaluations, regardless of their impact or the citations from them. The demand for a more comprehensive coverage of bibliometric database in the social sciences for a higher quality of evaluations is shown.
KeywordsNon-source items Social sciences Publication patterns Research evaluation Political science
Mathematics Subject Classification01 94
This study is based on a previous work presented at 14th ISSI 2013 in Vienna (Chi 2013), and supported by the German Federal Ministry for Education and Research (BMBF, project number 01PQ08004A). The author would like to thank William Dinkel, Paul Donner, Sybille Hinze, Stefan Hornbostel, Vivien Petras, Jasmin Schmitz, Daniel Sirtes, Andreas Strotmann, Jian Wang, and Manuela Zinnbauer, those who contribute to improve the current and previous versions, and two reviewers for providing valuable comments on this paper. The citation data used in this paper are from a bibliometric database developed and maintained by the Competence Center for Bibliometrics for the German Science System (KB) and derived from the 2003 to 2012 Science Citation Index Expanded (SCIE), Social Sciences Citation Index (SSCI), and Arts and Humanities Citation Index (A&HCI) provided by Thomson Reuters (Scientific) Inc. (TR®), Philadelphia, Pennsylvania, USA: ©Copyright Thomson Reuters (Scientific) 2012.
- Albertsson, D., Kågedal, E. A. & Hammarfelt, B. (2013, October). Changing publication patterns in the humanities: a case study from the faculty of arts at Uppsala University. Paper Presented at the 18th Nordic Workshop on Bibliometrics and Research Policy, Stockholm, Sweden.Google Scholar
- Amez, L. (2013). Citation patterns for social sciences and humanities publications. In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, & H. Moed (Eds.), Proceedings of the 14th international society of scientometrics and informetrics conference (Vol. II, pp. 1891–1893). Vienna: AIT GmbH.Google Scholar
- Borgman, C. L., & Furner, J. (2002). Scholarly communication and bibliometrics. Annual Review of Information Science and Technology, 36, 3–72.Google Scholar
- Bourke, P., Butler, L., Biglia, B. (1996). Monitoring research in the periphery: Australia and the ISI indices. Research Evaluation and Policy Project, Monograph Series No. 3, Canberra: Australian National University.Google Scholar
- Burnhill, P. M., & Tubby-Hille, M. E. (1994). On measuring the relation between social science research activity and research publication. Research Evaluation, 4(3), 130–152.Google Scholar
- CHE University Ranking 2010/11-Political science (2010). Retrieved 10. 08. 2010, 2010, from http://ranking.zeit.de/che2010/en/rankingkompakt?esb=28&hstyp=1.
- Chi, P. S. (2013). Do non-source items make a difference in the social sciences? In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, H. Moed, (Eds.), In: Proceedings of the 14th International Society of Scientometrics and Informetrics Conference (Vol. I., pp. 612–625). Vienna: AIT GmbH.Google Scholar
- Luwel, M., Moed, H. F., Nederhof, A. J., De Samblanx, V., Verbrugghen, K., Van der Wurff, L. J. (1999). Toward indicators of research performance in the social sciences and humanities. An exploratory study in the fields of law and linguistics at Flemish universities. Report of the Flemish Inter-University Council (VLIR), Brussels, Belgium/Centre for science and technology studies (CWTS), Leiden university, the Netherlands/Ministry of the Flemish Community, Brussels, Belgium.Google Scholar
- Mabe, M. (2003). The growth and number of journals. Serials, 16(2), 191–197.Google Scholar
- Nederhof, A. J., Noyons, E. C. M. (1990). Trends in publication and international co-publication activity in the social and behavioral sciences and the humanities (1984–1989). Report CWTS-90-05. Leiden: Centre for Science and Technology Studies.Google Scholar
- Pestaña, A., Gómez, I., Fernández, M. T., Zulueta, M. A., & Méndez, A. (1995). Scientometric evaluation of R&D activities in medium-size institutions : A case study based on the Spanish scientific research council. In M. Koenig & A. Bookstein (Eds.), Proceedings of the Fifth Biennial International Conference of the International Society for Scientometrics and Infometrics (pp. 425–434). Medford: Learned Information Inc.Google Scholar
- Schoepflin, U. (1992). Problems of representativity in the social sciences citation index. In P. Weingart, R. Sehringer, & M. Winterhager (Eds.), Representations of Science and Technology: Proceedings of the International Conference on Science and Technology Indicators (pp. 177–188). Bielefeld: DSWO Press.Google Scholar
- Sivertsen, G. (2009). Publication patterns in all fields. In: F. Astrom, R. Danell, B. Larsen, J. W. Schneider, (Eds.), Celebrating scholarly communication studies: A festschrift for Olle Persson at his 60th birthday. Special volume of the E-newsletter of the International Society for Scientometrics and Informetrics (pp. 55–60). ISSI.Google Scholar
- van Leeuwen, T. N. (2013). Bibliometric research evaluations, Web of Science and the social sciences and humanities: A problematic relationship? Bibliometrie-Praxis und Forschung, 2, 8-1–8-18.Google Scholar
- Winterhager, M. (1994). Bibliometrische Basisdaten zur Entwicklung der Sozialwissenschaften in Deutschland. In H. Best, B. Endres-Niggemeyer, M. Herfurth, & H. P. Ohly (Eds.), Informations- und Wissensverarbeitung in den Sozialwissenschaften. Opladen: Westdeutscher Verlag.Google Scholar