Skip to main content
SpringerLink
Log in

Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Eugene Garfield, always insisted that citation analysis “can be used wisely or abused” and that it is “up to the scientific community to prevent abuse of the SCI by devoting the necessary attention to its proper and judicious exploitation” (Garfield in Nat 227:669–671, 1970). Dedicated to his memory, this paper aim to assess the significance of a parameter that is seldom taken into account in evaluation studies: the existence of a USA comparative citation (visibility) advantage built in the database and thus affecting countries that collaborate more with the USA than with other countries. We analyze how this USA citation advantage affects the measure of the scientific impact (usually measured through citations received) of major countries. The main conclusion coming out of this study is that, given the strong presence of the USA in the WoS database, the comparative rankings tend, by construction, to give a citation advantage to countries having the closest relation to that country.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Aksnes, D. (2003). Characteristics of highly cited papers. Research Evaluation, 12(3), 159–170.

    Article  Google Scholar 

  • Archambault, E., Vignola-Gagne, E., Coté, G., Larivière, V., & Gingras, Y. (2006). Benchmarking scientific output in the social sciences and humanities: The limits of existing databases. Scientometrics, 68(3), 329–342.

    Article  Google Scholar 

  • Bar-Ilan, J. (2008). Informetrics at the beginning of the 21st century—A review. Journal of Infometrics, 2(1), 1–52.

    Article  Google Scholar 

  • Basken, P. (2016). As concerns grows about using data to measure faculty, a company changes its message. The Chronicle of Higher Education, 11 October 2016. http://www.chronicle.com/article/As-Concerns-Grow-About-Using/238034.

  • Bordon, M., Gomez, I., Teresea Fernandez, M., Angeles Zulueta, M., & Mendez, A. (1996). Local, domestic and international scientific collaboration in biomedical research. Scientometrics, 37(2), 279–295.

    Article  Google Scholar 

  • Bornmann, L., & Leydesdorff, L. (2013). Macro-indicators of citation impacts of six prolific countries: InCites data and the statistical significance of trends. PLoS ONE, 8(2), e56768.

    Article  Google Scholar 

  • Collazo-Reyes, F. (2014). Growth of the number of indexed journals of Latin America and the Caribbean: The effect on the impact of each country. Scientometrics, 98(1), 197–209.

    Article  Google Scholar 

  • Confraria, H., & Godinho, M. (2015). The impact of African science: A bibliometric analysis. Scientometrics, 102(2), 1241–1268.

    Article  Google Scholar 

  • Davidson Frame, J., & Carpenter, M. K. (1979). International research collaboration. Social Studies of Science, 9(4), 481–497.

    Article  Google Scholar 

  • de Beaver, B. (2004). Does collaborative research have greater epistemic authority? Scientometrics, 60(3), 399–408.

    Article  Google Scholar 

  • European Commission. (2014). Research and innovation performance in EU member states and associated countries. Union progress at country level. Brussels: European Commission.

    Google Scholar 

  • Frenken, K., Hölzl, W., & de Vor, F. (2005). The citation impact of research collaborations: The case of European biotechnology and applied microbiology (1988–2002). Journal of Engineering and Technology Management, 22(1), 9–30.

    Article  Google Scholar 

  • Garfield, E. (1970). Citation indexing for studying science. Nature, 227(5259), 669–671.

    Article  Google Scholar 

  • Glänzel, W. (2001). National characteristics in international scientific co-authorship relations. Scientometrics, 51(1), 69–115.

    Article  MathSciNet  Google Scholar 

  • Glänzel, W., Debackere, K., & Meyer, M. (2008). ‘Triad’ or ‘tetrad’? On global changes in a dynamic world. Scientometrics, 74(1), 71–88.

    Article  Google Scholar 

  • Gonzalez-Brambila, C. N., Reyes-Gonzalez, L., Veloso, F., & Perez-Angón, M. A. (2016). The scientific impact of developing nations. PLoS ONE, 11(3), e0151328.

    Article  Google Scholar 

  • Guerrero-Bote, V. P., Olmeda-Gomez, C., & de Moya-Anegon, F. (2013). Quantifiying the benefits of international scientific collaboration. Journal of the Association for Information Science and Technology, 64(2), 392–404.

    Google Scholar 

  • Gul, S., Nisa, N. T., Shah, T. A., Gupta, S., Jan, A., & Ahmad, S. (2015). Middle East: Research productivity and performance across nations. Scientometrics, 105(2), 1157–1166.

    Article  Google Scholar 

  • Hsu, J., & Huang, D. (2011). Correlation between impact and collaboration. Scientometrics, 86(2), 317–324.

    Article  Google Scholar 

  • Inhaber, H., & Alvo, M. (1978). World science as an input-output system. Scientometrics, 1(1), 43–64.

    Article  Google Scholar 

  • Jurajda, S., Kozubek, S., Münich, D., & Skoda, S. (2017). Scientific publication performance in post-communist countries: Still lagging far behind. Scientometrics, 112(1), 315–328.

    Article  Google Scholar 

  • Katz, J. S. (1994). Geographical proximity and scientific collaboration. Scientometrics, 31(1), 31–43.

    Article  MathSciNet  Google Scholar 

  • King, D. A. (2004). The scientific impact of nations. Nature, 430(6997), 311–316.

    Article  Google Scholar 

  • Lancho-Barrantes, B., Guerrero-Bote, V. P., & de Moya-Anegon, F. (2013). Citation increments between collaborating countries. Scientometrics, 94(3), 817–831.

    Article  Google Scholar 

  • Larivière, V., & Gingras, Y. (2010). The impact factor’s Matthew Effect: A natural experiment in bibliometrics. Journal of the American Society for Information Science and Technology, 61(2), 424–427.

    Google Scholar 

  • Larivière, V., GingraS, Y., & Archambault, E. (2006). Canadian collaboration networks: A comparative analysis of the natural sciences. Social Sciences and the Humanities. Scientometrics, 68(3), 519–533.

    Google Scholar 

  • Larivière, V., Gingras, Y., Sugimoto, C. R., & Tsou, A. (2015). Team size matters: Collaboration and scientific impact since 1900. Journal of the Association for Information Science and Technology, 66(7), 1323–1332.

    Article  Google Scholar 

  • Leydesdorff, L., & Wagner, C. S. (2009). Is the United States losing ground in science? A global perspective on the world science system. Scientometrics, 78(1), 23–36.

    Article  Google Scholar 

  • Leydesdorff, L., Wagner, C. S., & Bornmann, L. (2014). The European Union, China, and the United States in the top-1% and top-10% layers of most-frequently cited publications: competition and collaborations. Journal of Informetrics, 8(3), 606–617.

    Article  Google Scholar 

  • Leydesdorff, L., & Zhou, P. (2005). Are the contributions of China and Korea upsetting the world system of science? Scientometrics, 63(3), 617–630.

    Article  Google Scholar 

  • Lozano, G. A., Larivière, V., & Gingras, Y. (2012). The weakening relationship between the impact factor and papers’ citations in the digital age. Journal of the Association for Information Science and Technology, 63(11), 2140–12145.

    Article  Google Scholar 

  • Luukkonen, T., Persson, O., & Sivertsen, G. (1992). Understanding patterns of international collaboration. Science, Technology and Human Values, 17(1), 101–126.

    Article  Google Scholar 

  • May, R. (1997). The scientific wealth of nations. Science, 275(5301), 793–796.

    Article  Google Scholar 

  • Mongeon, P., & Paul-Hus, A. (2016). The journal coverage of Web of Science and Scopus: A comparative analysis. Scientometrics, 106(1), 213–228.

    Article  Google Scholar 

  • Narin, F., Stevens, K., & Whitlow, E. S. (1991). Scientific co-operation in Europe and the citation of multinationally authored papers. Scientometrics, 21(3), 313–323.

    Article  Google Scholar 

  • National Science Board. (2016). Science and engineering indicators 2016. Arlington, VA: National Science Foundation.

    Google Scholar 

  • Öquist, G., & Benner, M. (2015). Why are some nations more successful than others in research impact? A comparison between Denmark and Sweden. In I. Welpe et al. (Eds.), Incentives and performance (pp. 241–257). Springer: Governance of Research Organizations.

    Google Scholar 

  • Rabkin, Y., & Inhaber, H. (1979). Science on the periphery: A citation study of three less developed countries. Scientometrics, 1(3), 261–274.

    Article  Google Scholar 

  • Rodriguez-Navarro, A., & Narin, F. (2017). European paradox or delusion—Are European science and economy outdated? Science and Public Policy. https://doi.org/10.1093/scipol/scx021.

    Google Scholar 

  • Sarwar, R., & Hassan, S. (2015). A bibliometric assessment of scientific productivity and international collaboration of the Islamic World in science and technology (S&T) areas. Scientometrics, 105(2), 1059–1077.

    Article  Google Scholar 

  • Van Leeuwen, T. N., Moed, H. F., Tijssen, R. J., Visser, M. S., & Van Raan, A. F. (2001). Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance. Scientometrics, 51(1), 335–346.

    Article  Google Scholar 

  • Witze, A. (2016). Research gets increasingly international. Nature News, 19 January 2016. http://www.nature.com/news/research-gets-increasingly-international-1.19198.

  • Zhou, P., & Leydesdorff, L. (2006). The emergence of China as a leading nation in science. Research Policy, 35(1), 83–104.

    Article  Google Scholar 

  • Zitt, M., Bassecoulard, E., & Okubo, Y. (2000). Shadows of the past in international collaboration: Collaboration profiles of the top five producers of Science. Scientometrics, 47(3), 627–657.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Observatoire des sciences et des technologies, Centre interuniversitaire de recherche sur la science et la technologie, Université du Québec à Montréal, Montréal, Québec, Canada

    Yves Gingras & Mahdi Khelfaoui

Authors
  1. Yves Gingras
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahdi Khelfaoui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yves Gingras.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gingras, Y., Khelfaoui, M. Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database. Scientometrics 114, 517–532 (2018). https://doi.org/10.1007/s11192-017-2593-6

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-017-2593-6

Keywords

Search

Navigation