European Political Science

, Volume 12, Issue 2, pp 245–253 | Cite as

The Contribution of ISI Indexing to a Paper's Citations: Results of a Natural Experiment

  • Diego Varela


In this article, I investigate the extent to which ISI Web of Science indexing contributes to the impact of an academic paper. I do this by analysing the results of a natural experiment consisting in the accidental exclusion from the index of an entire issue of a Political Science journal. The statistical tests indicate a significant effect of ISI indexing on the number of citations received by individual papers. The conclusion is that ISI indexing does not simply provide an objective measure of academic impact, but it also affects academic impact itself. This fact provides evidence that, in spite of the increasing competition from other providers such as Scopus or Google Scholar, ISI indexing still has a considerable amount of market power.


bibliometrics indexing impact factor Political Science 


  1. Althouse, B.M., West, J.D., Bergstrom, C.T. and Bergstrom, T. (2009) ‘Differences in impact factor across fields and over time’, Journal of the American Society for Information Science and Technology 60 (1): 27–34.CrossRefGoogle Scholar
  2. Angrist, J.D. and Pischke, J.-S. (2009) Mostly Harmless Econometrics: An Empiricist's Companion, Princeton, NJ: Princeton University Press.Google Scholar
  3. Antelman, K. (2004) ‘Do open-access articles have a greater research impact?’ College & Research Libraries 65 (5): 372–382.CrossRefGoogle Scholar
  4. Cameron, B.D. (2005) ‘Trends in the usage of ISI bibliometric data: uses, abuses, and implications’, Libraries and the Academy 5 (1): 105–125.CrossRefGoogle Scholar
  5. Cantor, R. and Packer, F. (1996) ‘Determinants and impacts of sovereign credit ratings’, Economic Policy Review 2 (2): 37–54.Google Scholar
  6. Conlon, D.E., Morgeson, F.P., McNamara, G., Wiseman, R.M. and Skilton, P.F. (2006) ‘From the editors: examining the impact and role of special issue and regular journal articles in the field of management’, The Academy of Management Journal 49 (5): 857–872.CrossRefGoogle Scholar
  7. Davis, P.M. (2011) ‘Open access, readership, citations: a randomized controlled trial of scientific journal publishing’, The FASEB Journal 25 (7): 2129–2134.CrossRefGoogle Scholar
  8. Vanclay, J.K. (2009) ‘Bias in the journal impact factor’, Scientometrics 78 (1): 3–12.CrossRefGoogle Scholar
  9. Varela, D. (2009) ‘Just a lobbyist? The European Parliament and the consultation procedure’, European Union Politics 10 (1): 7–34.CrossRefGoogle Scholar

Copyright information

© European Consortium for Political Research 2012

Authors and Affiliations

  • Diego Varela
    • 1
  1. 1.University of A Coruña, Campus de ElviñaA CoruñaSpain

Personalised recommendations