, Volume 91, Issue 2, pp 461–471

Validating online reference managers for scholarly impact measurement



This paper investigates whether CiteULike and Mendeley are useful for measuring scholarly influence, using a sample of 1,613 papers published in Nature and Science in 2007. Traditional citation counts from the Web of Science (WoS) were used as benchmarks to compare with the number of users who bookmarked the articles in one of the two free online reference manager sites. Statistically significant correlations were found between the user counts and the corresponding WoS citation counts, suggesting that this type of influence is related in some way to traditional citation-based scholarly impact but the number of users of these systems seems to be still too small for them to challenge traditional citation indexes.


Webometrics Research evaluation Online reference managers Validation Research impact Research influence 

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2011

Authors and Affiliations

  1. 1.Peter F. Bronfman LibraryYork UniversityTorontoCanada
  2. 2.Statistical Cybermetrics Research Group, School of TechnologyUniversity of WolverhamptonWolverhamptonUK
  3. 3.Biomedical Branch Library, Gordon and Leslie Diamond Health Care CentreUniversity of British ColumbiaVancouverCanada

Personalised recommendations