Early Mendeley readers correlate with later citation counts
- 461 Downloads
Counts of the number of readers registered in the social reference manager Mendeley have been proposed as an early impact indicator for journal articles. Although previous research has shown that Mendeley reader counts for articles tend to have a strong positive correlation with synchronous citation counts after a few years, no previous studies have compared early Mendeley reader counts with later citation counts. In response, this first diachronic analysis compares reader counts within a month of publication with citation counts after 20 months for ten fields. There are moderate or strong correlations in eight out of ten fields, with the two exceptions being the smallest categories (n = 18, 36) with wide confidence intervals. The correlations are higher than the correlations between later citations and early citations, showing that Mendeley reader counts are more useful early impact indicators than citation counts.
KeywordsMendeley Citation analysis Altmetrics Alternative indicators
- Brody, T., Harnad, S., & Carr, L. (2006). Earlier web usage statistics as predictors of later citation impact. Journal of the Association for Information Science and Technology, 57(8), 1060–1072.Google Scholar
- de Solla Price, D. (1976). A general theory of bibliometric and other cumulative advantage processes. Journal of the Association for Information Science and Technology, 27(5), 292–306.Google Scholar
- Fisher, R. A. (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika, 10(4), 507–521.Google Scholar
- Haustein, S., Bowman, T. D., & Costas, R. (2015). When is an article actually published? An analysis of online availability, publication, and indexation dates. In 15th international conference on scientometrics and informetrics (ISSI2015) (pp. 1170–1179).Google Scholar
- HEFCE. (2015). The metric tide: Correlation analysis of REF2014 scores and metrics (supplementary report ii to the independent review of the role of metrics in research assessment and management). http://www.hefce.ac.uk/pubs/rereports/Year/2015/metrictide/Title,104463,en.html.
- Moed, H. F. (2005). Statistical relationships between downloads and citations at the level of individual documents within a single journal. Journal of the Association for Information Science and Technology, 56(10), 1088–1097.Google Scholar
- Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Altmetrics: A manifesto. http://altmetrics.org/manifesto/.
- Wouters, P., & Costas, R. (2012). Users, narcissism and control: Tracking the impact of scholarly publications in the 21st century. In: Science and technology indicators 2012 (STI2012). Utrecht: SURF foundation (pp. 847–857).Google Scholar
- Zahedi, Z., Haustein, S. & Bowman, T. (2014). Exploring data quality and retrieval strategies for Mendeley reader counts. In Presentation at SIGMET metrics 2014 workshop, 5 November 2014. http://www.slideshare.net/StefanieHaustein/sigmetworkshop-asist2014.