Download indicators are of major potential interest because the great quantity of readily available download data means that any statistical inferences drawn from them will be of robust significance. We study the relationship between citation and downloads at the journal and paper levels, and the influence of language on that relationship. The data used were taken from the Scopus (citations) and ScienceDirect (downloads) databases. The results showed that downloads have limited utility as predictors of citation since it is in the early years when any correlations have the least significance. The relationship between downloads and citation also differs from one discipline to another. The relationship at the paper level is considerably weaker than at the journal level. This may be indicative of the number of downloads depending largely on the diffusion of the journal. In francophone regions, downloading from journals is proportionately less than citations to those same journals. There seems to be a part of citations to non-English-language journals which is invisible to Scopus. This makes the number of downloads proportionately greater than that of citations, leading to a lack of correlation between downloads and citations in that class of journal.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009). A principal component analysis of 39 scientific impact measures. PLoS ONE, 4(6), e6022. doi:10.1371/journal.pone.0006022.
Bollen, J., Van de Sompel, H., & Rodriguez, M. A. (2008). Towards usage-based impact metrics: First results from the MESUR project. In joint conference on digital libraries (JCDL2006) Pittsburgh, PA, June 2008.
Bollen, J., Van de Sompel, H., Smith, J., & Luce, R. (2005). Toward alternative metrics of journal impact: A comparison of download and citation data. Information Processing and Management, 41(6), 1419–1440.
Bornmann, L., Moya Anegón, F., & Leydesdorff, L. (2012). The new excellence indicator in the world report of the SCImago institutions rankings 2011. Journal of Informetrics, 6(2), 333–335.
Braun, T., Glänzel, W., & Schubert, A. (2000). The Web of knowledge, a festschrift in honor of Eugene Garfield. In B. Cronin & H. Barsky Atkins (Eds.), How balanced is the science citation index’s journal coverage? A preliminary overview of macrolevel statistical data (pp. 251–277). Canada: American Society of Information Science.
Broadus, R. N. (1971). The literature of the social sciences: A survey of citation studies. International Social Sciences Journal, 23, 236–243.
Brooks, T. A. (1985). Private acts and public objects: An investigation of citer motivations. Journal of the American Society for Information Science, 36(4), 223–229.
Clemens, E. S., Powell, W. W., Mcilwaine, K., & Okamoto, D. (1995). Careers in print: Books, journals, and scholarly reputations. American Journal of Sociology, 101, 433–494.
Craig, I., Plume, A., McVeigh, M., Pringle, J., & Amin, M. (2007). Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics, 1, 239–248.
Cronin, B., Snyder, H., & Atkins, H. (1997). Comparative citation rankings of authors in monographic and journal literature: A study of sociology. Journal of Documentation, 53, 263–273.
Darmoni, S. J., Roussel, F., Benichou, J., Faure, G. C., Thirion, B., & Pinhas, N. (2000). Reading factor as a credible alternative to impact factor: A preliminary study. Technology and Health Care, 8(3–4), 174–175.
Davis, P. M., Lewenstein, B. V., Simon, D. H., Booth, J. G., & Connolly, Matthew. (2008). Open access publishing, article downloads, and citations: Randomized controlled trial. British Medical Journal, 337, 331–345.
Egghe, L., & Rousseau, R. (2000). Aging, obsolescence, impact, growth, and utilization: Definitions and relations. Journal of the American Society for Information Science, 51(11), 1004–1017.
Filippo, D., & Fernández, M. T. (2002). Bibliometría: Importancia de los indicadores bibliométricos. In El estado de la ciencia (pp. 69–76). Red Iberoamericana de Indicadores de Ciencia y Tecnología (RICYT).
Grupo SCImago. (2006). Análisis de la cobertura de la base de datos Scopus. El Profesional de la Información, 15(2), 144–145.
Guerrero-Bote, V. P., & Moya-Anegón, F. (2013). Relationship between Downloads and Citation and the influence of language. In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, & H. Moed (Eds.), Proceedings of the 14th international conference on scientometrics and informetrics—ISSI 2013 (pp. 1469–1484). Vienna: Austrian Institute of Technology.
Guerrero-Bote, V. P., Zapico-Alonso, F., Espinosa-Calvo, M. E., Gómez-Crisóstomo, R., & Moya-Anegón, F. (2007). The iceberg hypothesis: Import-export of knowledge between scientific subject categories. Scientometrics, 71(3), 423–441.
Hargens, L. L. (2000). Using the literature: Reference networks, reference contexts, and the social structure of scholarship. American Sociological Review, 65, 846–865.
Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C. S., Demleitner, M., & Murray, S. S. (2005). The bibliometric properties of article readership information. Journal of the American Society for Information Science and Technology, 56, 111–128.
Kyvik, S. (2003). Changing trends in publishing behaviour among university faculty, 1980–2000. Scientometrics, 58, 35–48.
Lancho-Barrantes, B. S., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010a). The iceberg hypothesis revisited. Scientometrics, 85, 443–461.
Lancho-Barrantes, B. S., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010b). What lies behind the averages and significance of citation indicators in different disciplines? Journal of Information Science., 36(3), 371–382.
Lewison, G. (2001). Evaluation of books as research outputs in history of medicine. Research Evaluation, 10, 89–95.
Lindholm-Romantschuk, Y., & Warner, J. (1996). The role of monographs in scholarly communication: An empirical study of philosophy, sociology and economics. Journal of Documentation, 54, 389–404.
Lundberg, J. (2007). Lifting the crown—citation z-score. Journal of Informetrics, 1, 145–154.
Moed, H. F. (2005a). Citation analysis in research evaluation (p. 346). Dordrecht: Springer.
Moed, H. F. (2005b). Statistical relationships between downloads and citations at the level of individual documents within a single journal. Journal of the American Society for Information Science and Technology, 56, 1088–1097.
Moya-Anegón, F., Chinchilla-Rodríguez, Z., Vargas-Quesada, B., Corera-Álvarez, E., Muñoz-Fernández, F. J., González-Molina, A., et al. (2007). Coverage analysis of Scopus: A journal metric approach. Scientometrics, 73(1), 53–78.
Moya-Anegón, F., Guerrero-Bote, V. P., Bornmann, L., & Moed, H. F. (2013). The research guarantors of scientific papers and the output counting: A promising new approach. Scientometrics, 97(2), 421–434.
Nederhof, A. J., Zwaan, R. A., De Bruin, R. E., & Dekker, P. J. (1989). Assessing the usefulness of bibliometric indicators for the humanities and the social sciences. Scientometrics, 15, 423–435.
Nock, D. A. (2001). Careers in print: Canadian sociological books and their wider impact, 1975–1992. Canadian Journal of Sociology/Cahiers canadiens de sociologie, 26, 469–485.
Price, D. J. (1970). Communication among scientists and engineers. In C. E. Nelson & D. Pollack (Eds.), Citation measures of hard science, soft science, technology, and non-science. Lexington, MA: Lexington Books.
Schloegl, C., & Gorraiz, J. (2010). Comparison of citation and usage indicators: The case of oncology journals. Scientometrics, 82(3), 567–580.
Schloegl, C., & Gorraiz, J. (2011). Global usage versus global citation metrics: The case of pharmacology journals. Journal of the American Society for Information Science and Technology, 62(1), 161–170.
Shepherd, P. T. (2007). The feasibility of developing and implementing journal usage factors: A research project sponsored by UKSG. Serials: The Journal for the Serials Community, 20(2), 117–123.
Small, H. G., & Crane, D. (1979). Specialties and disciplines in science and social science: An examination of their structure using citation indexes. Scientometrics, 1, 445–461.
Thompson, J. W. (2002). The death of the scholarly monograph in the humanities? Citation patterns in literary scholarship. Libri, 52(3), 121–136.
Wan, J.-K., Hua, P.-H., Rousseau, R., & Sun, X.-K. (2010). The journal download immediacy index (DII): Experiences using a Chinese full-text database. Scientometrics, 82(3), 555–566.
This work was supported by Elsevier as part of the Elsevier Bibliometric Research Program (EBRP), and financed by the Junta de Extremadura, Consejería de Empleo, Empresa e Innovación and by the Fondo Social Europeo as part of the research group Grant GR10019.
About this article
Cite this article
Guerrero-Bote, V.P., Moya-Anegón, F. Relationship between downloads and citations at journal and paper levels, and the influence of language. Scientometrics 101, 1043–1065 (2014). https://doi.org/10.1007/s11192-014-1243-5
- Scientometric indicators
- Download indicator
- Citation indicators
- Language influence