Skip to main content
SpringerLink
Log in

Relationship between downloads and citations at journal and paper levels, and the influence of language

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Download indicators are of major potential interest because the great quantity of readily available download data means that any statistical inferences drawn from them will be of robust significance. We study the relationship between citation and downloads at the journal and paper levels, and the influence of language on that relationship. The data used were taken from the Scopus (citations) and ScienceDirect (downloads) databases. The results showed that downloads have limited utility as predictors of citation since it is in the early years when any correlations have the least significance. The relationship between downloads and citation also differs from one discipline to another. The relationship at the paper level is considerably weaker than at the journal level. This may be indicative of the number of downloads depending largely on the diffusion of the journal. In francophone regions, downloading from journals is proportionately less than citations to those same journals. There seems to be a part of citations to non-English-language journals which is invisible to Scopus. This makes the number of downloads proportionately greater than that of citations, leading to a lack of correlation between downloads and citations in that class of journal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009). A principal component analysis of 39 scientific impact measures. PLoS ONE, 4(6), e6022. doi:10.1371/journal.pone.0006022.

    Article  Google Scholar 

  • Bollen, J., Van de Sompel, H., & Rodriguez, M. A. (2008). Towards usage-based impact metrics: First results from the MESUR project. In joint conference on digital libraries (JCDL2006) Pittsburgh, PA, June 2008.

  • Bollen, J., Van de Sompel, H., Smith, J., & Luce, R. (2005). Toward alternative metrics of journal impact: A comparison of download and citation data. Information Processing and Management, 41(6), 1419–1440.

    Article  Google Scholar 

  • Bornmann, L., Moya Anegón, F., & Leydesdorff, L. (2012). The new excellence indicator in the world report of the SCImago institutions rankings 2011. Journal of Informetrics, 6(2), 333–335.

    Article  Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (2000). The Web of knowledge, a festschrift in honor of Eugene Garfield. In B. Cronin & H. Barsky Atkins (Eds.), How balanced is the science citation index’s journal coverage? A preliminary overview of macrolevel statistical data (pp. 251–277). Canada: American Society of Information Science.

    Google Scholar 

  • Broadus, R. N. (1971). The literature of the social sciences: A survey of citation studies. International Social Sciences Journal, 23, 236–243.

    Google Scholar 

  • Brooks, T. A. (1985). Private acts and public objects: An investigation of citer motivations. Journal of the American Society for Information Science, 36(4), 223–229.

    Article  Google Scholar 

  • Clemens, E. S., Powell, W. W., Mcilwaine, K., & Okamoto, D. (1995). Careers in print: Books, journals, and scholarly reputations. American Journal of Sociology, 101, 433–494.

    Article  Google Scholar 

  • Craig, I., Plume, A., McVeigh, M., Pringle, J., & Amin, M. (2007). Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics, 1, 239–248.

    Article  Google Scholar 

  • Cronin, B., Snyder, H., & Atkins, H. (1997). Comparative citation rankings of authors in monographic and journal literature: A study of sociology. Journal of Documentation, 53, 263–273.

    Article  Google Scholar 

  • Darmoni, S. J., Roussel, F., Benichou, J., Faure, G. C., Thirion, B., & Pinhas, N. (2000). Reading factor as a credible alternative to impact factor: A preliminary study. Technology and Health Care, 8(3–4), 174–175.

    Google Scholar 

  • Davis, P. M., Lewenstein, B. V., Simon, D. H., Booth, J. G., & Connolly, Matthew. (2008). Open access publishing, article downloads, and citations: Randomized controlled trial. British Medical Journal, 337, 331–345.

    Article  Google Scholar 

  • Egghe, L., & Rousseau, R. (2000). Aging, obsolescence, impact, growth, and utilization: Definitions and relations. Journal of the American Society for Information Science, 51(11), 1004–1017.

    Article  Google Scholar 

  • Filippo, D., & Fernández, M. T. (2002). Bibliometría: Importancia de los indicadores bibliométricos. In El estado de la ciencia (pp. 69–76). Red Iberoamericana de Indicadores de Ciencia y Tecnología (RICYT).

  • Grupo SCImago. (2006). Análisis de la cobertura de la base de datos Scopus. El Profesional de la Información, 15(2), 144–145.

    Article  Google Scholar 

  • Guerrero-Bote, V. P., & Moya-Anegón, F. (2013). Relationship between Downloads and Citation and the influence of language. In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, & H. Moed (Eds.), Proceedings of the 14th international conference on scientometrics and informetrics—ISSI 2013 (pp. 1469–1484). Vienna: Austrian Institute of Technology.

    Google Scholar 

  • Guerrero-Bote, V. P., Zapico-Alonso, F., Espinosa-Calvo, M. E., Gómez-Crisóstomo, R., & Moya-Anegón, F. (2007). The iceberg hypothesis: Import-export of knowledge between scientific subject categories. Scientometrics, 71(3), 423–441.

    Article  Google Scholar 

  • Hargens, L. L. (2000). Using the literature: Reference networks, reference contexts, and the social structure of scholarship. American Sociological Review, 65, 846–865.

    Article  Google Scholar 

  • Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C. S., Demleitner, M., & Murray, S. S. (2005). The bibliometric properties of article readership information. Journal of the American Society for Information Science and Technology, 56, 111–128.

    Article  Google Scholar 

  • Kyvik, S. (2003). Changing trends in publishing behaviour among university faculty, 1980–2000. Scientometrics, 58, 35–48.

    Article  Google Scholar 

  • Lancho-Barrantes, B. S., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010a). The iceberg hypothesis revisited. Scientometrics, 85, 443–461.

    Article  Google Scholar 

  • Lancho-Barrantes, B. S., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010b). What lies behind the averages and significance of citation indicators in different disciplines? Journal of Information Science., 36(3), 371–382.

    Article  Google Scholar 

  • Lewison, G. (2001). Evaluation of books as research outputs in history of medicine. Research Evaluation, 10, 89–95.

    Article  Google Scholar 

  • Lindholm-Romantschuk, Y., & Warner, J. (1996). The role of monographs in scholarly communication: An empirical study of philosophy, sociology and economics. Journal of Documentation, 54, 389–404.

    Article  Google Scholar 

  • Lundberg, J. (2007). Lifting the crown—citation z-score. Journal of Informetrics, 1, 145–154.

    Article  Google Scholar 

  • Moed, H. F. (2005a). Citation analysis in research evaluation (p. 346). Dordrecht: Springer.

    Google Scholar 

  • Moed, H. F. (2005b). Statistical relationships between downloads and citations at the level of individual documents within a single journal. Journal of the American Society for Information Science and Technology, 56, 1088–1097.

    Article  Google Scholar 

  • Moya-Anegón, F., Chinchilla-Rodríguez, Z., Vargas-Quesada, B., Corera-Álvarez, E., Muñoz-Fernández, F. J., González-Molina, A., et al. (2007). Coverage analysis of Scopus: A journal metric approach. Scientometrics, 73(1), 53–78.

    Article  Google Scholar 

  • Moya-Anegón, F., Guerrero-Bote, V. P., Bornmann, L., & Moed, H. F. (2013). The research guarantors of scientific papers and the output counting: A promising new approach. Scientometrics, 97(2), 421–434.

    Google Scholar 

  • Nederhof, A. J., Zwaan, R. A., De Bruin, R. E., & Dekker, P. J. (1989). Assessing the usefulness of bibliometric indicators for the humanities and the social sciences. Scientometrics, 15, 423–435.

    Article  Google Scholar 

  • Nock, D. A. (2001). Careers in print: Canadian sociological books and their wider impact, 1975–1992. Canadian Journal of Sociology/Cahiers canadiens de sociologie, 26, 469–485.

    Article  Google Scholar 

  • Price, D. J. (1970). Communication among scientists and engineers. In C. E. Nelson & D. Pollack (Eds.), Citation measures of hard science, soft science, technology, and non-science. Lexington, MA: Lexington Books.

    Google Scholar 

  • Schloegl, C., & Gorraiz, J. (2010). Comparison of citation and usage indicators: The case of oncology journals. Scientometrics, 82(3), 567–580.

    Article  Google Scholar 

  • Schloegl, C., & Gorraiz, J. (2011). Global usage versus global citation metrics: The case of pharmacology journals. Journal of the American Society for Information Science and Technology, 62(1), 161–170.

    Article  Google Scholar 

  • Shepherd, P. T. (2007). The feasibility of developing and implementing journal usage factors: A research project sponsored by UKSG. Serials: The Journal for the Serials Community, 20(2), 117–123.

    Article  MathSciNet  Google Scholar 

  • Small, H. G., & Crane, D. (1979). Specialties and disciplines in science and social science: An examination of their structure using citation indexes. Scientometrics, 1, 445–461.

    Article  Google Scholar 

  • Thompson, J. W. (2002). The death of the scholarly monograph in the humanities? Citation patterns in literary scholarship. Libri, 52(3), 121–136.

    Article  Google Scholar 

  • Wan, J.-K., Hua, P.-H., Rousseau, R., & Sun, X.-K. (2010). The journal download immediacy index (DII): Experiences using a Chinese full-text database. Scientometrics, 82(3), 555–566.

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by Elsevier as part of the Elsevier Bibliometric Research Program (EBRP), and financed by the Junta de Extremadura, Consejería de Empleo, Empresa e Innovación and by the Fondo Social Europeo as part of the research group Grant GR10019.

Author information

Authors and Affiliations

  1. Departamento de Información y Comunicación, Grupo Scimago, Universidad de Extremadura, Plazuela Ibn Marwan, 06071, Badajoz, Spain

    Vicente P. Guerrero-Bote

  2. Grupo Scimago, CSIC, CCHS, IPP, C/Albasanz, 26-28, 28037, Madrid, Spain

    Félix Moya-Anegón

Authors
  1. Vicente P. Guerrero-Bote
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Félix Moya-Anegón
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vicente P. Guerrero-Bote.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guerrero-Bote, V.P., Moya-Anegón, F. Relationship between downloads and citations at journal and paper levels, and the influence of language. Scientometrics 101, 1043–1065 (2014). https://doi.org/10.1007/s11192-014-1243-5

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-014-1243-5

Keywords

Search

Navigation