Evaluating the Relationship between Bibliometrics and Altmetrics: A Case Study of Russian Publications SCI-E (2015)

  • A. N. Libkind
  • V. A. Markusova
  • V. G. Bogorov
Information Analysis


A data array of Russian publications for 2015 registered in the SCI-E DB was evaluated for the correlation between traditional bibliometrics and altmetrics. A special methodology based on the Kendall rank correlation coefficient was developed for this purpose. In the case of publications, the correlation between the citedness of a publication (the value of the TC field in the SCI-E DB) and its usage (fields U1 and U2) was evaluated. In the case of source journals for the indicated publications, the correlation was determined between the Cited_Half-Life value and the values of journal-usage metrics, which were determined as the mean U1 (U2) value taken for all publications of the journal. It was established that the nature of journal distribution according to the Cited_Half-Life value of the source journals for Russian publications practically coincides with the nature of the distribution of source journals for publications of the entire global flow: the Russian distribution shifted somewhat toward larger Cited_Half-Life values (the median of the global distribution was 6.1, while that of the Russian distribution was 6.2). This shift increased sharply upon considering the number of Russian and global journal publications, respectively (the median of the global distribution was 5.8, while that of the Russian distribution was 6.8).


bibliometrics altmetrics citedness usage metrics rank correlation correlation dependence Russian publications Web of Science 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gonzalez-Valiente, CL., Pacheco-Mendoza, J., and Arencibia-Jorge, R., A review of altmetrics as an emerging discipline for research evaluation, Learned Publ., 2016, vol. 29, no. 4, pp. 229–238. doi 10.1002/leap.1043CrossRefGoogle Scholar
  2. 2.
    Thelwall, M. and Wilson, P., Mendeley readership altmetrics for medical articles: An analysis of 45 fields, J.Assoc. Inf. Sci. Technol., 2016, vol. 67, no. 8, pp. 1962–1972. doi 10.1002/asi.23501CrossRefGoogle Scholar
  3. 3.
    Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., and Terliesner, J., Coverage and adoption of altmetrics sources in the bibliometric community, Scientometrics, 2014, vol. 101, no. 2, pp. 1145–1163. doi 10.1007/s11192-013-1221-3CrossRefGoogle Scholar
  4. 4.
    Costas, R., Zahedi, Z., and Wouters, P., Do “altmetrics” correlate with citations? Extensive comparison of altmetrics indicators with citations from a multidisciplinary perspective, J. Assoc. Inf. Sci. Technol., 2015, vol. 66, no. 10, pp. 2003–2019.CrossRefGoogle Scholar
  5. 5.
    Gumpenberger, C., Glanzel, W., and Gorraiz, J., The ecstasy and the agony of the altmetrics score, Scientometrics, 2016, vol. 108, no. 2, pp. 977–982. doi 10.1007/s11192-016-1991-5CrossRefGoogle Scholar
  6. 6.
    Wang, X., Zhichao, F., and Sun, X., Usage patterns of scholarly articles on Web of Science, Scientometrics, 2016, vol. 109, no. 2, pp. 917–926. doi 10.1007/s11192-016-2093-2100CrossRefGoogle Scholar
  7. 7.
    Chi, P. and Glanzel, W., An empirical investigation of the associations among usage, scientific collaboration and citation impact, Scientometrics, 2017, vol. 112, no. 7, pp. 403–412. doi doi 10.1007/s11192-017-2356-4CrossRefGoogle Scholar
  8. 8.
    Arapov, M.V., Libkind, A.N., Libkind, I.A., and Minin, V.A., The information system RFBR Index as a means of creating a network structure of Russian science, Trudy konferentsii SAIT-2005 “Sistemnyi analiz i informatsionnye tekhnologii” (Proc. Conf. SAIT-2005 System Analysis and Information Technology), Moscow: URSS, 2005, vol. 2, pp. 9–14.Google Scholar
  9. 9.
    Libkind, A.N., Minin, V.A., Libkind, I.A., Markusova, V.A., and Yansts, M., The RFBR Index as a tool for information retrieval and analysis of trends in the fundamental science of Russia, Materialy Mezhdunarodnoi konferentsii NTI-2007 “Informatsionnoe obshchestvo, intellektual’naya obrabotka informatsii, informatsionnye tekhnologii” (Moskva, 24–26 oktyabrya 2007 g.) (Proc. Int. Conf. NTI-2007 Information Society, Intellectual Information Processing, and Information Technologies (Moscow, October 24–26, 2007)), Moscow: VINITI, 2007, pp. 180–183.Google Scholar
  10. 10.
    Glänzel, W., Characteristic scores and scales. A bibliometric analysis of subject characteristics based on longterm citation observation, J. Inf., 2007, no. 1, pp. 92–102.Google Scholar
  11. 11.
    Chi, P. and Glänzel, W., Impact and usage indicators for the assessment of research in scientific disciplines and journals, Proceedings of the 16th International Conference of the International Society of Scientometrics and Informetrics, 2017, pp. 203–213.Google Scholar

Copyright information

© Allerton Press, Inc. 2018

Authors and Affiliations

  • A. N. Libkind
    • 1
  • V. A. Markusova
    • 1
  • V. G. Bogorov
    • 2
  1. 1.All-Russian Institute for Scientific and Technical InformationRussian Academy of SciencesMoscowRussia
  2. 2.Clarivate Analytics RussiaMoscowRussia

Personalised recommendations