Skip to main content
Log in

Evaluating the Relationship between Bibliometrics and Altmetrics: A Case Study of Russian Publications SCI-E (2015)

  • Information Analysis
  • Published:
Automatic Documentation and Mathematical Linguistics Aims and scope

Abstract

A data array of Russian publications for 2015 registered in the SCI-E DB was evaluated for the correlation between traditional bibliometrics and altmetrics. A special methodology based on the Kendall rank correlation coefficient was developed for this purpose. In the case of publications, the correlation between the citedness of a publication (the value of the TC field in the SCI-E DB) and its usage (fields U1 and U2) was evaluated. In the case of source journals for the indicated publications, the correlation was determined between the Cited_Half-Life value and the values of journal-usage metrics, which were determined as the mean U1 (U2) value taken for all publications of the journal. It was established that the nature of journal distribution according to the Cited_Half-Life value of the source journals for Russian publications practically coincides with the nature of the distribution of source journals for publications of the entire global flow: the Russian distribution shifted somewhat toward larger Cited_Half-Life values (the median of the global distribution was 6.1, while that of the Russian distribution was 6.2). This shift increased sharply upon considering the number of Russian and global journal publications, respectively (the median of the global distribution was 5.8, while that of the Russian distribution was 6.8).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gonzalez-Valiente, CL., Pacheco-Mendoza, J., and Arencibia-Jorge, R., A review of altmetrics as an emerging discipline for research evaluation, Learned Publ., 2016, vol. 29, no. 4, pp. 229–238. doi 10.1002/leap.1043

    Article  Google Scholar 

  2. Thelwall, M. and Wilson, P., Mendeley readership altmetrics for medical articles: An analysis of 45 fields, J.Assoc. Inf. Sci. Technol., 2016, vol. 67, no. 8, pp. 1962–1972. doi 10.1002/asi.23501

    Article  Google Scholar 

  3. Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., and Terliesner, J., Coverage and adoption of altmetrics sources in the bibliometric community, Scientometrics, 2014, vol. 101, no. 2, pp. 1145–1163. doi 10.1007/s11192-013-1221-3

    Article  Google Scholar 

  4. Costas, R., Zahedi, Z., and Wouters, P., Do “altmetrics” correlate with citations? Extensive comparison of altmetrics indicators with citations from a multidisciplinary perspective, J. Assoc. Inf. Sci. Technol., 2015, vol. 66, no. 10, pp. 2003–2019.

    Article  Google Scholar 

  5. Gumpenberger, C., Glanzel, W., and Gorraiz, J., The ecstasy and the agony of the altmetrics score, Scientometrics, 2016, vol. 108, no. 2, pp. 977–982. doi 10.1007/s11192-016-1991-5

    Article  Google Scholar 

  6. Wang, X., Zhichao, F., and Sun, X., Usage patterns of scholarly articles on Web of Science, Scientometrics, 2016, vol. 109, no. 2, pp. 917–926. doi 10.1007/s11192-016-2093-2100

    Article  Google Scholar 

  7. Chi, P. and Glanzel, W., An empirical investigation of the associations among usage, scientific collaboration and citation impact, Scientometrics, 2017, vol. 112, no. 7, pp. 403–412. doi doi 10.1007/s11192-017-2356-4

    Article  Google Scholar 

  8. Arapov, M.V., Libkind, A.N., Libkind, I.A., and Minin, V.A., The information system RFBR Index as a means of creating a network structure of Russian science, Trudy konferentsii SAIT-2005 “Sistemnyi analiz i informatsionnye tekhnologii” (Proc. Conf. SAIT-2005 System Analysis and Information Technology), Moscow: URSS, 2005, vol. 2, pp. 9–14.

    Google Scholar 

  9. Libkind, A.N., Minin, V.A., Libkind, I.A., Markusova, V.A., and Yansts, M., The RFBR Index as a tool for information retrieval and analysis of trends in the fundamental science of Russia, Materialy Mezhdunarodnoi konferentsii NTI-2007 “Informatsionnoe obshchestvo, intellektual’naya obrabotka informatsii, informatsionnye tekhnologii” (Moskva, 24–26 oktyabrya 2007 g.) (Proc. Int. Conf. NTI-2007 Information Society, Intellectual Information Processing, and Information Technologies (Moscow, October 24–26, 2007)), Moscow: VINITI, 2007, pp. 180–183.

    Google Scholar 

  10. Glänzel, W., Characteristic scores and scales. A bibliometric analysis of subject characteristics based on longterm citation observation, J. Inf., 2007, no. 1, pp. 92–102.

    Google Scholar 

  11. Chi, P. and Glänzel, W., Impact and usage indicators for the assessment of research in scientific disciplines and journals, Proceedings of the 16th International Conference of the International Society of Scientometrics and Informetrics, 2017, pp. 203–213.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. N. Libkind.

Additional information

Original Russian Text © A.N. Libkind, V.A. Markusova, V.G. Bogorov, 2018, published in Nauchno-Tekhnicheskaya Informatsiya, Seriya 2: Informatsionnye Protsessy i Sistemy, 2018, No. 4, pp. 12–23.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Libkind, A.N., Markusova, V.A. & Bogorov, V.G. Evaluating the Relationship between Bibliometrics and Altmetrics: A Case Study of Russian Publications SCI-E (2015). Autom. Doc. Math. Linguist. 52, 80–90 (2018). https://doi.org/10.3103/S0005105518020061

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0005105518020061

Keywords

Navigation