Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data
- 1.5k Downloads
This paper measures social media activities of 15 broad scientific disciplines indexed in Scopus database using Altmetric.com data. First, the presence of Altmetric.com data in Scopus database is investigated, overall and across disciplines. Second, a zero-truncated negative binomial model is used to determine the association of various factors with increasing or decreasing citations. Lastly, the effectiveness of altmetric indices to identify publications with high citation impact is comprehensively evaluated by deploying area under the curve (AUC)—an application of receiver operating characteristic. Results indicate a rapid increase in the presence of Altmetric.com data in Scopus database from 10.19% in 2011 to 20.46% in 2015. It was found that Blog count was the most important factor in the field of Health Professions and Nursing as it increased the number of citations by 38.6%, followed by Twitter count increasing the number of citations by 8% in the field of Physics and Astronomy. The results of receiver operating characteristic show that altmetric indices can be a good indicator to discriminate highly cited publications, with an encouragingly AUC = 0.725 between highly cited publications and total altmetric count. Overall, findings suggest that altmetrics can be used to distinguish highly cited publications. The implications of this research are significant in many different directions. Firstly, they set the basis for a further investigation of altmetrics efficiency to predict publications impact and most significantly promote new insights for the measurement of research outcome dissemination over social media.
KeywordsAltmetrics Scopus Comparative analysis Research evaluation
We are thankful to Altmetric.com for providing the dataset.
- Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., & Terliesner, J. (2012). Beyond citations: Scholars’ visibility on the social Web. arXiv preprint arXiv:1205.5611.
- Boyack, K. W. & Klavans, R. (2005). Predicting the importance of current papers. In P. Ingwersen & B. Larsen (Ed.) Proceedings of ISSI 2005 (pp. 335–342). Stockholm, Sweden.Google Scholar
- Didegah, F., Bowman, T. D., & Holmberg, K. (2017). On the differences between citations and altmetrics: An investigation of factors driving altmetrics vs. citations. Journal of the Association for information Science and Technology (in press).Google Scholar
- Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research, 13(4), e123. doi: 10.2196/jmir.2012.
- Hassan, S. U., & Gillani, U. A. (2016). Altmetrics of” altmetrics” using Google Scholar, Twitter, Mendeley, Facebook, Google-plus, CiteULike, Blogs and Wiki. arXiv preprint arXiv:1603.07992.
- Haustein, S., & Siebenlist, T. (2011). Applying social bookmarking data to evaluate journal usage. Journal of informetrics, 5(3), 446–457.Google Scholar
- Nielsen, F. (2007). Scientific citations in Wikipedia. arXiv preprint arXiv:0705.2106.
- Priem, J., & Hemminger, B. H. (2010). Scientometrics 2.0: New metrics of scholarly impact on the social Web. First Monday, 15(7). http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2874/257. Accessed 7 July 2017.
- Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. arXiv preprint arXiv:1203.4745.
- Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Altmetrics: A manifesto. Available at: http://altmetrics.org/manifesto/.
- Wouters, P., & Costas, R. (2012). Users, narcissism and control: tracking the impact of scholarly publications in the 21st century (pp. 847–857). Utrecht: SURF foundation.Google Scholar
- Zahedi, Z., Costas, R., & Wouters, P. (2013, October). What is the impact of the publications read by the different mendeley users? Could they help to identify alternative types of impact? Paper presented at the PLoS ALM Workshop, San Francisco, CA.Google Scholar