Advertisement

Scientific vs. Public Attention: A Comparison of Top Cited Papers in WoS and Top Papers by Altmetric Score

  • Sumit Kumar BanshalEmail author
  • Aparna Basu
  • Vivek Kumar Singh
  • Pranab K. Muhuri
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 856)

Abstract

Alternative metrics or altmetrics are article level metrics that have been used to quantify the attention given to scholarly papers in online fora or social media. In a way it was sought to replace journal level metrics such as the Impact Factor and also to see if altmetric scores could predict highly cited papers. Early studies, done soon after altmetrics was proposed in 2010, were somewhat premature as the use of social media was not widely prevalent, and their results may no longer be relevant at the present time when use levels have risen significantly. In 2016, Altmetric.com has tracked over 17 million mentions of 2.7 million different research outputs. Of these, the top 100 most-discussed journal articles of 2016 were presented with details of journals in which the research was published, affiliations of authors, fields, countries, etc. Our attempt is to obtain a bibliometric profile of these papers with high altmetric scores to see the underlying patterns and characteristics that motivate high public attention. In parallel we have analyzed top 100 highly cited papers from the same year. Our objective in this empirical study is to examine the similarities and distinguishing features of scientific attention as measured by citations and public attention in online fora.

A significant finding is that there is very little overlap between very highly cited papers and those that received the highest altmetric scores.

Keywords

Altmetrics Social media Impact analysis Web of science Science Citation Index-Expanded 

References

  1. 1.
    Priem, J., Taraborelli, D., Groth, P., Neylon, C.: Altmetrics: A manifesto (2010). http://altmetrics.org/manifesto
  2. 2.
    Kim, H.S.: Attractability and virality: The role of message features and social influence in health news diffusion. University of Pennsylvania (2014)Google Scholar
  3. 3.
    Haustein, S.: Grand challenges in altmetrics: heterogeneity, data quality and dependencies. Scientometrics 108(1), 413–423 (2016)CrossRefGoogle Scholar
  4. 4.
    Priem, J.: Altmetrics. Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact, journal? 263–88 (2014)Google Scholar
  5. 5.
    Wouters P., Costas, R.: Users, Narcissism and Control – Tracking the Impact of Scholarly Publications in the 21st Century. Image Rochester, New York (2012)Google Scholar
  6. 6.
    Adie, E., Roe, W.: Altmetric: enriching scholarly content with article-level discussion and metrics. Learn. Publish. 26(1), 11–17 (2013)CrossRefGoogle Scholar
  7. 7.
    Roemer, R.C., Borchardt, R.: Introduction to Altmetrics. Libr. Tehnol. Reports 51(5), 5–10 (2015)Google Scholar
  8. 8.
    Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., Terliesner, J.: Beyond citations: Scholars’ visibility on the social web. In: Proceedings of the 17th International Conference on Science and Technology Indicators, Montreal, Quebec, Canada (2012). http://arxiv.org/abs/1205.5611/
  9. 9.
    Sud, P., Thelwall, M.: Evaluating altmetrics. Scientometrics 98(2), 1131–1143 (2014)CrossRefGoogle Scholar
  10. 10.
    Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. U.S.A. 102(46), 16569–16572 (2005)CrossRefGoogle Scholar
  11. 11.
    Piwowar, H., Priem, J.: The power of altmetrics on a CV. Bull. Assoc. Inf. Sci. Technol. 39, 10–13 (2013)CrossRefGoogle Scholar
  12. 12.
    Zahedi, Z., Costas, R., Wouters, P.: How well developed are Altmetrics? Cross disciplinary analysis of the presence of “alternative metrics” in scientific publications (RIP). In: Proceedings of the 14th International Society of Scientometrics and Informetrics Conference, Vienna, Austria, pp. 876–884. Facultas Verlags und Buchhandels, Wien (2013)Google Scholar
  13. 13.
    Bornmann, L.: Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. J. Informetrics 8(4), 895–903 (2014)CrossRefGoogle Scholar
  14. 14.
    Fenner, M.: What can article-level metrics do for you? PLoS Biol. 11(10) (2013)CrossRefGoogle Scholar
  15. 15.
    Costas, R., Zahedi, Z., Wouters, P.: Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. J. Assoc. Inf. Sci. Technol. 66(10), 2003–2019 (2015)CrossRefGoogle Scholar
  16. 16.
    Liu, J., Adie, E.: Five challenges in altmetrics: A toolmaker’s perspective. Bull. Am. Soc. Inf. Sci. Technol. 39(4), 31–34 (2013)CrossRefGoogle Scholar
  17. 17.
    Thelwall, M., Haustein, S., Larivière, V., Sugimoto, C.R.: Do altmetrics work? Twitter and ten other social web services. PLoS ONE 8(5) (2013)CrossRefGoogle Scholar
  18. 18.
    Thelwall, M., Kousha, K.: ResearchGate: Disseminating, communicating, and measuring Scholarship? J. Assoc. Inf. Sci. Technol. 66(5), 876–889 (2015)CrossRefGoogle Scholar
  19. 19.
    Haustein, S., Peters, I., Sugimoto, C.R., Thelwall, M., Larivière, V.: Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature. J. Am. Soc. Inf. Sci. Technol. 65(4), 656–669 (2014)CrossRefGoogle Scholar
  20. 20.
    Shema, H., Bar-Ilan, J., Thelwall, M.: Do blog citations correlate with a higher number of future citations? research blogs as a potential source for alternative metrics. J. Assoc. Inf. Sci. Technol. 65(5), 1018–1027 (2014)CrossRefGoogle Scholar
  21. 21.
    Haustein, S., Thelwall, M., Larivière, V., Sugimoto, C.R.: On the relation between altmetrics and citations in medicine (RIP). In: Hinze, S., Lottmann, A. (eds.) Proceedings of the 18th International Conference on Science and Technology Indicators (STI), Berlin, Germany, pp. 164–166, 4–6 September 2013Google Scholar
  22. 22.
    Waltman, L., Costas, R.: F1000 recommendations as a potential new data source for research evaluation: a comparison with citations. J. Assoc. Inf. Sci. Technol. 65(3), 433–445 (2014)CrossRefGoogle Scholar
  23. 23.
    Raza, G., Singh, S., Dutt, B.: Public, science, and cultural distance. Sci. Commun. 23(3), 293–309 (2002)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Sumit Kumar Banshal
    • 1
    Email author
  • Aparna Basu
    • 1
  • Vivek Kumar Singh
    • 2
  • Pranab K. Muhuri
    • 1
  1. 1.Department of Computer ScienceSouth Asian UniversityNew DelhiIndia
  2. 2.Department of Computer ScienceBanaras Hindu UniversityVaranasiIndia

Personalised recommendations