What we can learn from tweets linking to research papers
To explore whether there are other factors than count and sentiment that should be incorporated in evaluating research papers with social media mentions, this paper analyses the content of tweets linking to the top 100 papers of 2015 taken from www.altmetric.com, focusing on the goals, functions and features of research. We discuss three basic issues inherent in using tweets for research evaluation: whose tweets can be used to assess a paper, what objects can be evaluated, and how to score the paper according to each tweet. We suggest that tweets written by those involved in publication of the paper in question should not be included in the paper’s evaluation. Tweets unrelated to the content of the paper should also be excluded. Because controversies in research are inevitable and difficult to resolve, we suggest omitting somewhat supportive and negative tweets in research evaluation. Logically, neutral tweets (such as those linking to, and excerpts from, papers) express a degree of compliment, agreement, interest, or surprise, albeit less so than the tweets explicitly expressing these sentiments. Recommendation tweets also reflect one or more of these sentiments. Expansion tweets, which are inspired by the papers, reflect the function of research. Therefore, we suggest giving a higher weight to praise, agreement, interest, surprise, recommendation and expansion tweets linking to an academic paper than neutral tweets when scoring a paper. Issues related to electronic publishing and social media as learned from tweets are also discussed.
KeywordsAltmetrics Tweet Academic paper Research evaluation Function of science Electronic publishing
- Dallmeier-Tiessen, S., Darby, R., Goerner, B., Hyppoelae, J., Igo-Kemenes, P., Kahn, D., et al. (2011). Highlights from the SOAP project survey. What scientists think about open access publishing. arXiv 1101.5260.Google Scholar
- Haustein, S. (2014). Readership metrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: Harnessing multi-dimensional indicators of performance (pp. 327–344). Cambridge, MA: MIT Press.Google Scholar
- Krishnamurthy, B., Gill, P., & Arlitt, M. (2008). A few chirps about Twitter. In Proceedings of the first workshop on Online social networks (pp. 19–24). New York: ACM.Google Scholar
- Thelwall, M. (2014). Heart and soul: Sentiment strength detection in the social web with sentistrength. Retrieved January 16, 2016 from http://sentistrength.wlv.ac.uk/documentation/SentiStrengthChapter.pdf.
- Thelwall, M., Tsou, A., Weingart, S., Holmberg, K., & Haustein, S. (2013b). Tweeting links to academic articles. Cybermetrics, 17(1), 1–8.Google Scholar