Coverage and adoption of altmetrics sources in the bibliometric community
Altmetrics, indices based on social media platforms and tools, have recently emerged as alternative means of measuring scholarly impact. Such indices assume that scholars in fact populate online social environments, and interact with scholarly products in the social web. We tested this assumption by examining the use and coverage of social media environments amongst a sample of bibliometricians examining both their own use of online platforms and the use of their papers on social reference managers. As expected, coverage varied: 82 % of articles published by sampled bibliometricians were included in Mendeley libraries, while only 28 % were included in CiteULike. Mendeley bookmarking was moderately correlated (.45) with Scopus citation counts. We conducted a survey among the participants of the STI2012 participants. Over half of respondents asserted that social media tools were affecting their professional lives, although uptake of online tools varied widely. 68 % of those surveyed had LinkedIn accounts, while Academia.edu, Mendeley, and ResearchGate each claimed a fifth of respondents. Nearly half of those responding had Twitter accounts, which they used both personally and professionally. Surveyed bibliometricians had mixed opinions on altmetrics’ potential; 72 % valued download counts, while a third saw potential in tracking articles’ influence in blogs, Wikipedia, reference managers, and social media. Altogether, these findings suggest that some online tools are seeing substantial use by bibliometricians, and that they present a potentially valuable source of impact data.
KeywordsAltmetrics Social media presence Reference managers Download counts Citation counts
- Bar-Ilan, J. (2011). Articles tagged by ‘bibliometrics’ on Mendeley and CiteULike. Paper presented at the Metrics 2011 Symposium on Informetric and Scientometric Research.Google Scholar
- Bar-Ilan, J. (2012a). JASIST@mendeley. Presented at the ACM Web Science Conference Workshop on Altmetrics. Evanston, IL. Retrieved January 21, 2013 from http://altmetrics.org/altmetrics12/bar-ilan.
- Bar-Ilan, J. (2012b). JASIST 2001–2010. Bulletin of the American Society for Information Science and Technology, 38(6), 24–28.Google Scholar
- Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., & Terliesner, J. (2012). Beyond citations: Scholars’ visibility on the social Web. In Proceedings of the 17th International Conference on Science and Technology Indicators, Montréal, Canada (Vol. 1, pp. 98–109).Google Scholar
- Bar-Ilan, J., Shema, H., & Thelwall (2014). Bibliographic References in Web 2.0. In B. Cronin, & C. Sugimoto (eds.), Beyond Bibliometrics: Harnessing Multi-dimensional Indicators of Performance (pp. 307–325). Cambridge, MA: MIT Press.Google Scholar
- Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research, 13(4). Retrieved January 21, 2013 from http://www.jmir.org/2011/4/e123.
- Ganegan, F. (2012, August). Filtering the research record and farming big data. Retrieved January 21, 2013 from http://www.swets.com/blog/filtering-the-research-record-and-farming-big-data#.Google Scholar
- Glaser, B. G., & Strauss, A. L. (1967). The Discovery of Grounded Theory. Strategies for Qualitative Research. New Brunswick: Aldine Transactions.Google Scholar
- Groth, P., & Gurney, T. (2010). Studying scientific discourse on the Web using bibliometrics: A chemistry blogging case study. Presented at the WebSci10: Extending the Frontiers of Society On-Line, Raleigh, NC, USA.Google Scholar
- Haustein, S. (2014). Readership Metrics. In B. Cronin, & C. Sugimoto (eds.), Beyond Bibliometrics: Harnessing Multi-dimensional Indicators of Performance (pp. 327–344), Cambridge, MA: MIT Press.Google Scholar
- Haustein, S., Golov, E., Luckanus, K., Reher, S., & Terliesner, J. (2010). Journal evaluation and science 2.0. Using social bookmarks to analyze reader perception. In Book of Abstracts of the 11th International Conference on Science and Technology Indicators, (pp. 117–119). Leiden, The Netherlands.Google Scholar
- Haustein, S., & Peters, I. (2012). Using Social Bookmarks and Tags as Alternative Indicators of Journal Content Description. First Monday, 17(11). Retrieved January 21, 2013 from www.firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/4110/3357.
- Haustein, S., & Siebenlist, T. (2011). Applying social bookmarking data to evaluate journal usage. Journal of Informetrics, 5(3), 446–457.Google Scholar
- Henning, V., & Reichelt, J. (2008). Mendeley: A Last.fm for research? In Proceedings of 4th IEEE International Conference on Escience, (pp. 327–328). Indianapolis, IN, USA. Google Scholar
- Letierce, J., Passant, A., Decker, S., & Breslin, J.G. (2010). Understanding how Twitter is used to spread scientific messages. In Proceedings of the Web Science Conference, Raleigh, NC, USA.Google Scholar
- Li, X., & Thelwall, M. (2012). F1000, Mendeley and traditional bibliometric indicators. In Proceedings of the 17th International Conference on Science and Technology Indicators, (Vol. 2, pp. 451–551). Montréal, Canada.Google Scholar
- Mahrt, M., Weller, K., & Peters, I. (2013). Twitter in Scholarly Communication. In K. Weller, A. Bruns, J. Burgess, M. Mahrt, & C. Puschmann (Eds.), Twitter and Society (pp. 399–410). New York: Peter Lang.Google Scholar
- Mas-Bleda, A., Thelwall, M., Kousha, K., & Aguillo, I. (2013). European highly cited scientists’ presence on the Web. In Proceedings of the 14th International Conference of the International Society for Scientometrics and Informetrics (Vol. II, pp. 1966–1969). Vienna, AustriaGoogle Scholar
- Mendeley (2012). Mendeley Global Research Report. Retrieved January 21, 2013 from http://www.mendeley.com/global-research-report/#.UPxyUqPi58E.
- Mohammadi, E. & Thelwall, M. (in press). Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. Journal of the American Society for Information Science and Technology.Google Scholar
- Nielsen, F. (2007). Scientific citations in Wikipedia. First Monday, 12(8). Retrieved January 21, 2013 from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/1997/1872.
- Piwowar, H. (2013). Value all research products. Nature, 493, 159.Google Scholar
- Price, D., de Solla, J., & Gürsey, S. (1976). Studies in scientometrics I. Transience and continuance in scientific authorship. International Forum on Information and Documentation, 1(2), 17–24.Google Scholar
- Priem, J. (2010). Tweet by Jason Priem on September 28, 2010. Retrieved January 21, 2013 from https://twitter.com/#!/jasonpriem/status/25844968813.
- Priem, J. (2014). Altmetrics. In B. Cronin, & C. Sugimoto (eds.), Beyond Bibliometrics: Harnessing Multi-dimensional Indicators of Performance. Cambridge, MA: MIT Press.Google Scholar
- Priem, J., & Costello, K. (2010). How and why scholars cite on Twitter. In Proceedings of the 73rd Annual Meeting of the American Society for Information Science and Technology, Pittsburgh, PA, USA. doi: 10.1002/meet.14504701201/full.
- Priem, J., Costello, K., & Dzuba, T. (2011). First-year graduate students just wasting time? Prevalence and use of Twitter among scholars. Presented at the Metrics 2011 Symposium on Informetric and Scientometric Research, New Orleans, LA, USA. Retrieved January 21, 2013 from http://jasonpriem.org/self-archived/5uni-poster.png.
- Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Retrieved January 21, 2013 from http://arxiv.org/abs/1203.4745.
- Priem, J., Taraborelli, D., Groth, P., & Nylon, C. (2010). alt-metrics: a manifesto. Retrieved January 21, 2013 from http://altmetrics.org/manifesto.
- Reher, S., & Haustein, S. (2010). Social bookmarking in STM: Putting services to the acid test. Online - Leading Magazine for Information Professionals, 34(6), 34–42.Google Scholar
- Research Councils UK. (2011, March). Types of impact. Retrieved January 21, 2013 from http://www.rcuk.ac.uk/documents/impacts/TypologyofResearchImpacts.pdf.
- Schlögl, C., Gorraiz, J., Gumpenberger, C., Jack, K., & Kraker, P. (2013). Download vs. vitiation vs. readership data: The case of an information systems journal. In Proceedings of the 14th International Society of Scientometrics and Informetrics Conference (Vol. 1, 626–634).Google Scholar
- Schlögl, C., & Stock, W. G. (2004). Impact and relevance of LIS journals: A scientometric analysis of international and German-language LIS journals—Citation analysis versus reader survey. Journal of the American Society for Information Science and Technology, 55(13), 1155–1168.CrossRefGoogle Scholar
- Shema, H., Bar-Ilan, J., & Thelwall, M. (in press). Do blog citations correlate with higher number of future citations? Journal of the American Society for Information Science and Technology.Google Scholar
- Tenopir, C., & King, D. W. (2000). Towards electronic journals: Realities for scientists, librarians, and publishers. Washington, DC: Special Libraries Association.Google Scholar
- Thelwall, M. (2010). Webometrics: emergent or doomed? Information Research: An International Electronic Journal, 15(4). Retrieved January 21, 2013 from http://informationr.net/ir/15-4/colis713.html.
- Weller, K., & Peters, I. (2012). Citations in Web 2.0. In A. Tokar, M. Beurskens, S. Keuneke, M. Mahrt, I. Peters, C. Puschmann, et al. (eds.), Science and the Internet (pp. 211–224). Düsseldorf: Düsseldorf University Press.Google Scholar
- Weller, K, & Puschmann, C. (2011). Twitter for scientific communication: How can citations/references be identified and measured? In Proceedings of the 3rd ACM International Conference on Web Science, Koblenz, Germany. Retrieved January 21, 2013 from http://journal.webscience.org/500/1/153_paper.pdf.
- Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (submitted). Tweets vs. Mendeley readers: How do these two social media metrics differ? IT—information technology.Google Scholar
- Zahedi, Z., Costas, R., & Wouters, P. (2013). How well developed are altmetrics? Cross disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications. In Proceedings of the 14th International Society of Scientometrics and Informetrics Conference (Vol. 1, pp. 876–884).Google Scholar