Abstract
With the rapid growth of social media, knowledge diffusion of scientific literature comprises not only citation trajectory but also dimension of societal impact. For special types of knowledge diffusion, especially Sleeping Beauties in Science (SBs), it is essential but not adequate to only use citation analysis to measure its trajectory. The impact and value of scientific literature can be fully revealed only by integrating the diffusion trajectory of citation and social media. This study focuses on identifying the possible problems in research on SBs and emphasizes the necessity of Altmetrics-based SB (A-SB) to solve them. Referring to the practice in our earlier study, we identified 7 A-SBs and 11 citation-based SBs (C-SB). The comparative analysis of interdisciplinary and impact between A-SB and C-SB revealed the likely defects in the traditional C-SB research on the measurement of impact in knowledge diffusion, the mining of potential mechanism, the explanation of scientific knowledge diffusion pathways and the discovery of some key scientific literature, and that A-SB plays a vital role in these aspects. In contrast to C-SB, A-SB also offers the possibility to explore pathways for the diffusion of scientific knowledge. Furthermore, a typical A-SB case analysis suggested that A-SB has a unique advantage in discovering some innovative research with potential value ahead.
Similar content being viewed by others
References
Araujo, R. F. (2020). Communities of attention networks: introducing qualitative and conversational perspectives for altmetrics[J]. Scientometrics, 124(3), 1793–1809. https://doi.org/10.1007/s11192-020-03566-7
Ali, A., & Katz, D. (2015). Disease prevention and health promotion: How integrative medicine fits. American Journal of Preventive Medicine., 49, S230–S240. https://doi.org/10.1016/j.amepre.2015.07.019
Akshai, D., Baheti, A. D., & Bhargava, P. (2017). Altmetrics: a measure of social attention toward scientific research. Current Problems in Diagnostic Radiology, 46, 391–392. https://doi.org/10.1067/j.cpradiol.2017.06.005
Bornmann, L. (2012). Measuring the societal impact of research. EMBO Reports, 13(8), 673–676.
Bornmann, L. (2013). What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society for Information Science and Technology, 64(2), 217–233.
Bornmann, L. (2015). Usefulness of Altmetrics for measuring the broader impact of research: A case study using data from plos and f1000prime. Aslib Journal of Information Management, 67(3), 305–319.
Bornmann, L., Haunschild, R., & Adams, J. (2019). Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF). Journal of Informetrics., 13, 325–340. https://doi.org/10.1016/j.joi.2019.01.008
Braun, T., Glänzel, W., & Schubert, A. (2010). On Sleeping Beauties, Princes and other tales of citation distributions. Research Evaluation, 19(3), 195–202.
Butler, J. S., Kaye, I. D., Sebastian, A. S., et al. (2017). The evolution of current research impact metrics: From bibliometrics to altmetrics? Clinical Spine Surgery, 30, 226–228. https://doi.org/10.1097/BSD.000000000000053
Chen, C., & Hicks, D. (2004). Tracing knowledge diffusion. Scientometrics, 59(2), 199–211. https://doi.org/10.1023/B:SCIE.0000018528.59913.48
Cheung, M. (2013). Altmetrics: Too soon for use in assessment. Nature, 494, 176. https://doi.org/10.1038/494176d
Costas, R., van Leeuwen, T. N., & van Raan, A. F. J. (2010). Is scientific literature subject to a “sell-by-date”? a general methodology to analyze the “durability” of scientific documents. Journal of the American Society for Information Science & Technology, 61(2), 329–339.
Costas, R., Zahedi, Z., & Wouters, P. (2015). The thematic orientation of publications mentioned on social media: Large-scale disciplinary comparison of social media metrics with citations. Aslib Journal of Information Management, 67(3), 260–288.
Crotty, D. (2017). Altmetrics. European Heart Journal, 38, 2647–2648. https://doi.org/10.1093/eurheartj/ehx447
Das, A. K., & Mishra, S. (2014). Genesis of altmetrics or article-level metrics for measuring effificacy of scholarly communications: Current perspectives. Journal of Scientometric Research, 3(2), 82–92.
Dinsmore, A., Allen, L., & Dolby, K. (2014). Alternative perspectives on impact:the potential of ALMs and Altmetrics to inform funders about research impact. PLOS Biology, 12, 1002003. https://doi.org/10.1371/journal.pbio.1002003
Du, J., & Wu, Y. S. (2018). A parameter-free index for identifying under-cited sleeping beauties in science. Scientometrics, 116(2), 959–971.
Du, J., & Wu, Y. S. (2018). Sleeping beauties in science: Key characteristics, early identification clues and science policy implications. Studies in Science of Science, 11, 1938–1945. https://doi.org/10.16192/j.cnki.1003-2053.2018.11.003
Egghe, L., Guns, R., & Rousseau, R. (2011). Thoughts on uncitedness: Nobel laureates and Fields medalists as case studies. Journal of the American Society for Information Science and Technology, 62(8), 1637–1644.
El Aichouchi, A., & Gorry, P. (2018). Delayed recognition of Judah Folkman’s hypothesis on tumor angiogenesis: When a Prince awakens a Sleeping Beauty by self-citation. Scientometrics, 116(1), 385–399.
Garfield, E. (1980). Premature discovery or delayed recognition-why? Current Contents, 21, 5–10.
García-Villar, C. (2021). A critical review on altmetrics: Can we measure the social impact factor? Insights into Imaging, 12(1), 92. https://doi.org/10.1186/s13244-021-01033-2
Glänzel, W. (2008). Seven Myths in Bibliometrics. About facts and fiction in quantitative science studies. In: Kretschmer, H. & Havemann, F. (eds.): Proceedings of WIS 2008, Fourth International Conference on Webometrics, Informetrics and Scientometrics & Ninth COLLNET Meeting, (pp. 1–9).
Gorry, P., & Ragouet, P. (2016). “Sleeping beauty” and her restless sleep: Charles Dotter and the birth of interventional radiology. Scientometrics, 107, 773–784.
Guo, F., & Yan, X. Y. (2016). Research review of sleeping beauty in science. Library Development, 05, 40–45.
Haghani, M., & Varamini, P. (2021). Temporal evolution, most influential studies and sleeping beauties of the coronavirus literature. Scientometrics, 126(6), 1–46.
Hammarfelt, B. (2014). Using altmetrics for assessing research impact in the humanities. Scientometrics, 101(2), 1419–1430.
Haustein, S., Peters, I., Sugimoto, C. R., et al. (2013). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656–669.
Haustein, S., Costas, R., & Larivière, V. (2015a). Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(3), e0120495.
Haustein S, Bowman T, & Costas R. (2015b). Interpreting "altmetrics": Viewing acts on social media through the lens of citation and social theories. Theories of Informetrics: A Festschrift in Honor of Blaise Cronin.
Holmberg, K., & Thelwall, M. (2014). Disciplinary differences in Twitter scholarly communication. Scientometrics, 101(2), 1027–1042.
Hou, J., & Yang, X. (2019). Patent sleeping beauties: Evolutionary trajectories and identification methods. Scientometrics, 120(1), 187–215.
Hou, J., & Yang, X. (2020). Social media-based sleeping beauties: Defining, identifying and features. Journal of Informetrics, 14(2), 101012.
Hou, J., Li, H., Zhang, Y., & Gao, J. P. (2020). The evolutionary characteristics of sleeping beauties from the perspectives of Altmetrics. Journal of the China Society for Scientific and Technical Information, 40(9), 934–952.
Hu, X., & Rousseau, R. (2017). Nobel Prize winners 2016: Igniting or sparking foundational publications? Scientometrics, 110, 1053–1063. https://doi.org/10.1007/s11192-016-2205-x
Hyett, M., & Parker, G. (2009). Can the highly cited psychiatric paper be predicted early? Australian and New Zealand Journal of Psychiatry, 43(2), 173–176.
Ke, Q., Ferrara, E., Radicchi, F., & Flammini, A. (2015). Defining and identifying sleeping beauties in science. Proceedings of the National Academy of Sciences of the United States of America, 112(24), 7426.
Kokol, P., Vosner, H. B., & Jernej, Z. (2020). Did Sleeping Papers in nursing research miss their target audience. Scientometrics, 122, 1243–1248. https://doi.org/10.1007/s11192-019-03323-5
Li, J., & Ye, F. Y. (2014a). The phenomenon of all-elements-sleeping-beauties in scientific literature. Scientometrics, 92(3), 795–799.
Li, J., & Ye, F. Y. (2014b). A probe into the citation patterns of high-quality and high-impact publications. Malaysian Journal of Library & Information Science, 19(2), 17–33.
Li, J., & Ye, F. Y. (2016). Distinguishing sleeping beauties in science. Scientometrics, 108(2), 1–8.
Li, X., Thelwall, M., & Giustini, D. (2012). Validating online reference managers for scholarly impact measurement. Scientometrics, 91(2), 461–471.
Lin, J., & Fenner, M. (2013a). The many faces of article-level metrics. Bulletin of the American Society for Information Science and Technology, 39(4), 27–30.
Lin, J., & Fenner, M. (2013b). Altmetrics in evolution: Defining and redefining the ontology of article-level metrics. Information Standards Quarterly, 25(2), 20–26.
Leydesdorff, L., Wagner, C. S., & Bornmann, L. (2019a). Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient. Journal of Informetrics, 13(1), 255–269.
Leydesdorff, L., Wagner, C. S., & Bornmann, L.(2019b).Annex to:Interdisciplinarity as Diversity in Citation Patterns among Journals: Rao-Stirling Diversity, Relative Variety, and the Gini coefficient, from.https://leydesdorff.github.io/diversity_measurement/
Mcallister, P. R., Narin, F., & Corrigan, J. G. (1983). Programmatic evaluation and comparison based on standardized citation scores. IEEE Transactions on Engineering Management, 30(4), 205–211.
Merton, R. K. (1973). The sociology of science. Theoretical and empirical investigations. University of Chicago Press.
Melero, R. (2015). Altmetrics a complement to conventional metrics. Biochemia Medica, 25, 152–160. https://doi.org/10.11613/BM.2015.016
Michaela, M., Miriam, O., & Šušol, J. (2021). Bibliometrics versus altmetrics: Researchers’ attitudes in Slovakia. Iberoamerican Journal of Science Measurement and Communication. https://doi.org/10.47909/ijsmc.11
Miura, T., Asatani, K., & Sakata, I. (2021). Large-scale analysis of delayed recognition using sleeping beauty and the prince. Applied Network Science. https://doi.org/10.1007/S41109-021-00389-0
Mohammadi, E., Thelwall, M., Kwasny, M., & Holmes, K. L. (2018). Academic information on Twitter: A user survey. PLoS ONE, 13(5), 0197265. https://doi.org/10.1371/journal.pone.0197265
Mohammadi, E., Gregory, K. B., & Thelwall, M. (2020). Which health and biomedical topics generate the most Facebook interest and the strongest citation relationships? Information Processing and Management, 57(3), 102230.
NISO. (2016). NISO RP-25–2016 Outputs of the NISO Alternative Assessment Project. https://groups.niso.org/higherlogic/ws/public/download/17091
O’Connor, E. M., Nason, G. J., et al. (2017). Newsworthiness vs scientific impact: are the most highly cited urology papers the most widely disseminated in the media? BJU International, 120(3), 441–454. https://doi.org/10.1111/bju.13881
Parker, J., & Van Teijlingen, E. (2012). The Research Excellence Framework(REF): Assessing the impact of social work research on society. Practice, 24(1), 41–52.
Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Altmetrics: A manifesto. Retrieved March 20, 2020 from the http://altmetrics.org/manifesto/
Priem, J., Piwowar, H., & Hemminger, B. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Retrieved March 20, 2020 from the https://arxiv.org/abs/1203.4745v1/
Qin, F., & Gao, J. (2019). Comparative analysis of Altmetrics and citation measurement based on the Scopus database. Journal of the China Society for Scientific and Technical Information, 38(4), 377–383.
Qiu J., & Yu H. (2015). Stratifying Altmetrics Indicators Based on Impact Generation Model. International Conference on Scientometrics and Informetrics.
Ravenscroft, J., Liakata, M., Clare, A., & Duma, D. (2017). Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements. PLoS ONE, 12(3), e0173152.
Redner, S. (2005). Citation statistics for more than a century of physical review. Physics Today, 58(6), 49–54.
Rinia, E., Van Leeuwen, T., Bruins, E., et al. (2001). Citation delay in interdisciplinary knowledge exchange. Scientometrics, 51(1), 293–309. https://doi.org/10.1023/A:1010589300829
Roemer, R. C., & Borchardt, R. (2015). Meaningful metrics: A 21st century librarian's guide to bibliometrics, altmetrics, and research impact. Association of College and Research Libraries, A division of the American Library Association.
Stern, N. (2016). Lord Stern' s review of the Research Excellence Framework: call for evidence. https://exchange.nottingham.ac.uk/content/uploads/Stern-review.pdf
Stirling, A. (2007). A general framework for analysing diversity in science, technology and society. Journal of the Royal Society Interface, 4(15), 707–719.
Sun, J., Min, C., & Li, J. (2016). A vector for measuring obsolescence of scientific articles. Scientometrics, 107(2), 745–757.
Szczurko, O., Cooley, K., Busse, J. W., Seely, D., Bernhardt, B., et al. (2007). Naturopathic care for chronic low back pain: A randomized trial. PLoS ONE, 2(9), 919. https://doi.org/10.1371/journal.pone.0000919
Taberner, R. (2018). Altmetrics: Beyond the impact factor. Actas Dermosifiliogr (english Edition), 109, 95–97. https://doi.org/10.1016/j.ad.2018.01.002
Teixeira, A. A. C., Vieira, P. C., & Abreu, A. P. (2017). Sleeping Beauties and their princes in innovation studies. Scientometrics, 110(2), 541–580.
Thelwall, M., Haustein, S., et al. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS ONE, 8(5), e64841.
Thelwall, M., Kousha, K., Dinsmore, A., & Dolby, K. (2015). Alternative metric indicators for funding scheme evaluations. Aslib Journal of Information Management, 68(1), 2–18. https://doi.org/10.1108/AJIM-09-2015-0146
Thelwall, M. (2018). Early Mendeley readers correlate with later citation counts. Scientometrics, 115(3), 1231–1240. https://doi.org/10.1007/s11192-018-2715-9
Thelwall, M. (2021). Alternative medicines worth researching? Citation analyses of acupuncture, chiropractic, homeopathy, and osteopathy 1996–2017. Scientometrics, 126(1), 8731–8747. https://doi.org/10.1007/s11192-021-04145-0
van Raan, A. F. J. (2004). Sleeping beauties in science. Scientometrics, 59(3), 467–472.
van Raan, A. F. J. (2015). Dormitory of physical and engineering sciences: Sleeping beauties may be sleeping innovations. PLoS ONE, 10(10), e0139786.
van Raan, A. F. J. (2017). Sleeping beauties cited in patents: Is there also a dormitory of inventions? Scientometrics, 110(3), 1123–1156.
van Raan, A. F. J., & Winnink, J. J. (2018). Do younger Sleeping Beauties prefer a technological prince? Scientometrics, 114(2), 701–717.
van Raan, A. F. J. (2021). Sleeping beauties gain impact in overdrive mode. Scientometrics, 126(6), 1–22.
Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics, 10(2), 365–391.
Wang, X., Mao, W., Xu, S., & Zhang, C. (2014). Usage history of scientific literature: Nature metrics and metrics of Nature publications. Scientometrics, 98, 1923–1933.
Wang, X. G., Lv, T., & Donald, H. (2019). How do altmetric sources evaluate scientific collaboration? An empirical investigation for Chinese collaboration publications. Library, 38(3), 563–576.
Wu, S. N., & Zhao, R. Y. (2016). Research on status and development trend of altmetrics tools. Document, Information & Knowledge, 33(1), 84–93. https://doi.org/10.13366/j.dik.2016.01.084
Zahedi, Z., Costas, R., & Wouters, P. (2014). How well developed are altmetrics? A cross-disciplinary analysis of the presence of “alternative metrics” in scientific publications. Scientometrics, 101, 1491–1513.
Zingg, C., Nanumyan, V., & Schweitzer, F. (2020). Citations driven by so-cial connections? A multi-layer representation of coauthorship networks. Quantitative Science Studies, 1, 1493–1509. https://doi.org/10.1162/qss_a_00092
Zhai, S. S., Ye, D. L., Hu, P., et al. (2020). Evaluation of the academic impact of data papers fused with altmetrics and citation analysis. Journal of the China Society for Scientific and Technical Information, 39(7), 710–718.
Zhang, H. H., & Ye, F. Y. (2020). Identifying “associated-sleeping-beauties” in “swan-groups” based on small qualified datasets of physics and economics. Scientometrics, 122(3), 1525–1537.
Zhang, L., Rousseau, R., & Glänzel, W. (2016). Diversity of references as an indicator for interdisciplinarity of journals: Taking similarity between subject fields into account. Journal of the Association for Information Science and Technology, 67(5), 1257–1265.
Zhang, L., & Wang, J. (2018). Why highly cited articles are not highly tweeted? A biology case Scientometrics, 117(1), 495–509.
Zhang, L., Sun, B. B., & Wang, X. W. (2020). The impact of interdisciplinarity: distinct effects on usage and citation. Journal of the China Society for Scientific and Technical Information, 39(5), 469–477.
Zhao, W., Korobskiy, D., & Chacko, G. (2020). Delayed recognition: the co-citation perspective. Frontiers in Research Metrics and Analytics, 5, 577131. https://doi.org/10.3389/frma.2020.577131
Zong, Z., Liu, X., & Fang, H. (2018). Sleeping beauties with no prince based on the co-citation criterion. Scientometrics, 117(3479), 1841–1852. https://doi.org/10.1007/s11192018-2932-2
Acknowledgements
This research was supported by The National Social Science Fund of China(Grant No. 20BTQ085), and The Soft Science Project of Science and Technology Program of Guangdong Province(CN), 2019B101001024.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have declared that no competing interests exist.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hou, J., Li, H. & Zhang, Y. Altmetrics-based sleeping beauties: necessity or just a supplement?. Scientometrics 128, 5477–5506 (2023). https://doi.org/10.1007/s11192-023-04798-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-023-04798-z