Do ResearchGate Scores create ghost academic reputations?

Abstract

The academic social network site ResearchGate (RG) has its own indicator, RG Score, for its members. The high profile nature of the site means that the RG Score may be used for recruitment, promotion and other tasks for which researchers are evaluated. In response, this study investigates whether it is reasonable to employ the RG Score as evidence of scholarly reputation. For this, three different author samples were investigated. An outlier sample includes 104 authors with high values. A Nobel sample comprises 73 Nobel winners from Medicine and Physiology, Chemistry, Physics and Economics (from 1975 to 2015). A longitudinal sample includes weekly data on 4 authors with different RG Scores. The results suggest that high RG Scores are built primarily from activity related to asking and answering questions in the site. In particular, it seems impossible to get a high RG Score solely through publications. Within RG it is possible to distinguish between (passive) academics that interact little in the site and active platform users, who can get high RG Scores through engaging with others inside the site (questions, answers, social networks with influential researchers). Thus, RG Scores should not be mistaken for academic reputation indicators.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Notes

  1. 1.

    https://aminer.org.

  2. 2.

    http://academic.research.microsoft.com.

  3. 3.

    https://scholar.google.com/citations.

  4. 4.

    https://www.researcherid.com.

  5. 5.

    http://orcid.org.

  6. 6.

    https://www.mendeley.com/profiles.

  7. 7.

    https://www.academia.edu/.

  8. 8.

    https://www.researchgate.net.

  9. 9.

    https://www.researchgate.net/jobs.

  10. 10.

    https://www.researchgate.net/press.

  11. 11.

    https://www.researchgate.net/publicprofile.RGScoreFAQ.html.

  12. 12.

    https://doi.org/10.13140/RG.2.2.26322.35526

  13. 13.

    https://www.researchgate.net/post/Which_researcher_has_the_highest_RG_score_and_what_does_that_really_mean.

  14. 14.

    http://www.nobelprize.org.

References

  1. Bosman, J. & Kramer, B. (2016). Innovations in scholarly communicationdata of the global 20152016 survey. Available at: http://zenodo.org/record/49583#. Accessed December 11, 2016.

  2. González-Díaz, C., Iglesias-García, M., & Codina, L. (2015). Presencia de las universidades españolas en las redes sociales digitales científicas: Caso de los estudios de comunicación. El profesional de la información, 24(5), 1699–2407.

    Article  Google Scholar 

  3. Goodwin, S., Jeng, W., & He, D. (2014). Changing communication on ResearchGate through interface updates. Proceedings of the American Society for Information Science and Technology, 51(1), 1–4.

    Article  Google Scholar 

  4. Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). The Leiden Manifesto for research metrics. Nature, 520(7548), 429–431.

    Article  Google Scholar 

  5. Hoffmann, C. P., Lutz, C., & Meckel, M. (2015). A relational altmetric? Network centrality on ResearchGate as an indicator of scientific impact. Journal of the Association for Information Science and Technology, 67(4), 765–775.

    Article  Google Scholar 

  6. Jiménez-Contreras, E., de Moya Anegón, F., & Delgado López-Cózar, E. (2003). The evolution of research activity in Spain: The impact of the National Commission for the Evaluation of Research Activity (CNEAI). Research Policy, 32(1), 123–142.

    Article  Google Scholar 

  7. Jordan, K. (2014a). Academics’ awareness, perceptions and uses of social networking sites: Analysis of a social networking sites survey dataset (December 3, 2014). Available at: http://dx.doi.org/10.2139/ssrn.2507318. Accessed December 11, 2016.

  8. Jordan, K. (2014b). Academics and their online networks: Exploring the role of academic social networking sites. First Monday, 19(11). Available at: http://dx.doi.org/10.5210/fm.v19i11.4937. Accessed December 11, 2016.

  9. Jordan, K. (2015). Exploring the ResearchGate score as an academic metric: reflections and implications for practice. Quantifying and Analysing Scholarly Communication on the Web (ASCW’15), 30 June 2015, Oxford. Available at: http://ascw.know-center.tugraz.at/wp-content/uploads/2015/06/ASCW15_jordan_response_kraker-lex.pdf. Accessed December 11, 2016.

  10. Kadriu, A. (2013). Discovering value in academic social networks: A case study in ResearchGate. Proceedings of the ITI 201335th Int. Conf. on Information Technology Interfaces Information Technology Interfaces, pp. 57–62.

  11. Kraker, P. & Lex, E. (2015). A critical look at the ResearchGate score as a measure of scientific reputation. Proceedings of the Quantifying and Analysing Scholarly Communication on the Web workshop (ASCW’15), Web Science conference 2015. Available at: http://ascw.know-center.tugraz.at/wp-content/uploads/2016/02/ASCW15_kraker-lex-a-critical-look-at-the-researchgate-score_v1-1.pdf. Accessed December 11, 2016.

  12. Li, L., He, D., Jeng, W., Goodwin, S. & Zhang, C. (2015). Answer quality characteristics and prediction on an academic Q&A Site: A case study on ResearchGate. Proceedings of the 24th International Conference on World Wide Web Companion, pp. 1453–1458.

  13. Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M. & Delgado López-Cózar, E. (2016). The counting house: measuring those who count. Presence of Bibliometrics, Scientometrics, Informetrics, Webometrics and Altmetrics in the Google Scholar Citations, ResearcherID, ResearchGate, Mendeley & Twitter. Available at: https://arxiv.org/abs/1602.02412. Accessed December 11, 2016.

  14. Martín-Martín, A., Orduna-Malea, E. & Delgado López-Cózar, E. (2016). The role of ego in academic profile services: Comparing Google Scholar, ResearchGate, Mendeley, and ResearcherID. Researchgate, Mendeley, and Researcherid. The LSE Impact of Social Sciences blog. Available at: http://blogs.lse.ac.uk/impactofsocialsciences/2016/03/04/academic-profile-services-many-mirrors-and-faces-for-a-single-ego. Accessed December 11, 2016.

  15. Matthews, D. (2016). Do academic social networks share academics’ interests?. Times Higher Education. Available at: https://www.timeshighereducation.com/features/do-academic-social-networks-share-academics-interests. Accessed December 11, 2016.

  16. Memon, A. R. (2016). ResearchGate is no longer reliable: leniency towards ghost journals may decrease its impact on the scientific community. Journal of the Pakistan Medical Association, 66(12), 1643–1647.

    Google Scholar 

  17. Mikki, S., Zygmuntowska, M., Gjesdal, Ø. L. & Al Ruwehy, H. A. (2015). Digital presence of norwegian scholars on academic network sites-where and who are they?. Plos One 10(11). Available at: http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0142709. Accessed December 11, 2016.

  18. Nicholas, D., Clark, D., & Herman, E. (2016). ResearchGate: Reputation uncovered. Learned Publishing, 29(3), 173–182.

    Article  Google Scholar 

  19. Orduna-Malea, E., Martín-Martín, A., & Delgado López-Cózar, E. (2016). The next bibliometrics: ALMetrics (Author Level Metrics) and the multiple faces of author impact. El profesional de la información, 25(3), 485–496.

    Article  Google Scholar 

  20. Ortega, Jose L. (2015). Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC’s members. Journal of informetrics, 9(1), 39–49.

    Article  Google Scholar 

  21. Ortega, Jose L. (2016). Social network sites for scientists. Cambridge: Chandos.

    Google Scholar 

  22. Ovadia, S. (2014). ResearchGate and Academia. edu: Academic social networks. Behavioral & Social Sciences Librarian, 33(3), 165–169.

    Article  Google Scholar 

  23. Thelwall, M., & Kousha, K. (2015). ResearchGate: Disseminating, communicating, and measuring Scholarship? Journal of the Association for Information Science and Technology, 66(5), 876–889.

    Article  Google Scholar 

  24. Thelwall, M. & Kousha, K. (2017). ResearchGate articles: Age, discipline, audience size and impact. Journal of the Association for Information Science and Technology, 68(2), 468–479.

    Article  Google Scholar 

  25. Van Noorden, R. (2014). Online collaboration: Scientists and the social network. Nature, 512(7513), 126–129.

    Article  Google Scholar 

  26. Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S. et al. (2015). The Metric Tide: Independent Review of the Role of Metrics in Research Assessment and Management. HEFCE. Available at: http://doi.org/10.13140/RG.2.1.4929.1363. Accessed December 11, 2016.

Download references

Acknowledgements

Alberto Martín-Martín enjoys a four-year doctoral fellowship (FPU2013/05,863) granted by the Ministerio de Educación, Cultura, y Deporte (Spain). Enrique Orduna-Malea holds a postdoctoral fellowship (PAID-10-14), from the Polytechnic University of Valencia (Spain).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Emilio Delgado López-Cózar.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 133 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Orduna-Malea, E., Martín-Martín, A., Thelwall, M. et al. Do ResearchGate Scores create ghost academic reputations?. Scientometrics 112, 443–460 (2017). https://doi.org/10.1007/s11192-017-2396-9

Download citation

Keywords

  • Academic social networks
  • ResearchGate
  • Altmetrics
  • Research evaluation
  • Bibliometrics