OTARIOS: OpTimizing Author Ranking with Insiders/Outsiders Subnetworks

  • Jorge SilvaEmail author
  • David Aparício
  • Fernando Silva
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 812)


Evaluating scientists based on their scientific production is often a controversial topic. Nevertheless, bibliometrics and algorithmic approaches can assist traditional peer review in numerous tasks, such as attributing research grants, deciding scientific committees, or choosing faculty promotions. Traditional bibliometrics focus on individual measures, disregarding the whole data (i.e., the whole network). Here we put forward OTARIOS, a graph-ranking method which combines multiple publication/citation criteria to rank authors. OTARIOS divides the original network in two subnetworks, insiders and outsiders, which is an adequate representation of citation networks with missing information. We evaluate OTARIOS on a set of five real networks, each with publications in distinct areas of Computer Science. When matching a metric’s produced ranking with best papers awards received, we observe that OTARIOS is \({>} 20\%\) more accurate than traditional bibliometrics. We obtain the best results when OTARIOS considers (i) the author’s publication volume and publication recency, (ii) how recently his work is being cited by outsiders, and (iii) how recently his work is being cited by insiders and how individual he his.



This work is partially funded by the ERDF through the COMPETE 2020 Programme within project POCI-01-0145-FEDER-006961, and by National Funds through the FCT as part of project UID/EEA/50014/2013. Jorge Silva is supported by a FCT/MAP-i PhD grant (PD/BD/128157/2016). David Aparício is also supported by a FCT/MAP-i PhD grant (PD/BD/105801/2014).


  1. 1.
    Elvesier, B.V.: Research Metrics Guidebook. Elvesier, Amsterdam (2018)Google Scholar
  2. 2.
    Ding, Y.: Applying weighted pagerank to author citation networks. J. Am. Soc. Inf. Sci. Technol. 62(2), 236–245 (2009).
  3. 3.
    Dunaiski, M., Visser, W.: Comparing paper ranking algorithms.In: Proceedings of the South African Institute for ComputerScientists and Information Technologists Conference, pp. 21–30. ACM (2012)Google Scholar
  4. 4.
    Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102(46), 16569–16572 (2005)Google Scholar
  5. 5.
    Hwang, W.S., Chae, S.M., Kim, S.W., Woo, G.: Yet another paper ranking algorithm advocating recent publications. In: Proceedings of the 19th International Conference on World Wide Web, pp. 1117–1118. ACM (2010)Google Scholar
  6. 6.
    Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst. (TOIS) 20(4), 422–446 (2002)Google Scholar
  7. 7.
    Page, L., Brin, S., Motwani, R., Winograd, T., et al.: The Pagerank Citation Ranking: Bringing Order to the Web (1998)Google Scholar
  8. 8.
    Radicchi, F., Fortunato, S., Markines, B., Vespignani, A.: Diffusion of scientific credits and the ranking of scientists. Phys. Rev. E 80(5), 056,103 (2009)Google Scholar
  9. 9.
    Sidiropoulos, A., Manolopoulos, Y.: Generalized comparison of graph-based ranking algorithms for publications and authors. J. Syst. Softw. 79(12), 1679–1700 (2006)Google Scholar
  10. 10.
    Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: Arnetminer: Extraction and Mining of Academic Social Networks. In: KDD 2008, pp. 990–998 (2008)Google Scholar
  11. 11.
    Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: Citation Network Dataset. (2017). Accessed 14 Sep 2018
  12. 12.
    Valente, T.W., Coronges, K., Lakon, C., Costenbader, E.: How correlated are network centrality measures? Connections (Toronto, Ont.) 28(1), 16 (2008)Google Scholar
  13. 13.
    Vieira, E.S., Cabral, J.A., Gomes, J.A.: How good is a model based on bibliometric indicators in predicting the final decisions made by peers? J. Inf. 8(2), 390–405 (2014)Google Scholar
  14. 14.
    Wang, H., Shen, H.W., Cheng, X.Q.: Scientific credit diffusion: researcher level or paper level? Scientometrics 109(2), 827–837 (2016)Google Scholar
  15. 15.
    West, J.D., Jensen, M.C., Dandrea, R.J., Gordon, G.J., Bergstrom, C.T.: Author-level eigenfactor metrics: Evaluating the influence of authors, institutions, and countries within the social science research network community. J. Am. Soc. Inf. Sci. Technol. 64(4), 787–801 (2013)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.CRACS & INESC-TEC, DCC-FCUPUniversidade do PortoPortoPortugal

Personalised recommendations