, Volume 120, Issue 3, pp 1333–1349 | Cite as

Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation

  • Yundong Xie
  • Qiang WuEmail author
  • Xingchen Li


Evaluating the scholarly reputation of journals has become one of the key concerns and research focuses in academia. The scholarly performance of a journal’s editorial team helps to enhance the journal’s academic impact. This paper develops an editorial team scholarly index from the new perspective of journal editorship, combining the editors’ scholarly performance and the editors’ titles (e.g., associate, assistant) to provide an alternative indicator for evaluating academic journal reputation. This index is useful to measure and rank journals, especially new journals. The paper classifies journal editorial teams and evaluates academic journals using data for 738 members of editorial teams for 21 well-known journals in the field of library and information science. The study concludes that the new index has a significantly positive relationship with journal reputation and shows that the journals’ rankings according to the new index are neither far away from nor uselessly close to the four baseline indicators traditionally measuring journal reputation. Finally, the research finds that there are significant positive correlations between journal reputation and the new index when three different levels of titles of editors are considered, and a comparative empirical analysis of the title levels is provided.


Editorial team scholarly index Journal reputation Journal rankings Editorial title Bibliometric indicators H-index Impact factor Citation analysis Scholarly performance 



This research was supported by the National Natural Science Foundation of China (Grants 71874173 and 71273250) and the Academic Division of Mathematics and Physics of the Chinese Academy of Sciences (Grant No. 2018-M04-B-004). We would like to thank the editor and anonymous reviewers for their constructive comments and suggestions, which helped us to improve the paper.


  1. Andrikopoulos, A., & Economou, L. (2015). Editorial board interlocks in financial economics. International Review of Financial Analysis, 37, 51–62.Google Scholar
  2. Asnafi, S., Gunderson, T., McDonald, R. J., & Kallmes, D. F. (2017). Association of h-index of editorial board members and impact factor among radiology journals. Academic Radiology, 24(2), 119–123.Google Scholar
  3. Baccini, A., & Barabesi, L. (2011). Seats at the table: The network of the editorial boards in information and library science. Journal of Informetrics, 5(3), 382–391.Google Scholar
  4. Bedeian, A. G., Van Fleet, D. D., & Hyman, H. H. (2009). Scientific achievement and editorial board membership. Organizational Research Methods, 12(2), 211–238.Google Scholar
  5. Besancenot, D., Huynh, K. V., & Faria, J. R. (2012). Search and research: The influence of editorial boards on journals’ quality. Theory and Decision, 73(4), 687–702.MathSciNetzbMATHGoogle Scholar
  6. Braun, T., Dióspatonyi, I., Zsindely, S., & Zádor, E. (2007). Gatekeeper index versus impact factor of science journals. Scientometrics, 71(3), 541–543.Google Scholar
  7. Braun, T., Glänzel, W., & Schubert, A. (2006). A Hirsch-type index for journals. Scientometrics, 69(1), 169–173.Google Scholar
  8. Burgess, T. F., & Shaw, N. E. (2010). Editorial board membership of management and business journals: A social network analysis study of the financial times 40. British Journal of Management, 21(3), 627–648.Google Scholar
  9. Cai, L., Tian, J., Liu, J., Bai, X., Lee, I., Kong, X., et al. (2019). Scholarly impact assessment: A survey of citation weighting solutions. Scientometrics, 118(2), 453–478.Google Scholar
  10. Callaway, E. (2016). Publishing elite turns against impact factor. Nature, 535(7611), 210–211.Google Scholar
  11. Chan, K. C., & Fok, R. C. (2003). Membership on editorial boards and finance department rankings. Journal of Financial Research, 26(3), 405–420.Google Scholar
  12. da Silva, J. A. T., & Al-Khatib, A. (2017). How are editors selected, recruited and approved? Science and Engineering Ethics, 23(6), 1801–1804.Google Scholar
  13. Faria, J. R. (2005). The game academics play: Editors versus authors. Bulletin of Economic Research, 57(1), 1–12.MathSciNetGoogle Scholar
  14. Finlay, S. C., Ni, C., Tsou, A., & Sugimoto, C. R. (2013). Publish or practice? An examination of librarians’ contributions to research. portal: Libraries and the Academy, 13(4), 403–421.Google Scholar
  15. Frey, B. S., & Rost, K. (2010). Do rankings reflect research quality? Journal of Applied Economics, 13(1), 1–38.Google Scholar
  16. García-Carpintero, E., Granadino, B., & Plaza, L. M. (2010). The representation of nationalities on the editorial boards of international journals and the promotion of the scientific output of the same countries. Scientometrics, 84(3), 799–811.Google Scholar
  17. Giménez-Toledo, E., Román-Román, A., Perdiguero, P., & Palencia, I. (2009). The editorial boards of Spanish scholarly journals: What are they like? What should they be like? Journal of Scholarly Publishing, 40(3), 287–306.Google Scholar
  18. Glänzel, W. (2006). On the opportunities and limitations of the H-index. Science Focus, 1(1), 10–11. English version retrieved from
  19. Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572.zbMATHGoogle Scholar
  20. Hirsch, J. E. (2019). hα: An index to quantify an individual’s scientific leadership. Scientometrics, 118(2), 673–686.Google Scholar
  21. Kay, J., Memon, M., de Sa, D., Simunovic, N., Duong, A., Karlsson, J., et al. (2017). The h-index of editorial board members correlates positively with the impact factor of sports medicine journals. Orthopaedic Journal of Sports Medicine, 5(3), 2325967117694024.Google Scholar
  22. Konrad, A. M. (2008). Knowledge creation and the journal editor’s role. In Y. Baruch, A. M. Konrad, H. Aguinis, & W. H. Starbuck (Eds.), Opening the black box of editorship (pp. 3–15). New York: Palgrave MacMillan.Google Scholar
  23. Lowe, D. J., & Van Fleet, D. D. (2009). Scholarly achievement and accounting journal editorial board membership. Journal of Accounting Education, 27(4), 197–209.Google Scholar
  24. Mauleón, E., Hillán, L., Moreno, L., Gómez, I., & Bordons, M. (2013). Assessing gender balance among journal authors and editorial board members. Scientometrics, 95(1), 87–114.Google Scholar
  25. Mazov, N. A., & Gureev, V. N. (2016). The editorial boards of scientific journals as a subject of scientometric research: A literature review. Scientific and Technical Information Processing, 43(3), 144–153.Google Scholar
  26. Mendonça, S., Pereira, J., & Ferreira, M. E. (2018). Gatekeeping African studies: What does “editormetrics” indicate about journal governance? Scientometrics, 117(3), 1513–1534.Google Scholar
  27. Metz, I., Harzing, A. W., & Zyphur, M. J. (2016). Of journal editors and editorial boards: Who are the trailblazers in increasing editorial board gender equality? British Journal of Management, 27(4), 712–726.Google Scholar
  28. Mingers, J., & Yang, L. (2017). Evaluating journal quality: A review of journal citation indicators and ranking in business and management. European Journal of Operational Research, 257(1), 323–337.MathSciNetzbMATHGoogle Scholar
  29. Mukaka, M. M. (2012). A guide to appropriate use of correlation coefficient in medical research. Malawi Medical Journal, 24(3), 69–71.Google Scholar
  30. Nisonger, T. (2002). The relationship between international editorial board composition and citation measures in political science, business, and genetics journals. Scientometrics, 54(2), 257–268.Google Scholar
  31. Oleinik, A. (2014). Conflict (s) of interest in peer review: Its origins and possible solutions. Science and Engineering Ethics, 20(1), 55–75.Google Scholar
  32. Pagel, P. S., & Hudetz, J. A. (2011). Bibliometric analysis of anaesthesia journal editorial board members: Correlation between journal impact factor and the median h-index of its board members. British Journal of Anaesthesia, 107(3), 357–361.Google Scholar
  33. Paulus, F. M., Cruz, N., & Krach, S. (2018). The impact factor fallacy. Frontiers in Psychology, 9, 1487.Google Scholar
  34. Petersen, J., Hattke, F., & Vogel, R. (2017). Editorial governance and journal impact: A study of management and business journals. Scientometrics, 112(3), 1593–1614.Google Scholar
  35. Resnik, D. B., & Elmore, S. A. (2016). Ensuring the quality, fairness, and integrity of journal peer review: A possible role of editors. Science and Engineering Ethics, 22(1), 169–188.Google Scholar
  36. Roth, W. M. (2002). Editorial power/authorial suffering. Research in Science Education, 32(2), 215–240.Google Scholar
  37. Straub, D., & Anderson, C. (2010). Journal quality and citations: Common metrics and considerations about their use. MIS Quarterly, 34(1), iii–xii.Google Scholar
  38. Teixeira, E. K., & Oliveira, M. (2018). Editorial board interlocking in knowledge management and intellectual capital research field. Scientometrics, 117(3), 1853–1869.Google Scholar
  39. Tsui, A. S., & Hollenbeck, J. R. (2009). Successful authors and effective reviewers: Balancing supply and demand in the organizational sciences. Organizational Research Methods, 12(2), 259–263.Google Scholar
  40. Walters, W. H. (2016). The research contributions of editorial board members in library and information science. Journal of Scholarly Publishing, 47(2), 121–146.Google Scholar
  41. Walters, W. H. (2017a). Citation-based journal rankings: Key questions, metrics, and data sources. IEEE Access, 5, 22036–22053.Google Scholar
  42. Walters, W. H. (2017b). Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact? Journal of Informetrics, 11(3), 730–744.Google Scholar
  43. Walters, W. H., & Wilder, E. I. (2016). Disciplinary, national, and departmental contributions to the literature of library and information science, 2007–2012. Journal of the Association for Information Science and Technology, 67(6), 1487–1506.Google Scholar
  44. Wu, D., Li, J., Lu, X., & Li, J. (2018). Journal editorship index for assessing the scholarly impact of academic institutions: An empirical analysis in the field of economics. Journal of Informetrics, 12(2), 448–460.Google Scholar
  45. Zdeněk, R. (2018). Editorial board self-publishing rates in Czech economic journals. Science and Engineering Ethics, 24(2), 669–682.Google Scholar
  46. Zdeněk, R., & Lososová, J. (2018). An analysis of editorial board members’ publication output in agricultural economics and policy journals. Scientometrics, 117(1), 563–578.Google Scholar
  47. Zhang, J., Zhao, Y., & Wang, Y. (2016). A study on statistical methods used in six journals of library and information science. Online Information Review, 40(3), 416–434.Google Scholar
  48. Zsindely, S., Schubert, A., & Braun, T. (1982). Editorial gatekeeping patterns in international science journals: A new science indicator. Scientometrics, 4(1), 57–68.Google Scholar

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2019

Authors and Affiliations

  1. 1.School of ManagementUniversity of Science and Technology of ChinaHefeiChina

Personalised recommendations