Skip to main content
SpringerLink
Log in

Ranking Journals in Sociology, Education, and Public Administration by Social Choice Theory Methods

  • Chapter
  • First Online:
Recent Advances in Game Theory and Applications

Part of the book series: Static & Dynamic Game Theory: Foundations & Applications ((SDGTFA))

Abstract

An analysis of journals’ rankings based on five commonly used bibliometric indicators (impact factor, article influence score, SNIP, SJR, and H-index) has been conducted. It is shown that despite the high correlation, these single-indicator-based rankings are not identical. Therefore, new approach to ranking academic journals is proposed based on the aggregation of single bibliometric indicators using several ordinal aggregation procedures. In particular, we use the threshold procedure, which allows to reduce opportunities for manipulations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This product is based on another Thomson database, Web of Science (WoS). WoS contains citation data on an individual paper level, while JCR aggregates citation indicators for journals as a whole.

  2. 2.

    http://www.journalmetrics.com/values.php. As of 2013 “optimized” values of SNIP (the so-called SNIP2) are published. We use older version of SNIP intentionally, since it has already been tested for a while by the academic community. The latest published data are the values for the first half of 2013. The same is to be said about SJR (see below).

References

  1. Aizerman, M., Aleskerov, F.: Theory of Choice. Amsterdam: North-Holland/Elsevier (1995)

    MATH  Google Scholar 

  2. Aleskerov, F., Chistyakov, V., Kalyagin, V.: Social threshold aggregations. Soc. Choice Welf. 35 (4), 627–646 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  3. Aleskerov, F.T., Pislyakov, V.V., Subochev, A.N., Chistyakov, A.G.: Rankings of management science journals constructed by methods from Social Choice Theory: Working paper WP7/2011/04. National Research University Higher School of Economics, Moscow (2011) (in Russian)

    Google Scholar 

  4. Aleskerov, F., Kataeva, E., Pislyakov, V., Yakuba, V.: ‘Evaluation of scientists’ output using the method of threshold aggregation. Large-scale Syst. Control 44, 172–189 (2013) (in Russian)

    Google Scholar 

  5. Aleskerov, F.T., Pislyakov, V.V., Subochev, A.N.: Rankings of economic journals constructed by methods from Social Choice Theory: Working paper WP7/2013/03. Moscow: National Research University Higher School of Economics (2013) (in Russian)

    Google Scholar 

  6. Aleskerov, F., Pislyakov, V., Subochev, A.: Ranking Journals in Economics, Management and Political Science by Social Choice Theory Methods. Working paper WP BRP 27/STI/2014, 39 p. Publishing House of the Higher School of Economics, Moscow (2014)

    Google Scholar 

  7. Aleskerov, F.T, Boriskova, A.M., Pislyakov, V.V., Yakuba V.I.: Ranking journals in sociology, education and public administration by social choice theory methods. https://www.hse.ru/pubs/share/direct/document/175522561 (2016)

    Google Scholar 

  8. Braun, T., Glä nzel, W., Schubert, A.: A Hirsch-type index for journals. Scientometrics 69 (1), 169–173 (2006)

    Google Scholar 

  9. Chebotarev, P., Shamis, E.: Preference fusion when the number of alternatives exceeds two: indirect scoring procedures. J. Frankl. Inst. 336, 205–226 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  10. Copeland, A.H.: A reasonable social welfare function (mimeo). Seminar on Application of Mathematics to the Social Sciences. University of Michigan, Ann Arbor (1951)

    Google Scholar 

  11. Daniels, H.E.: Round-robin tournament scores. Biometrica 56, 295–299 (1969)

    Article  Google Scholar 

  12. Egghe, L.: Mathematical relations between impact factors and average number of citations. Inf. Process. Manag. 24, 567–576 (1988)

    Article  Google Scholar 

  13. Epstein, D.: Impact factor manipulation. J. Eur. Med. Writ. Assoc. 16 (3), 133–134 (2007)

    Google Scholar 

  14. Fisher, J, Shanks, G., Lamp, J.W.: A ranking list for information systems journals. Aust. J. Inf. Syst. 14 (2), 5–18 (2007)

    Google Scholar 

  15. Garfield, E., Sher, I.H.: New factors in the evaluation of scientific literature through citation indexing. Am. Doc. 14 (3), 195–201 (1963)

    Article  Google Scholar 

  16. Glänzel, W., Moed, H.F.: Journal impact measures in bibliometric research. Scientometrics 53 (2), 71–193 (2002)

    Article  Google Scholar 

  17. Gonzalez-Pereira, B., Guerrero-Bote, V., Moya-Anegon, F.: A new approach to the metric of journals scientific prestige: the SJR indicator. J. Inf. 4 (3), 379–391 (2010)

    Article  Google Scholar 

  18. Good, I.J.: A note on Condorcet sets. Public Choice 10, 97–101 (1971)

    Article  Google Scholar 

  19. Harzing, A.-W., Mingers, J.: Ranking journals in business and management: a statistical analysis of the Harzing dataset. Eur. J. Inf. Syst. 16 (4), 303–316 (2007)

    Article  Google Scholar 

  20. Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102 (46), 16569–16572 (2005)

    Article  Google Scholar 

  21. Jacsó, P.: Differences in the rank position of journals by Eigenfactor metrics and the five-year impact factor in the Journal Citation Reports and the Eigenfactor Project web site. Online Inf. Rev. 34 (3), 496–508 (2010)

    Article  Google Scholar 

  22. Laslier, J.F.: Tournament Solutions and Majority Voting. Springer, Berlin (1997)

    Book  MATH  Google Scholar 

  23. Moed, H.F.: The Source normalized impact per paper is a valid and sophisticated indicator of journal citation impact. J. Am. Soc. Inf. Sci. Technol. 62(1), 211–213 (2011)

    Google Scholar 

  24. Pislyakov, V.V.: Methods for evaluation of scientific knowledge in terms of citation. Sociol. J. 1, 128–140 (2007) (in Russian)

    Google Scholar 

  25. Rousseau, R.: Citation distribution of pure mathematics journals. In: Egghe, L., Rousseau, R. (eds.) Informetrics 87/88, pp. 249–262. Elsevier, Amsterdam (1988)

    Google Scholar 

  26. Schwartz, T.: Rationality and the Myth of the Maximum. Noûs 6, 97–117 (1972)

    Article  Google Scholar 

  27. Smith, J.: Aggregation of preferences with variable electorates. Econometrica 41 (6), 1027–1041 (1973)

    Article  MathSciNet  MATH  Google Scholar 

  28. Ushakov, I.A.: The problem of choosing the preferable object. Izv. Akad. Nauk SSSR. Tekhnicheskaya Kibernetika 4, 3–7 (1971) (in Russian)

    Google Scholar 

  29. Ward, B.: Majority rule and allocation. J. Confl. Resolut. 5, 379–389 (1961)

    Article  Google Scholar 

Download references

Acknowledgements

This study comprises research findings from the “Constructing Rankings by Social Choice methods” project (grant No 12-05-0036, years 2012–2013) carried out within The National Research University Higher School of Economics’ Academic Fund Program. The work was partially financed by the International Laboratory of Decision Choice and Analysis (DeCAn Lab) as a part of project 93.0 (2013) within the Program for Fundamental Research of the National Research University Higher School of Economics.

Author information

Authors and Affiliations

  1. National Research University Higher School of Economics, Moscow, Russia

    Fuad T. Aleskerov & Vladimir V. Pislyakov

  2. Institute of Control Sciences of Russian Academy of Science, Moscow, Russia

    Fuad T. Aleskerov

  3. International Laboratory of Decision Choice and Analysis, National Research University Higher School of Economics, Moscow, Russia

    Anna M. Boriskova & Vyacheslav I. Yakuba

Authors
  1. Fuad T. Aleskerov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anna M. Boriskova
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vladimir V. Pislyakov
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vyacheslav I. Yakuba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna M. Boriskova .

Editor information

Editors and Affiliations

  1. Department of Applied Mathematics and Control Processes, Saint Petersburg State University, Saint Petersburg, Russia

    Leon A. Petrosyan

  2. Institute of Applied Mathematical Research, Karelia Research Center of Russian Academy of Sciences, Petrozavodsk, Russia

    Vladimir V. Mazalov

Appendix

Appendix

See Tables 12, 13, and 14.

Table 12 Ranks of sociology science journals in single-indicator-based and aggregate rankings (journals are ordered by journal impact factor)
Full size table
Table 13 Ranks of education science journals in single-indicator-based and aggregate rankings (journals are ordered by journal impact factor)
Full size table
Table 14 Ranks of public administration science journals in single-indicator-based and aggregate rankings (journals are ordered by journal impact factor)
Full size table

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Aleskerov, F.T., Boriskova, A.M., Pislyakov, V.V., Yakuba, V.I. (2016). Ranking Journals in Sociology, Education, and Public Administration by Social Choice Theory Methods. In: Petrosyan, L., Mazalov, V. (eds) Recent Advances in Game Theory and Applications. Static & Dynamic Game Theory: Foundations & Applications. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-43838-2_1

Download citation

Publish with us

Policies and ethics

Search

Navigation