Skip to main content

Rank Aggregation: Models and Algorithms

  • Chapter
  • First Online:
The Palgrave Handbook of Operations Research

Abstract

In today’s society, in which a large amount of information of all kinds is collected daily, the aggregation of rankings is becoming a necessary task to provide us with significant knowledge for decision-making. Rank aggregation consists, in general terms, of developing a ranking of a set of elements, based on multiple ranked lists, so that the final ranking is able to combine the information contained in the available rankings. From a mathematical point of view, ranking aggregation problems are combinatorial optimization problems and different types of techniques have been proposed to solve them: exact, heuristic and also metaheuristic approaches. In this chapter, we review some of the most well-known ranking aggregation problems that can be grouped into two broad categories: rankings of elements and rankings of sets. Each of the problems is formally described and then some of the techniques proposed for their resolution are discussed. Illustrative examples are presented throughout the chapter to facilitate understanding of the different problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chenery, H.B. and Watanabe,T.: International comparisons of the structure of production. Econometrica 26, 487–521 (1958)

    Article  Google Scholar 

  2. Garey, M.R. and Johnson, D.S.: Computers and intractability: A guide to the theory of NP-completeness. W. H. FREEMAN AND COMPANY, New York (1979)

    Google Scholar 

  3. Martí, R. and Reinelt, G.: The lineal ordering problem. Exact and heuristic methods in combinational optimization. Springer. (2011)

    Google Scholar 

  4. Ceberio, J., Mendiburu, A. and Lozano, J.A.: The linear ordering problem revisited. European Journal of Operational Research 241, 686–696 (2015)

    Article  Google Scholar 

  5. Qian, Y., Lin, J., Li, D. and Hu, H.: Block-insertion-based algorithms for the linear ordering problem. Computers & Operations Research 115, 1048–61 (2020)

    Article  Google Scholar 

  6. Feng, J., Fang, Q. and Ng, W.: Discovering Bucket Orders from full Rankings. Proceedings of the 2008 ACM SIGMOD international conference on Management of data, 55–66 (2008).

    Google Scholar 

  7. Boussaid, I., Lepagnot, J. and Siarry, P.: A survey on optimization metaheuristics. Information Sciences 237, 82-117 (2013)

    Article  Google Scholar 

  8. Aparicio, J., Landete, M. and Monge, J.F.: A linear ordering problem of sets. Annals of Operations Research. 288, 45–64 (2020)

    Article  Google Scholar 

  9. Aledo, J.A., Gàmez, J.A. and Molina, D.: Tackling the rank aggregation problem with evolutionay algorithms. Applied Mathematics and Computation. 222, 632–644. (2013).

    Article  Google Scholar 

  10. Andoni, A., Fagin, R., Kumar, R., Patrascu, M. and Sivakumar, D.: Efficient similarity search and classification via rank aggregation. In Proceedings of the ACM SIG-MOD International Conference on Management of Data, 1375–1376 (2008)

    Google Scholar 

  11. Dwork, C., Kumar, R., Naor, M. and Sivakumar, D.: Rank aggregation methods for the web. In Proceedings of the Tenth International World Wide Web Conference(WWW’01), 613–622 (2001)

    Google Scholar 

  12. Fagin, R., Kumar, R. and Sivakumar, D.: Eficient similarity search and classification via rank aggregation. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 301–312 (2003)

    Google Scholar 

  13. Schalekamp, F. and Zuylen, A.V.: Rank aggregation: Together we’re strong. ALENEX 38–51 (2009)

    Google Scholar 

  14. Yasutake, S., Hatano, K., Takimoto, E. and Takeda, M: Online Rank Aggregation. JMLR: Workshop and Conference proceedings, Asian Conference on Machine Learning 25, 539–553 (2012)

    Google Scholar 

  15. Betzler, N., Brederec, R. and Niedermeier, R.: Theoretical and empirical evaluation of data reduction for exact kemeny rank aggregation. Autonomous Agents and Multi-Agent Systems 28, 721–748 (2014)

    Article  Google Scholar 

  16. Conitzer, V., A. Davenport, A. and Kalagnanam, J.: Improved bounds for computing kemeny rankings. In: proceedings of the 21st national conference on Artificial intelligence, 620–626 (2006)

    Google Scholar 

  17. Ali, A. and Meilă, M.: Experiments with Kemeny ranking: What works when?. Mathematical Social Sciences 64, 28–40 (2012)

    Article  Google Scholar 

  18. Gattaca, L.: An Analysis of Rank Aggregation Algorithms. Data Structures and Algorithms (2014) arXiv:1402.5259v5.

  19. García-Nové, E.M., Alcaraz, J., Landete, M., Puerto, J. and Monge, J.F. Rank aggregation in cyclic sequences. Optimization Letters 11, 667–678 (2017)

    Article  Google Scholar 

  20. Grundel, D.A. and Jeffcoat, D.E.: Formulation and solution of the target visitation problem. Proceedings of the AIAA 1st Intelligent systems technical conferences (2004)

    Google Scholar 

  21. Arulselvan, A., Commander, C.W. and Pardalos, P.M.: A hybrid genetic algorithm for the target visitation problem. Naval Research Logistics 1-20 (2007)

    Google Scholar 

  22. Lörwald, S.: Exact solving methods for the target visitation problem, Diploma thesis (2014)

    Google Scholar 

  23. Hildenbrandt, A.: The Target Visitation Problem. PhD (2015) http://www.ub.uni-heidelberg.de/archiv/17993

  24. Hildenbrandt, A. and Reinelt, G.: Inter Programming Models for the Target Visitation Problem. Informatica 39 257–260 (2015)

    Google Scholar 

  25. Hildenbrandt, A.: A branch-and-cut algorithm for the target visitation problem. EURO J Comput Optim 7, 209–242 (2019)

    Article  Google Scholar 

  26. Rodríguez-Pereira, J., Laporte, G. The target visitation arc routing problem. TOP (2021). https://doi.org/10.1007/s11750-021-00601-5

    Google Scholar 

  27. Claiborne Price, C.: Applications of Operations Research models to problems in Health Care. University of Maryland (2009)

    Google Scholar 

  28. Popov, V.Y.: Multiple genome rearrangement by swaps and by element duplications. Theoretical Computer Science, 385, 115–126 (2007)

    Article  Google Scholar 

  29. Fagin, R., Kumar, R., Mahdian, M., Sivakumar, D. and Vee, E: Comparing and aggregating rankings with ties. In Proceedings of the ACM Symposium on Principles of Database Systems(PODS), 47–58, (2004)

    Google Scholar 

  30. Gionis, A. Mannila, H., Puolamaki, K. and Ukkonen, A.: Algorithms for Discovering Bucket Orders from Data. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 561–566 (2006)

    Google Scholar 

  31. Miklos, I., Somodi, I. and Podani, J.: Rearrangement of ecological matrices via markov chain monte carlo simulation. Ecology, 86, 3398–3410 (2005)

    Article  Google Scholar 

  32. Halekoh, U. and Vach, W.: A bayesian approach to seriation problems in archeology. Computational Statistics and Data Analysis 45, 651–673 (2004)

    Article  Google Scholar 

  33. Fortelius, M., Gionis, A., Jernvall, J. and Mannila, H.: Spectral ordering and biochronology of european fossil mammals. Paleobiology, 206-214 (2006)

    Google Scholar 

  34. Puolamaki, M., Fortelius, M. and Mannila, H.: Seriation in paleontological data matrices via markov chain monte carlo methods. PLoS Computational Biology, 2 (2006).

    Google Scholar 

  35. Alcaraz, J., Garcìa-Novè, E.M., Landete, M. and Monge, J.F.: The linear ordering problem with clusters: a new partial ranking. TOP 28, 646-671 (2020).

    Article  Google Scholar 

  36. Aledo, J.A., Gàmez, J.A. and Rosete, A.: Utopia in the solution of the Bucket Order Problem. Decision Support Systems 97, 69–80 (2017)

    Article  Google Scholar 

  37. Ukkonen, A., Puolamäki, K., Gionis, A. and Mannila, H.: A randomized approximation algorithm for computing bucket orders. Information Processing Letters, 109, 356–359 (2009)

    Article  Google Scholar 

  38. Kenkre, S., Khan, A. and Pandit, V.: On Discovering Bucket Orders from Preference Data. Proceedings of the 2011 SIAM International Conference on Data Mining: 872–883 (2011)

    Google Scholar 

  39. Aledo, J.A., Gàmez, J.A. and Rosete, A.: Approaching rank aggregation problems by using evolution strategies: The case of the optimal bucket order problem. European Journal of Operational Research 270, 982-998 (2018).

    Article  Google Scholar 

  40. Arrow, K.J.: Social Choice and Individual Values. Wiley, New York (1951)

    Google Scholar 

  41. Kemeny, J.: Mathematics Without Numbers. Daedalus, 88, 577–591 (1959)

    Google Scholar 

  42. Monge, J.F.: The Concordance coefficient: An alternative to the Kruskal-Wallis test (2019), arXiv:1912.12880v2

  43. Alcaraz, J.; Anton-Sanchez, L.; Monge, J: ConcordanceTest: An Alternative to the Kruskal-Wallis Test Based on the Kendall Tau Ideas. R Package. 2020. https://CRAN.R-project.org/package= ConcordanceTest (accessed on 15 January 2021).

Download references

Acknowledgements

The authors thank the grant PID2019-105952GB-I00 funded by Ministerio de Ciencia e Innovación/Agencia Estatal de Investigación /10.13039/501100011033. This work was partially also supported by the Generalitat Valenciana under grant PROMETEO/2021/063.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mercedes Landete .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Alcaraz, J., Landete, M., Monge, J.F. (2022). Rank Aggregation: Models and Algorithms. In: Salhi, S., Boylan, J. (eds) The Palgrave Handbook of Operations Research . Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-96935-6_5

Download citation

Publish with us

Policies and ethics