Skip to main content
Log in

Voting-based ensemble learning for partial lexicographic preference forests over combinatorial domains

  • Published:
Annals of Mathematics and Artificial Intelligence Aims and scope Submit manuscript

Abstract

We study preference representation models based on partial lexicographic preference trees (PLP-trees). We propose to represent preference relations as forests of small PLP-trees (PLP-forests), and to use voting rules to aggregate orders represented by the individual trees into a single order to be taken as a model of the agent’s preference relation. We show that when learned from examples, PLP-forests have better accuracy than single PLP-trees. We also show that the choice of a voting rule does not have a major effect on the aggregated order, thus rendering the problem of selecting the “right” rule less critical. Next, for the proposed PLP-forest preference models, we develop methods to compute optimal and near-optimal outcomes, the tasks that appear difficult for some other common preference models. Lastly, we compare our models with those based on decision trees, which brings up questions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Allen, J., Moussa, A., Liu, X.: Human-in-the-loop learning of qualitative preference models. In: The 32Nd International Florida Artificial Intelligence Research Society Conference. AAAI Press (2019)

  2. Ansótegui, C., Bonet, M.L., Levy, J.: A new algorithm for weighted partial maxsat. In: Fox, M., Poole, D. (eds.) Proceedings of the 24th AAAI Conference on Artificial Intelligence. AAAI Press (2010)

  3. Booth, R., Chevaleyre, Y., Lang, J., Mengin, J., Sombattheera, C.: Learning conditionally lexicographic preference relations. In: ECAI, pp 269–274 (2010)

  4. Bräuning, M., Hüllermeier, E., Keller, T., Glaum, M.: Lexicographic preferences for predictive modeling of human decision making: a new machine learning method with an application in accounting. Eur. J. Oper. Res. 258(1), 295–306 (2017)

    Article  MathSciNet  Google Scholar 

  5. Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  Google Scholar 

  6. Felsenthal, D.S., Maoz, Z., Rapoport, A.: An empirical evaluation of six voting procedures: do they really make any difference? Br. J. Polit. Sci. 23(01), 1–27 (1993)

    Article  Google Scholar 

  7. Fraser, N.M.: Ordinal preference representations. Theor. Decis. 36(1), 45–67 (1994)

    Article  Google Scholar 

  8. Gehrlein, W.V.: Condorcet’s paradox and the likelihood of its occurrence: different perspectives on balanced preferences. Theor. Decis. 52(2), 171–199 (2002)

    Article  MathSciNet  Google Scholar 

  9. Hurley, B., O’Sullivan, B., Allouche, D., Katsirelos, G., Schiex, T., Zytnicki, M., De Givry, S.: Multi-language evaluation of exact solvers in graphical model discrete optimization. Constraints 21(3), 413–434 (2016)

    Article  MathSciNet  Google Scholar 

  10. Lang, J., Mengin, J., Xia, L.: Aggregating conditionally lexicographic preferences on multi-issue domains. In: Principles and Practice of Constraint Programming, pp 973–987. Springer (2012)

  11. Lang, J., Xia, L.: Sequential composition of voting rules in multi-issue domains. Math. Soc. Sci. 57(3), 304–324 (2009)

    Article  MathSciNet  Google Scholar 

  12. Liu, X., Truszczynski, M.: Aggregating conditionally lexicographic preferences using answer set programming solvers. In: Proceedings of the 3rd International Conference on Algorithmic Decision Theory, pp 244–258. Springer (2013)

  13. Liu, X., Truszczynski, M.: Learning partial lexicographic preference trees over combinatorial domains. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp 1539–1545. AAAI Press (2015)

  14. Liu, X., Truszczynski, M.: Reasoning with Preference Trees over Combinatorial Domains. In: Algorithmic Decision Theory, pp 19–34. Springer (2015)

  15. Liu, X., Truszczynski, M.: Learning partial lexicographic preference trees and forests over multi-valued attributes. In: Proceedings of the 2nd Global Conference on Artificial Intelligence (GCAI-16), EPiC Series in Computing, vol. 41, pp 314–328. EasyChair (2016)

  16. Liu, X., Truszczynski, M.: Preference learning and optimization for partial lexicographic preference forests over combinatorial domains. In: Proceedings of the 10th International Symposium on Foundations of Information and Knowledge Systems. Springer (2018)

  17. Mattei, N.: Empirical evaluation of voting rules with strictly ordered preference data. In: International Conference on Algorithmic Decisiontheory, pp 165–177. Springer (2011)

  18. Myers, J.L., Well, A., Lorch, R.F.: Research design and statistical analysis. Routledge (2010)

  19. Schmitt, M., Martignon, L.: Complexity of lexicographic strategies on binary cues. Preprint (1999)

  20. Wilson, N.: Preference inference based on lexicographic models. In: Schaub, T., Friedrich, G., O’Sullivan, B. (eds.) Proceedings of the 21st European Conference on Artificial Intelligence, ECAI 2014, Frontiers in Artificial Intelligence and Applications, vol. 263, pp 921–926. IOS Press (2014)

  21. Wilson, N., George, A.: Efficient inference and computation of optimal alternatives for preference languages based on lexicographic models. In: Sierra, C. (ed.) Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, pp 1311–1317 (2017)

Download references

Acknowledgments

The work of the second author was supported by the NSF grant IIS-1618783.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xudong Liu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This is an extension of the paper that appeared in the proceedings of the 10th International Symposium on Foundations of Information and Knowledge Systems [16].

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, X., Truszczynski, M. Voting-based ensemble learning for partial lexicographic preference forests over combinatorial domains. Ann Math Artif Intell 87, 137–155 (2019). https://doi.org/10.1007/s10472-019-09645-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10472-019-09645-7

Keywords

Mathematics Subject Classification (2010)

Navigation