Skip to main content

An Artificial Decision Maker for Comparing Reference Point Based Interactive Evolutionary Multiobjective Optimization Methods

  • Conference paper
  • First Online:
Evolutionary Multi-Criterion Optimization (EMO 2021)

Abstract

Comparing interactive evolutionary multiobjective optimization methods is controversial. The main difficulties come from features inherent to interactive solution processes involving real decision makers. The human can be replaced by an artificial decision maker (ADM) to evaluate methods quantitatively. We propose a new ADM to compare reference point based interactive evolutionary methods, where reference points are generated in different ways for the different phases of the solution process. In the learning phase, the ADM explores different parts of the objective space to gain insight about the problem and to identify a region of interest, which is studied more closely in the decision phase. We demonstrate the ADM by comparing interactive versions of RVEA and NSGA-III on benchmark problems with up to 9 objectives. The experiments show that our ADM is efficient and allows repetitive testing to compare interactive evolutionary methods in a meaningful way.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Barba-González, C., Ojalehto, V., García-Nieto, J., Nebro, A.J., Miettinen, K., Aldana-Montes, J.F.: Artificial decision maker driven by PSO: an approach for testing reference point based interactive methods. In: Auger, A., Fonseca, C.M., Lourenço, N., Machado, P., Paquete, L., Whitley, D. (eds.) PPSN 2018. LNCS, vol. 11101, pp. 274–285. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99253-2_22

    Chapter  Google Scholar 

  2. Branke, J., Deb, K., Miettinen, K., Slowinski, R. (eds.): Multiobjective Optimization. Interactive and Evolutionary Approaches. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88908-3

    Book  MATH  Google Scholar 

  3. Cheng, R., Jin, Y., Olhofer, M., Sendhoff, B.: A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans. Evol. Comput. 20(5), 773–791 (2016)

    Article  Google Scholar 

  4. Chugh, T., Jin, Y., Miettinen, K., Hakanen, J., Sindhya, K.: A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Trans. Evol. Comput. 22(1), 129–142 (2018)

    Article  Google Scholar 

  5. Cornell, J.A.: Experiments with Mixtures: Designs, Models, and the Analysis of Mixture Data. Wiley, Hoboken (2011)

    Book  Google Scholar 

  6. Deb, K., Jain, H.: An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans. Evol. Comput. 18(4), 577–601 (2013)

    Article  Google Scholar 

  7. Deb, K., Thiele, L., Laumanns, M., Zitzler, E.: Scalable multi-objective optimization test problems. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 825–830 (2002)

    Google Scholar 

  8. Hakanen, J., Chugh, T., Sindhya, K., Jin, Y., Miettinen, K.: Connections of reference vectors and different types of preference information in interactive multiobjective evolutionary algorithms. In: Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence, pp. 1–8 IEEE (2016)

    Google Scholar 

  9. Hou, Z., Yang, S., Zou, J., Zheng, J., Yu, G., Ruan, G.: A performance indicator for reference-point-based multiobjective evolutionary optimization. In: Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence, pp. 1571–1578. IEEE (2018)

    Google Scholar 

  10. Huber, S., Geiger, M.J., Sevaux, M.: Simulation of preference information in an interactive reference point-based method for the bi-objective inventory routing problem. J. Multi-Criteria Decis. Anal. 22(1–2), 17–35 (2015)

    Article  Google Scholar 

  11. Li, K., Deb, K., Yao, X.: R-Metric: evaluating the performance of preference-based evolutionary multiobjective optimization using reference points. IEEE Trans. Evol. Comput. 22(6), 821–835 (2018)

    Article  Google Scholar 

  12. Li, M., Yao, X.: Quality evaluation of solution sets in multiobjective optimisation: a survey. ACM Comput. Surv. 52(2), 1–38 (2019)

    Article  Google Scholar 

  13. López-Ibáñez, M., Knowles, J.: Machine decision makers as a laboratory for interactive EMO. In: Gaspar-Cunha, A., Henggeler Antunes, C., Coello, C.C. (eds.) EMO 2015. LNCS, vol. 9019, pp. 295–309. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15892-1_20

    Chapter  Google Scholar 

  14. Meignan, D., Knust, S., Frayret, J.M., Pesant, G., Gaud, N.: A review and taxonomy of interactive optimization methods in operations research. ACM Trans. Interact. Intell. Syst. 5(3), 17:1–17:43 (2015)

    Article  Google Scholar 

  15. Miettinen, K.: Nonlinear Multiobjective Optimization. Kluwer Academic Publishers, Boston (1999)

    MATH  Google Scholar 

  16. Miettinen, K., Ruiz, F., Wierzbicki, A.P.: Introduction to multiobjective optimization: interactive approaches. In: Branke, J., Deb, K., Miettinen, K., Słowiński, R. (eds.) Multiobjective Optimization. LNCS, vol. 5252, pp. 27–57. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88908-3_2

    Chapter  Google Scholar 

  17. Mohammadi, A., Omidvar, M.N., Li, X.: A new performance metric for user-preference based multi-objective evolutionary algorithms. In: 2013 IEEE Congress on Evolutionary Computation, Proceedings, pp. 2825–2832. IEEE (2013)

    Google Scholar 

  18. Ojalehto, V., Podkopaev, D., Miettinen, K.: Towards automatic testing of reference point based interactive methods. In: Handl, J., Hart, E., Lewis, P.R., López-Ibáñez, M., Ochoa, G., Paechter, B. (eds.) PPSN 2016. LNCS, vol. 9921, pp. 483–492. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45823-6_45

    Chapter  Google Scholar 

  19. Steuer, R.E.: Multiple Criteria Optimization: Theory, Computation and Application. Wiley, Hoboken (1986)

    MATH  Google Scholar 

  20. Szczepanski, M., Wierzbicki, A.P.: Application of multiple criteria evolutionary algorithm to vector optimization, decision support and reference-point approaches. J. Telecommun. Inf. Technol. 3(3), 16–33 (2003)

    Google Scholar 

  21. Xin, B., Chen, L., Chen, J., Ishibuchi, H., Hirota, K., Liu, B.: Interactive multiobjective optimization: a review of the state-of-the-art. IEEE Access 6, 41256–41279 (2018)

    Article  Google Scholar 

  22. Yu, G., Zheng, J., Li, X.: An improved performance metric for multiobjective evolutionary algorithms with user preferences. In: Proceedings of the 2015 IEEE Congress on Evolutionary Computation, pp. 908–915. IEEE (2015)

    Google Scholar 

Download references

Acknowledgements

This research was partly funded by the Academy of Finland (grants 322221 and 311877) and is related to the thematic research area Decision Analytics utilizing Causal Models and Multiobjective Optimization (DEMO), https://www.jyu.fi/demo, at the University of Jyvaskyla. Ana B. Ruiz would like to thank the support of the Spanish government (project ECO2017-88883-R) and the Andalusian regional government (PAI group SEJ-532 and project UMA18-FEDERJA-024).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bekir Afsar .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 206 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Afsar, B., Miettinen, K., Ruiz, A.B. (2021). An Artificial Decision Maker for Comparing Reference Point Based Interactive Evolutionary Multiobjective Optimization Methods. In: Ishibuchi, H., et al. Evolutionary Multi-Criterion Optimization. EMO 2021. Lecture Notes in Computer Science(), vol 12654. Springer, Cham. https://doi.org/10.1007/978-3-030-72062-9_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-72062-9_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-72061-2

  • Online ISBN: 978-3-030-72062-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics