Abstract
Comparing interactive evolutionary multiobjective optimization methods is controversial. The main difficulties come from features inherent to interactive solution processes involving real decision makers. The human can be replaced by an artificial decision maker (ADM) to evaluate methods quantitatively. We propose a new ADM to compare reference point based interactive evolutionary methods, where reference points are generated in different ways for the different phases of the solution process. In the learning phase, the ADM explores different parts of the objective space to gain insight about the problem and to identify a region of interest, which is studied more closely in the decision phase. We demonstrate the ADM by comparing interactive versions of RVEA and NSGA-III on benchmark problems with up to 9 objectives. The experiments show that our ADM is efficient and allows repetitive testing to compare interactive evolutionary methods in a meaningful way.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barba-González, C., Ojalehto, V., García-Nieto, J., Nebro, A.J., Miettinen, K., Aldana-Montes, J.F.: Artificial decision maker driven by PSO: an approach for testing reference point based interactive methods. In: Auger, A., Fonseca, C.M., Lourenço, N., Machado, P., Paquete, L., Whitley, D. (eds.) PPSN 2018. LNCS, vol. 11101, pp. 274–285. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99253-2_22
Branke, J., Deb, K., Miettinen, K., Slowinski, R. (eds.): Multiobjective Optimization. Interactive and Evolutionary Approaches. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88908-3
Cheng, R., Jin, Y., Olhofer, M., Sendhoff, B.: A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans. Evol. Comput. 20(5), 773–791 (2016)
Chugh, T., Jin, Y., Miettinen, K., Hakanen, J., Sindhya, K.: A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Trans. Evol. Comput. 22(1), 129–142 (2018)
Cornell, J.A.: Experiments with Mixtures: Designs, Models, and the Analysis of Mixture Data. Wiley, Hoboken (2011)
Deb, K., Jain, H.: An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans. Evol. Comput. 18(4), 577–601 (2013)
Deb, K., Thiele, L., Laumanns, M., Zitzler, E.: Scalable multi-objective optimization test problems. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 825–830 (2002)
Hakanen, J., Chugh, T., Sindhya, K., Jin, Y., Miettinen, K.: Connections of reference vectors and different types of preference information in interactive multiobjective evolutionary algorithms. In: Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence, pp. 1–8 IEEE (2016)
Hou, Z., Yang, S., Zou, J., Zheng, J., Yu, G., Ruan, G.: A performance indicator for reference-point-based multiobjective evolutionary optimization. In: Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence, pp. 1571–1578. IEEE (2018)
Huber, S., Geiger, M.J., Sevaux, M.: Simulation of preference information in an interactive reference point-based method for the bi-objective inventory routing problem. J. Multi-Criteria Decis. Anal. 22(1–2), 17–35 (2015)
Li, K., Deb, K., Yao, X.: R-Metric: evaluating the performance of preference-based evolutionary multiobjective optimization using reference points. IEEE Trans. Evol. Comput. 22(6), 821–835 (2018)
Li, M., Yao, X.: Quality evaluation of solution sets in multiobjective optimisation: a survey. ACM Comput. Surv. 52(2), 1–38 (2019)
López-Ibáñez, M., Knowles, J.: Machine decision makers as a laboratory for interactive EMO. In: Gaspar-Cunha, A., Henggeler Antunes, C., Coello, C.C. (eds.) EMO 2015. LNCS, vol. 9019, pp. 295–309. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15892-1_20
Meignan, D., Knust, S., Frayret, J.M., Pesant, G., Gaud, N.: A review and taxonomy of interactive optimization methods in operations research. ACM Trans. Interact. Intell. Syst. 5(3), 17:1–17:43 (2015)
Miettinen, K.: Nonlinear Multiobjective Optimization. Kluwer Academic Publishers, Boston (1999)
Miettinen, K., Ruiz, F., Wierzbicki, A.P.: Introduction to multiobjective optimization: interactive approaches. In: Branke, J., Deb, K., Miettinen, K., Słowiński, R. (eds.) Multiobjective Optimization. LNCS, vol. 5252, pp. 27–57. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88908-3_2
Mohammadi, A., Omidvar, M.N., Li, X.: A new performance metric for user-preference based multi-objective evolutionary algorithms. In: 2013 IEEE Congress on Evolutionary Computation, Proceedings, pp. 2825–2832. IEEE (2013)
Ojalehto, V., Podkopaev, D., Miettinen, K.: Towards automatic testing of reference point based interactive methods. In: Handl, J., Hart, E., Lewis, P.R., López-Ibáñez, M., Ochoa, G., Paechter, B. (eds.) PPSN 2016. LNCS, vol. 9921, pp. 483–492. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45823-6_45
Steuer, R.E.: Multiple Criteria Optimization: Theory, Computation and Application. Wiley, Hoboken (1986)
Szczepanski, M., Wierzbicki, A.P.: Application of multiple criteria evolutionary algorithm to vector optimization, decision support and reference-point approaches. J. Telecommun. Inf. Technol. 3(3), 16–33 (2003)
Xin, B., Chen, L., Chen, J., Ishibuchi, H., Hirota, K., Liu, B.: Interactive multiobjective optimization: a review of the state-of-the-art. IEEE Access 6, 41256–41279 (2018)
Yu, G., Zheng, J., Li, X.: An improved performance metric for multiobjective evolutionary algorithms with user preferences. In: Proceedings of the 2015 IEEE Congress on Evolutionary Computation, pp. 908–915. IEEE (2015)
Acknowledgements
This research was partly funded by the Academy of Finland (grants 322221 and 311877) and is related to the thematic research area Decision Analytics utilizing Causal Models and Multiobjective Optimization (DEMO), https://www.jyu.fi/demo, at the University of Jyvaskyla. Ana B. Ruiz would like to thank the support of the Spanish government (project ECO2017-88883-R) and the Andalusian regional government (PAI group SEJ-532 and project UMA18-FEDERJA-024).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Afsar, B., Miettinen, K., Ruiz, A.B. (2021). An Artificial Decision Maker for Comparing Reference Point Based Interactive Evolutionary Multiobjective Optimization Methods. In: Ishibuchi, H., et al. Evolutionary Multi-Criterion Optimization. EMO 2021. Lecture Notes in Computer Science(), vol 12654. Springer, Cham. https://doi.org/10.1007/978-3-030-72062-9_49
Download citation
DOI: https://doi.org/10.1007/978-3-030-72062-9_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-72061-2
Online ISBN: 978-3-030-72062-9
eBook Packages: Computer ScienceComputer Science (R0)