Derivative-Free Optimization: Lifting Single-Objective to Multi-Objective Algorithm
Most of the derivative-free optimization (DFO) algorithms rely on a comparison function able to compare any pair of points with respect to a black-box objective function. Recently, new dedicated derivative-free optimization algorithms have emerged to tackle multi-objective optimization problems and provide a Pareto front approximation to the user. This work aims at reusing single objective DFO algorithms (such as Nelder-Mead) in the context of multi-objective optimization. Therefore we introduce a comparison function able to compare a pair of points in the context of a set of non-dominated points. We describe an algorithm, MOGEN, which initializes a Pareto front approximation composed of a population of instances of single-objective DFO algorithms. These algorithms use the same introduced comparison function relying on a shared Pareto front approximation. The different instances of single-objective DFO algorithms are collaborating and competing to improve the Pareto front approximation. Our experiments comparing MOGEN with the state-of the-art Direct Multi-Search algorithm on a large set of benchmarks shows the practicality of the approach, allowing to obtain high quality Pareto fronts using a reasonably small amount of function evaluations.
Unable to display preview. Download preview PDF.
- 3.Conn, A., Scheinberg, K., Vicente, L.: Introduction to Derivative-Free Optimization. Society for Industrial and Applied Mathematics, Mps-siam Series on Optimization (2009)Google Scholar
- 4.Custódio, A., Emmerich, M., Madeira, J.: Recent Developments in Derivative-Free Multiobjective Optimization (2012)Google Scholar
- 9.Echagüe, E., Delbos, F., Dumas, L.: A global derivative-free optimization method for expensive functions with bound constraints. In: Proceedings of Global Optimization Workshop, pp. 65–68 (2012)Google Scholar
- 13.Nelder, J.A., Mead, R.: A simplex method for function minimization. In Comput. J. 7 (1965)Google Scholar
- 15.Zitzler, E., Brockhoff, D., Thiele, L.: The hypervolume indicator revisited: On the design of pareto-compliant indicators via weighted integration. In: Obayashi, S., Deb, K., Poloni, C., Hiroyasu, T., Murata, T. (eds.) EMO 2007. LNCS, vol. 4403, pp. 862–876. Springer, Heidelberg (2007) CrossRefGoogle Scholar