Computational Optimization and Applications

, Volume 63, Issue 3, pp 875–902 | Cite as

On multiobjective selection for multimodal optimization

  • Simon WessingEmail author
  • Mike Preuss


Multiobjective selection operators are a popular and straightforward tool for preserving diversity in evolutionary optimization algorithms. One application area where diversity is essential is multimodal optimization with its goal of finding a diverse set of either globally or locally optimal solutions of a single-objective problem. We therefore investigate multiobjective selection methods that identify good quality and diverse solutions from a larger set of candidates. Simultaneously, unary quality indicators from multiobjective optimization also turn out to be useful for multimodal optimization. We focus on experimentally detecting the best selection operators and indicators in two different contexts, namely a one-time subset selection and an iterative application in optimization. Experimental results indicate that certain design decisions generally have advantageous tendencies regarding run time and quality. One such positive example is using a concept of nearest better neighbors instead of the common nearest-neighbor distances.


Multimodal optimization Multiobjectivization Nearest neighbor Selection Quality indicator Benchmarking 


  1. 1.
    Bandaru, S., Deb, K.: A parameterless-niching-assisted bi-objective approach to multimodal optimization. In: IEEE Congress on Evolutionary Computation (CEC), pp. 95–102 (2013)Google Scholar
  2. 2.
    Basak, A., Das, S., Tan, K.C.: Multimodal optimization using a biobjective differential evolution algorithm enhanced with mean distance-based selection. IEEE Trans. Evol. Comput. 17(5), 666–685 (2013)CrossRefGoogle Scholar
  3. 3.
    Beasley, D., Bull, D.R., Martin, R.R.: A sequential niche technique for multimodal function optimization. Evol. Comput. 1(2), 101–125 (1993)CrossRefGoogle Scholar
  4. 4.
    Bringmann, K., Friedrich, T.: Don’t be greedy when calculating hypervolume contributions. In: Proceedings of the tenth ACM SIGEVO workshop on Foundations of genetic algorithms, FOGA ’09, pp. 103–112. ACM (2009)Google Scholar
  5. 5.
    Brockhoff, D., Friedrich, T., Hebbinghaus, N., Klein, C., Neumann, F., Zitzler, E.: Do additional objectives make a problem harder? In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, GECCO ’07, pp. 765–772. ACM (2007)Google Scholar
  6. 6.
    Bui, L.T., Abbass, H.A., Branke, J.: Multiobjective optimization for dynamic environments. IEEE Congr. Evol. Comput. 3, 2349–2356 (2005)Google Scholar
  7. 7.
    Coello Coello, C.A., Cruz Cortés, N.: Solving multiobjective optimization problems using an artificial immune system. Genet. Program. Evolvable Mach. 6(2), 163–190 (2005)CrossRefGoogle Scholar
  8. 8.
    Danna, E., Woodruff, D.L.: How to select a small set of diverse solutions to mixed integer programming problems. Oper. Res. Lett. 37(4), 255–260 (2009)CrossRefMathSciNetzbMATHGoogle Scholar
  9. 9.
    Das, S., Maity, S., Qu, B.Y., Suganthan, P.N.: Real-parameter evolutionary multimodal optimization—a survey of the state-of-the-art. Swarm Evol. Comput. 1(2), 71–88 (2011)CrossRefGoogle Scholar
  10. 10.
    De Jong, K.A.: An analysis of the behavior of a class of genetic adaptive systems. Ph.D. Thesis, University of Michigan (1975)Google Scholar
  11. 11.
    Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRefGoogle Scholar
  12. 12.
    Deb, K., Saha, A.: Multimodal optimization using a bi-objective evolutionary algorithm. Evol. Comput. 20(1), 27–62 (2012)CrossRefGoogle Scholar
  13. 13.
    Eiben, A.E., Jelasity, M.: A critical note on experimental research methodology in EC. IEEE Congr. Evol. Comput. 1, 582–587 (2002)Google Scholar
  14. 14.
    Emmerich, M.T.M., Deutz, A.H., Kruisselbrink, J.W.: On quality indicators for black-box level set approximation. In: EVOLVE— A Bridge between Probability, Set Oriented Numerics and Evolutionary Computation. Studies in Computational Intelligence, vol. 447, pp. 157–185. Springer, (2013)Google Scholar
  15. 15.
    Epitropakis, M.G., Plagianakos, V.P., Vrahatis, M.N.: Finding multiple global optima exploiting differential evolution’s niching capability. In: IEEE Symposium on Differential Evolution (SDE) (2011)Google Scholar
  16. 16.
    Glover, F.: Future paths for integer programming and links to artificial intelligence. Comput. Oper. Res. 13(5), 533–549 (1986)CrossRefMathSciNetzbMATHGoogle Scholar
  17. 17.
    Handl, J., Lovell, S.C., Knowles, J.: Multiobjectivization by decomposition of scalar cost functions. In: Rudolph, G., Jansen, T., Lucas, S., Poloni, C., Beume, N. (eds.) Parallel Problem Solving from Nature PPSN X. Lecture Notes in Computer Science, vol. 5199, pp. 31–40. Springer (2008)Google Scholar
  18. 18.
    de Jong, E.D., Watson, R.A., Pollack, J.B.: Reducing bloat and promoting diversity using multi-objective methods. In: Spector, L. (ed.) Proceedings of the Genetic and Evolutionary Computation Conference, pp. 11–18. Morgan Kaufman (2001)Google Scholar
  19. 19.
    Kukkonen, S., Deb, K.: Improved pruning of non-dominated solutions based on crowding distance for bi-objective optimization problems. In: IEEE Congress on Evolutionary Computation, pp. 1179–1186 (2006)Google Scholar
  20. 20.
    Lehman, J., Stanley, K.O.: Abandoning objectives: evolution through the search for novelty alone. Evol. Comput. 19(2), 189–223 (2011)CrossRefGoogle Scholar
  21. 21.
    Lehman, J., Stanley, K.O., Miikkulainen, R.: Effective diversity maintenance in deceptive domains. In: Proceeding of the Fifteenth Annual Conference on Genetic and Evolutionary Computation Conference, GECCO ’13, pp. 215–222. ACM (2013)Google Scholar
  22. 22.
    Li, J.P., Balazs, M.E., Parks, G.T., Clarkson, P.J.: A species conserving genetic algorithm for multimodal function optimization. Evol. Comput. 10(3), 207–234 (2002)CrossRefGoogle Scholar
  23. 23.
    Li, X., Engelbrecht, A., Epitropakis, M.G.: Benchmark functions for CEC’2013 special session and competition on niching methods for multimodal function optimization. RMIT University, Evolutionary Computation and Machine Learning Group, Australia, Tech. rep. (2013)Google Scholar
  24. 24.
    Mahfoud, S.W.: Niching methods for genetic algorithms. Ph.D. Thesis, University of Illinois at Urbana-Champaign (1995)Google Scholar
  25. 25.
    Meinl, T., Ostermann, C., Berthold, M.R.: Maximum-score diversity selection for early drug discovery. J. Chem. Inf. Model. 51(2), 237–247 (2011)CrossRefGoogle Scholar
  26. 26.
    Miettinen, K.: Introduction to multiobjective optimization: noninteractive approaches. In: Branke, J., Deb, K., Miettinen, K., Sowiski, R. (eds.) Multiobjective Optimization. Lecture Notes in Computer Science, vol. 5252, pp. 1–26. Springer (2008)Google Scholar
  27. 27.
    Mouret, J.B.: Novelty-based multiobjectivization. In: Doncieux, S., Bredche, N., Mouret, J.B. (eds.) New Horizons in Evolutionary Robotics. Studies in Computational Intelligence, vol. 341, pp. 139–154. Springer (2011)Google Scholar
  28. 28.
    Pétrowski, A.: A clearing procedure as a niching method for genetic algorithms. In: T. Fukuda, T. Furuhashi, D.B. Fogel (eds.) Proceedings of 1996 IEEE International Conference on Evolutionary Computation (ICEC ’96), pp. 798–803. IEEE Press (1996)Google Scholar
  29. 29.
    Preuss, M., Lasarczyk, C.: On the importance of information speed in structured populations. In: Parallel Problem Solving from Nature—PPSN VIII, Lecture Notes in Computer Science, vol. 3242, pp. 91–100. Springer (2004)Google Scholar
  30. 30.
    Preuss, M., Rudolph, G., Tumakaka, F.: Solving multimodal problems via multiobjective techniques with application to phase equilibrium detection. In: IEEE Congress on Evolutionary Computation, pp. 2703–2710 (2007)Google Scholar
  31. 31.
    Preuss, M., Schönemann, L., Emmerich, M.: Counteracting genetic drift and disruptive recombination in \((\mu +/, \lambda )\)-EA on multimodal fitness landscapes. In: Proceedings of the 2005 Conference on Genetic and evolutionary computation, GECCO ’05, pp. 865–872. ACM (2005)Google Scholar
  32. 32.
    Preuss, M., Wessing, S.: Measuring multimodal optimization solution sets with a view to multiobjective techniques. In: EVOLVE – A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation IV. Advances in Intelligent Systems and Computing, vol. 227, pp. 123–137. Springer (2013)Google Scholar
  33. 33.
    Qu, B.Y., Suganthan, P.N., Liang, J.J.: Differential evolution with neighborhood mutation for multimodal optimization. IEEE Trans. Evol. Comput. 16(5), 601–614 (2012)CrossRefGoogle Scholar
  34. 34.
    Rönkkönen, J., Li, X., Kyrki, V., Lampinen, J.: Simulated Evolution and Learning. In: A Generator for Multimodal Test Functions with Multiple Global Optima. Lecture Notes in Computer Science, vol. 5361, pp. 239–248. Springer (2008)Google Scholar
  35. 35.
    Saha, A., Deb, K.: A bi-criterion approach to multimodal optimization: Self-adaptive approach. In: Simulated Evolution and Learning. Lecture Notes in Computer Science, vol. 6457, pp. 95–104. Springer (2010)Google Scholar
  36. 36.
    Schütze, O., Esquivel, X., Lara, A., Coello Coello, C.A.: Using the averaged Hausdorff distance as a performance measure in evolutionary multiobjective optimization. IEEE Trans. Evol. Comput. 16(4), 504–522 (2012)CrossRefGoogle Scholar
  37. 37.
    Segredo, E., Segura, C., León, C.: Analysing the robustness of multiobjectivisation parameters with large scale optimisation problems. In: IEEE Congress on Evolutionary Computation (CEC), pp. 1–8 (2012)Google Scholar
  38. 38.
    Segura, C., Coello Coello, C.A., Miranda, G., León, C.: Using multi-objective evolutionary algorithms for single-objective optimization. 4OR 11(3), 201–228 (2013)CrossRefMathSciNetzbMATHGoogle Scholar
  39. 39.
    Segura, C., Coello Coello, C.A., Segredo, E., Miranda, G., León, C.: Improving the diversity preservation of multi-objective approaches used for single-objective optimization. In: IEEE Congress on Evolutionary Computation (CEC), pp. 3198–3205 (2013)Google Scholar
  40. 40.
    Shir, O.M.: Niching in evolution strategies. In: Beyer, H.G. (ed.) GECCO ’05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 865–872. ACM Press, New York (2005)Google Scholar
  41. 41.
    Solow, A.R., Polasky, S.: Measuring biological diversity. Environ. Ecol. Stat. 1(2), 95–103 (1994)CrossRefGoogle Scholar
  42. 42.
    Stoean, C., Preuss, M., Stoean, R., Dumitrescu, D.: Multimodal optimization by means of a topological species conservation algorithm. IEEE Trans. Evol. Comput. 14(6), 842–864 (2010)CrossRefGoogle Scholar
  43. 43.
    Thomsen, R.: Multimodal optimization using crowding-based differential evolution. IEEE Congr. Evol. Comput. 2, 1382–1389 (2004)Google Scholar
  44. 44.
    Toffolo, A., Benini, E.: Genetic diversity as an objective in multi-objective evolutionary algorithms. Evol. Comput. 11(2), 151–167 (2003)CrossRefGoogle Scholar
  45. 45.
    Törn, A., Ali, M.M., Viitanen, S.: Stochastic global optimization: problem classes and solution techniques. J. Glob. Optim. 14(4), 437–447 (1999)CrossRefzbMATHGoogle Scholar
  46. 46.
    Tran, T.D., Brockhoff, D., Derbel, B.: Multiobjectivization with NSGA-II on the noiseless BBOB testbed. In: Proceeding of the Fifteenth Annual Conference Companion on Genetic and Evolutionary Computation Conference Companion, GECCO ’13 Companion, pp. 1217–1224. ACM (2013)Google Scholar
  47. 47.
    Ulrich, T., Bader, J., Thiele, L.: Defining and optimizing indicator-based diversity measures in multiobjective search. In: Parallel Problem Solving from Nature, PPSN XI. Lecture Notes in Computer Science, vol. 6238, pp. 707–717. Springer (2010)Google Scholar
  48. 48.
    Ulrich, T., Thiele, L.: Maximizing population diversity in single-objective optimization. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, GECCO ’11, pp. 641–648. ACM (2011)Google Scholar
  49. 49.
    Ursem, R.K.: Multinational evolutionary algorithms. In: Angeline, P.J. (ed.) Proceedings of the Congress of Evolutionary Computation (CEC 99), vol. 3, pp. 1633–1640. IEEE Press (1999)Google Scholar
  50. 50.
    Wessing, S.: Repair methods for box constraints revisited. In: Esparcia-Alcázar, A.I. (ed.) Applications of Evolutionary Computation. Lecture Notes in Computer Science, vol. 7835, pp. 469–478. Springer (2013)Google Scholar
  51. 51.
    Wessing, S., Preuss, M., Rudolph, G.: Niching by multiobjectivization with neighbor information: trade-offs and benefits. In: IEEE Congress on Evolutionary Computation (CEC), pp. 103–110 (2013)Google Scholar
  52. 52.
    Zitzler, E., Knowles, J., Thiele, L.: Quality assessment of pareto set approximations. In: Multiobjective Optimization. Lecture Notes in Computer Science. vol. 5252, pp. 373–404. Springer (2008)Google Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.Chair of Algorithm Engineering, Department of Computer ScienceTU DortmundDortmundGermany
  2. 2.European Research Center for Information Systems (ERCIS), WWU MünsterMünsterGermany

Personalised recommendations