Comparing the Niches of CMA-ES, CHC and Pattern Search Using Diverse Benchmarks

  • Darrell Whitley
  • Monte Lunacek
  • Artem Sokolov
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4193)


This paper explores two questions: 1) On a relatively difficult and varied set of test problems, can we observe differences in evolutionary search algorithm performance related to problem features? 2) How do the evolutionary algorithms compare to Pattern Search algorithms, a more traditional optimization tool popular in the larger scientific community? The results suggest there are consistent differences in algorithm performance that can be related back to problem features. Some new ideas for the construction of benchmark problems are also introduced.


Genetic Algorithm Search Space Local Search Problem Feature Mesh Adaptive Direct Search 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Audet, C., Dennis Jr., J.E.: Mesh adaptive direct search algorithms for constrained optimization. SIAM Journal on Optimization 17(1), 188–217 (2006)MATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Eshelman, L.J.: The CHC adaptive search algorithm. In: Foundations of Genetic Algorithms, pp. 265–283. Morgan Kaufmann, San Francisco (1991)Google Scholar
  3. 3.
    Hansen, N., Kern, S.: Evaluating the cma evolution strategy on multimodal test functions. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 282–291. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  4. 4.
    Hansen, N., Ostermeier, A.: Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation 9(2), 159–195 (2001)CrossRefGoogle Scholar
  5. 5.
    Schaffer, J.D., Eshelman, L.: Real-Coded Genetic Algorithms and Interval Schemata. In: Foundations of Genetic Algorithms, vol. 2, Morgan Kaufmann, San Francisco (1993)Google Scholar
  6. 6.
    Lunacek, M., Whitley, D.: The dispersion metric and cma algorithm. In: GECCO, ACM Press, New York (2006)Google Scholar
  7. 7.
    Mathias, K., Whitley, D., Kusuma, T., Stork, C.: An Empirical Evaluation of Genetic Algorithms on Noisy Objective Functions. In: Genetic Algorithms for Pattern Recognition, pp. 65–86. CRC Press, Boca Raton (1996)Google Scholar
  8. 8.
    Mühlenbein, H., Schlierkamp-Voosen, D.: Predictive Models for the Breeder Genetic Algorithm. Evolutionary Computation 1(1), 25–49 (1993)CrossRefGoogle Scholar
  9. 9.
    Salomon, R.: Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. BioSystems 39, 263–278 (1996)CrossRefGoogle Scholar
  10. 10.
    Torczon, A.: On the convergence of pattern search algorthims. SIAM Journal on Optimization 7(1), 1–25 (1997)MATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Whitley, D., Rana, S.B., Dzubera, J., Mathias, K.E.: Evaluating evolutionary algorithms. Artificial Intelligence 85(1-2), 245–276 (1996)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Darrell Whitley
    • 1
  • Monte Lunacek
    • 1
  • Artem Sokolov
    • 1
  1. 1.Computer ScienceColorado State UniversityFort Collins

Personalised recommendations