A Linear Constrained Optimization Benchmark for Probabilistic Search Algorithms: The Rotated Klee-Minty Problem

  • Michael HellwigEmail author
  • Hans-Georg Beyer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11324)


The development, assessment, and comparison of randomized search algorithms heavily rely on benchmarking. Regarding the domain of constrained optimization, the small number of currently available benchmark environments bears no relation to the vast number of distinct problem features. The present paper advances a proposal of a scalable linear constrained optimization problem that is suitable for benchmarking Evolutionary Algorithms. By comparing two recent Evolutionary Algorithm variants, the linear benchmarking environment is demonstrated.


Probabilistic search algorithms Benchmarking Evolutionary algorithms Linear problems Constrained optimization Klee-Minty cube 



This work was supported by the Austrian Science Fund (FWF) under grant P29651-N32. The article is also based upon work from COST Action CA15140 supported by COST (European Cooperation in Science and Technology).


  1. 1.
    Deza, A., Nematollahi, E., Terlaky, T.: How good are interior point methods? Klee–Minty cubes tighten iteration-complexity bounds. Mathematical Programming 113(1), 1–14 (2008)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Deza, A., Nematollahi, E., Peyghami, R., Terlaky, T.: The central path visits all the vertices of the klee-minty cube. Optim. Methods Softw. 21(5), 851–865 (2006)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Hansen, N., Auger, A., Brockhoff, D., Tusar, D., Tusar, T.: COCO: performance assessment. CoRR abs/1605.03560 (2016).
  4. 4.
    Hansen, N., Auger, A., Mersmann, O., Tusar, T., Brockhoff, D.: COCO code repository.
  5. 5.
    Hellwig, M., Beyer, H.: A matrix adaptation evolution strategy for constrained real-parameter optimization. In: 2018 IEEE Congress on Evolutionary Computation (CEC), Rio de Janeiro, Brazil, 8–13 July 2018 (2018).
  6. 6.
    Hellwig, M., Beyer, H.G.: Benchmarking evolutionary algorithms for single objective real-valued constrained optimization – A critical review. Swarm Evol. Comput. (2018).
  7. 7.
    Johnson, D.S.: A theoretician’s guide to the experimental analysis of algorithms. In: Data Structures, Near Neighbor Searches, and Methodology: Fifth and Sixth DIMACS Implementation Challenges, vol. 59, pp. 215–250 (2002)Google Scholar
  8. 8.
    Klee, V., Minty, G.: How good is the Simplex algorithm? Defense Technical Information Center (1970).
  9. 9.
    Liang, J.J.: Problem definitions and evaluation criteria for the CEC 2006 special session on constrained real-parameter optimization (2006).
  10. 10.
    Mallipeddi, R., Suganthan, P.N.: Problem definitions and evaluation criteria for the CEC 2010 competition on constrained real-parameter optimization (2010).
  11. 11.
    Megiddo, N., Shub, M.: Boundary behavior of interior point algorithms in linear programming. Math. Oper. Res. 14(1), 97–146 (1989)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Mezura-Montes, E., Coello, C.A.C.: What makes a constrained problem difficult to solve by an evolutionary algorithm. Technical report, Technical Report EVOCINV-01-2004, CINVESTAV-IPN, México (2004)Google Scholar
  13. 13.
    Moré, J.J., Wild, S.M.: Benchmarking derivative-free optimization algorithms. SIAM J. Optim. 20(1), 172–191 (2009)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Neumaier, A.: Global optimization test problems, Vienna University.
  15. 15.
    Polakova, R., Tvrdík, J.: L-SHADE with competing strategies applied to constrained optimization. In: 2017 IEEE Congress on Evolutionary Computation, CEC 2017, Donostia, San Sebastián, Spain, 5–8 June 2017, pp. 1683–1689 (2017)Google Scholar
  16. 16.
    Spettel, P., Beyer, H., Hellwig, M.: A Covariance matrix self-adaptation evolution strategy for optimization under linear constraints. IEEE Trans. Evol. Comput. (2018).
  17. 17.
    Sutton, A.M., Lunacek, M., Whitley, L.D.: Differential evolution and non-separability: using selective pressure to focus search. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 1428–1435. ACM (2007)Google Scholar
  18. 18.
    Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1(1), 67–82 (1997)CrossRefGoogle Scholar
  19. 19.
    Wu, G.H., Mallipeddi, R., Suganthan, P.N.: Problem definitions and evaluation criteria for the CEC 2017 competition on constrained real-parameter optimization (2016).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Vorarlberg University of Applied Sciences, Research Centre PPEDornbirnAustria

Personalised recommendations