Adaptation of operators and continuous control parameters in differential evolution for constrained optimization

  • Saber Elsayed
  • Ruhul Sarker
  • Carlos Coello Coello
  • Tapabrata Ray
Methodologies and Application
  • 167 Downloads

Abstract

A large number of differential evolution algorithms has been proposed in recent years, many of which have been used to solve mainly unconstrained problems. However, similar to other evolutionary algorithms, their performances are highly dependent on their search operators and control parameters. Although many investigations have been conducted to ensure appropriate choices of these operators and parameters, the task is recognized as tedious. In this research, a differential evolution algorithm, which includes a new mechanism for automatically selecting the best combinations of parameters (amplification factor, crossover rate, and population size) as well as search operators, is developed. Instead of choosing discrete values for the amplification factor and crossover rate from a given set of values, this study adaptively selects them from some given continuous ranges and, furthermore, proposes a new methodology for handling constraints. The performance of the algorithm is assessed using a well-known set of constrained problems, with the experimental results demonstrating that it is superior to state-of-the-art algorithms.

Keywords

Constrained optimization Differential evolution Multi-operator 

Notes

Compliance with ethical standards

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Conflicts of interest

The authors declare that they have no conflict of interest.

Informed consent

Informed consent was obtained from all individual participants included in the study.

References

  1. Abbass HA (2002) The self-adaptive pareto differential evolution algorithm. IEEE Congress Evol Comput 1:831–836Google Scholar
  2. Abdul-Rahman OA, Munetomo M, Akama K (2013) An adaptive parameter binary-real coded genetic algorithm for constraint optimization problems: performance analysis and estimation of optimal control parameters. Inf Sci 233:54–86. doi: 10.1016/j.ins.2013.01.005 MathSciNetCrossRefGoogle Scholar
  3. Asafuddoula M, Ray T, Sarker R (2011) An adaptive differential evolution algorithm and its performance on real world optimization problems. In: IEEE Congress on Evolutionary Computation. IEEE, pp 1057–1062Google Scholar
  4. Asafuddoula M, Ray T, Sarker R (2015) A differential evolution algorithm with constraint sequencing: an efficient approach for problems with inequality constraints. Appl Soft Comput 36:101–113CrossRefMATHGoogle Scholar
  5. Bertsekas D (1999) Nonlinear programming. Athena Scientific, BelmontMATHGoogle Scholar
  6. Birattari M, Yuan Z, Balaprakash P, Stützle T (2010) F-race and iterated f-race: An overview. In: Experimental methods for the analysis of optimization algorithms. Springer, pp 311–336Google Scholar
  7. Brest J, Maučec MS (2008) Population size reduction for the differential evolution algorithm. Appl Intell 29(3):228–247CrossRefGoogle Scholar
  8. Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRefGoogle Scholar
  9. Brest J, Boskovic B, Zamuda A, Fister I, Mezura-Montes E (2013) Real parameter single objective optimization using self-adaptive differential evolution algorithm with more strategies. In: IEEE congress on evolutionary computation. IEEE, pp 377–383Google Scholar
  10. Caraffini F, Neri F, Cheng J, Zhang G, Picinali L, Iacca G, Mininno E (2013) Super-fit multicriteria adaptive differential evolution. In: IEEE congress on evolutionary computation. IEEE, pp 1678–1685Google Scholar
  11. Choi TJ, Ahn CW (2015) An adaptive cauchy differential evolution algorithm with population size reduction and modified multiple mutation strategies. In: Proceedings of the 18th Asia Pacific symposium on intelligent and evolutionary systems, vol 2. Springer, pp 13–26Google Scholar
  12. Corder GW, Foreman DI (2009) Nonparametric statistics for non-statisticians: a step-by-step approach. Wiley, HobokenCrossRefMATHGoogle Scholar
  13. Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRefGoogle Scholar
  14. Davis L et al (1991) Handbook of genetic algorithms, vol 115. Van Nostrand Reinhold, New YorkGoogle Scholar
  15. Deb K (2000) An efficient constraint handling method for genetic algorithms. Comput Methods Appl Mech Eng 186(2):311–338CrossRefMATHGoogle Scholar
  16. Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38(12):1877–1896MathSciNetCrossRefMATHGoogle Scholar
  17. Elsayed SM, Sarker RA, Essam DL (2012) On an evolutionary approach for constrained optimization problem solving. Appl Soft Comput 12(10):3208–3227CrossRefGoogle Scholar
  18. Elsayed SM, Sarker RA, Essam DL (2013a) An improved self-adaptive differential evolution algorithm for optimization problems. IEEE Trans Ind Inform 9(1):89–99CrossRefGoogle Scholar
  19. Elsayed SM, Sarker RA, Essam DL (2013b) Self-adaptive differential evolution incorporating a heuristic mixing of operators. Comput Optim Appl 54(3):771–790MathSciNetCrossRefMATHGoogle Scholar
  20. Fitzgerald T, O’Sullivan B, Malitsky Y, Tierney K (2014) Online search algorithm configuration. In: AAAI, pp 3104–3105Google Scholar
  21. Gao WF, Yen GG, Liu SY (2015) A dual-population differential evolution with coevolution for constrained optimization. IEEE Trans Cybern 45(5):1108–1121Google Scholar
  22. Gong W, Cai Z, Liang D (2015) Adaptive ranking mutation operator based differential evolution for constrained optimization. IEEE Trans Cybern 45(4):716–727. doi: 10.1109/TCYB.2014.2334692 CrossRefGoogle Scholar
  23. Grefenstette J (1986) Optimization of control parameters for genetic algorithms. IEEE Trans Syst Man Cybern 16(1):122–128. doi: 10.1109/TSMC.1986.289288 CrossRefGoogle Scholar
  24. Hansen N, Müller S, Koumoutsakos P (2003) Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol Comput 11(1):1–18CrossRefGoogle Scholar
  25. Huang VL, Qin AK, Suganthan PN (2006) Self-adaptive differential evolution algorithm for constrained real-parameter optimization. In: IEEE congress on evolutionary computation, pp 17–24Google Scholar
  26. Jia G, Wang Y, Cai Z, Jin Y (2013) An improved (\(\mu \)+ \(\lambda \))-constrained differential evolution for constrained optimization. Inf Sci 222:302–322MathSciNetCrossRefMATHGoogle Scholar
  27. Kennedy J (2010) Particle swarm optimization. In: Encyclopedia of machine learning. Springer, pp 760–766Google Scholar
  28. Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462CrossRefMATHGoogle Scholar
  29. Mallipeddi R, Suganthan P (2009) Differential evolution algorithm with ensemble of populations for global numerical optimization. Opsearch 46(2):184–213MathSciNetCrossRefMATHGoogle Scholar
  30. Mallipeddi R, Suganthan PN (2010a) Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies. In: Swarm, evolutionary, and memetic computing. Springer, pp 71–78Google Scholar
  31. Mallipeddi R, Suganthan PN (2010b) Ensemble of constraint handling techniques. IEEE Trans Evol Comput 14(4):561–579CrossRefGoogle Scholar
  32. Mallipeddi R, Suganthan PN (2010c) Problem definitions and evaluation criteria for the cec 2010 competition on constrained real-parameter optimization. Technical Report, Nanyang Technological University, SingaporeGoogle Scholar
  33. Mallipeddi R, Suganthan PN, Pan QK, Tasgetiren MF (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696CrossRefGoogle Scholar
  34. Mezura Montes E, Coello Coello CA (2003) Adding a diversity mechanism to a simple evolution strategy to solve constrained optimization problems. IEEE Congress Evol Comput 1:6–13MATHGoogle Scholar
  35. Michalewicz Z, Schoenauer M (1996) Evolutionary algorithms for constrained parameter optimization problems. Evol Comput 4(1):1–32CrossRefGoogle Scholar
  36. Mohamed AW, Sabry HZ (2012) Constrained optimization based on modified differential evolution algorithm. Inf Sci 194:171–208CrossRefGoogle Scholar
  37. Montgomery DC, Peck EA, Vining GG (2012) Introduction to linear regression analysis, vol 821. Wiley, HobokenMATHGoogle Scholar
  38. Poláková R, TvrdíkJ (2011) Various mutation strategies in enhanced competitive differential evolution for constrained optimization. In: IEEE symposium on differential evolution. IEEE, pp 1–8Google Scholar
  39. Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer, BerlinMATHGoogle Scholar
  40. Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRefGoogle Scholar
  41. Rönkkönen J, et al (2009) Continuous multimodal global optimization with differential evolution-based methods. Lappeenranta University of TechnologyGoogle Scholar
  42. Sarker R, Elsayed S, Ray T (2014) Differential evolution with dynamic parameters selection for optimization problems. IEEE Trans Evol Comput 18(5):689–707. doi: 10.1109/TEVC.2013.2281528 CrossRefGoogle Scholar
  43. Schoenauer M, Xanthakis S (1993) Constrained ga optimization. In: ICGA, pp 573–580Google Scholar
  44. Schwefel HP (1984) Evolution strategies: a family of non-linear optimization techniques based on imitating some principles of organic evolution. Ann Oper Res 1(2):165–167CrossRefGoogle Scholar
  45. Si C, An J, Lan T, Ußmüller T, Wang L, Wu Q (2014) On the equality constraints tolerance of constrained optimization problems. Theor Comput Sci 551:55–65MathSciNetCrossRefMATHGoogle Scholar
  46. Storn R (2008) Differential evolution research—trends and open questions. In: Chakraborty U (ed) Advances in Differential evolution, studies in computational intelligence, vol 143. Springer, Berlin, pp 1–31. doi: 10.1007/978-3-540-68830-3_1 Google Scholar
  47. Storn R, Price K (1995) Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces, vol 3. ICSI, BerkeleyMATHGoogle Scholar
  48. Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359MathSciNetCrossRefMATHGoogle Scholar
  49. Takahama T, Sakai S (2010) Constrained optimization by the \(\varepsilon \) constrained differential evolution with an archive and gradient-based mutation. In: IEEE Congress on evolutionary computation. IEEE, pp 1–9Google Scholar
  50. Tanabe R, Fukunaga A (2013a) Evaluating the performance of shade on cec 2013 benchmark problems. In: IEEE congress on evolutionary computation. IEEE, pp 1952–1959Google Scholar
  51. Tanabe R, Fukunaga A (2013b) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation. IEEE, pp 71–78Google Scholar
  52. Tanabe R, Fukunaga A (2014) Improving the search performance of shade using linear population size reduction. In: IEEE Congress on Evolutionary Computation, pp 1658–1665, 10.1109/CEC.2014.6900380Google Scholar
  53. Tasgetiren M, Suganthan P (2006) A multi-populated differential evolution algorithm for solving constrained optimization problem. In: IEEE congress on evolutionary computation, pp 33–40.  10.1109/CEC.2006.1688287
  54. Teo J (2006) Exploring dynamic self-adaptive populations in differential evolution. Soft Comput 10(8):673–686CrossRefGoogle Scholar
  55. Tsai JT (2015) Improved differential evolution algorithm for nonlinear programming and engineering design problems. Neurocomputing 148:628–640CrossRefGoogle Scholar
  56. Tvrdík J (2009) Adaptation in differential evolution: a numerical comparison. Appl Soft Comput 9(3):1149–1155MathSciNetCrossRefGoogle Scholar
  57. TvrdíkJ, Polakova R (2010) Competitive differential evolution for constrained problems. In: IEEE congress on evolutionary computation. IEEE, pp 1–8Google Scholar
  58. TvrdíkJ, Polakova R (2013) Competitive differential evolution applied to cec 2013 problems. In: IEEE congress on evolutionary computation. IEEE, pp 1651–1657Google Scholar
  59. Vrugt JA, Robinson BA (2007) Improved evolutionary optimization from genetically adaptive multimethod search. Proc Natl Acad Sci 104(3):708–711CrossRefGoogle Scholar
  60. Vrugt JA, Robinson BA, Hyman JM (2009) Self-adaptive multimethod search for global optimization in real-parameter spaces. IEEE Trans Evol Comput 13(2):243–259CrossRefGoogle Scholar
  61. Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66CrossRefGoogle Scholar
  62. Wang Y, Wang BC, Li HX, Yen GG (2016) Incorporating objective function information into the feasibility rule for constrained evolutionary optimization. IEEE Trans Cybern 46(12):2938–2952CrossRefGoogle Scholar
  63. Wei W, Wang J, Tao M (2015) Constrained differential evolution with multiobjective sorting mutation operators for constrained optimization. Appl Soft Comput 33:207–222CrossRefGoogle Scholar
  64. Wei W, Zhou J, Chen F, Yuan H (2016) Constrained differential evolution using generalized opposition-based learning. Soft Comput 20(11):4413–4437Google Scholar
  65. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRefGoogle Scholar
  66. Yi W, Li X, Gao L, Zhou Y, Huang J (2016) \(\varepsilon \) constrained differential evolution with pre-estimated comparison using gradient-based approximation for constrained optimization problems. Exp Syst Appl 44:37–49CrossRefGoogle Scholar
  67. Yu WJ, Shen M, Chen WN, Zhan ZH, Gong YJ, Lin Y, Liu O, Zhang J (2014) Differential evolution with two-level parameter adaptation. IEEE Trans Cybern 44(7):1080–1099CrossRefGoogle Scholar
  68. Zaharie D (2007) A comparative analysis of crossover variants in differential evolution. In: Proceedings of IMCSIT, pp 171–181Google Scholar
  69. Zamuda A, Brest J (2012) Population reduction differential evolution with multiple mutation strategies in real world industry challenges. In: Korytkowski M, Scherer R, Tadeusiewicz R, Zadeh L, Zurada J, Rutkowski L (eds) Swarm and evolutionary computation. Springer, Berlin, pp 154–161CrossRefGoogle Scholar
  70. Zamuda A, Brest J, Mezura-Montes E (2013) Structured population size reduction differential evolution with multiple mutation strategies on cec 2013 real parameter optimization. In: IEEE congress on evolutionary computation. IEEE, pp 1925–1931Google Scholar
  71. Zhang J, Sanderson AC (2009) Jade: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Saber Elsayed
    • 1
    • 3
  • Ruhul Sarker
    • 1
  • Carlos Coello Coello
    • 2
  • Tapabrata Ray
    • 1
  1. 1.School of Engineering and IT (SEIT)University of New South Wales at CanberraCanberraAustralia
  2. 2.Depto. de ComputaciónCINVESTAV-IPNMexico CityMexico
  3. 3.Zagazig UniversityZagazigEgypt

Personalised recommendations