Skip to main content

Advertisement

SpringerLink
Log in

Differential Evolution with Grid-Based Parameter Adaptation

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The reduction of human intervention in tuning metaheuristic optimization algorithms has been an ongoing research pursuit. Differential Evolution is a very popular algorithm that counts a large number of variants. However, its efficiency has been shown to depend on the type of its crossover operators (binomial or exponential), mutation operators, as well as on the two parameters that dominate these procedures. Making proper decisions on these parameters has proved to be a laborious, problem-dependent task. We propose a parameter adaptation technique that allows the algorithm to dynamically determine the most suitable crossover type and parameter values during its execution. The technique is based on a search procedure in the discretized parameter search space, using estimations of the algorithm’s performance. The proposed approach is tested and statistically validated on an established high-dimensional test suite. Also, comparisons with other algorithms are reported, verifying the competitiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://www.open-mpi.org/

References

  • Auger A, Hansen N (2005) A restart CMA evolution strategy with increasing population size. In: Proceedings of the 2005 IEEE congress on evolutionary computation, pp 769–1776

  • Bäck T (1996) Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford University Press, New York

  • Brest J, Bošković B, Zamuda A (2012) Self-adaptive differential evolution algorithm with a small and varying population size. In: WCCI 2012 IEEE World congress on computational intelligence

  • Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657

    Article  Google Scholar 

  • Brest J, Maucec MS (2011) Self-adaptive differential evolution algorithm using population size reduction and three strategies. Soft Comput 15:2157–2174

    Article  Google Scholar 

  • Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31

    Article  Google Scholar 

  • de Oca MAM, Aydin D, Stützle T (2011) An incremental particle swarm for large-scale optimization problems: an example of tuning-in-the-loop (re)design of optimization algorithms. Soft Comput 15:2233–2255

    Article  Google Scholar 

  • Duarte A, Martí R, Gortazar F (2011) Path relinking for large scale global optimization. Soft Comput 15:2257–2273

    Article  Google Scholar 

  • Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141

    Article  Google Scholar 

  • Eiben AE, Smit SK (2011) Evolutionary algorithm parameters and methods to tune them. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 2. Springer, Berlin, pp 15–36

  • Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Found Genet Algorithms 2:187–202

  • García-Martínez C, Rodríguez FJ, Lozano M (2011) Role differentiation and malleable mating for differential evolution: an analysis on large scale optimisation. Soft Comput 15:2109–2126

    Article  Google Scholar 

  • García-Nieto J, Alba E (2011) Restart particle swarm optimization with velocity modulation: a scalability test. Soft Comput 15:2221–2232

    Article  Google Scholar 

  • Gardeux V, Chelouah R, Siarry P, Glover F (2011) EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems. Soft Comput 15:2275–2285

    Article  Google Scholar 

  • Hoos HH (2011) Automated algorithm configuration and parameter tuning. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 3. Springer, Berlin, pp 37–72

  • LaTorre A, Muelas S, Peña J (2011) A MOS-based dynamic memetic differential evolution algorithm for continuous optimization a scalability test. Soft Comput 15:2187–2199

    Article  Google Scholar 

  • LaTorre A, Muelas S, Peña J (2012) Multiple offspring sampling in large scale global optimization. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Lozano M, Herrera F, Molina D (2010) Evolutionary algorithms and other metaheuristics for continuous optimization problems. http://sci2s.ugr.es/eamhco/

  • Lozano M, Herrera F, Molina D (2011) Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems. Soft Comput 15:2085–2087

    Article  Google Scholar 

  • Molina D, Lozano M, Sánchez AM, Herrera F (2011) Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains. Soft Comput 15:2201–2220

    Article  Google Scholar 

  • Neumaier A, Fendl H, Schilly H, Leitner T (2011) VXQR: derivative-free unconstrained optimization based on QR factorizations. Soft Comput 15:2287–2298

    Article  Google Scholar 

  • Parsopoulos K, Vrahatis M (2010) Particle swarm optimization and intelligence: advances and applications. Information Science Publishing (IGI Global)

  • Piotrowski AP (2013) Adaptive memetic differential evolution with global and local neighborhood-based mutation operators. Inf Sci 241:164–194

    Article  Google Scholar 

  • Poláková R, Tvrdík J, Bujok P (2014) Controlled restart in differential evolution applied to CEC2014 benchmark functions. In: IEEE congress on evolutionary computation

  • Price K, Storn R (2009) Differential evolution (DE) for continuous function optimization (an algorithm by Kenneth Price and Rainer Storn). http://www1.icsi.berkeley.edu/~storn/code.html

  • Price KV, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization. Springer, Berlin

    MATH  Google Scholar 

  • Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417

    Article  Google Scholar 

  • Qing A (2009) Differential evolution: fundamentals and applications in electrical engineering. Wiley-IEEE Press, New York

  • Segura C, Coello CAC, Segredo E, León C (2015) On the adaptation of the mutation scale factor in differential evolution. Optim Lett 9(1):189–198

    Article  MathSciNet  MATH  Google Scholar 

  • Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359

    Article  MathSciNet  MATH  Google Scholar 

  • Takahama T (1997) Sample source code of differential evolution (coded by T. Takahama). http://www.ints.info.hiroshima-cu.ac.jp/~takahama/download/DE.html

  • Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation

  • Tanabe R, Fukunaga A (2014) Improving the search performance of SHADE using linear population size reduction. In: IEEE congress on evolutionary computation

  • Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177

  • Tvrdík J (2006) Competitive differential evolution. In: 12th international coference on soft computing

  • Tvrdík J, Poláková R (2013) Competitive differential evolution applied to CEC 2013 problems. In: 2013 IEEE Congress on evolutionary computation (CEC). IEEE, pp 1651–1657

  • Wang H, Wu Z, Rahnamayan S (2011) Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems. Soft Comput 15:2127–2140

    Article  Google Scholar 

  • Weber M, Neri F, Tirronen V (2011) Shuffle or update parallel differential evolution for large scale optimization. Soft Comput 15:2089–2107

    Article  Google Scholar 

  • Weber M, Tirronen V, Neri F (2010) Scale factor inheritance mechanism in distributed differential evolution. Soft Comput 14:1187–1207

    Article  Google Scholar 

  • Yang Z, Tang K, Yao X (2011) Scalability of generalized adaptive differential evolution for large-scale continuous optimization. Soft Comput 15:2141–2155

    Article  Google Scholar 

  • Zaharie D (2007) A comparative analysis of crossover variants in differential evolution. In: Proceedings of IMCSIT, pp 171–181

  • Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9(3):1126–1138

    Article  Google Scholar 

  • Zaharie D, Petcu D (2005) Parallel implementation of multi-population differential evolution. In: Concurrent information processing and computing, pp 223–232

  • Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13:945–958

    Article  Google Scholar 

  • Zhao S, Suganthan P, Das S (2011) Self-adaptive differential evolution with multi-trajectory search for large-scale optimization. Soft Comput 15(11):2175–2185

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of Ioannina, GR-45110, Ioannina, Greece

    Vasileios A. Tatsis & Konstantinos E. Parsopoulos

Authors
  1. Vasileios A. Tatsis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Konstantinos E. Parsopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Konstantinos E. Parsopoulos.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tatsis, V.A., Parsopoulos, K.E. Differential Evolution with Grid-Based Parameter Adaptation. Soft Comput 21, 2105–2127 (2017). https://doi.org/10.1007/s00500-015-1911-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-015-1911-2

Keywords

Search

Navigation