Abstract
Differential evolution (DE) has been used to solve real-parameter optimization problems with nonlinear and multimodal functions for more than a decade of years. However, it is pointed out that this classical DE harbors restricted efficiency and limited local search ability. Inspired by that gradient-based algorithms have powerful local search ability, we propose a new algorithm, which is diversity-maintained DE based on gradient local search (namely, DMGBDE), by incorporating approximate gradient-based algorithms into the DE search while maintaining the diversity of the population. The primary novelties of the proposed DMGBDE are the following: (1) the gradient-based algorithm is embedded into DE in a different manner and (2) a diversity-maintained mutation is introduced to slow down the learning procedure from the searched best individual. We conduct numerical experiments with a number of benchmark problems to measure the performance of the proposed DMGBDE. Simulation results show that the proposed DMGBDE outperforms classical DE and variant without gradient local search or diversity-based mutation. Moreover, comparison with some other recently reported approaches indicates that our proposed DMGBDE is rather competitive.
Similar content being viewed by others
References
Bandurski K, Kwedlo W (2010) A Lamarckian hybrid of differential evolution and conjugate gradients for neural network training. Neural Process Lett 32(1):31–44
Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657
Cai Z, Gong W, Ling C, Zhang H (2011) A clustering-based differential evolution for global optimization. Appl Soft Comput 11(1):1363–1379
Chiang C, Lee W, Heh J (2010) A 2-opt based differential evolution for global optimization. Appl Soft Comput 10(4):1200–1207
Conn A, Gould N, Toint P (2000) Trust-region methods, vol 1. Society for Industrial Mathematics, Philadelphia, PA, USA
Das S, Konar A (2009) Automatic image pixel clustering with an improved differential evolution. Appl Soft Comput 9(1):226–236
Das S, Suganthan P (2011) Differential evolution: A survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31
Das S, Abraham A, Chakraborty U, Konar A (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Trans Evol Comput 13(3):526–553
Dasgupta S, Das S, Biswas A, Abraham A (2009) On stability and convergence of the population-dynamics in differential evolution. AI Commun 22(1):1–20
Dorronsoro B, Bouvry P (2011) Improving classical and decentralized differential evolution with new mutation operator and population topologies. IEEE Trans Evol Comput 15(1):67–98
Duvvuru N, Swarup K (2011) A hybrid interior point assisted differential evolution algorithm for economic dispatch. IEEE Trans Power Syst 26(2):541–549
Fan H, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27(1):105–129
Gämperle R, Müller S, Koumoutsakos A (2002) A parameter study for differential evolution. In: International conference on advances in intelligence systems, fuzzy systems, evolutionary computation, Citeseer, vol 10, pp 293–298
García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms behaviour: a case study on the cec2005 special session on real parameter optimization. J Heuristics 15(6):617–644
Ghaffari-Miab M, Farmahini-Farahani A, Faraji-Dana R, Lucas C (2007) An efficient hybrid swarm intelligence-gradient optimization method for complex time Green’s functions of multilayer media. Prog Electromagn Res 77:181–192
Gibbons J, Chakraborti S (2003) Nonparametric statistical inference, vol 168. Marcel Dekker, New York
Han F, Ling Q, Huang D (2010) An improved approximation approach incorporating particle swarm optimization and a priori information into neural networks. Neural Comput Appl 19(2):255–261
Jia D, Zheng G, Khurram Khan M (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187
Koh A (2007) Solving transportation bi-level programs with differential evolution. In: IEEE congress on evolutionary computation, IEEE, Singapore, pp 2243–2250
Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462
Lopez Cruz I, Van Willigenburg L, Van Straten G (2003) Optimal control of nitrate in lettuce by a hybrid approach: differential evolution and adjustable control weight gradient algorithms. Comput Electron Agric 40(1-3):179–197
Mallipeddi R, Suganthan P, Pan Q, Tasgetiren M (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696
Mandal A, Das A, Mukherjee P, Das S, Suganthan P (2011) Modified differential evolution with local search algorithm for real world optimization. In: IEEE congress on evolutionary computation, IEEE, New Orleans, LA, pp 1565–1572
Masters T, Land W (1997) A new training algorithm for the general regression neural network. In: IEEE international conference on systems, man, and cybernetics, IEEE, Orlando, FL, vol 3, pp 1990–1994
Neri F, Tirronen V (2009) Scale factor local search in differential evolution. Memet Comput 1(2):153–171
Nocedal J, Wright S (1999) Numerical optimization. Springer verlag, New York, USA
Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125
Pant M, Ali M, Singh V (2008) Differential evolution with parent centric crossover. In: Second UKSIM European symposium on computer modeling and simulation, IEEE, Liverpool, pp 141–146
Plevris V, Papadrakakis M (2011) A hybrid particle swarmgradient algorithm for global structural optimization. Comput-Aided Civ Inf 26(1):48–68
Price K, Storn R, Lampinen J (2005) Differential evolution: a practical approach to global optimization. Springer, New York
Qin A, Suganthan P (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: The 2005 IEEE congress on evolutionary computation, IEEE 2, pp 1785–1791
Qin A, Huang V, Suganthan P (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417
Rahnamayan S, Tizhoosh H, Salama M (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79
Rönkkönen J, Kukkonen S, Price K (2005) Real-parameter optimization with differential evolution. In: The 2005 IEEE congress on evolutionary computation, IEEE, Edinburgh, Scotland, vol 1, pp 506–513
Storn R, Price K (1995) Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces. International computer science institute, Berkely, CA, USA, Tech Rep TR-95-012
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359
Suganthan P, Hansen N, Liang J, Deb K, Chen Y, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization. Nanyang Technological University, Singapore, Tech Rep
Takahama T, Sakai S (2006) Constrained optimization by the \(\varepsilon\) constrained differential evolution with gradient-based mutation and feasible elites. In: IEEE congress on evolutionary computation, IEEE, Vancouver, BC, pp 1–8
Wang H, Wu Z, Rahnamayan S (2011) Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems. Soft Comput 15(11):2127–2140
Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66
Wiegand R (2004) An analysis of cooperative coevolutionary algorithms. PhD thesis, Fairfax, VA, USA
Yang Z, Yao X, He J (2008) Making a difference to differential evolution. In: Siarry P, Michalewicz Z (eds) Advances in metaheuristics for hard optimization, Springer, Berlin, pp 397–414
Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102
Zahara E, Kao Y, Su J (2009) Enhancing particle swarm optimization with gradient information. In: Fifth international conference on natural computation, IEEE, Tianjin, China, vol 3, pp 251–254
Zaharie D (2008) Statistical properties of differential evolution and related random search algorithms. COMPSTAT 2008, pp 473–485
Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9(3):1126–1138
Zamuda A, Brest J, Bošković B, Žumer V (2009) Differential evolution with self-adaptation and local search for constrained multiobjective optimization. In: IEEE congress on evolutionary computation, IEEE, Trondheim, pp 195–202
Zhang J, Sanderson A (2009) Jade: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
Zhao R, Tang W (2008) Monkey algorithm for global numerical optimization. J Uncertain Syst 2(3):165–176
Zhao S, Liang J, Suganthan P, Tasgetiren M (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. In: IEEE congress on evolutionary computation, IEEE, Hong Kong, pp 3845–3852
Acknowledgments
The authors thank the anonymous reviewers for their helpful comments and suggestions, and also would like to thank Dr. Ponnuthurai Nagaratnam Suganthan in Nanyang Technological University, Singapore, Dr. Yong Wang in Central South University, China, Dr. Janez Brest in University of Maribor, Slovenia, and Dr. Rammohan Mallipeddi in Nanyang Technological University, Singapore, for providing the source codes of their algorithms SaDE, CoDE, jDE, and EPSDE, respectively, on the websites. This work was supported by the Chinese National Natural Science Foundation under Grant 61173060 and the Major Research Plan of National Natural Science Foundation of China under Grant 91230118.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by F. Herrera.
Rights and permissions
About this article
Cite this article
Xie, W., Yu, W. & Zou, X. Diversity-maintained differential evolution embedded with gradient-based local search. Soft Comput 17, 1511–1535 (2013). https://doi.org/10.1007/s00500-012-0962-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-012-0962-x