Abstract
Differential evolution (de) is a popular population-based meta-heuristic that has been successfully used in complex optimization problems. Premature convergence is one of the most important drawbacks that affects its performance. In this paper, a novel replacement strategy that combines the use of an elite population and a mechanism to preserve diversity explicitly is devised. The proposal is integrated with de to generate the de with enhanced diversity maintenance. The main novelty is the use of a dynamic balance between exploration and exploitation to adapt the optimizer to the requirements of the different optimization stages. Experimental validation is carried out with several benchmark tests proposed in competitions of the well-known IEEE Congress on Evolutionary Computation. Top-rank algorithms of each competition, as well as other diversity-based schemes, are used to illustrate the usefulness of the proposal. The new method avoids premature convergence and significantly improves further the results obtained by state-of-the-art algorithms.
Similar content being viewed by others
Notes
The code in C++ can be downloaded in the next link https://github.com/joelchaconcastillo/Diversity_DE_Research.git/.
References
Awad, N.H., Ali, M.Z., Suganthan, P.N., Reynolds, R.G.: An ensemble sinusoidal parameter adaptation incorporated with L-SHADE for solving CEC2014 benchmark problems. In: 2016 IEEE Congress on Evolutionary Computation (CEC’16), pp. 2958–2965. IEEE (2016)
Bolufé-Röhler, A., Estévez-Velarde, S., Piad-Morffis, A., Chen, S., Montgomery, J.: Differential evolution with thresheld convergence. In: 2013 IEEE Congress on Evolutionary Computation (CEC’13), pp. 40–47. IEEE (2013)
Brest, J., Maučec, M.S., Bošković, B.: iL-SHADE: improved L-SHADE algorithm for single objective real-parameter optimization. In: 2016 IEEE Congress on Evolutionary Computation (CEC’16), pp. 1188–1195. IEEE (2016)
Brest, J., Maučec, M.S., Bošković, B.: Single objective real-parameter optimization: algorithm jSO. In: 2017 IEEE Congress on Evolutionary Computation (CEC’17), pp. 1311–1318. IEEE (2017)
Chakraborty, U.K.: Advances in Differential Evolution, vol. 143. Springer, Berlin (2008)
Črepinšek, M., Liu, S.H., Mernik, M.: Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput. Surv. 45(3), 35:1–35:33 (2013)
Das, S., Suganthan, P.N.: Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems. Jadavpur University, Nanyang Technological University, Kolkata (2010)
Das, S., Suganthan, P.N.: Differential evolution: a survey of the state-of-the-art. IEEE Trans. Evol. Comput. 15(1), 4–31 (2011)
Durillo, J.J., Nebro, A.J., Coello, C.A.C., Garcia-Nieto, J., Luna, F., Alba, E.: A study of multiobjective metaheuristics when solving parameter scalable problems. IEEE Trans. Evol. Comput. 14(4), 618–635 (2010)
Elsayed, S., Hamza, N., Sarker, R.: Testing united multi-operator evolutionary algorithms-ii on single objective optimization problems. In: 2016 IEEE Congress on Evolutionary Computation (CEC’16), pp. 2966–2973. IEEE (2016)
Eshelman, L.J., Schaffer, J.D.: Real-coded genetic algorithms and interval-schemata. In: Foundations of Genetic Algorithms, vol. 2, pp. 187–202. Elsevier, Amsterdam (1993)
Harik, G.R.: Finding multimodal solutions using restricted tournament selection. In: ICGA, pp. 24–31 (1995)
Kumar, A., Misra, R.K., Singh, D.: Improving the local search capability of effective butterfly optimizer using covariance matrix adapted retreat phase. In: 2017 IEEE Congress on Evolutionary Computation (CEC’17), pp. 1835–1842. IEEE (2017)
Lampinen, J., Zelinka, I., et al.: On stagnation of the differential evolution algorithm. In: Proceedings of MENDEL, pp. 76–83 (2000)
Liang, J., Qu, B., Suganthan, P.: Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore (2013)
Liang, J., Qu, B., Suganthan, P., Chen, Q.: Problem Definitions and Evaluation Criteria for the CEC 2015 Competition on Learning-Based Real-parameter Single Objective Optimization. Technical Report 201411A, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore (2014)
Liu, B., Chen, Q., Zhang, Q., Liang, J., Suganthan, P., Qu, B.: Problem definitions and evaluation criteria for computational expensive optimization. In: Technical Report (2013)
Locatelli, M., Vasile, M.: (Non) convergence results for the differential evolution method. Optim. Lett. 9(3), 413–425 (2015)
Molina, D., Moreno-García, F., Herrera, F.: Analysis among winners of different IEEE CEC competitions on real-parameters optimization: Is there always improvement? In: 2017 IEEE Congress on Evolutionary Computation (CEC’17), pp. 805–812. IEEE (2017)
Montgomery, J.: Differential evolution: difference vectors and movement in solution space. In: 2009 IEEE Congress on Evolutionary Computation, pp. 2833–2840 (2009). https://doi.org/10.1109/CEC.2009.4983298
Montgomery, J., Chen, S.: An analysis of the operation of differential evolution at high and low crossover rates. In: 2010 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE (2010)
Montgomery, J., Chen, S.: A simple strategy for maintaining diversity and reducing crowding in differential evolution. In: 2012 IEEE Congress on Evolutionary Computation (CEC’12), pp. 1–8 (2012)
Nelder, J.A., Mead, R.: A simplex method for function minimization. Comput. J. 7(4), 308–313 (1965)
Price, W.: Global optimization by controlled random search. J. Optim. Theory Appl. 40(3), 333–348 (1983)
Sá, Â.A., Andrade, A.O., Soares, A.B., Nasuto, S.J.: Exploration vs. exploitation in differential evolution. In: AISB 2008 Convention Communication, Interaction and Social Intelligence, vol. 1, p. 57 (2008)
Segura, C., Coello, C.A.C., Hernández-Díaz, A.G.: Improving the vector generation strategy of differential evolution for large-scale optimization. Inf. Sci. 323, 106–129 (2015)
Segura, C., Coello, C.A.C., Segredo, E., Aguirre, A.H.: A novel diversity-based replacement strategy for evolutionary algorithms. IEEE Trans. Cybern. 46(12), 3233–3246 (2016)
Storn, R., Price, K.: Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4), 341–359 (1997)
Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y.P., Auger, A., Tiwari, S.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. KanGAL Rep. 2005005, 2005 (2005)
Talbi, E.: Metaheuristics: From Design to Implementation. Wiley Series on Parallel and Distributed Computing. Wiley, New York (2009)
Tang, K., Yáo, X., Suganthan, P.N., MacNish, C., Chen, Y.P., Chen, C.M., Yang, Z.: Benchmark Functions for the CEC2008 Special Session and Competition on Large Scale Global Optimization, vol. 24. Nature Inspired Computation and Applications Laboratory, USTC, China (2007)
Vidal, T., Crainic, T.G., Gendreau, M., Prins, C.: A hybrid genetic algorithm with adaptive diversity management for a large class of vehicle routing problems with time-windows. Comput. Oper. Res. 40(1), 475–489 (2013)
Wu, G., Mallipeddi, R., Suganthan, P.: Problem Definitions and Evaluation Criteria for the CEC 2017 Competition on Constrained Real-Parameter Optimization. National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore, Technical Report (2016)
Yang, M., Li, C., Cai, Z., Guan, J.: Differential evolution with auto-enhanced population diversity. IEEE Trans. Cybern. 45(2), 302–315 (2015)
Zaharie, D.: Control of population diversity and adaptation in differential evolution algorithms. Proc. MENDEL 9, 41–46 (2003)
Zhang, J., Sanderson, A.C.: Jade: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 13(5), 945–958 (2009)
Zhao, L., Sun, C., Huang, X., Zhou, B.: Differential evolution with strategy of improved population diversity. In: 2016 35th Chinese eControl Conference (CCC), pp. 2784–2787. IEEE (2016)
Acknowledgements
Authors acknowledge the financial support from CONACyT through the “Ciencia Básica” Project No. 285599.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chacón Castillo, J., Segura, C. Differential evolution with enhanced diversity maintenance. Optim Lett 14, 1471–1490 (2020). https://doi.org/10.1007/s11590-019-01454-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-019-01454-5