Abstract
Differential evolution (DE) is among the best evolutionary algorithms for global optimization. However, the basic DE has several shortcomings, like the slow convergence speed, and it is more likely to be stuck at local optima. Additionally, DE's performance is sensitive to its mutation strategies and control parameters for mutation and crossover. In this scope, we present in this paper three mechanisms to overcome DE limitations. First, two novel mutations called DE/mean-current/2 and DE/best-mean-current/2 are proposed and integrated in the DE algorithm, and they have both exploration ability and exploitation trend. On the other hand, to avoid being trapped in local minima of hard functions, a new exploration operator has been proposed called Weibull flight based on the Weibull distribution. Finally, new adapted control parameters based on the Weibull distribution are integrated. These parameters contribute to the optimization process by adjusting mutation scale and alleviating the parameter setting problem often encountered in various metaheuristics. The efficacy of the proposed algorithms called meanDE, MDEW, AMDE, and AMDEW is validated through intensive experimentations using classical tests, some challenging tests, the CEC2017, CEC2020, the most recent CEC2022, four constraint engineering problems, and the data clustering problem. Moreover, comparisons with several popular, recent, and high-performance optimization algorithms show a high effectiveness of the proposed algorithms in locating the optimal or near-optimal solutions with higher efficiency. The experiments clearly indicate the effectiveness of the new mutations compared to the standard DE mutations. Moreover, the proposed Weibull flight has a great capacity to deal with the hard composition functions of CEC benchmarks. Finally, the use of adapted control parameters for the mutation scale helps overcome the parameter setting problem commonly encountered in various metaheuristics.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Enquiries about data availability should be directed to the author.
Code availability
References
Abd EM, Ibrahim A (2021) An improved Henry gas solubility optimization algorithm for task scheduling in cloud computing. Artif Intell Rev 54:3599–3637
Abdel-Basset M, et al. (2023) Exponential distribution optimizer (EDO): a novel math-inspired algorithm for global optimization and engineering problems. Artif Intell Rev: 1–72
Abdulnassar AA, Latha RN (2023) Performance analysis of Kmeans with modified initial centroid selection algorithms and developed Kmeans9+ model." Measur Sens: 100666
Ahmad MF, et al. (2021) Differential evolution: a recent review based on state-of-the-art works. Alexand Eng J
Ahmadianfar I et al (2021) RUN beyond the metaphor: an efficient optimization algorithm based on Runge Kutta method. Expert Syst Appl 181:115079
Ahmadianfar I et al (2022) INFO: an efficient optimization algorithm based on weighted mean of vectors. Expert Syst Appl 195:116516
Alabool HM et al (2021) Harris hawks optimization: a comprehensive review of recent variants and applications. Neural Comput Appl 33:8939–8980
Ali MZ, Awad NH, Suganthan PN (2015) Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization. Appl Soft Comput 33:304–327
Almalki SJ, Saralees N (2014) Modifications of the Weibull distribution: a review. Reliab Eng Syst Saf 124:32–55
Aragón VS, Susana CE, Carlos ACC (2010) A modified version of a T-Cell Algorithm for constrained optimization problems. Int J Numer Meth Eng 84(3):351–378
Awad N, et al. (2016) Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective bound constrained real-parameter numerical optimization: technical report. Nanyang Technological University, Singapore
Bernardino HS, et al. (2008) A new hybrid AIS-GA for constrained optimization problems in mechanical engineering. In: 2008 IEEE congress on evolutionary computation (IEEE world congress on computational intelligence). IEEE
Chakraborty S et al (2021) COVID-19 X-ray image segmentation by modified whale optimization algorithm with population reduction. Comput Biol Med 139:104984
Chen X et al (2017) Biogeography-based learning particle swarm optimization. Soft Comput 21(24):7519–7541
Chen H et al (2023) Slime mould algorithm: a comprehensive review of recent variants and applications. Int J Syst Sci 54(1):204–235
Coello CAC, Becerra RL (2004) Efficient evolutionary optimization through the use of a cultural algorithm. Eng Optim 36:219–236
Coello Coello CA (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41:113–127
Cui L et al (2018) A novel differential evolution algorithm with a self-adaptation parameter control method by differential evolution. Soft Comput 22:6171–6190
Dhiman G, Amandeep K (2019) STOA: a bio-inspired based optimization algorithm for industrial engineering problems. Eng Appl Artif Intell 82:148–174
Dorigo M, Mauro B, Thomas S (2006) Ant colony optimization. IEEE Comput Intell Mag 1(4):28–39
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory MHS’95. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, IEEE, pp. 39–43
Ezugwu AE et al (2022) A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects. Eng Appl Artif Intell 110:104743
Faramarzi A et al (2020) Equilibrium optimizer: a novel optimization algorithm. Knowl-Based Syst 191:105190
Fontes DBMM, Homayouni SM, Gonçalves JF (2023) A hybrid particle swarm optimization and simulated annealing algorithm for the job shop scheduling problem with transport resources. Eur J Oper Res 306.3:1140–1157
Glover F (1990) Tabu search: a tutorial. Interfaces 20(4):74–94
Hailong W, Zhongbo H, Yuqiu S, Qinghua S, Xuewen X (2018) Modified backtracking search optimization algorithm inspired by simulated annealing for constrained engineering optimization problems. In: Computational Intelligence and Neuroscience, vol. 2018, Article ID 9167414, pp 27
Hashim FA et al (2019) Henry gas solubility optimization: a novel physics-based algorithm. Fut Gen Comput Syst 101:646–667
He Q, Wang L (2007) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20:89–99
Heidari AA et al (2019) Harris hawks optimization: algorithm and applications. Fut Gen Comput Syst 97:849–872
Holland JH (1992) Genetic algorithms. Sci Am 267(1):66–73
Houssein EH, Saad MR, Hashim FA, Shaban H, Hassaballah M (2020) Lévy flight distribution: a new metaheuristic algorithm for solving engineering optimization problems. Eng Appl Artif Intell 94:103731
Huang F, Wang L, He Q (2007) An effective co-evolutionary differential evolution for constrained optimization. Appl Math Comput 186:340–356
Karim B, Abdesslem L (2023) Data clustering tangent search algorithm. In: International Conference on Intelligent Systems & Pattern Recognition, pp.1–15
Kaveh A, Dadras A (2017) A novel meta-heuristic optimization algorithm: thermal exchange optimization. Adv Eng Softw 110:69–84
Kaya E et al (2022) A review on the studies employing artificial bee colony algorithm to solve combinatorial optimization problems. Eng Appl Artif Intell 115:105311
Kumar A, Misra R, Singh D (2017) Improving the local search capability of effective butterfly optimizer using covariance matrix adapted retreat phase. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1835–1842
Kumar A, Price K, Mohamed A, Hadi A, Suganthan PN (2022) Problem definitions and evaluation criteria for the CEC 2022 special session and competition on single objective bound constrained numerical optimization; technical report. Nanyang Technological University, Singapore
Kvasov DE, Mukhametzhanov MS (2018) Metaheuristic vs deterministic global optimization algorithms: the univariate case. Appl Math Comput 318:245–259
Layeb A (2022a) Tangent search algorithm for solving optimization problems. Neural Comput Appl 34:8853–8884
Layeb A (2022b) New hard benchmark functions for global optimization. arXiv preprint arXiv:2202.04606
Li S et al (2020) Slime mould algorithm: a new method for stochastic optimization. Fut Gen Comput Syst 111:300–323
Liu H, Cai Z, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10(2):629–640
Mezura-Montes E, Coello CAC (2008) An empirical study about the usefulness of evolution strategies to solve constrained optimization problems. Int J Gen Syst 37:443–473
Mirjalili S, Andrew L (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Mohamed AW, Suganthan PN (2018) Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation. Soft Comput 22(10):3215–3235
Mohamed AW, Hadi AA, Mohamed AK (2021) Differential evolution mutations: taxonomy, comparison and convergence analysis. IEEE Access 9:68629–68662
Mohamed AK, Mohamed AW (2019) Real-parameter unconstrained optimization based on enhanced AGDE algorithm. In: Machine Learning Paradigms: Theory and Application. Springer, pp 431–450.
Mohamed AW, et al. (2021) Gaining-sharing knowledge based algorithm with adaptive parameters hybrid with IMODE algorithm for solving CEC 2021 benchmark problems. In: 2021 IEEE Congress on Evolutionary Computation (CEC). IEEE
Mohammadi-Balani A et al (2021) Golden eagle optimizer: a nature-inspired metaheuristic algorithm. Comput Ind Eng 152:107050
Montes E, Ocana B (2008) Bacterial foraging for engineering design problems: preliminary results. In: 4th Mex. Congr. Evol. Comput. COMCEV’2008, Mexico, pp. 33–38
Nasiri J, Farzin MK (2018) A whale optimization algorithm (WOA) approach for clustering. Cogent Math Stat 5(1):1483565
Neggaz N, Essam HH, Kashif H (2020) An efficient henry gas solubility optimization for feature selection. Expert Syst Appl 152:113364
Opara K, Arabas J (2018) Comparison of mutation strategies in differential evolution—a probabilistic perspective. Swarm Evol Comput 39:53–69
Pachung P, Jagdish CB (2022) An improved tangent search algorithm. MethodsX 9:101839
Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Sun G, Lan Y, Zhao R (2019) Differential evolution with Gaussian mutation and dynamic parameter adjustment. Soft Comput 23(5):1615–1642
Sun G, Yang B, Yang Z, Xu G (2020) An adaptive differential evolution with combined strategy for global numerical optimization. Soft Comput 24:6277–6296
Tanabe, R, Alex SF (2014) Improving the search performance of SHADE using linear population size reduction. In: 2014 IEEE congress on evolutionary computation (CEC). IEEE
Tu J et al (2021) The colony predation algorithm. J Bionic Eng 18:674–710
Wang Y, Cai ZX, Zhou YR, Fan Z (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscip Optim 37(4):395–413
Wang S, Li Y, Yang H (2019) Self-adaptive mutation differential evolution algorithm based on particle swarm optimization. Appl Soft Comput 81:105496
Wang M, et al (2022) Harris hawk optimization algorithm based on cauchy distribution inverse cumulative function and tangent flight operator. Appl Intell: 1–28
Wei D, Sunney YSL, Yang T, Athanasios VV (2017) Differential evolution with event-triggered impulsive control. IEEE Trans Cybern 47(1):244–257
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evolut Comput 1.1:67–82
Xing J et al (2023) Boosting whale optimizer with quasi-oppositional learning and Gaussian barebone for feature selection and COVID-19 image segmentation. J Bionic Eng 20(2):797–818
Xueqing Y, Tian M (2022) Differential evolution with two-level adaptive mechanism for numerical optimization. Knowl Based Syst:108209.
Yi W et al (2022) Adaptive differential evolution with ensembling operators for continuous optimization problems. Swarm Evol Comput 69:100994
Yue CT, et al. (2020) Problem definitions and evaluation criteria for the CEC 2020 special session and competition on single objective bound constrained numerical optimization. Comput Intell Lab, Zhengzhou Univ, Zhengzhou, China, Tech. Rep 201911
Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evolut Comput 13(5):945–958
Zhang M, Luo W, Wang X (2008) Differential evolution with dynamic stochastic selection for constrained optimization. Inf Sci 178(15):3043–3074
Zhang J, Liang C, Huang Y, Wu J, Yang S (2009) An effective multiagent evolutionary algorithm integrating a novel roulette inversion operator for engineering optimization. Appl Math Comput 211:392–416
Zhao X et al (2022) Multi-swarm improved moth–flame optimization algorithm with chaotic grouping and Gaussian mutation for solving engineering optimization problems. Expert Syst Appl 204:117562
Zou, L, et al. (2022) Improving the search accuracy of differential evolution by using the number of consecutive unsuccessful updates. Knowl Based Syst: 109005
Funding
No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
The author confirms sole responsibility for the following: study conception and design, data collection, analysis and interpretation of results, and manuscript preparation.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethical approval
Not applicable, because this article does not contain any studies with human or animal subjects.
Informed consent
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix
1.1 Pressure vessel design
Mathematical model
subject to
where
1.2 Welded beam design
Mathematical model
subject to
where \(0.1\le {x}_{1}\le \mathrm{2,0.1}\le {x}_{2}\le \mathrm{10,0.1}\le {x}_{3}\le \mathrm{10,0.1}\le {x}_{4}\le 2,\)
Tension/compression spring design
Mathematical model
Subject to
where \(0.05\le {x}_{1}\le 2.00, 0.25\le {x}_{2}\le 1.30\), \(2.0\le {x}_{3}\le 15.0.\)
Speed reducer design problem
Mathematical model
subject to
where \(2.6\le {x}_{1}\le 3.6\) \(0.7\le {x}_{2}\le 0.8\), \(17\le {x}_{3}\le 28\), \(7.3\le {x}_{4}\le 8.3\), \(7.3\le {x}_{5}\le 8.3\), \(2.9\le {x}_{6}\le 3.9\). \(5.0\le {x}_{7}\le 5.5\)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Layeb, A. Differential evolution algorithms with novel mutations, adaptive parameters, and Weibull flight operator. Soft Comput 28, 7039–7091 (2024). https://doi.org/10.1007/s00500-023-09561-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-023-09561-3