Abstract
Numerous optimization problems can be addressed using metaheuristics instead of deterministic and heuristic approaches. This study proposes a novel population-based metaheuristic algorithm called the Exponential Distribution Optimizer (EDO). The main inspiration for EDO comes from mathematics based on the exponential probability distribution model. At the outset, we initialize a population of random solutions representing multiple exponential distribution models. The positions in each solution represent the exponential random variables. The proposed algorithm includes two methodologies for exploitation and exploration strategies. For the exploitation stage, the algorithm utilizes three main concepts, memoryless property, guiding solution and the exponential variance among the exponential random variables to update the current solutions. To simulate the memoryless property, we assume that the original population contains only the winners that obtain good fitness. We construct another matrix known as memoryless to retain the newly generated solutions regardless of their fitness compared to their corresponding winners in the original population. As a result, the memoryless matrix stores two types of solutions: winners and losers. According to the memoryless property, we disregard and do not memorize the previous history of these solutions because past failures are independent and have no influence on the future. The losers can thus contribute to updating the new solutions next time. We select two solutions from the original population derived from the exponential distributions to update the new solution throughout the exploration phase. Furthermore, EDO is tested against classical test functions in addition to the Congress on Evolutionary Computation (CEC) 2014, CEC 2017, CEC 2020 and CEC 2022 benchmarks, as well as six engineering design problems. EDO is compared with the winners of CEC 2014, CEC 2017 and CEC 2020, which are L-SHADE, LSHADE−cnEpSin and AGSK, respectively. EDO reveals exciting results and can be a robust tool for CEC competitions. Statistical analysis demonstrates the superiority of the proposed EDO at a 95% confidence interval.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abdollahzadeh B, Gharehchopogh FS, Mirjalili S (2021a) African vultures optimization algorithm: a new nature-inspired metaheuristic algorithm for global optimization problems. Comput Ind Eng 158:107408
Abdollahzadeh B, Gharehchopogh FS, Mirjalili S (2021b) Artificial gorilla troops optimizer: a new nature-inspired metaheuristic algorithm for global optimization problems. Int J Intell Syst 36(10):5887–5958
Abualigah L et al (2021b) Aquila optimizer: a novel meta-heuristic optimization algorithm. Comput Ind Eng 157:107250
Abualigah L et al (2021a) The arithmetic optimization algorithm. Comput Methods Appl Mech Eng 376:113609
Abualigah L et al (2022) Reptile search algorithm (RSA): a nature-inspired meta-heuristic optimizer. Expert Syst Appl 191:116158
Agushaka JO, Ezugwu AE, Abualigah L (2022) Dwarf mongoose optimization algorithm. Comput Methods Appl Mech Eng 391:114570
Ahmadianfar I, Bozorg-Haddad O, Chu X (2020) Gradient-based optimizer: a new metaheuristic optimization algorithm. Inf Sci 540:131–159
Ahmadianfar I et al (2021) RUN beyond the metaphor: an efficient optimization algorithm based on Runge Kutta method. Expert Syst Appl 181:115079
Alweshah M et al (2020) The monarch butterfly optimization algorithm for solving feature selection problems. Neural Comput Appl 1–15.
Askari Q, Younas I, Saeed M (2020a) Political optimizer: a novel socio-inspired meta-heuristic for global optimization. Knowl-Based Syst 195:105709
Askari Q, Saeed M, Younas I (2020b) Heap-based optimizer inspired by corporate rank hierarchy for global optimization. Expert Syst Appl 161:113702
Atashpaz-Gargari E, Lucas C (2007) Imperialist competitive algorithm: an algorithm for optimization inspired by imperialistic competition. In: 2007 IEEE congress on evolutionary computation. IEEE.
Awad NH, Ali MZ, Suganthan PN (2017) Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems. In: 2017 IEEE congress on evolutionary computation (CEC). IEEE.
Bayzidi H et al (2021) Social network search for solving engineering optimization problems. Computat Intell Neurosci
Borji A (2007) A new global optimization algorithm inspired by parliamentary political competitions. In: Mexican international conference on artificial intelligence. Springer, Berlin.
Cavazzuti M (2013) Deterministic optimization. Optimization methods. Springer, pp 77–102
Charin C et al (2021) A hybrid of bio-inspired algorithm based on Levy flight and particle swarm optimizations for photovoltaic system under partial shading conditions. Sol Energy 217:1–14
Chen C, Wang S (1993) Branch-and-bound scheduling for thermal generating units. IEEE Trans Energy Convers 8(2).
Chen R et al (2019) QSSA: quantum evolutionary Salp swarm algorithm for mechanical design. IEEE Access 7:145582–145595
Coello CAC, Montes EM (2002) Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv Eng Inform 16(3):193–203
Cui Z et al (2020) Hybrid many-objective particle swarm optimization algorithm for green coal production problem. Inf Sci 518:256–271
da Costa PRDO et al (2018) A genetic algorithm for a green vehicle routing problem. Electron Notes Discret Math 64:65–74
Daryani N, Hagh MT, Teimourzadeh S (2016) Adaptive group search optimization algorithm for multi-objective optimal power flow problem. Appl Soft Comput 38:1012–1024
Das S, Suganthan P (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 1(15):4–31
Dennis JE Jr, Turner K (1987) Generalized conjugate directions. Linear Algebra Appl 88:187–209
Dhiman G, Kumar V (2019) Seagull optimization algorithm: theory and its applications for large-scale industrial engineering problems. Knowl-Based Syst 165:169–196
Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B 26(1):29–41
dos Santos Coelho L (2010) Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems. Expert Syst Appl 37(2):1676–1683
Dulhare UN (2018) Prediction system for heart disease using Naive Bayes and particle swarm optimization. Biomed Res 29(12):2646–2649
Eberhart R, Kennedy J (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks. Citeseer.
Elbeltagi E, Hegazy T, Grierson D (2005) Comparison among five evolutionary-based optimization algorithms. Adv Eng Inform 19(1):43–53
Erol OK, Eksin I (2006) A new optimization method: big bang–big crunch. Adv Eng Softw 37(2):106–111
Eskandar H et al (2012) Water cycle algorithm–a novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput Struct 110:151–166
Fadakar E, Ebrahimi M (2016) A new metaheuristic football game inspired algorithm. In: 2016 1st conference on swarm intelligence and evolutionary computation (CSIEC). IEEE.
Fan Q et al (2021) A modified self-adaptive marine predators algorithm: framework and engineering applications. Eng Comput 1–26.
Faramarzi A et al (2020a) Marine predators algorithm: a nature-inspired metaheuristic. Expert Syst Appl 152:113377
Faramarzi A et al (2020b) Equilibrium optimizer: a novel optimization algorithm. Knowl-Based Syst 191:105190
Flores JJ, López R, Barrera J (2011) Gravitational interactions optimization. In: International conference on learning and intelligent optimization. Springer, Berlin.
Formato RA (2007) Central force optimization. Prog Electromagn Res 77(1):425–491
Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Commun Nonlinear Sci Numer Simul 17(12):4831–4845
Gao B et al (2022) A hybrid improved whale optimization algorithm with support vector machine for short-term photovoltaic power prediction. Appl Artif Intell 1–33.
Gargari EA et al (2008) Colonial competitive algorithm: a novel approach for PID controller design in MIMO distillation column process. Int J Intell Comput Cybern
George T, Amudha T (2020) Genetic algorithm based multi-objective optimization framework to solve traveling salesman problem. Advances in computing and intelligent systems. Springer, pp 141–151
Gill PE, Murray W (1972) Quasi-Newton methods for unconstrained optimization. IMA J Appl Math 9(1):91–108
Gogna A, Tayal A (2013) Metaheuristics: review and application. J Exp Theor Artif Intell 25(4):503–526
Habib M et al (2020) Multi-objective particle swarm optimization: theory, literature review, and application in feature selection for medical diagnosis. Evolut Machine Learn Tech 175–201.
Hashim FA, Hussien AG (2022) Snake optimizer: a novel meta-heuristic optimization algorithm. Knowl-Based Syst 108320.
Hashim FA et al (2019) Henry gas solubility optimization: a novel physics-based algorithm. Futur Gener Comput Syst 101:646–667
He Q, Wang L (2007) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20(1):89–99
Holland JH (1992) Genetic algorithms. Sci Am 267(1):66–73
Hosseinabadi AAR et al (2019) Extended genetic algorithm for solving open-shop scheduling problem. Soft Comput 23(13):5099–5116
Hwang S-F, He R-S (2006) A hybrid real-parameter genetic algorithm for function optimization. Adv Eng Inform 20(1):7–21
Jadhav S, He H, Jenkins K (2018) Information gain directed genetic algorithm wrapper feature selection for credit rating. Appl Soft Comput 69:541–553
Jadon SS et al (2015) Accelerating artificial bee colony algorithm with adaptive local search. Memetic Comput 7(3):215–230
Jadon SS et al (2018) Artificial bee colony algorithm with global and local neighborhoods. Int J Syst Assur Eng Manag 9(3):589–601
Jain M, Singh V, Rani A (2019) A novel nature-inspired algorithm for optimization: squirrel search algorithm. Swarm Evol Comput 44:148–175
Karaboga D, Basturk B (2007) Artificial bee colony (ABC) optimization algorithm for solving constrained optimization problems. In: International fuzzy systems association world congress. Springer, Berlin.
Karami H et al (2021) Flow direction algorithm (FDA): A novel optimization approach for solving optimization problems. Comput Ind Eng 156:107224
Kashan AH (2014) League Championship Algorithm (LCA): an algorithm for global optimization inspired by sport championships. Appl Soft Comput 16:171–200
Kaveh A, Dadras A (2017) A novel meta-heuristic optimization algorithm: thermal exchange optimization. Adv Eng Softw 110:69–84
Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213(3):267–289
Kumar M, Kulkarni AJ, Satapathy SC (2018) Socio evolution & learning optimization algorithm: a socio-inspired optimization methodology. Futur Gener Comput Syst 81:252–272
Kundu T, Garg H (2022) A hybrid TLNNABC algorithm for reliability optimization and engineering design problems. Eng Comput 1–45.
Lai X et al (2020) Diversity-preserving quantum particle swarm optimization for the multidimensional knapsack problem. Expert Syst Appl 149:113310
Liang JJ, Qu BY, Suganthan PN (2013) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore 635:490
Liang J et al (2020) Classified perturbation mutation based particle swarm optimization algorithm for parameters extraction of photovoltaic models. Energy Convers Manag 203:112138
Liu W-L et al (2019) Coordinated charging scheduling of electric vehicles: a mixed-variable differential evolution approach. IEEE Trans Intell Transp Syst 21(12):5094–5109
Liu H, Cai Z, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10(2):629–640
Lv W et al (2010) Election campaign algorithm. In: 2010 2nd international Asia conference on informatics in control, automation and robotics (CAR 2010). IEEE.
Ma H et al (2017) Biogeography-based optimization: a 10-year review. IEEE Trans Emerg Top Comput Intell 1(5):391–407
Mandic D (2004) A generalized normalized gradient descent algorithm. IEEE Signal Process Lett 11(2):115–118
McMahon G, Burton P (1967) Flow-shop scheduling with the branch-and-bound method. Oper Res 15(3):473–481
Mehta P et al (2022) Hunger games search algorithm for global optimization of engineering design problems. Mater Test 64(4):524–532
Melvix JL (2014) Greedy politics optimization: metaheuristic inspired by political strategies adopted during state assembly elections. In: 2014 IEEE international advance computing conference (IACC). IEEE.
Mirjalili S (2015a) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249
Mirjalili S (2015b) The ant lion optimizer. Adv Eng Softw 83:80–98
Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133
Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61
Mirjalili S, Mirjalili SM, Hatamlou A (2016) Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513
Mirjalili S et al (2017) Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
Mohamed AW et al (2021) Gaining-sharing knowledge based algorithm with adaptive parameters hybrid with IMODE algorithm for solving CEC 2021 benchmark problems. In: 2021 IEEE congress on evolutionary computation (CEC). IEEE.
Mohammadi-Balani A et al (2021) Golden eagle optimizer: a nature-inspired metaheuristic algorithm. Comput Ind Eng 152:107050
Mohana S, Saroja M, Venkatachalam M (2014) Comparative analysis of swarm intelligence optimization techniques for cloud scheduling. Int J Innov Sci Eng Technol 1(10):15–19
Moosavi SHS, Bardsiri VK (2019) Poor and rich optimization algorithm: A new human-based and multi populations algorithm. Eng Appl Artif Intell 86:165–181
Moosavian N, Roodsari BK (2014) Soccer league competition algorithm: a novel meta-heuristic algorithm for optimal design of water distribution networks. Swarm Evol Comput 17:14–24
Moré JJ (1978) The Levenberg-Marquardt algorithm: implementation and theory. Numerical analysis. Springer, pp 105–116
Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Caltech Concurrent Computation Program C3P Rep 826:1989.
Mühlenbein H, Paaß G (1996) From recombination of genes to the estimation of distributions I. Binary parameters. In: International conference on parallel problem solving from nature. Springer, Berlin.
Naderi E, Pourakbari-Kasmaei M, Abdi H (2019) An efficient particle swarm optimization algorithm to solve optimal power flow problem integrated with FACTS devices. Appl Soft Comput 80:243–262
Nelder JA, Mead R (1965) A simplex method for function minimization. Comput J 7(4):308–313
Owais M, Osman MK (2018) Complete hierarchical multi-objective genetic algorithm for transit network design problem. Expert Syst Appl 114:143–154
Oyelade ON et al (2022) Ebola optimization search algorithm: a new nature-inspired metaheuristic optimization algorithm. IEEE Access 10:16150–16177
Ozsoydan FB, Baykasoğlu A (2019) Quantum firefly swarms for multimodal dynamic optimization problems. Expert Syst Appl 115:189–199
Ramezani F, Lotfi S (2013) Social-based algorithm (SBA). Appl Soft Comput 13(5):2837–2856
Rao RV, Savsani VJ, Vakharia D (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315
Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Razmjooy N, Khalilpour M, Ramezani M (2016) A new meta-heuristic optimization algorithm inspired by FIFA world cup competitions: theory and its application in PID designing for AVR system. J Control Autom Electr Syst 27(4):419–440
Rigakis M et al (2021) Tourist group itinerary design: When the firefly algorithm meets the n-person Battle of Sexes. Knowl-Based Syst 228:107257
Sadollah A et al (2013) Mine blast algorithm: a new population based algorithm for solving constrained engineering optimization problems. Appl Soft Comput 13(5):2592–2612
Salem SA (2012) BOA: a novel optimization algorithm. In: 2012 international conference on engineering and technology (ICET). IEEE.
Salih SQ, Alsewari AA (2020) A new algorithm for normal and large-scale optimization problems: nomadic people optimizer. Neural Comput Appl 32(14):10359–10386
Sarker R, Ray T (2009) An improved evolutionary algorithm for solving multi-objective crop planning models. Comput Electron Agric 68(2):191–199
Satapathy S, Naik A (2016) Social group optimization (SGO): a new population evolutionary optimization technique. Complex Intell Syst 2(3):173–203
Sayed GI, Darwish A, Hassanien AE (2019) Quantum multiverse optimization algorithm for optimization problems. Neural Comput Appl 31(7):2763–2780
Silver D et al (2014) Deterministic policy gradient algorithms. In: International conference on machine learning. PMLR.
Simon D (2008) Biogeography-based optimization. IEEE Trans Evol Comput 6(12):702–713
Singh PR, Elaziz MA, Xiong S (2019) Ludo game-based metaheuristics for global and engineering optimization. Appl Soft Comput 84:105723
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11:341–359
Subbu R, Sanderson AC (2004) Modeling and convergence analysis of distributed coevolutionary algorithms. IEEE Trans Syst Man Cybern B 34(2):806–822
Taher MA et al (2019) An improved moth-flame optimization algorithm for solving optimal power flow problem. Int Trans Electr Energy Syst 29(3):e2743
Tan KC, Yang Y, Goh CK (2006) A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Trans Evol Comput 10(5):527–549
Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. In 2014 IEEE congress on evolutionary computation (CEC). IEEE.
Tang D et al (2015) ITGO: invasive tumor growth optimization algorithm. Appl Soft Comput 36:670–698
Tanyildizi E, Demir G (2017) Golden sine algorithm: a novel math-inspired algorithm. Adv Electr Comput Eng 17(2):71–78
Tenemaza M et al (2020) Improving itinerary recommendations for tourists through metaheuristic algorithms: an optimization proposal. IEEE Access 8:79003–79023
Tsai J-F et al (2014) Optimization theory, methods, and applications in engineering 2013. Hindawi.
Tu J et al (2021) The colony predation algorithm. J Bionic Eng 18(3):674–710
Usharani B (2022) COVID-19 detection using discrete particle swarm optimization clustering with image processing. Assessing COVID-19 and other pandemics and epidemics using computational modelling and data analysis. Springer, pp 221–238
Wang Y et al (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscip Optim 37(4):395–413
Wang G-G, Deb S, Coelho LDS (2018) Earthworm optimisation algorithm: a bio-inspired metaheuristic algorithm for global optimisation problems. Int J Bio-Inspired Comput 12(1):1–22
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Wu W et al (2021) A hybrid metaheuristic algorithm for location inventory routing problem with time windows and fuel consumption. Expert Syst Appl 166:114034
Xia X et al (2019) Triple archives particle swarm optimization. IEEE Trans Cybern
Xie H et al (2021) A decision variable classification-based cooperative coevolutionary algorithm for dynamic multiobjective optimization. Inf Sci 560:307–330
Xiong G et al (2018) Parameter extraction of solar photovoltaic models using an improved whale optimization algorithm. Energy Convers Manag 174:388–405
Xu Y, Cui Z, Zeng J (2010) Social emotional optimization algorithm for nonlinear constrained optimization problems. In: International conference on swarm, evolutionary, and memetic computing. Springer, Berlin.
Yang X-S (2010) Firefly algorithm, Levy flights and global optimization. Research and development in intelligent systems XXVI. Springer, pp 209–218
Yang X-S, Deb S (2009) Cuckoo search via Lévy flights. In: 2009 World congress on nature & biologically inspired computing (NaBIC). IEEE.
Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102
Yao X et al (2003) Fast evolutionary algorithms. Advances in evolutionary computing. Springer, pp 45–94
Yıldız AR et al (2019) A new hybrid Harris hawks-Nelder-Mead optimization algorithm for solving design and manufacturing problems. Mater Test 61(8):735–743
Zarand G et al (2002) Using hysteresis for optimization. Phys Rev Lett 89(15):150201
Zhai Q et al (2020) Whale optimization algorithm for multiconstraint second-order stochastic dominance portfolio optimization. Comput Intell Neurosci
Zhang Y, Wang S, Ji G (2015) A comprehensive survey on particle swarm optimization algorithm and its applications. Math Probl Eng
Zhang Y, Jin Z, Mirjalili S (2020) Generalized normal distribution optimization and its applications in parameter extraction of photovoltaic models. Energy Convers Manag 224:113301
Zhao F, He X, Wang L (2020a) A two-stage cooperative evolutionary algorithm with problem-specific knowledge for energy-efficient scheduling of no-wait flow-shop problem. IEEE Trans Cybern
Zhao F et al (2020b) An ensemble discrete differential evolution for the distributed blocking flowshop scheduling with minimizing makespan criterion. Expert Syst Appl 160:113678
Zhao F, Ma R, Wang L (2021) A self-learning discrete Jaya algorithm for multiobjective energy-efficient distributed no-idle flow-shop scheduling problem in heterogeneous factory system. IEEE Trans Cybern
Zhao W, Wang L, Mirjalili S (2022) Artificial hummingbird algorithm: a new bio-inspired optimizer with its engineering applications. Comput Methods Appl Mech Eng 388:114194
Zhong F, Li H, Zhong S (2016) A modified ABC algorithm based on improved-global-best-guided approach and adaptive-limit strategy for global optimization. Appl Soft Comput 46:469–486
Zhou S et al (2021) A self-adaptive differential evolution algorithm for scheduling a single batch-processing machine with arbitrary job sizes and release times. IEEE Trans Cybern 51(3):1430–1442
Funding
This research has no funding source.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interest about the research.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Abdel-Basset, M., El-Shahat, D., Jameel, M. et al. Exponential distribution optimizer (EDO): a novel math-inspired algorithm for global optimization and engineering problems. Artif Intell Rev 56, 9329–9400 (2023). https://doi.org/10.1007/s10462-023-10403-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-023-10403-9