Skip to main content
SpringerLink
Log in

Machine learning enhancing metaheuristics: a systematic review

  • Optimization
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

During the optimization process, a large number of data are generated through the search. Machine learning techniques and algorithms can be used to handle the generated data to contribute to the optimization process. The use of machine learning enhancing metaheuristics applied to optimization problems has been drawing attention due to their capacity to add domain knowledge during the search process. This knowledge can accelerate metaheuristics and lead to better and promising solutions. This work provides a systematic literature review of machine learning enhancing metaheuristics and summarizes the current state of the classification of the research field, main techniques and machine learning models, validations strategies, and real-world optimization problems that the approach was applied. Our keyword search found 1.960 papers, published in the last 10 years. After considering the inclusion and exclusion criteria and performing backward snowballing procedure, we have analyzed 111 primary studies. The results show the predominance of the use of surrogate-assisted evolutionary algorithms (SAEAs) for improving the efficiency of the optimization, and the use of estimation of distribution algorithms (EDAs) to increase the effectiveness of the optimization. The objective function value is the mostly applied evaluating criteria to validate the algorithm with other methods. The developed techniques of the studies found are applied in diverse real-world applications such as developing machine learning models, physics simulations with expensive function evaluation, and the variants of the classical job shop scheduling problem. We also discuss trends and opportunities of the research field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

All data generated or analyzed during this study are included in this published article. Any queries regarding these data may be directed to the corresponding author.

References

  • Abd Elaziz M, Oliva D, Xiong S (2017) An improved opposition-based sine cosine algorithm for global optimization. Expert Syst Appl 90:484–500

    Google Scholar 

  • Abdessalem RB, Nejati S, Briand LC, Stifter T (2018) Testing vision-based control systems using learnable evolutionary algorithms. In: 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE), IEEE, pp 1016–1026

  • Akinsolu MO, Liu B, Grout V, Lazaridis PI, Mognaschi ME, Barba PD (2019) A parallel surrogate model assisted evolutionary algorithm for electromagnetic design optimization. IEEE Trans Emerg Topics Comput Intell 3(2):93–105. https://doi.org/10.1109/TETCI.2018.2864747

    Article  Google Scholar 

  • Al-Duoli F, Rabadi G, Seck M, Handley HA (2018) Hybridizing meta-raps with machine learning algorithms. In: 2018 IEEE technology and engineering management conference (TEMSCON), IEEE, pp 1–6

  • Al-Juboori M, Datta B (2019) Optimum design of hydraulic water retaining structures incorporating uncertainty in estimating heterogeneous hydraulic conductivity utilizing stochastic ensemble surrogate models within a multi-objective multi-realisation optimisation model. J Comput Design Eng 6(3):296–315

    Google Scholar 

  • Ali M, Siarry P, Pant M (2012) An efficient differential evolution based algorithm for solving multi-objective optimization problems. Eur J Oper Res 217(2):404–416. https://doi.org/10.1016/j.ejor.2011.09.025

    Article  MathSciNet  MATH  Google Scholar 

  • Anderson JR (1990) Machine learning: an artificial intelligence approach, vol 3. Morgan Kaufmann, Burlington

    Google Scholar 

  • Arias-Montaño A, Coello Coello CA, Mezura-Montes E (2012) Multi-objective airfoil shape optimization using a multiple-surrogate approach. In: 2012 IEEE Congress on Evolutionary Computation, pp 1–8, https://doi.org/10.1109/CEC.2012.6256491

  • Azzouz N, Bechikh S, Ben Said L (2014) Steady state ibea assisted by mlp neural networks for expensive multi-objective optimization problems. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, pp 581–588

  • Bacigalupo A, Gnecco G, Lepidi M, Gambarotta L (2021) Computational design of innovative mechanical metafilters via adaptive surrogate-based optimization. Comput Methods Appl Mech Eng 375:113623

    MathSciNet  MATH  Google Scholar 

  • Baluja S, Caruana R (1995) Removing the genetics from the standard genetic algorithm. In: Machine learning Proceedings, Elsevier, pp 38–46

  • Bengio Y, Lodi A, Prouvost A (2020) Machine learning for combinatorial optimization: a methodological tour d’horizon. Eur J Operat Res 290(2):405–421

    MathSciNet  MATH  Google Scholar 

  • Ben Kacem A, Kamach O, Chafik S, Hammou MA (2020) A hybrid algorithm to size the hospital resources in the case of a massive influx of victims. Int J Electr Comput Eng 2088–8708:10

    Google Scholar 

  • Bliek L, Verwer S, de Weerdt M (2020) Black-box combinatorial optimization using models with integer-valued minima. Ann Math Artif Intell 89:639–653

    MathSciNet  MATH  Google Scholar 

  • Boussaïd I, Lepagnot J, Siarry P (2013) A survey on optimization metaheuristics. Inf Sci 237:82–117

    MathSciNet  MATH  Google Scholar 

  • Browne MW (2000) Cross-validation methods. J Math Psychol 44(1):108–132

    Google Scholar 

  • Calvet L, de Armas J, Masip D, Juan AA (2017) Learnheuristics: hybridizing metaheuristics with machine learning for optimization with dynamic inputs. Open Math 15(1):261–280

    MathSciNet  MATH  Google Scholar 

  • Cao Y, Wu Q, Wang H, Hong W (2019) Design of broadband reflectarray antenna using machine-learning-assisted optimization method. In: 2019 International Symposium on Antennas and Propagation (ISAP), IEEE, pp 1–3

  • Chambers JB, Barnes JW (1996) Flexible job shop scheduling by tabu search. The University of Texas, Austin, TX, Technical Report Series ORP96-09, Graduate program in operations research and industrial engineering

  • Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using gaussian process-based inverse modeling. IEEE Trans Evol Comput 19(6):838–856. https://doi.org/10.1109/TEVC.2015.2395073

    Article  Google Scholar 

  • Chia JY, Goh CK, Shim VA, Tan KC (2012) A data mining approach to evolutionary optimisation of noisy multi-objective problems. Int J Syst Sci 43(7):1217–1247

    MATH  Google Scholar 

  • Coello CAC, Lamont GB, Van Veldhuizen DA et al (2007) Evolutionary algorithms for solving multi-objective problems, vol 5. Springer, Berlin

    MATH  Google Scholar 

  • Coello CAC, Brambila SG, Gamboa JF, Tapia MGC, Gómez RH (2020) Evolutionary multiobjective optimization: open research areas and some challenges lying ahead. Compl Intell Syst 6(2):221–236

    Google Scholar 

  • Cui H, Turan O, Sayer P (2012) Learning-based ship design optimization approach. Comput Aided Des 44(3):186–195

    Google Scholar 

  • Dai Z, Wang L, Yang S (2020) Data mining-based model simplification and optimization of an electrical power generation system. IEEE Trans Transport Electr 6(4):1665–1678

    Google Scholar 

  • Dauzère-Pérès S, Paulli J (1997) An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search. Ann Oper Res 70:281–306

    MathSciNet  MATH  Google Scholar 

  • Deb K, Thiele L, Laumanns M, Zitzler E (2002) Scalable multi-objective optimization test problems. In: Proceedings of the 2002 congress on evolutionary computation. CEC’02 (Cat. No. 02TH8600), IEEE, vol 1, pp 825–830

  • Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Google Scholar 

  • Dey A (2016) Machine learning algorithms: a review. Int J Comput Sci Inform Technol 7(3):1174–1179

    Google Scholar 

  • Dey A, Sharma KD, Sanyal T, Bhattacharjee Jr P, Bhattacharjee P (2019) Population based study on arsenic induced blood samples employing hybrid metaheuristic optimization based ml approach. In: 2019 IEEE Region 10 Symposium (TENSYMP), IEEE, pp 599–604

  • Du J, Rada R (2012) Knowledge-guided genetic algorithm for financial forecasting. In: 2012 IEEE Conference on computational intelligence for financial engineering & economics (CIFEr), IEEE, pp 1–8

  • El-Beltagy M, Keane A (1999) A comparison of various optimization algorithms on a multilevel problem. Eng Appl Artif Intell 12(5):639–654. https://doi.org/10.1016/S0952-1976(99)00033-0

    Article  Google Scholar 

  • Fan Z, Hu K, Li F, Rong Y, Li W, Lin H (2016) Multi-objective evolutionary algorithms embedded with machine learning-a survey. In: 2016 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 1262–1266

  • Farfán JF, Cea L (2021) Coupling artificial neural networks with the artificial bee colony algorithm for global calibration of hydrological models. Neural Comput Appl 33:8479–8494

    Google Scholar 

  • Fleming PJ, Purshouse RC, Lygoe RJ (2005) Many-objective optimization: An engineering design perspective. In: International conference on evolutionary multi-criterion optimization, Springer, pp 14–32

  • Gao Y, Yang T, Bozhko S, Wheeler P, Dragičević T (2020) Filter design and optimization of electromechanical actuation systems using search and surrogate algorithms for more-electric aircraft applications. IEEE Trans Transport Electrif 6(4):1434–1447

    Google Scholar 

  • García J, Moraga P, Valenzuela M, Crawford B, Soto R, Pinto H, Peña A, Altimiras F, Astorga G (2019) A db-scan binarization algorithm applied to matrix covering problems. Comput Intell Neurosci. https://doi.org/10.1155/2019/3238574

    Article  Google Scholar 

  • García-Ortega RH, García-Sánchez P, Merelo-Guervós JJ (2020) Startroper, a film trope rating optimizer using machine learning and evolutionary algorithms. Expert Syst 37(6):e12525

    Google Scholar 

  • Gardner MW, Dorling S (1998) Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ 32(14–15):2627–2636

    Google Scholar 

  • Garrison WT, Petty MD (2019) A comparison of simulation optimization algorithm performance. In: 2019 SoutheastCon, IEEE, pp 1–7

  • Gatopoulos I, Lepert R, Wiggers A, Mariani G, Tomczak J (2020) Evolutionary algorithm with non-parametric surrogate model for tensor program optimization. In: 2020 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 1–8

  • Ghorbel H, Zannini N, Cherif S, Sauser F, Grunenwald D, Droz W, Baradji M, Lakehal D (2019) Smart adaptive run parameterization (sarp): enhancement of user manual selection of running parameters in fluid dynamic simulations using bio-inspired and machine-learning techniques. Soft Comput 23(22):12031–12047

    Google Scholar 

  • Giagkiozis I, Fleming PJ (2012) Increasing the density of available pareto optimal solutions. Automatic Control and Systems Engineering, University of Sheffield, Sheffield

  • Gonzalez SR, Jalali H, Van Nieuwenhuyse I (2020) A multiobjective stochastic simulation optimization algorithm. Eur J Oper Res 284(1):212–226

    MathSciNet  MATH  Google Scholar 

  • Guo P, Cheng W, Wang Y (2017) Hybrid evolutionary algorithm with extreme machine learning fitness function evaluation for two-stage capacitated facility location problems. Expert Syst Appl 71:57–68

    Google Scholar 

  • Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195

    Google Scholar 

  • Harada T, Kaidan M, Thawonmas R (2020) Comparison of synchronous and asynchronous parallelization of extreme surrogate-assisted multi-objective evolutionary algorithm. Natural Comput. https://doi.org/10.1007/s11047-020-09806-2

    Article  Google Scholar 

  • Hildebrandt T, Branke J (2015) On using surrogates with genetic programming. Evol Comput 23(3):343–367

    Google Scholar 

  • Ho SL, Zhu L, Yang S, Huang J (2015) A real coded population-based incremental learning for inverse problems in continuous space. IEEE Trans Magn 51(3):1–4

    Google Scholar 

  • Hosseinzadeh M, Tho QT, Ali S, Rahmani AM, Souri A, Norouzi M, Huynh B (2020) A hybrid service selection and composition model for cloud-edge computing in the internet of things. IEEE Access 8:85939–85949

    Google Scholar 

  • Huband S, Barone L, While L, Hingston P (2005) A scalable multi-objective test problem toolkit. In: International conference on evolutionary multi-criterion optimization, Springer, pp 280–295

  • Iman RL, Davenport JM, Zeigler DK (1980) Latin hypercube sampling (program user’s guide). Department of Energy, Sandia Laboratories

    Google Scholar 

  • Ishibuchi H, Masuda H, Tanigaki Y, Nojima Y (2015) Modified distance calculation in generational distance and inverted generational distance. In: International conference on evolutionary multi-criterion optimization, Springer, pp 110–125

  • Jamil M, Yang XS (2013) A literature survey of benchmark functions for global optimisation problems. Int J Math Modell Numer Optim 4(2):150–194

    MATH  Google Scholar 

  • Jennings PC, Lysgaard S, Hummelshøj JS, Vegge T, Bligaard T (2019) Genetic algorithms for computational materials discovery accelerated by machine learning. NPJ Comput Mater 5(1):1–6

    Google Scholar 

  • Jiang Q, Wang L, Cheng J, Zhu X, Li W, Lin Y, Yu G, Hei X, Zhao J, Lu X (2017) Multi-objective differential evolution with dynamic covariance matrix learning for multi-objective optimization problems with variable linkages. Knowl-Based Syst 121:111–128

    Google Scholar 

  • Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12

    Google Scholar 

  • Jin Y (2011) Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm Evol Comput 1(2):61–70

    Google Scholar 

  • Jørgensen MS, Groves MN, Hammer B (2017) Combining evolutionary algorithms with clustering toward rational global structure optimization at the atomic scale. J Chem Theory Comput 13(3):1486–1493

    Google Scholar 

  • Jourdan L, Dhaenens C, Talbi EG (2006) Using datamining techniques to help metaheuristics: a short survey. In: International Workshop on Hybrid Metaheuristics, Springer, pp 57–69

  • Kitchenham B (2004) Procedures for performing systematic reviews. Keele University, Keele 33:1–26

    Google Scholar 

  • Kitchenham B, Brereton OP, Budgen D, Turner M, Bailey J, Linkman S (2009) Systematic literature reviews in software engineering-a systematic literature review. Inf Softw Technol 51(1):7–15

    Google Scholar 

  • Kohira T, Kemmotsu H, Oyama A, Tatsukawa T (2017) Proposal of simultaneous design optimization benchmark problem of multiple car structures using response surface method. Trans Jpn Soci Evolut Comput 8(1):11–21

    Google Scholar 

  • Kotinis M (2014) Improving a multi-objective differential evolution optimizer using fuzzy adaptation and k-medoids clustering. Soft Comput 18(4):757–771

    Google Scholar 

  • Koziel S, Leifsson L, Yang XS (2014) Solving computationally expensive engineering problems: methods and applications, vol 97. Springer, Berlin

    Google Scholar 

  • Kurek M, Becker T, Luk W (2013) Parametric optimization of reconfigurable designs using machine learning. In: International symposium on applied reconfigurable computing, Springer, pp 134–145

  • Larrañaga P, Lozano JA (2001) Estimation of distribution algorithms: a new tool for evolutionary computation, vol 2. Springer, Berlin

    MATH  Google Scholar 

  • Le HL, Landa-Silva D, Galar M, Garcia S, Triguero I (2020) A hybrid surrogate model for evolutionary undersampling in imbalanced classification. In: 2020 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Le HL, Landa-Silva D, Galar M, Garcia S, Triguero I (2021) Eusc: a clustering-based surrogate model to accelerate evolutionary undersampling in imbalanced classification. Appl Soft Comput 101:107033. https://doi.org/10.1016/j.asoc.2020.107033

    Article  Google Scholar 

  • Li B, Li J, Tang K, Yao X (2015) Many-objective evolutionary algorithms: a survey. ACM Comput Surv (CSUR) 48(1):1–35

    MathSciNet  Google Scholar 

  • Li K, Xiang Z, Tan KC (2019a) Which surrogate works for empirical performance modelling? a case study with differential evolution. In: 2019 IEEE congress on evolutionary computation (CEC), IEEE, pp 1988–1995

  • Li L, Liang Y, Li T, Wu C, Zhao G, Han X (2019) Boost particle swarm optimization with fitness estimation. Nat Comput 18(2):229–247

    MathSciNet  Google Scholar 

  • Li X, Han X, Chen Z, Ming W, Cao Y, Ma J (2020) A multi-constraint failure-pursuing sampling method for reliability-based design optimization using adaptive kriging. Eng Comput. https://doi.org/10.1007/s00366-020-01135-3

    Article  Google Scholar 

  • Li Y, Zhang Q, Wu Y, Wang S (2019) A sequential kriging method assisted by trust region strategy for proxy cache size optimization of the streaming media video data due to fragment popularity distribution. Multim Tools Appl 78(20):28737–28756

    Google Scholar 

  • Li Z, Qian B, Hu R, Chang L, Yang J (2019) An elitist nondominated sorting hybrid algorithm for multi-objective flexible job-shop scheduling problem with sequence-dependent setups. Knowl-Based Syst 173:83–112

    Google Scholar 

  • Lindmark DM, Servin M (2018) Computational exploration of robotic rock loading. Robot Auton Syst 106:117–129

    Google Scholar 

  • Liu B, Zhao D, Reynaert P, Gielen GG (2011) Synthesis of integrated passive components for high-frequency RF ics based on evolutionary computation and machine learning techniques. IEEE Trans Comput Aided Des Integr Circuits Syst 30(10):1458–1468

    Google Scholar 

  • Liu B, Deferm N, Zhao D, Reynaert P, Gielen GG (2012) An efficient high-frequency linear rf amplifier synthesis method based on evolutionary computation and machine learning techniques. IEEE Trans Comput Aided Des Integr Circuits Syst 31(7):981–993

    Google Scholar 

  • Liu B, Aliakbarian H, Ma Z, Vandenbosch GAE, Gielen G, Excell P (2014) An efficient method for antenna design optimization based on evolutionary computation and machine learning techniques. IEEE Trans Antennas Propag 62(1):7–18. https://doi.org/10.1109/TAP.2013.2283605

    Article  Google Scholar 

  • Liu B, Koziel S, Zhang Q (2016) A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems. J Comput Sci 12:28–37

    MathSciNet  Google Scholar 

  • Lu J, Li B, Jin Y (2013) An evolution strategy assisted by an ensemble of local gaussian process models. In: Proceedings of the 15th annual conference on Genetic and evolutionary computation, pp 447–454

  • Luke S (2013) Essentials of Metaheuristics, 2nd edn. Lulu, available for free at http://cs.gmu.edu/sean/book/metaheuristics/

  • Ma X, Liu F, Qi Y, Li L, Jiao L, Liu M, Wu J (2014) Moea/d with baldwinian learning inspired by the regularity property of continuous multiobjective problem. Neurocomputing 145:336–352

    Google Scholar 

  • Maheswaranathan N, Metz L, Tucker G, Choi D, Sohl-Dickstein J (2019) Guided evolutionary strategies: augmenting random search with surrogate gradients. In: International Conference on Machine Learning, PMLR, pp 4264–4273

  • Martinez-Cantin R (2018) Funneled bayesian optimization for design, tuning and control of autonomous systems. IEEE Trans Cybernet 49(4):1489–1500

    Google Scholar 

  • Mendes-Moreira J, Soares C, Jorge AM, Sousa JFD (2012) Ensemble approaches for regression: a survey. ACM Comput Surv (csur) 45(1):1–40

    MATH  Google Scholar 

  • Michalak K (2018) Informed mutation operator using machine learning for optimization in epidemics prevention. In: Proceedings of the genetic and evolutionary computation conference, pp 1294–1301

  • Michalak K (2019) Surrogate-based optimization for reduction of contagion susceptibility in financial systems. In: Proceedings of the genetic and evolutionary computation conference, pp 1266–1274

  • Minella G, Ruiz R, Ciavotta M (2008) A review and evaluation of multiobjective algorithms for the flowshop scheduling problem. INFORMS J Comput 20(3):451–471

    MathSciNet  MATH  Google Scholar 

  • Mlakar M, Petelin D, Tušar T, Filipič B (2015) Gp-demo: differential evolution for multiobjective optimization based on gaussian process models. Eur J Oper Res 243(2):347–361

    MathSciNet  MATH  Google Scholar 

  • Molga M, Smutnicki C (2005) Test functions for optimization needs, Vol 101, p 48

  • Nguyen DD, Nguyen L (2021) An adaptive control for surrogate assisted multi-objective evolutionary algorithms. In: ICT Systems and Sustainability, Springer, pp 123–132

  • Nouri HE, Driss OB, Ghédira K (2018) Solving the flexible job shop problem by hybrid metaheuristics-based multiagent model. J Ind Eng Int 14(1):1–14

    Google Scholar 

  • Ohtsuka H, Kaidan M, Harada T, Thawonmas R (2018) Evolutionary algorithm using surrogate assisted model for simultaneous design optimization benchmark problem of multiple car structures. In: Proceedings of the genetic and evolutionary computation conference companion, pp 55–56

  • Pantula PD, Mitra K (2019) An evolutionary machine learning approach towards less conservative robust optimization. In: 2019 IEEE Congress on evolutionary computation (CEC), IEEE, pp 2990–2997

  • Park D (2019) Research of cyclone optimization based on CFD, gmdh-type neural network and genetic algorithm. In: Proceedings of the 2019 3rd International conference on virtual and augmented reality simulations, pp 90–96

  • Parque V, Miyashita T (2017) A method to learn high-performing and novel product layouts and its application to vehicle design. Neurocomputing 248:41–56

    Google Scholar 

  • Pelikan M, Goldberg DE, Lobo FG (2002) A survey of optimization by building and using probabilistic models. Comput Optim Appl 21(1):5–20

    MathSciNet  MATH  Google Scholar 

  • Peng C, Li Y, Cao L, Jiao L (2019) A surrogate model assisted quantum-inspired evolutionary algorithm for hyperparameter optimization in machine learning. In: 2019 IEEE Congress on evolutionary computation (CEC), IEEE, pp 1060–1067

  • Pennisi M, Russo G, Pappalardo F (2018) Combining parallel genetic algorithms and machine learning to improve the research of optimal vaccination protocols. 2018 26th Euromicro International conference on parallel. Distributed and network-based processing (PDP), IEEE, pp 399–405

    Google Scholar 

  • Plastino A, Barbalho H, Santos LFM, Fuchshuber R, Martins SL (2014) Adaptive and multi-mining versions of the DM-grasp hybrid metaheuristic. J Heurist 20(1):39–74

    Google Scholar 

  • Probst DM, Raju M, Senecal PK, Kodavasal J, Pal P, Som S, Moiz AA, Pei Y (2019) Evaluating optimization strategies for engine simulations using machine learning emulators. J Eng Gas Turb Power 141(9):091011

    Google Scholar 

  • Provost F, Kohavi R (1998) Glossary of terms. J Mach Learn 30(2–3):271–274

  • Pyle J, Chimeh MK, Richmond P (2019) Surrogate modelling for efficient discovery of emergent population dynamics. In: 2019 International Conference on high performance computing & simulation (HPCS), IEEE, pp 99–106

  • Qi Y, Liu F, Liu M, Gong M, Jiao L (2012) Multi-objective immune algorithm with baldwinian learning. Appl Soft Comput 12(8):2654–2674

    Google Scholar 

  • Rana S, Li C, Gupta S, Nguyen V, Venkatesh S (2017) High dimensional bayesian optimization with elastic gaussian process. In: International conference on machine learning, PMLR, pp 2883–2891

  • Remli MA, Deris S, Mohamad MS, Omatu S, Corchado JM (2017) An enhanced scatter search with combined opposition-based learning for parameter estimation in large-scale kinetic models of biochemical systems. Eng Appl Artif Intell 62:164–180

    Google Scholar 

  • Saikia P, Rakshit D et al (2020) Designing a clean and efficient air conditioner with AI intervention to optimize energy-exergy interplay. Energy AI 2:100029

    Google Scholar 

  • Santana R, Bonnet L, Legény J, Lécuyer A (2012) Introducing the use of model-based evolutionary algorithms for eeg-based motor imagery classification. In: Proceedings of the 14th annual conference on genetic and evolutionary computation, pp 1159–1166

  • Santos M, de Oliveira JA, Britto A (2019) Decision variable learning. In: 2019 8th Brazilian conference on intelligent systems (BRACIS), IEEE, pp 497–502

  • Schutze O, Lara A, Coello CAC (2010) On the influence of the number of objectives on the hardness of a multiobjective optimization problem. IEEE Trans Evol Comput 15(4):444–455

    Google Scholar 

  • Shahane S, Aluru N, Ferreira P, Kapoor SG, Vanka SP (2020) Optimization of solidification in die casting using numerical simulations and machine learning. J Manuf Process 51:130–141

    Google Scholar 

  • She D, Pei K, Epstein D, Yang J, Ray B, Jana S (2019) Neuzz: Efficient fuzzing with neural program smoothing. In: 2019 IEEE symposium on security and privacy (SP), IEEE, pp 803–817

  • Shi L, Rasheed K (2010) A survey of fitness approximation methods applied in evolutionary algorithms. In: Computational intelligence in expensive optimization problems, Springer, pp 3–28

  • Shim VA, Tan KC, Cheong CY, Chia JY (2013) Enhancing the scalability of multi-objective optimization via restricted boltzmann machine-based estimation of distribution algorithm. Inf Sci 248:191–213. https://doi.org/10.1016/j.ins.2013.06.037

    Article  MathSciNet  MATH  Google Scholar 

  • Simons CL, Smith J, White P (2014) Interactive ant colony optimization (iaco) for early lifecycle software design. Swarm Intell 8(2):139–157

    Google Scholar 

  • Song J, Yang Y, Wu J, Wu J, Sun X, Lin J (2018) Adaptive surrogate model based multiobjective optimization for coastal aquifer management. J Hydrol 561:98–111

    Google Scholar 

  • Song K, Zhang Y, Zhuang X, Yu X, Song B (2019) Reliability-based design optimization using adaptive surrogate model and importance sampling-based modified sora method. Eng Comput 37:1295–1314

    Google Scholar 

  • Stander L, Woolway M, van Zyl T (2020) Extended surrogate assisted continuous process optimisation. In: 2020 7th International Conference on soft computing & machine intelligence (ISCMI), IEEE, pp 275–279

  • Stoean R (2020) Analysis on the potential of an EA-surrogate modelling tandem for deep learning parametrization: an example for cancer classification from medical images. Neural Comput Appl 32(2):313–322

    Google Scholar 

  • Suganthan P, Hansen N, Liang J, Deb K, Chen Yp, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Natural Computing, pp 341-357

  • Sun J, Zhang H, Zhou A, Zhang Q, Zhang K, Tu Z, Ye K (2018) Learning from a stream of nonstationary and dependent data in multiobjective evolutionary optimization. IEEE Trans Evol Comput 23(4):541–555

    Google Scholar 

  • Sun X, Gong D, Jin Y, Chen S (2013) A new surrogate-assisted interactive genetic algorithm with weighted semisupervised learning. IEEE Trans Cybernet 43(2):685–698

    Google Scholar 

  • Taillard E (1993) Benchmarks for basic scheduling problems. Eur J Operat Research 64(2):278–285

    MathSciNet  MATH  Google Scholar 

  • Talbi EG (2016) Combining metaheuristics with mathematical programming, constraint programming and machine learning. Ann Oper Res 240(1):171–215

    MathSciNet  MATH  Google Scholar 

  • Tang Q, Li Y, Deng Z, Chen D, Guo R, Huang H (2020) Optimal shape design of an autonomous underwater vehicle based on multi-objective particle swarm optimization. Nat Comput 19(4):733–742

    MathSciNet  Google Scholar 

  • Tenne Y (2012) A computational intelligence algorithm for expensive engineering optimization problems. Eng Appl Artif Intell 25(5):1009–1021. https://doi.org/10.1016/j.engappai.2012.03.009

    Article  Google Scholar 

  • Tenne Y (2012) A computational intelligence algorithm for simulation-driven optimization problems. Adv Eng Softw 47(1):62–71

    Google Scholar 

  • Thierens D, Bosman PA (2011) Optimal mixing evolutionary algorithms. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, Association for Computing Machinery, New York, NY, USA, GECCO ’11, p 617-624, https://doi.org/10.1145/2001576.2001661,

  • Tian J, Sun C, Tan Y, Zeng J (2020) Granularity-based surrogate-assisted particle swarm optimization for high-dimensional expensive optimization. Knowl-Based Syst 187:104815

    Google Scholar 

  • Tian K, Li Z, Huang L, Du K, Jiang L, Wang B (2020) Enhanced variable-fidelity surrogate-based optimization framework by gaussian process regression and fuzzy clustering. Comput Methods Appl Mech Eng 366:113045

    MathSciNet  MATH  Google Scholar 

  • Tian L, Mehari MT, Santi S, Latré S, De Poorter E, Famaey J (2019) Multi-objective surrogate modeling for real-time energy-efficient station grouping in ieee 802.11 ah. Pervasive Mob Comput 57:33–48

    Google Scholar 

  • Tinós R (2019) An rbf network based crossover for pseudo-boolean optimization. In: 2019 8th Brazilian Conference on Intelligent Systems (BRACIS), IEEE, pp 174–179

  • Tizhoosh HR (2005) Opposition-based learning: a new scheme for machine intelligence. In: International conference on computational intelligence for modelling, control and automation and international conference on intelligent agents, web technologies and internet commerce (CIMCA-IAWTIC’06), IEEE, vol 1, pp 695–701

  • Toscano G, Deb K (2016) Study of the approximation of the fitness landscape and the ranking process of scalarizing functions for many-objective problems. In: 2016 IEEE congress on evolutionary computation (CEC), IEEE, pp 4358–4365

  • Vijayachandran AA, Davidson P, Waas AM (2020) Optimal fiber paths for robotically manufactured composite structural panels. Int J Non-Linear Mech 126:103567

    Google Scholar 

  • Virgolin M, Alderliesten T, Witteveen C, Bosman PAN (2017) Scalable genetic programming by gene-pool optimal mixing and input-space entropy-based building-block learning. In: Proceedings of the Genetic and Evolutionary Computation Conference, Association for Computing Machinery, New York, NY, USA, GECCO ’17, p 1041-1048, https://doi.org/10.1145/3071178.3071287

  • Virgolin M, Alderliesten T, Bel A, Witteveen C, Bosman PA (2018) Symbolic regression and feature construction with gp-gomea applied to radiotherapy dose reconstruction of childhood cancer survivors. In: Proceedings of the Genetic and evolutionary computation conference, pp 1395–1402

  • Volz V (2020) Uncertainty handling in surrogate assisted optimisation of games. KI-Künstliche Intelligenz 34(1):95–99

    MathSciNet  Google Scholar 

  • Wang H, Wu Z, Rahnamayan S (2011) Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems. Soft Comput 15(11):2127–2140

    Google Scholar 

  • Wang H, Jin Y, Sun C, Doherty J (2018) Offline data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans Evol Comput 23(2):203–216

    Google Scholar 

  • Wang L, Wang S, Xu Y, Zhou G, Liu M (2012) A bi-population based estimation of distribution algorithm for the flexible job-shop scheduling problem. Comput Ind Eng 62(4):917–926

    Google Scholar 

  • Wang S, Yin Y (2018) Polygene-based evolutionary algorithms with frequent pattern mining. Front Comp Sci 12(5):950–965

    Google Scholar 

  • Wang SC (2003) Artificial neural network. In: Interdisciplinary computing in java programming, Springer, pp 81–100

  • Wang X, Tang L (2016) An adaptive multi-population differential evolution algorithm for continuous multi-objective optimization. Inf Sci 348:124–141. https://doi.org/10.1016/j.ins.2016.01.068

    Article  Google Scholar 

  • Wang X, Tang L (2017) A machine-learning based memetic algorithm for the multi-objective permutation flowshop scheduling problem. Comput Operat Res 79:60–77

    MathSciNet  MATH  Google Scholar 

  • Watkins CJ, Dayan P (1992) Q-learning. Machine learning 8(3–4):279–292

    Google Scholar 

  • Weng J, Lindvall R, Zhuang K, Ståhl JE, Ding H, Zhou J (2020) A machine learning based approach for determining the stress-strain relation of grey cast iron from nanoindentation. Mech Mater 148:103522

    Google Scholar 

  • While L, Hingston P, Barone L, Huband S (2006) A faster algorithm for calculating hypervolume. IEEE Trans Evol Comput 10(1):29–38

    Google Scholar 

  • Wohlin C (2014) Guidelines for snowballing in systematic literature studies and a replication in software engineering. In: Proceedings of the 18th international conference on evaluation and assessment in software engineering, pp 1–10

  • Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2012) Experimentation in software engineering. Springer, Berlin

    MATH  Google Scholar 

  • Wu Q, Wang H, Hong W (2020) Multistage collaborative machine learning and its application to antenna modeling and optimization. IEEE Trans Antennas Propag 68(5):3397–3409

    Google Scholar 

  • Xie W, Chen W, Shen L, Duan J, Yang M (2021) Surrogate network-based sparseness hyper-parameter optimization for deep expression recognition. Patt Recogn 111:107701

    Google Scholar 

  • Yin J, Tsai FTC (2020) Bayesian set pair analysis and machine learning based ensemble surrogates for optimal multi-aquifer system remediation design. J Hydrol 580:124280

    Google Scholar 

  • Zangari M, Pozo A, Santana R, Mendiburu A (2017) A decomposition-based binary ACO algorithm for the multiobjective ubqp. Neurocomputing 246:58–68

    Google Scholar 

  • Zangari M, Santana R, Mendiburu A, Pozo ATR (2017) Not all pbils are the same: unveiling the different learning mechanisms of pbil variants. Appl Soft Comput 53:88–96

    Google Scholar 

  • Zhang B, Shafi K, Abbass H (2014) Online knowledge-based evolutionary multi-objective optimization. In: 2014 IEEE Congress on evolutionary computation (CEC), pp 2222–2229, https://doi.org/10.1109/CEC.2014.6900610

  • Zhang B, Shafi K, Abbass HA (2016) Hybrid knowledge-based evolutionary many-objective optimization. In: 2016 IEEE Congress on evolutionary computation (CEC), IEEE, pp 1007–1014

  • Zhang J, Zhan Zh, Lin Y, Chen N, Gong Yj, Zhong Jh, Chung HS, Li Y, Shi Yh (2011) Evolutionary computation meets machine learning: A survey. IEEE Comput Intell Mag 6(4):68–75

    Google Scholar 

  • Zhang Q, Zhou A, Zhao S, Suganthan PN, Liu W, Tiwari S (2008) Multiobjective optimization test instances for the CEC 2009 special session and competition. Colchester

  • Zhou Y, Jin Y, Ding J (2020) Surrogate-assisted evolutionary search of spiking neural architectures in liquid state machines. Neurocomputing 406:12–23

    Google Scholar 

  • Zimmerman DW (1997) Teacher’s corner: a note on interpretation of the paired-samples t test. J Educat Behav Stat 22(3):349–360

    Google Scholar 

  • Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evol Comput 8(2):173–195

  • Zuluaga M, Krause A, Püschel M (2016) e-pal: An active learning approach to the multi-objective optimization problem. J Machine Learn Res, 17(104):1–32, http://jmlr.org/papers/v17/15-047.html

Download references

Funding

This work was funded by CAPES, Brazil - Finance Code 001.

Author information

Authors and Affiliations

  1. Post-Graduation Program on Computer Science, Federal University of Sergipe, São Cristóvão, SE, Brazil

    Artur Leandro da Costa Oliveira

  2. Department of Computing, Federal University of Sergipe, São Cristóvão, SE, Brazil

    André Britto & Renê Gusmão

Authors
  1. Artur Leandro da Costa Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. André Britto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Renê Gusmão
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. The literature search and data analysis were performed by all authors. The first draft of the manuscript was written by ALCO and all authors commented and critically revised on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Artur Leandro da Costa Oliveira.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

Not applicable.

Informed consent

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

da Costa Oliveira, A.L., Britto, A. & Gusmão, R. Machine learning enhancing metaheuristics: a systematic review. Soft Comput 27, 15971–15998 (2023). https://doi.org/10.1007/s00500-023-08886-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-08886-3

Keywords

Search

Navigation