This paper presents a new global optimization algorithm named MGOSIC to solve unconstrained expensive black-box optimization problems. In MGOSIC, three surrogate models Kriging, Radial Basis Function (RBF), and Quadratic Response Surfaces (QRS) are dynamically constructed, respectively. Additionally, a multi-point infill criterion is proposed to obtain new points in each cycle, where a score-based strategy is presented to mark cheap points generated by Latin hypercube sampling. According to their predictive values from the three surrogate models, the promising cheap points are assigned with different scores. In order to obtain the samples with diversity, a Max-Min approach is proposed to select promising sample points from the cheap point sets with higher scores. Simultaneously, the best solutions predicted by Kriging, RBF, and QRS are also recorded as supplementary samples, respectively. Once MGOSIC gets stuck in a local valley, the estimated mean square error of Kriging will be maximized to explore the sparsely sampled regions. Moreover, the whole optimization algorithm is carried out alternately in the global space and a reduced space. In summary, MGOSIC not only brings a new idea for multi-point sampling, but also builds a reasonable balance between exploitation and exploration. Finally, 19 mathematical benchmark cases and an engineering application of hydrofoil optimization are used to test MGOSIC. Furthermore, seven existing global optimization algorithms are also tested as contrast. The final results show that MGOSIC has high efficiency, strong stability, and better multi-point sampling capability in dealing with expensive black-box optimization problems.
Kriging model Quadratic response surface Radial basis function Expensive black-box problems Multi-point infilling criterion
This is a preview of subscription content, log in to check access.
This project is supported by National Natural Science Foundation of China (Grant No. 51805436). The authors are also grateful to members of the research group for the implementation of some existing global optimization algorithms and benchmark test cases.
This project is supported by National Natural Science Foundation of China (Grant No. 51805436).
Cai X, Qiu H, Gao L et al (2017) A multi-point sampling method based on kriging for global optimization. Struct Multidiscip Optim 56(1):71–88MathSciNetCrossRefGoogle Scholar
Dong H, Song B, Wang P et al (2015a) Multi-fidelity information fusion based on prediction of kriging. Struct Multidiscip Optim 51(6):1267–1280CrossRefGoogle Scholar
Dong H, Song B, Wang P et al (2015b) A kind of balance between exploitation and exploration on kriging for global optimization of expensive functions. J Mech Sci Technol 29(5):2121–2133CrossRefGoogle Scholar
Dong H, Song B, Dong Z et al (2016) Multi-start space reduction (MSSR) surrogate-based global optimization method. Struct Multidiscip Optim 54(4):907–926CrossRefGoogle Scholar
Dong H, Song B, Wang P et al (2018) Surrogate-based optimization with clustering-based space exploration for expensive multimodal problems. Struct Multidiscip Optim 57(4):1553–1577CrossRefGoogle Scholar
Krige DG (1951) A statistical approach to some basic mine valuation problems on the Witwatersrand. J South Afr Inst Min Metall 52(6):119–139Google Scholar
Krityakierne T, Akhtar T, Shoemaker CA (2016) SOP: parallel surrogate global optimization with Pareto center selection for computationally expensive single objective problems. J Glob Optim 66(3):417–437MathSciNetCrossRefzbMATHGoogle Scholar
Lakshika E, Barlow M, Easton A (2017) Understanding the interplay of model complexity and fidelity in multiagent systems via an evolutionary framework. IEEE Trans Comput Intell AI in Games 9(3):277–289CrossRefGoogle Scholar
Li Z, Ruan S, Gu J et al (2016) Investigation on parallel algorithms in efficient global optimization based on multiple points infill criterion and domain decomposition. Struct Multidiscip Optim 54(4):747–773MathSciNetCrossRefGoogle Scholar
Long T, Wu D, Guo X et al (2015) Efficient adaptive response surface method using intelligent space exploration strategy. Struct Multidiscip Optim 51(6):1335–1362CrossRefGoogle Scholar
Masters DA, Taylor NJ, Rendall TCS et al (2017) Multilevel subdivision parameterization scheme for aerodynamic shape optimization. AIAA J 55:3288–3303CrossRefGoogle Scholar
Meng Z, Pan JS, Xu H (2016) QUasi-affine TRansformation evolutionary (QUATRE) algorithm: a cooperative swarm based algorithm for global optimization. Knowl-Based Syst 109:104–121CrossRefGoogle Scholar
Regis RG, Shoemaker CA (2013) A quasi-multistart framework for global optimization of expensive functions using response surface models. J Glob Optim 56(4):1719–1753MathSciNetCrossRefzbMATHGoogle Scholar
Rocca P, Oliveri G, Massa A (2011) Differential evolution as applied to electromagnetics. IEEE Antennas Propag Mag 53(1):38–49CrossRefGoogle Scholar
Sala R, Baldanzini N, Pierini M (2016) Representative surrogate problems as test functions for expensive simulators in multidisciplinary design optimization of vehicle structures. Struct Multidiscip Optim 54(3):449–468MathSciNetCrossRefGoogle Scholar
Singh P, Van Der Herten J, Deschrijver D et al (2017) A sequential sampling strategy for adaptive classification of computationally expensive data. Struct Multidiscip Optim 55(4):1425–1438MathSciNetCrossRefGoogle Scholar
Tyan M, Nguyen NV, Lee JW (2015) Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aerofoil design. Eng Optim 47(7):885–908CrossRefGoogle Scholar
Wang L, Shan S, Wang GG (2004) Mode-pursuing sampling method for global optimization on expensive black-box functions. Eng Optim 36(4):419–438CrossRefGoogle Scholar
Wang H, Fan T, Li G (2017a) Reanalysis-based space mapping method, an alternative optimization way for expensive simulation-based problems. Struct Multidiscip Optim 55(6):2143–2157CrossRefGoogle Scholar
Wang L, Pei J, Menhas MI et al (2017b) A hybrid-coded human learning optimization for mixed-variable optimization problems. Knowl-Based Syst 127:114–125CrossRefGoogle Scholar
Yang XS (2010) A new metaheuristic bat-inspired algorithm. Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp 65–74Google Scholar
Younis A, Dong Z (2010) Metamodelling and search using space exploration and unimodal region elimination for design optimization. Eng Optim 42(6):517–533CrossRefGoogle Scholar
Zhou G, Zhao W, Li Q et al (2017) Multi-objective robust design optimization of a novel NPR energy absorption structure for vehicles front ends to enhance pedestrian lower leg protection. Struct Multidiscip Optim 56(5):1215–1224CrossRefGoogle Scholar
Zhou Q, Wang Y, Choi SK et al (2017a) A sequential multi-fidelity metamodeling approach for data regression. Knowl-Based Syst 134:199–212CrossRefGoogle Scholar
Zhou Q, Jiang P, Shao X et al (2017b) A variable fidelity information fusion method based on radial basis function. Adv Eng Inform 32:26–39CrossRefGoogle Scholar