Abstract
In engineering practice, most optimization problems have multiple objectives, which are usually in a form of expensive black-box functions. The multiobjective efficient global optimization (MOEGO) algorithms have been proposed recently to sequentially sample the design space, aiming to seek for optima with a minimum number of sampling points. With the advance in computing resources, it is wise to make optimization parallelizable to shorten the total design cycle further. In this study, two different parallelized multiobjective efficient global optimization algorithms were proposed on the basis of the Kriging modeling technique. With use of the multiobjective expectation improvement, the proposed algorithm is able to balance local exploitation and global exploration. To implement parallel computing, the “Kriging Believer” and “multiple good local optima” strategies were adopted here to develop new sample infill criteria for multiobjective optimization problems. The proposed algorithms were applied to five mathematical benchmark examples first, which demonstrated faster convergence and better accuracy with more uniform distribution of Pareto points, in comparison with the two other conventional algorithms. The best performed “Kriging Believer” strategy approach was then applied to two more sophisticated real-life engineering case studies on the tailor-rolled blank (TRB) structures for crashworthiness design. After optimization, the TRB hat-shaped tube achieved a 3% increase in energy absorption and a 10.7% reduction in mass, and the TRB B-pillar attained a 10.1% reduction in mass and a 12.8% decrease in intrusion, simultaneously. These benchmark and engineering examples demonstrated that the proposed methods are fairly promising for being an effective tool for a range of design problems.
Similar content being viewed by others
References
Akhtar T, Shoemaker CA (2016) Multiobjective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection. J Glob Optim 64(1):17–32
Chankong V, Haimes YY (2008) Multiobjective decision making: theory and methodology. Courier Dover Publications
Chen G, Han X, Liu G, Jiang C, Zhao Z (2012) An efficient multi-objective optimization method for black-box functions using sequential approximate technique. Appl Soft Comput 12(1):14–27
Chevalier C, Ginsbourger D (2013, January) Fast computation of the multi-points expected improvement with applications in batch selection. In: International Conference on Learning and Intelligent Optimization. Springer, Berlin, Heidelberg, pp 59–69
Chokshi P, Dashwood R, Hughes DJ (2017) Artificial Neural Network (ANN) based microstructural prediction model for 22MnB5 boron steel during tailored hot stamping. Comput Struct 190:162–172
Coello CC, Lechuga MS (2002) MOPSO: a proposal for multiple objective particle swarm optimization. In: Proceedings of the 2002 Congress on Evolutionary Computation. CEC’02 (Cat. No. 02TH8600), vol 2. IEEE, pp 1051–1056
Coello CA, Pulido GT (2001) Multiobjective optimization using a micro-genetic algorithm. In: Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation. Morgan Kaufmann Publishers Inc, pp 274–282
Cressie NA (1993) In: NAC C (ed) Spatial prediction and kriging. Statistics for Spatial Data. John Wiley & Sons, New York, pp 105–209
Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197
Deb K, Mohan M, Mishra S (2003, April) Towards a quick computation of well-spread pareto-optimal solutions. In: International Conference on Evolutionary Multi-Criterion Optimization. Springer, Berlin, Heidelberg, pp 222–236
Dixon LCW, Szego GP (1978) The optimization problem: an introduction. Towards Global Optimization II. North Holland, New York
Doerner K, Gutjahr WJ, Hartl RF, Strauss C, Stummer C (2004) Pareto Ant colony optimization: a metaheuristic approach to multiobjective portfolio selection. Ann Oper Res 131(1-4):79–99
Duan L, Xiao NC, Li G, Xu F, Chen T, Cheng A (2017) Bending analysis and design optimisation of tailor-rolled blank thin-walled structures with top-hat sections. Int J Crashworthiness 22(3):227–242
Emmerich MTM, Giannakoglou KC, Naujoks B (2006) Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans Evol Comput 10(4):421–439
Fang H, Rais-Rohani M, Liu Z, Horstemeyer MF (2005) A comparative study of metamodeling methods for multiobjective crashworthiness optimization. Comput Struct 83(25-26):2121–2136
Fang J, Gao Y, Sun G, Qiu N, Li Q (2015a) On design of multi-cell tubes under axial and oblique impact loads. Thin-Walled Struct 95:115–126
Fang J, Gao Y, Sun G, Zheng G, Li Q (2015b) Dynamic crashing behavior of new extrudable multi-cell tubes with a functionally graded thickness. Int J Mech Sci 103:63–73
Fang J, Gao Y, Sun G, Xu C, Li Q (2016) Multiobjective sequential optimization for a vehicle door using hybrid materials tailor-welded structure. Proc Inst Mech Eng C J Mech Eng Sci 230(17):3092–3100
Fang J, Sun G, Qiu N, Kim NH, Li Q (2017) On design optimization for structural crashworthiness and its state of the art. Struct Multidiscip Optim 55(3):1091–1119
Farina M (2002) A neural network based generalized response surface multiobjective evolutionary algorithm. In: Proceedings of the 2002 Congress on Evolutionary Computation. CEC’02 (Cat. No. 02TH8600), vol 1. IEEE, pp 956–961
Fonseca, C. M., & Fleming, P. J. (1995). Multiobjective optimization and multiple constraint handling with evolutionary algorithms 1: a unified formulation
Forrester AIJ, Keane AJ (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79
Forrester A, Sobester A, Keane A (2008) Engineering design via surrogate modelling: a practical guide. John Wiley & Sons
Ginsbourger D, Riche RL, Carraro L (2008) A multi-points criterion for deterministic parallel global optimization based on Gaussian processes. J Glob Optim Revision
Gutmann HM (2001) A radial basis function method for global optimization. J Glob Optim 19(3):201–227
Haftka RT, Villanueva D, Chaudhuri A (2016) Parallel surrogate-assisted global optimization with expensive functions–a survey. Struct Multidiscip Optim 54(1):3–13
Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76(8):1905–1915
Hernández-Lobato JM, Hoffman MW, Ghahramani Z (2014) Predictive entropy search for efficient global optimization of black-box functions. In: Advances in neural information processing systems, pp 918–926
Hou S, Han X, Sun G, Long S, Li W, Yang X, Li Q (2011) Multiobjective optimization for tapered circular tubes. Thin-Walled Struct 49(7):855–863
Jeong S, Obayashi S (2005) Efficient global optimization (EGO) for multi-objective problem and data mining. In: 2005 IEEE congress on evolutionary computation, vol 3. IEEE, pp 2138–2145
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492
Karakasis MK, Giannakoglou KC (2006) On the use of metamodel-assisted, multi-objective evolutionary algorithms. Eng Optim 38(8):941–957
Keane AJ (2006) Statistical improvement criteria for use in multiobjective design optimization. AIAA J 44(4):879–891
Knowles J, Hughes EJ (2005) Multiobjective optimization on a budget of 250 evaluations. In: International Conference on Evolutionary Multi-criterion Optimization. Springer, Berlin, Heidelberg, pp 176–190
Luo C, Shimoyama K, Obayashi S (2014) Kriging model based many-objective optimization with efficient calculation of expected hypervolume improvement. In: 2014 IEEE Congress on Evolutionary Computation (CEC), pp. 1187-1194. Beijing, China
Martínez SZ, Coello CAC (2013) Combining surrogate models and local search for dealing with expensive multi-objective optimization problems. In: 2013 IEEE Congress on Evolutionary Computation, pp 2572–2579
McKay MD, Beckman RJ, Conover WJ (2000) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42(1):55–61
Pan F, Zhu P, Zhang Y (2010) Metamodel-based lightweight design of B-pillar with TWB structure via support vector regression. Comput Struct 88(1–2):36–44
Poloni, C. (1995). Hybrid GA for multi objective aerodynamic shape optimization.
Ponweiser W, Wagner T, Biermann D, Vincze M (2008) Multiobjective optimization on a limited budget of evaluations using model-assisted $\mathcal {S} $-metric selection. In: International Conference on Parallel Problem Solving from Nature. Springer, Berlin, Heidelberg, pp 784–794
Qiu N, Gao Y, Fang J, Feng Z, Sun G, Li Q (2015) Crashworthiness analysis and design of multi-cell hexagonal columns under multiple loading cases. Finite Elem Anal Des 104:89–101
Regis RG, Shoemaker CA (2005) Constrained global optimization of expensive black box functions using radial basis functions. J Glob Optim 31(1):153–171
Shimoyama K, Yoshimizu S, Jeong S, Obayashi S, Yokono Y (2011) Multi-objective design optimization for a steam turbine stator blade using LES and GA. J Comput Sci Technol 5(3):134–147
Sóbester A, Leary SJ, Keane AJ (2004) A parallel updating scheme for approximating and optimizing high fidelity computer simulations. Struct Multidiscip Optim 27(5):371–383
Sun G, Li G, Hou S, Zhou S, Li W, Li Q (2010) Crashworthiness design for functionally graded foam-filled thin-walled structures. Mater Sci Eng A 527(7–8):1911–1919
Sun G, Xu F, Li G, Li Q (2014) Crashing analysis and multiobjective optimization for thin-walled structures with functionally graded thickness. Int J Impact Eng 64(64):62–74
Sun G, Zhang H, Lu G, Guo J, Cui J, Li Q (2016) An experimental and numerical study on quasi-static and dynamic crashworthiness for tailor rolled blank (TRB) structures. Mater Des 118
Sun G, Pang T, Fang J, Li G, Li Q (2017a) Parameterization of criss-cross configurations for multiobjective crashworthiness optimization. Int J Mech Sci 124:145–157
Sun G, Zhang H, Fang J, Li G, Li Q (2017b) Multi-objective and multi-case reliability-based design optimization for tailor rolled blank (TRB) structures. Struct Multidiscip Optim 55(5):1899–1916
Van DA, Gary V, Lamont B (1999) Multiobjective evolutionary algorithm research: a history and analysis. Evol Comput 8(2):125–147
Vincenzi L, Gambarelli P (2017) A proper infill sampling strategy for improving the speed performance of a surrogate-assisted evolutionary algorithm. Comput Struct 178:58–70
Voß T, Hansen N, Igel C (2010) Improved step size adaptation for the MO-CMA-ES. In: Proceedings of the 12th annual conference on Genetic and evolutionary computation. ACM, pp 487–494
Wang D, Wu Z, Fei Y, Zhang W (2014) Structural design employing a sequential approximation optimization approach. Comput Struct 134(4):75–87
Xu F, Sun G, Li G, Li Q (2013) Crashworthiness design of multi-component tailor-welded blank (TWB) structures. Struct Multidiscip Optim 48(3):653–667
Yang Z, Peng Q, Yang J (2012) Lightweight design of B-pillar with TRB concept considering crashworthiness. In: 2012 Third International Conference on Digital Manufacturing & Automation. IEEE, pp 510–513
Yun Y, Min Y, Nakayama H (2009) Multi-objective optimization based on meta-modeling by using support vector regression. Optim Eng 10(2):167–181
Zhang Y, Sun G, Li G, Luo Z, Li Q (2012) Optimization of foam-filled bitubal structures for crashworthiness criteria. Mater Des 38:99–109
Zitzler, E., & Thiele, L. (1998a). An evolutionary algorithm for multiobjective optimization: the strength pareto approach. TIK-report, 43
Zitzler E, Thiele L (1998b) Multiobjective optimization using evolutionary algorithms—a comparative case study. In: International conference on parallel problem solving from nature. Springer, Berlin, Heidelberg, pp 292–301
Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evol Comput 8(2):173–195
Zitzler, E., Laumanns, M., & Thiele, L. (2001). SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-report, 103
Zuluaga M, Krause A, Püschel M (2016) ε-pal: an active learning approach to the multi-objective optimization problem. J Mach Learn Res 17(1):3619–3650
Zurada JM (1992) Introduction to artificial neural systems, vol 8. West publishing company, St. Paul
Funding
This work is supported by National Natural Science Foundation of China (51575172) and Australian Research Council (ARC) (DP190103752). Dr Guangyong Sun is a recipient of ARC Discovery Early Career Research Award (DECRA).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Nestor V Queipo
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sun, G., Tian, Y., Wang, R. et al. Parallelized multiobjective efficient global optimization algorithm and its applications. Struct Multidisc Optim 61, 763–786 (2020). https://doi.org/10.1007/s00158-019-02417-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-019-02417-1