# Multi-objective optimization for design under uncertainty problems through surrogate modeling in augmented input space

- 247 Downloads

## Abstract

Multi-objective design under uncertainty problems that adopt probabilistic quantities as performance objectives and consider their estimation through stochastic simulation are examined in this paper, focusing on development of a surrogate modeling framework to reduce computational burden for the numerical optimization. The surrogate model is formulated to approximate the system response with respect to both the design variables and the uncertain model parameters, so that it can simultaneously support both the uncertainty propagation and the identification of the Pareto optimal solutions. Kriging is chosen as the metamodel, and its probabilistic nature (its ability to offer a local estimate of the prediction error) is leveraged within different aspects of the framework. To reduce the number of simulations for the expensive system model, an iterative approach is established with adaptive characteristics for controlling the metamodel accuracy. At each iteration, a new metamodel is developed utilizing all available training points. A new Pareto front is then identified utilizing this surrogate model and is compared, for assessing stopping criteria, to the front that was identified in the previous iteration. This comparison utilizes explicitly the potential error associated with the metamodel predictions. If stopping criteria are not achieved, a set of refinement experiments (new training points) is identified and process proceeds to the next iteration. A hybrid design of experiments is considered for this refinement, with a dual goal of global coverage and local exploitation of regions of interest, separately identified for the design variables and the uncertain model parameters.

## Keywords

Design under uncertainty Multi-objective design Augmented input space Adaptive metamodels Kriging Iterative optimization## Notes

## References

- Beck AT, Santana Gomes WJ (2012) A comparison of deterministic, reliability-based and risk-based structural optimization under uncertainty. Probabilistic Engineering Mechanics 12:18–29Google Scholar
- Beck JL, Taflanidis A (2013) Prior and posterior robust stochastic predictions for dynamical systems using probability logic. Journal of Uncertainty Quantification 3(4):271–288MathSciNetGoogle Scholar
- Bichon BJ, Eldred MS, Mahadevan S, McFarland JM (2013) Efficient global surrogate modeling for reliability-based design optimization. J Mech Design 135(1):011009Google Scholar
- Coelho RF, Lebon J, Bouillard P (2011) Hierarchical stochastic metamodels based on moving least squares and polynomial chaos expansion. Struct Multidiscip Optim 43(5):707–729MathSciNetzbMATHGoogle Scholar
- Dahlberg T (1978) Ride comfort and road holding of a 2-DOF vehicle travelling on a randomly profiled road. J Sound Vib 58(2):179–187Google Scholar
- Deb K (2001) Multi-objective optimization using evolutionary algorithms, vol 16. John Wiley & SonsGoogle Scholar
- Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197Google Scholar
- Dubourg V, Sudret B, Bourinet J-M (2011) Reliability-based design optimization using kriging surrogates and subset simulation. Struct Multidiscip Optim 44(5):673–690Google Scholar
- Dubreuil S, Bartoli N, Gogu C, Lefebvre T, Colomer JM (2018) Extreme value oriented random field discretization based on an hybrid polynomial chaos expansion-Kriging approach. Comput Methods Appl Mech EngGoogle Scholar
- Eldred MS, Giunta AA, Wojtkiewicz SF, Trucano T (2002) Formulations for surrogate-based optimization under uncertainty. Paper presented at the 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, GA,Google Scholar
- Gidaris I, Taflanidis AA, Lopez-Garcia D, Mavroeidis GP (2016) Multi-objective risk-informed design of floor isolation systems. Earthquake Engineering & Structural Dynamics 45(8):1293–1313Google Scholar
- Goh CK, Tan KC (2006) Noise handling in evolutionary multi-objective optimization. In: Evolutionary Computation, 2006. CEC 2006. IEEE Congress on. IEEE, pp 1354–1361Google Scholar
- Haimes YY, Ladson L, Wismer DA (1971) Bicriterion formulation of problems of integrated system identification and system optimization. IEEE Transactions on Systems Man and Cybernetics (3):296-&Google Scholar
- Hartigan JA, Wong MA (1979) Algorithm AS 136: a K-means clustering algorithm. J R Stat Soc: Ser C: Appl Stat 28(1):100–108zbMATHGoogle Scholar
- Helton JC, Johnson JD, Oberkampf WL (2004) An exploration of alternative approaches to the representation of uncertainty in model predictions. Reliab Eng Syst Saf 85(1):39–71Google Scholar
- Janusevskis J, Le Riche R (2013) Simultaneous kriging-based estimation and optimization of mean response. J Glob Optim 55:313–336MathSciNetzbMATHGoogle Scholar
- Jia G, Taflanidis AA (2013) Kriging metamodeling for approximation of high-dimensional wave and surge responses in real-time storm/hurricane risk assessment. Comput Methods Appl Mech Eng 261-262:24–38MathSciNetzbMATHGoogle Scholar
- Jin R, Du X, Chen W (2003) The use of metamodeling techniques for optimization under uncertainty. Struct Multidiscip Optim 25(2):99–116Google Scholar
- Jones D, Schonlau M, Welch W (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455–492MathSciNetzbMATHGoogle Scholar
- Jones DR (2001) A taxonomy of global optimization methods based on response surfaces. J Glob Optim 21(4):345–383MathSciNetzbMATHGoogle Scholar
- Kim IY, De Weck O (2006) Adaptive weighted sum method for multiobjective optimization: a new method for Pareto front generation. Struct Multidiscip Optim 31(2):105–116MathSciNetzbMATHGoogle Scholar
- Kleijnen JPC (2009) Kriging metamodeling in simulation: a review. Eur J Oper Res 192(3):707–716MathSciNetzbMATHGoogle Scholar
- Kouri DP, Heinkenschloss M, Ridzal D, van Bloemen Waanders BG (2014) Inexact objective function evaluations in a trust-region algorithm for PDE-constrained optimization under uncertainty. SIAM J Sci Comput 36(6):A3011–A3029MathSciNetzbMATHGoogle Scholar
- Lagaros ND, Papadrakakis M (2007) Robust seismic design optimization of steel structures. Struct Multidiscip Optim 33(6):457–469Google Scholar
- Leotardi C, Serani A, Iemma U, Campana EF, Diez M (2016) A variable-accuracy metamodel-based architecture for global MDO under uncertainty. Struct Multidiscip Optim 54(3):573–593MathSciNetGoogle Scholar
- Liang C, Mahadevan S (2017) Pareto surface construction for multi-objective optimization under uncertainty. Struct Multidiscip Optim 55(5):1865–1882MathSciNetGoogle Scholar
- Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE-A MATLAB Kriging Toolbox. Technical University of DenmarkGoogle Scholar
- Marler RT, Arora JS (2004) Survey of multi-objective optimization methods for engineering. Struct Multidiscip Optim 26:369–395MathSciNetzbMATHGoogle Scholar
- Mavrotas G (2009) Effective implementation of the ε-constraint method in multi-objective mathematical programming problems. Appl Math Comput 213(2):455–465MathSciNetzbMATHGoogle Scholar
- Medina JC, Taflanidis A (2014) Adaptive importance sampling for optimization under uncertainty problems. Comput Methods Appl Mech Eng 279:133–162. https://doi.org/10.1016/j.cma.2014.06.025 MathSciNetzbMATHGoogle Scholar
- Medina JC, Taflanidis A (2015) Probabilistic measures for assessing appropriateness of robust design optimization solutions. Struct Multidiscip Optim 51(4):813–834MathSciNetGoogle Scholar
- Medina JC, Taflanidis AA (2013) Adaptive Importance Sampling for Optimization under Uncertainty Using Stochastic Simulation. In: 54th Structures, Structural Dynamics, and Materials Conference AIAA Conference, Boston, MA, April 8-11Google Scholar
- Moustapha M, Sudret B, Bourinet J-M, Guillaume B (2016) Quantile-based optimization under uncertainties using adaptive Kriging surrogate models. Struct Multidiscip Optim 54(6):1403–1421MathSciNetGoogle Scholar
- Müller J (2017) SOCEMO: surrogate optimization of computationally expensive multiobjective problems. INFORMS J Comput 29(4):581–596MathSciNetGoogle Scholar
- Papadimitriou D, Papadimitriou C (2016) Robust and reliability-based structural topology optimization using a continuous adjoint method. J Risk Uncerainty Eng Part A: Civil Eng. https://doi.org/10.1061/AJRUA1066.0000869
- Poles S, Lovison A (2009) A polynomial chaos approach to robust multiobjective optimization. In: Dagstuhl Seminar Proceedings. Schloss Dagstuhl-Leibniz-Zentrum für Informatik,Google Scholar
- Ren X, Rahman S (2013) Robust design optimization by polynomial dimensional decomposition. Struct Multidiscip Optim 48(1):127–148MathSciNetzbMATHGoogle Scholar
- Robert CP, Casella G (2004) Monte Carlo statistical methods, 2nd edn. Springer, New York, NYzbMATHGoogle Scholar
- Ruiz R, Taflanidis AA, Lopez-Garcia VC (2016) Life-cycle based design of mass dampers for the Chilean region and its application for the evaluation of the effectiveness of tuned liquid dampers with floating roof. Bull Earthq Eng 14(3):943–970Google Scholar
- Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423MathSciNetzbMATHGoogle Scholar
- Scott DW (1992) Multivariate density estimation: theory, Practise and Visualization. Wiley-Interscience, New York, N.YGoogle Scholar
- Spall JC (2003) Introduction to stochastic search and optimization. Wiley-Interscience, New YorkzbMATHGoogle Scholar
- Teich J (2001) Pareto-front exploration with uncertain objectives. In: International Conference on Evolutionary Multi-Criterion Optimization. Springer, pp 314–328Google Scholar
- Verros C, Natsiavas S, Papadimitriou C (2005) Design optimization of quarter-car models with passive and semi-active suspensions under random road excitation. J Vib Control 11(5):581–606zbMATHGoogle Scholar
- Wang Q, Stengel RF (2000) Robust nonlinear control of a hypersonic aircraft. J Guid Control Dyn 23(4):577–585Google Scholar
- Yang B, Yeun Y-S, Ruy W-S (2002) Managing approximation models in multiobjective optimization. Struct Multidiscip Optim 24(2):141–156Google Scholar
- Zhang J, Taflanidis AA, Medina JC (2016) Sequential approximate optimization for design under uncertainty problems utilizing Kriging metamodeling in augmented input space. Comput Methods Appl Mech Eng 315(369–395)Google Scholar
- Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evol Comput 8(2):173–195Google Scholar