Skip to main content
SpringerLink
Log in

Surrogate-assisted reliability-based design optimization: a survey and a unified modular framework

  • Review Article
  • Published:
Structural and Multidisciplinary Optimization Aims and scope Submit manuscript

Abstract

Reliability-based design optimization (RBDO) is an active field of research with an ever increasing number of contributions. Numerous methods have been proposed for the solution of RBDO, a complex problem that combines optimization and reliability analysis. Classical approaches are based on approximation methods and have been classified in review papers. In this paper, we first review classical approaches based on approximation methods such as FORM, and also more recent methods that rely upon surrogate modelling and Monte Carlo simulation. We then propose a generalization of the existing surrogate-assisted and simulation-based RBDO techniques using a unified framework that includes three independent blocks, namely adaptive surrogate modelling, reliability analysis, and optimization. These blocks are non-intrusive with respect to each other and can be plugged independently in the framework. After a discussion on numerical considerations that require attention for the framework to yield robust solutions to various types of problems, the latter is applied to three examples (using two analytical functions and a finite element model). Kriging and support vector machines regression together with their own active learning schemes are considered in the surrogate model block. In terms of reliability analysis, the proposed framework is illustrated using both crude Monte Carlo and subset simulation. Finally, the covariance matrix adaptation-evolution scheme (CMA-ES), a global search algorithm, or sequential quadratic programming (SQP), a local gradient-based method, is used in the optimization block. The comparison of the results to benchmark studies shows the effectiveness and efficiency of the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Agarwal H, Renaud J (2004) Reliability-based design optimization using response surfaces in application to multidisciplinary systems. Eng Opt 36(3):291–311

    Google Scholar 

  • Agarwal H, Mozumder CK, Renaud JE, Watson LT (2007) An inverse-measure-based unilevel architecture for reliability-based design optimization. Struct Multidisc Optim 33(3):217–227

    Google Scholar 

  • Aoues Y, Chateauneuf A (2010) Benchmark study of numerical methods for reliability-based design optimization. Struct Multidisc Optim 41(2):277–294

    MathSciNet  MATH  Google Scholar 

  • Arnold DV, Hansen N (2012) A (1 + 1)-CMA-ES for constrained optimisation. In: Soule T, Moore JH (eds) Genetic and evolutionary computation conference, pp 297–304

  • Au SK (2005) Reliability-based design sensitivity by efficient simulation. Comput Struct 83(14):1048–1061

    Google Scholar 

  • Au SK, Beck JL (2001) Estimation of small failure probabilities in high dimensions by subset simulation. Prob Eng Mech 16(4):263–277

    Google Scholar 

  • Bachoc F (2013) Cross validation and maximum likelihood estimations of hyper-parameters of Gaussian processes with model misspecifications. Comput Stat Data Anal 66:55–69

    MathSciNet  MATH  Google Scholar 

  • Basudhar A, Missoum S (2008) Adaptive explicit decision functions for probabilistic design and optimization using support vector machines. Comput Struct 86(19–20):1904–1917

    Google Scholar 

  • Basudhar A, Missoum S (2010) An improved adaptive sampling scheme for the construction of explicit boundaries. Struct Multidisc Optim 42(4):517–529

    Google Scholar 

  • Beaurepaire P, Jensen HA, Schuëller GI, Valdebenito MA (2013) Reliability-based optimization using bridge importance sampling. Prob Eng Mech 34:48–57

    Google Scholar 

  • Beck AT, Gomes WJS (2012) A comparison of deterministic, reliability-based and risk-based structural optimization under uncertainty. Prob Eng Mech 28:18–29

    Google Scholar 

  • Bichon BJ, Eldred MS, Swiler L, Mahadevan S, McFarland J (2008) Efficient global reliability analysis for nonlinear implicit performance functions. AIAA J 46(10):2459–2468

    Google Scholar 

  • Boronson E, Missoum M (2017) Stochastic optimization of nonlinear energy sinks. Struct Multidisc Optim 55:633–646

    MathSciNet  Google Scholar 

  • Bourinet JM (2018) Reliability analysis and optimal design under uncertainty - Focus on adaptive surrogate-based approaches. Université Blaise Pascal, Clermont-Ferrand, France, habilitation à diriger des recherches, p 243

  • Chapelle O, Vapnik V, Bengio Y (2002) Model selection for small sample regression. Mach Learn 48 (1):9–23

    MATH  Google Scholar 

  • Chateauneuf A (2008) Structural design optimization considering uncertainties. Taylor & Francis, chap 1, pp 3–30

  • Chen X, Hasselman KT, Neil DJ (1997) Reliability-based structural design optimization for practical applications. In: 38th Structures, Structural Dynamics, and Materials Conference, pp 2724–2732

  • Chen Z, Peng S, Li X, Qiu H, Xiong H, Gao L, Li P (2015) An important boundary sampling method for reliability-based design optimization using Kriging model. Struct Multidisc Optim 52(1):55–70

    MathSciNet  Google Scholar 

  • Cheng G, Xu L, Jiang L (2006) A sequential approximate programming strategy for reliability-based structural optimization. Comput Struct 84(21):1353–1367

    Google Scholar 

  • Cho TM, Lee BC (2011) Reliability-based design optimization using convex linearization and sequential optimization and reliability assessment method. Struct Saf 33(1):42–50

    MathSciNet  Google Scholar 

  • de Angelis M, Patelli E, Beer M (2015) Advanced line sampling for efficient robust reliability analysis. Struct Saf 52(B):170–182

    Google Scholar 

  • Ditlevsen O, Madsen H (1996) Structural reliability methods. Wiley, Chichester

    Google Scholar 

  • Du X, Chen W (2004) Sequential optimization and reliability assessment method for efficient probabilistic design. J Mech Design 126(2):225–233

    Google Scholar 

  • Dubourg V (2011) Adaptive surrogate models for reliability analysis and reliability-based design optimization. PhD thesis université Blaise Pascal, Clermont-Ferrand, France

  • Dubourg V, Sudret B, Bourinet JM (2011) Reliability-based design optimization using Kriging and subset simulation. Struct Multidisc Optim 44(5):673–690

    Google Scholar 

  • Enevoldsen I, Sørensen JD (1994) Reliability-based optimization in structural engineering. Struct Saf 15 (3):169–196

    Google Scholar 

  • Foschi RO, Li H, Zhang J (2002) Reliability and performance-based design: a computational approach and applications. Struct Saf 24(2–4):205–218

    Google Scholar 

  • Frangopol DM (1985) Structural optimization using reliability concepts. J Struct Eng 111(11):2288–2301

    Google Scholar 

  • Frangopol DM, Maute K (2003) Life-cycle reliability-based optimization of civil and aerospace structures. Comput Struct 81:397–410

    Google Scholar 

  • Gao T, Li J (2017) A derivative-free trust-region algorithm for reliability-based optimization. Struct Multidisc Optim 55(4):1535–1539

    MathSciNet  Google Scholar 

  • Gaspar B, Teixeira AP, Guedes Soares C (2017) Adaptive surrogate model with active refinement combining Kriging and a trust region method. Reliab Eng Syst Saf 165:277–291

    Google Scholar 

  • Geyer S, Papaiannou I, Straub D (2019) Cross-entropy-based importance sampling using gaussian densities revisited. Struct Saf 76:15–27

    Google Scholar 

  • Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195

    Google Scholar 

  • Hilton HH, Feigen M (1960) Minimum weight analysis based on structural reliability. J Aerospace Sci 27 (9):641–652

    MathSciNet  MATH  Google Scholar 

  • Jia G, Taflanidis AA (2013) Non-parametric stochastic subset optimization for optimal-reliability design problems. Comput Struct 126:86–99

    Google Scholar 

  • Jiang C, Qiu H, Gao L, Cai X, Li P (2017) An adaptive hybrid single-loop method for reliability-based design optimization using iterative control strategy. Struct Multidisc Optim, pp 1–16

  • Kaveh A, Talatahari S (2009) Particle swarm optimizer, and colony strategy and harmony search scheme hybridized for optimization of truss structures. Comput Struct 87:1267–283

    Google Scholar 

  • Kaymaz I (2007) Approximation methods for reliability-based design optimization problems. GAMM-Mitt 30 (2):225–268

    MathSciNet  MATH  Google Scholar 

  • Kharmanda G, Mohamed A, Lemaire M (2002) Efficient reliability-based design optimization using a hybrid space with application to finite element analysis. Struct Multidisc Optim, 24(3)

    Google Scholar 

  • Kurtz N, Song J (2013) Cross-entropy-based adaptive importance sampling using gaussian mixture. Struct Saf 42:35–44

    Google Scholar 

  • Kuschel N, Rackwitz R (1997) Two basic problems in reliability-based structural optimization. Math Method Oper Res 46(3):309–333

    MathSciNet  MATH  Google Scholar 

  • Lacaze S, Missoum M (2014) A generalized max-min sample for surrogate updates. Struct Multidisc Optim 49:683–687

    Google Scholar 

  • Lacaze S, Missoum S (2013) Reliability-based design optimization using Kriging and support vector machines. In: Proceedings of the 11th International Conference on Structural Safety and Reliability (ICOSSAR), June 16–20, 2013, New York, United States, p 2013

  • Lataniotis C, Marelli S, Sudret B (2018) The gaussian process modeling module in UQLab. Soft Computing in Civil Engineering 2(3):91–116

    Google Scholar 

  • Lee I, Choi KK, Du L, Gorsich D (2008) Inverse analysis method using MPP-based dimension reduction for reliability-based design optimization of nonlinear and multi-dimensional systems. Comput Methods Appl Mech Engrg 198:14–27

    MATH  Google Scholar 

  • Lee I, Choi KK, Zhao L (2011) Sampling-based RBDO using the stochastic sensitivity analysis and dynamic Kriging method. Struct Multidisc Optim 44(3):299–317

    MathSciNet  MATH  Google Scholar 

  • Lee JO, Yang YS, Ruy WS (2002) A comparative study of reliability-index and target-performance-based probabilistic structural design optimization. Comput Struct 80:257–269

    Google Scholar 

  • Lee PM (1997) Bayesian statistics: an introduction, 2nd edn. Wiley Publishing, London

    MATH  Google Scholar 

  • Lee T, Jung J (2008) A sampling technique enhancing accuracy and efficiency of metamodel-based RBDO: Constraint boundary sampling. Comput Struct 86(13–14):1463–1476

    Google Scholar 

  • Lehký D, Slowik O, Novák D (2017) Reliability-based design: Artificial neural networks and double-loop reliability-based optimization approaches. Adv Eng Soft, pp 1–13

  • Li G, Meng Z, Hu H (2015) An adaptive hybrid approach for reliability-based design optimization. Struct Multidisc Optim 51(5):1051–1065

    MathSciNet  Google Scholar 

  • Li W, Yang L (1994) An effective optimization procedure based on structural reliability. Comput Struct 52(5):1061–1067

    MATH  Google Scholar 

  • Li X, Qiu H, Chen Z, Gao L, Shao X (2016) A local Kriging approximation method using MPP for reliability-based design optimization. Comput Struct 162:102–115

    Google Scholar 

  • Liang J, Mourelatos Z, Tu J (2004) A single-loop method for reliability-based design optimization. In: Proc. DETC’04 ASME 2004 Design engineering technical conferences and computers and information in engineering conference, Sept. 28 – Oct. 2, 2004, Salt Lake City, Utah, USA

  • Liang J, Mourelatos ZP, Nikolaidis E (2007) A single-loop approach for system reliability-based design optimization. J Mech Des 129(12):1215–1224

    Google Scholar 

  • Lim J, Lee B (2016) A semi-single-loop method using approximation of most probable point for reliability-based design optimization. Struct Multidisc Optim 53(4):745–757

    MathSciNet  Google Scholar 

  • Liu WS, Cheung SH (2017) Reliability-based design optimization with approximate failure probability function in partitioned design space. Reliab Eng Syst Saf 167:602–611

    Google Scholar 

  • Madsen HO, Hansen PF (1992) A comparison of some algorithms for reliability based structural optimization and sensitivity analysis. In: Rackwitz R, Thoft-Christensen P (eds) Reliability and Optimization of Structural Systems’91. Lectures Notes in Engineering, vol 76. Springer, Berlin, pp 443–451

    Google Scholar 

  • Marelli S, Sudret B (2014) UQLab: a framework for uncertainty quantification in Matlab. In: Vulnerability, uncertainty, and risk (Proc. 2nd int. Conf. on vulnerability, risk analysis and management (ICVRAM2014), Liverpool, United Kingdom), pp 2554–2563

  • McKay MD, Beckman RJ, Conover WJ (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 2:239–245

    MathSciNet  MATH  Google Scholar 

  • Moustapha M, Sudret B (2017) Quantile-based optimization under uncertainties using bootstrap polynomial chaos expansions. In: Proc 12th Internatinoal Conference on Structural Safety and Reliability (ICOSSAR), August 6–10, Vienna, Austria, p 2017

  • Moustapha M, Sudret B, Bourinet JM, Guillaume B (2016) Quantile-based optimization under uncertainties using adaptive Kriging surrogate models. Struct Multidisc Optim 54(6):1403–1421

    MathSciNet  Google Scholar 

  • Moustapha M, Lataniotis C, Marelli S, Sudret B (2018a) UQLAb user manual – support vector machines for regression. Tech rep, chair of risk, safety & uncertainty quantification, ETH Zurich, report # UQLab-V1.1–111

  • Moustapha M, Sudret B, Bourinet JM, Guillaume B (2018b) Comparative study of Kriging and support vector regression for structural engineering applications. ASCE-ASME J Risk Uncertainty Eng Syst, Part A: Civ Eng 4(2)

    Google Scholar 

  • Moustapha M, Marelli S, Sudret B (2019) UQLab user manual- Reliability-based design optimization. Tech rep, chair of risk, safety & uncertainty quantification, ETH Zurich, report # UQLab-V1.2–114

  • Nikolaidis E, Burdisso R (1988) Reliability-based optimization: a safety index approach. Comput Struct 28(6):781–788

    MATH  Google Scholar 

  • Papadrakakis M, Lagaros ND, Plevris V (2005) Design optimization of steel structures considering uncertainties. Eng Struct 27(9):1408–1418

    MATH  Google Scholar 

  • Papaioannou I, Betz W, Zwirglmaier K, Straub D (2015) MCMC Algorithms for subset simulation. Prob Eng Mech 41:89–103

    Google Scholar 

  • Pradlwarter HJ, Schuëller G I, Koutsourelakis PS, Charmpis DC (2007) Application of line sampling simulation method to reliability benchmark problems. Struct Saf 29(3):208–221

    Google Scholar 

  • Rahman S, Wei D (2008) Design sensitivity and reliability-based structural optimization by univariate decomposition. Struct Multidisc Optim 35(3):245–261

    Google Scholar 

  • Rahman S, Xu H (2004) A univariate dimension-reduction method for multi-dimensional integration in stochastic mechanics. Prob Eng Mech 19:393–408

    Google Scholar 

  • Rashki M, Miri M, Moghaddam MA (2014) A simulation-based method for reliability-based design optimization problems with highly nonlinear constraints. Autom Constr 47:24–36

    Google Scholar 

  • Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning, Internet edn. Adaptive computation and machine learning. MIT Press, Cambridge

  • Royset JO (2004) Reliability-based optimal design using sample average approximations. Prob Eng Mech 19:331–343

    Google Scholar 

  • Royset JO, Der Kiureghian A, Polak E (2001) Reliability-based optimal structural design by the decoupling approach. Reliab Eng Sys Safety 73(3):213–221

    Google Scholar 

  • Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, New York

    MATH  Google Scholar 

  • Shetty NK, Guedes-Soares C, Thoft-Christensen P, Jensen FM (1998) Fire safety assessment and optimal design of passive fire protection for offshore structures. Reliab Eng Syst Saf 61(1–2):139–149

    Google Scholar 

  • Smola AJ, Schölkopf B (2004) A tutorial on support vector regression. Stat Comput 14:199–222

    MathSciNet  Google Scholar 

  • Sobol’ IM (1967) Distribution of points in a cube and approximate evaluation of integrals. USSR Comput Maths Math Phys 7:86–112

    MathSciNet  MATH  Google Scholar 

  • Song H (2013) Efficient sampling-based RBDO by using virtual support vector machine and improving the accuracy of the Kriging method. PhD thesis, University of Iowa, USA

  • Spall JC (1998a) Implementation of the simultaneous perturbation algorithm for stochastic optimization. IEEE Trans Aerosp Electron Syst 34(3):817–823

    Google Scholar 

  • Spall JC (1998b) An overview of the simultaneous perturbation method for efficient optimization. Johns Hopkins Apl Technical Digest 19(4):482–492

    Google Scholar 

  • Spall JC (2003a) Introduction to stochastic search and optimization: Estimation, simulation and control, Wiley, chap 14: Simulation-based optimization I: regression, common random numbers, and selection methods

  • Spall JC (2003b) Introduction to stochastic search and optimization: Estimation, simulation and control. Wiley, New York

    MATH  Google Scholar 

  • Strömberg N (2017) Reliability-based design optimization using SORM and SQP. Struct Multidisc Optim 56(3):631–645

    MathSciNet  Google Scholar 

  • Taflanidis AA (2007) Stochastic system design and applications to stochastic robust structural control. PhD thesis, California Institute of Technology, Pasadena, California, USA

  • Taflanidis AA, Beck JL (2008) Stochastic subset optimization for optimal reliability problems. Prob Eng Mech 23:324–338

    Google Scholar 

  • Taflanidis AJ, Medina AC (2014) Adaptive Kriging for simulation-based design under uncertainty: Development of metamodels in augmented input space and adaptive tuning of their characteristics. In: Proc 4th international Conference on Simulation and Modeling Methodologies, Technologies and Applications, August 28-30, 2014, Vienna, Austria

  • Torre E, Marelli S, Embrechts P, Sudret B (2018) A general framework for data-driven uncertainty quantification under complex input dependencies using vine copulas. Prob Eng Mech (in press)

  • Tu J, Choi KK, Park YH (1999) A new study on reliability-based design optimization. J Mech Des 121:557–564

    Google Scholar 

  • Valdebenito AM, Schuëller GI (2010) A survey on approaches for reliability-based optimization. Struct Multidisc Optim 42:645–663

    MathSciNet  MATH  Google Scholar 

  • Vapnik VN (1995) The nature of statistical learning theory. Springer, New York

    MATH  Google Scholar 

  • Wang GG (2003) Adaptive response surface method using inherited Latin Hypercube design points. J Mech Design 125:210–220

    Google Scholar 

  • Wang I-J, Spall JC (1998) A constrained simulation perturbation stochastic approximation algorithm based on penalty functions. In: Proceedings of the 1998 IEEE ISIC/CIRA/ISAS Joint Conference, Sept. 14–17, 1998, Gaithersburg, MD, USA

  • Youn BD (2007) Adaptive-loop method for non-deterministic design optimization. Proceedings of the Institution of Mechanical Engineers Part O: Journal of Risk and Reliability 221(2):107– 116

    Google Scholar 

  • Youn BD, Choi KK, Du L (2005) Enriched performance measure approach for reliability-based design optimization. AIAA J 43(4):874–884

    Google Scholar 

  • Zhang J, Taflanidis AA, Medina JC (2017) Sequential approximate optimization for design under uncertainty problems utilizing Kriging metamodeling in augmented input space. Comput Methods Appl Mech Engrg 315:369–395

    MathSciNet  Google Scholar 

  • Zou T, Mahadevan S (2006) A direct decoupling approach for efficient reliability-based design optimization. Struct Multidisc Optim 31:190–200

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Chair of Risk, Safety and Uncertainty Quantification, ETH Zurich, Zurich, Switzerland

    Maliki Moustapha & Bruno Sudret

Authors
  1. Maliki Moustapha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bruno Sudret
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maliki Moustapha.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest.

Additional information

Responsible Editor: Erdem Acar

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moustapha, M., Sudret, B. Surrogate-assisted reliability-based design optimization: a survey and a unified modular framework. Struct Multidisc Optim 60, 2157–2176 (2019). https://doi.org/10.1007/s00158-019-02290-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00158-019-02290-y

Keywords

Search

Navigation