Skip to main content
Log in

Multi-fidelity uncertainty propagation using polynomial chaos and Gaussian process modeling

  • Research Paper
  • Published:
Structural and Multidisciplinary Optimization Aims and scope Submit manuscript

Abstract

The polynomial chaos (PC) method has been widely studied and applied for uncertainty propagation (UP) due to its high efficiency and mathematical rigor. However, the straightforward application of PC on the computationally expensive and highly complicated model for UP might be too costly. Therefore, a multi-fidelity PC approach using the Gaussian process modeling theory is developed in this work, by which the classic multi-level co-kriging multi-fidelity modeling framework in the deterministic domain is extended to the stochastic one. Meanwhile, taking advantage of the Gaussian process modeling theory, the strategies for response models with hierarchical and non-hierarchical fidelity are both addressed within the proposed multi-fidelity PC approach. The effectiveness and relative merit of the proposed method are demonstrated by comparative studies on several numerical examples for UP. It is noticed that the proposed approach can significantly improve the accuracy and robustness of UP compared to the commonly used addition correction-based multi-fidelity PC method; compared to co-kriging, the accuracy and robustness are generally also improved, especially for problems with unsymmetric distributed random input and large variation. An engineering robust aerodynamic optimization problem further verifies the applicability of the proposed multi-fidelity PC method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Abbreviations

GP:

Gaussian process

HF:

The high-fidelity model

LF:

The low-fidelity model

PC:

Polynomial chaos

b i :

The ith coefficient of PC model

d :

Response data

d :

Dimension of random inputs

h :

Exponential of the exponential correlation function

n i :

The number of sample points for the ith-level fidelity model

s :

The highest level fidelity

t :

The tth-level fidelity

x :

Random input vector

y :

Stochastic response value

B :

Polynomial coefficient matrix

D t :

Input sites

E :

Unknown covariance matrix between lower-fidelity models

R :

Correlation function

α :

Multi-indices for PC

δ(x):

Correction function

μ :

Mean value

θ :

Hyper-parameters vector

ρ :

Scaling factor

σ :

Standard deviation value

ξ :

Random vector in standard random space

Φ :

Orthogonal polynomial

Γ :

Input space

References

  • Allaire D, Willcox K. Fusing information from multifidelity computer models of physical systems. International Conference on Information Fusion. IEEE Jul, 9-12, 2012, Singapore, Singapore

  • Blatman G, Sudret B (2011) Adaptive sparse polynomial chaos expansion based on least angle regression. J Comput Phys 230(6):2345–2367

    Article  MathSciNet  Google Scholar 

  • Chen Z, Peng S, Li X et al (2015) An important boundary sampling method for reliability-based design optimization using kriging model. Struct Multidiscip Optim 52(1):55–70

    Article  MathSciNet  Google Scholar 

  • Chen S, Jiang Z, Yang S et al (2016) Nonhierarchical multi-model fusion using spatial random processes. Int J Numer Methods Eng 106(7):503–526

    Article  MathSciNet  Google Scholar 

  • Du X, Chen W (2002) Efficient uncertainty analysis methods for multidisciplinary robust design. AIAA J 40(3):545–552

    Article  Google Scholar 

  • Eldred M. Recent advances in non-intrusive polynomial chaos and stochastic collocation methods for uncertainty analysis and design. 50th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference May. 4-7, 2009, Palm Springs, California, USA

  • Farin G (1993) Curves and surfaces for computer aided geometric design. Academic Press, Boston

    MATH  Google Scholar 

  • Fernández-Godino MG, Park C et al (2016) Review of multi-fidelity models. arXiv preprint arXiv:1609.07196

  • Gratiet LL, Cannamela C (2012) Kriging-based sequential design strategies using fast cross-validation techniques with extensions to multi-fidelity computer codes. Technometrics 57(3):418–427

    Article  Google Scholar 

  • Gratiet LL, Cannamela C, Iooss B (2014) A Bayesian approach for global sensitivity analysis of (multi-fidelity) computer codes. SIAM/ASA J Uncertain Quantif 2(1):336–363

    Article  MathSciNet  Google Scholar 

  • Guo Z, Song L, Park C et al (2018) Analysis of dataset selection for multi-fidelity surrogates for a turbine problem. Struct Multidiscip Optim 57(6):2127–2142

    Article  Google Scholar 

  • Han Z, Zimmerman R, Görtz S (2012) Alternative cokriging method for variable-fidelity surrogate modeling. AIAA J 50(5):1205–1210

    Article  Google Scholar 

  • Hu Z, Mahadevan S (2018) Adaptive surrogate modeling for time-dependent multidisciplinary reliability analysis. J Mech Des 140(2):021401

    Article  Google Scholar 

  • Huang D, Allen TT, Notz WI et al (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382

    Article  Google Scholar 

  • Huang L, Gao Z et al (2013) Research on multi-fidelity aerodynamic optimization methods. Chin J Aeronaut 26(2):279–286

    Article  Google Scholar 

  • Jiang Z, Chen S, Apley DW et al (2016) Reduction of epistemic uncertainty in simulation-based multidisciplinary design. J Mech Des 138(8):081403

    Article  Google Scholar 

  • Kennedy MC, O'Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13

    Article  MathSciNet  Google Scholar 

  • Kersaudy P, Sudret B, Varsier N et al (2015) A new surrogate modeling technique combining kriging and polynomial chaos expansions-application to uncertainty analysis in computational dosimetry. J Comput Phys 286:103–117

    Article  MathSciNet  Google Scholar 

  • Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA J 46(2):498–507

    Article  Google Scholar 

  • Lee SH, Chen W (2009) A comparative study of uncertainty propagation methods for black-box-type problems. Struct Multidiscip Optim 37(3):239–253

    Article  Google Scholar 

  • Li C, Wang P, Dong H (2018) Kriging-based multi-fidelity optimization via information fusion with uncertainty. J Mech Sci Technol 32(1):245–259

    Article  Google Scholar 

  • Liu Y, Chen S, Wang F et al (2018) Sequential optimization using multi-level cokriging and extended expected improvement criterion. Struct Multidiscip Optim 58(3):1155–1173

  • Matteo B (2016) Multi-fidelity surrogate modelling with polynomial chaos expansions. M.S. dissertation, Federal institute of technology in Zurich

  • Ng WT, Eldred M. Multifidelity uncertainty quantification using non-intrusive polynomial chaos and stochastic collocation. AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, AIAA/ASME/AHS Adaptive Structures Conference April. 23-26, 2012, Honolulu, Hawaii, USA

  • Palar PS, Tsuchiya T, Parks G. Decomposition-based evolutionary aerodynamic robust optimization with multi-fidelity point collocation non-intrusive polynomial chaos. AIAA Non-Deterministic Approaches Conference Jan. 5-9, 2015, Kissimmee, Florida, USA

  • Palar PS, Zuhal LR, Shimoyama K et al (2018) Global sensitivity analysis via multi-fidelity polynomial chaos expansion. Reliab Eng Syst Saf 170:175–190

    Article  Google Scholar 

  • Park C, Haftka RT, Kim NH (2016) Remarks on multi-fidelity surrogates. Struct Multidiscip Optim 55(3):1029–1050

  • Pramudita SP, Takeshi T, Geoffrey TP (2016) Multi-fidelity non-intrusive polynomial chaos based on regression. Comput Methods Appl Mech Eng 307:489–490

    Article  MathSciNet  Google Scholar 

  • Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press, Cambridge

    MATH  Google Scholar 

  • Ren J, Thelen AS, Amrit A et al. Application of multifidelity optimization techniques to benchmark aerodynamic design problems. 54th AIAA Aerospace Sciences Meeting, 4–8 January 2016, San Diego, California, USA

  • Santiago Padron A, Juan JA, Francisco P et al. Multi-fidelity uncertainty quantification: application to a vertical axis wind turbine under an extreme gust. 15th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference June. 16-20, 2014, Atlanta, GA

  • Schobi R, Sudret B, Wiart J (2015) Polynomial-chaos-based kriging. Int J Uncertain Quantif 5(2):171–193

    Article  MathSciNet  Google Scholar 

  • Shah H, Hosder S, Koziel S et al. Multi-fidelity robust aerodynamic design optimization under mixed uncertainty. AIAA SciTech Forum, 17th AIAA Non-Deterministic Approaches Conference January, 5–9, 2015, Kissimmee, Florida, USA

  • Toal DJJ, Keane AJ (2015) Efficient multipoint aerodynamic design optimization via cokriging. J Aircr 48(5):1685–1695

    Article  Google Scholar 

  • Toal DJJ, Bressloff NW, Keane AJ et al (2011) The development of a hybridized particle swarm for kriging hyperparameter tuning. Eng Optim 43(6):675–699

    Article  Google Scholar 

  • Wang F, Xiong F, Yang S, Xiong Y. A sparse data-driven polynomial chaos expansion method for uncertainty propagation. ASME. International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 42nd Design Automation Conference, August 21–24, 2016, Charlotte, North Carolina, USA

  • West TK IV, Gumbert C. Multidisciplinary design under uncertainty with non-intrusive polynomial chaos. 2017 AIAA SciTech Forum Jan. 9–13, 2017, Grapevine, Texas, USA

  • Xiong FF, Chen W, Xiong Y, Yang SX (2011) Weighted stochastic response surface method considering sample weights. Struct Multidiscip Optim 43(6):837–849

    Article  Google Scholar 

  • Zhang Y, Han Z, Zhang K (2018) Variable-fidelity expected improvement method for efficient global optimization of expensive functions. Struct Multidiscip Optim 58(4):1431–1451

    Article  MathSciNet  Google Scholar 

  • Zhu X, Narayan A, Xiu D (2014) Computational aspects of stochastic collocation with multifidelity models. SIAM/ASA J Uncertain Quantif 2:444–463

    Article  MathSciNet  Google Scholar 

  • Zhu X, Linebarger EM, Xiu D (2017) Multi-fidelity stochastic collocation method for computation of statistical moments. J Comput Phys 341:386–396

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The grant support from Science Challenge Project (No. TZ2018001) and Hongjian Innovation Foundation (No.BQ203-HYJJ-Q2018002) is greatly acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fenfen Xiong.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Responsible Editor: Christian Gogu

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, F., Xiong, F., Chen, S. et al. Multi-fidelity uncertainty propagation using polynomial chaos and Gaussian process modeling. Struct Multidisc Optim 60, 1583–1604 (2019). https://doi.org/10.1007/s00158-019-02287-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00158-019-02287-7

Keywords

Navigation