Skip to main content
SpringerLink
Log in

Metamodeling for high dimensional design problems by multi-fidelity simulations

  • RESEARCH PAPER
  • Published:
Structural and Multidisciplinary Optimization Aims and scope Submit manuscript

Abstract

Multi-fidelity metamodeling provides an efficient way to approximate expensive black-box problems by utilizing the samples of multiple fidelities. While it still faces the challenge of “curse-of-dimensionality” when used in approximating high dimensional problems. On the other hand, the high dimensional model representation (HDMR) method, as an efficient tool to tackle high dimensional problems, can only handle single-fidelity samples in approximation. Therefore, a hybrid metamodel which combines Cut-HDMR with Co-kriging and kriging is proposed to improve the metamodeling efficiency for high dimensional problems. The developed HDMR, termed as MF-HDMR, can efficiently use multi-fidelity samples to approximate black-box problems by using a two stage metamodeling strategy. It can naturally explore and exploit the linearity/nonlinearity and correlations among variables of underlying problems, which are unknown or computationally expensive. Besides, to further improve the efficiency of MF-HDMR, an extended maximin distance sequential sampling method is proposed to add new sample points of different fidelities in the metamodeling process. Moreover, a mathematical function is used to illustrate the modeling theory and procedures of MF-HDMR. In order to validate the proposed method, it is tested by several numerical benchmark problems and successfully applied in the optimal design of a long cylinder pressure vessel. Moreover, an overall comparison between the proposed method and several other metamodeling methods has been made. Results show that the proposed method is very efficient in approximating high dimensional problems by using multi-fidelity samples, thus making it particularly suitable for high dimensional engineering design problems involving computationally expensive simulations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  • Alış ÖF, Rabitz H (2001) Efficient implementation of high dimensional model representations. J Math Chem 29(2):127–142

    Article  MathSciNet  MATH  Google Scholar 

  • Cai X, Qiu H, Gao L, Yang P, Shao X (2016) An enhanced RBF-HDMR integrated with an adaptive sampling method for approximating high dimensional problems in engineering design. Struct Multidiscip Optim 53(6):1209–1229

    Article  Google Scholar 

  • Chen Z (1993) Fitting multivariate regression functions by interaction spline models. J R Stat Soc SerB (Methodol) 473–491

  • Cleveland WS, Devlin SJ (1988) Locally weighted regression: an approach to regression analysis by local fitting. J Am Stat Assoc 83(403):596–610

    Article  MATH  Google Scholar 

  • Couckuyt I, Dhaene T, Demeester P (2012) ooDACE toolbox. Adv Eng Softw 49(3):1–13

    Article  MATH  Google Scholar 

  • Cressie N (1990) The origins of kriging. Math Geol 22:239–252

    Article  MathSciNet  MATH  Google Scholar 

  • Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Adv Neural Inf Proces Syst 9:155–161

  • Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. In Proceedings of the royal society of london a: mathematical, physical and engineering sciences. R Soc 463(2088):3251–3269

    Article  MathSciNet  MATH  Google Scholar 

  • Friedman JH (1991) Multivariate adaptive regression splines. Ann stat 1–67

  • Gano SE, Renaud JE, Sanders B (2005) Hybrid variable fidelity optimization by using a kriging-based scaling function. AIAA J 43(11):2422–2433

    Article  Google Scholar 

  • Han ZH, Görtz S, Zimmermann R (2013) Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function. Aerosp Sci Technol 25(1):177–189

    Article  Google Scholar 

  • Huang D, Allen TT, Notz WI, Miller RA (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382

    Article  Google Scholar 

  • Huang Z, Qiu H, Zhao M, Cai X, Gao L (2015) An adaptive SVR-HDMR model for approximating high dimensional problems. Eng Comput 32(3):643–667

    Article  Google Scholar 

  • Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13

    Article  Google Scholar 

  • Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Am Soc Mech Eng 539–548

  • Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the Lipschitz constant. J Optim Theory Appl 79(1):157–181

  • Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492

    Article  MathSciNet  MATH  Google Scholar 

  • Kim HS, Koc M, Ni J (2007) A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network. Int J Mach Tools Manuf 47(2):211–222

    Article  Google Scholar 

  • Kim BS, Lee YB, Choi DH (2009) Comparison study on the accuracy of metamodeling technique for non-convex functions. J Mech Sci Technol 23(4):1175–1181

    Article  Google Scholar 

  • Leary SJ, Bhaskar A, Keane AJ (2003) A knowledge-based approach to response surface modelling in multifidelity optimization. J Glob Optim 26(3):297–319

    Article  MathSciNet  MATH  Google Scholar 

  • Li E, Wang H (2016) An alternative adaptive differential evolutionary Algorithm assisted by Expected Improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design. Adv Eng Soft 97:96–107

  • Li G, Wang SW, Rabitz H (2002) Practical approaches to construct RS-HDMR component functions. J Phys Chem A 106(37):8721–8733

  • Lophaven S, Nielsen H, Sondergaard J (2002) AMatlab Kriging Toolbox. Technical University of Denmark, Kongens Lyngby, Technical Report No. IMM-TR-2002-12

  • Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060

  • Mullur AA, Messac A (2005) Extended radial basis functions: more flexible and effective metamodeling. AIAA J 43(6):1306–1315

    Article  Google Scholar 

  • Orr MJ (1995) Local smoothing of radial basis function networks. In International Symposium on Artificial Neural Networks

  • Rabitz H, Aliş ÖF (1999) General foundations of high‐dimensional model representations. J Math Chem 25(2–3):197–233

    Article  MathSciNet  MATH  Google Scholar 

  • Rabitz H, Aliş ÖF, Shorter J, Shim K (1999) Efficient input—output model representations. Comput Phys Commun 117(1):11–20

  • Rajnarayan D, Haas A, Kroo I (2008) A multi-fidelity gradient-free optimization method and application to aerodynamic design. In 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, Victoria, British Columbia AIAA 6020

  • Rao B, Chowdhury R (2008) Probabilistic analysis using high dimensional model representation and fast Fourier transform. Int J Comput Methods Eng Sci Mech 9(6):342–357

    Article  MATH  Google Scholar 

  • Shan S, Wang GG (2009) Development of adaptive RBF-HDMR model for approximating high dimensional problems, ASME

  • Shan S, Wang GG (2010) Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optim 41(2):219–241

    Article  MathSciNet  MATH  Google Scholar 

  • Shan S, Wang GG (2011) Turning Black-Box Functions Into White Functions. J Mech Des 133(3):031003

    Article  Google Scholar 

  • Simpson TW, Poplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150

    Article  MATH  Google Scholar 

  • Simpson TW, Toropov V, Balabanov V, Viana FA (2008) Design and analysis of computer experiments in multidisciplinary design optimization: a review of how far we have come or not. 12th AIAA/ISSMO Mult Anal Opt Conf 5(10):10–12

    Google Scholar 

  • Sobol I (2003) Theorems and examples on high dimensional model representation. Reliabil En Syst Safety 79(2):187–193

    Article  MathSciNet  Google Scholar 

  • Sun G, Li G, Zhou S, Xu W, Yang X, Li Q (2011) Multi-fidelity optimization for sheet metal forming process. Struct Multidiscip Optim 44(1):111–124

    Article  Google Scholar 

  • Tang L, Wang H, Li G (2013) Advanced high strength steel springback optimization by projection-based heuristic global search algorithm. Mater Des 43:426–437

    Article  Google Scholar 

  • Tyan M, Nguyen NV, Lee JW (2015) Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aero foil design. Eng Optim 47(7):885–908

    Article  Google Scholar 

  • Ulaganathan S, Couckuyt I, Ferranti F, Laermans E, Dhaene T (2015) Performance study of multi-fidelity gradient enhanced kriging. Struct Multidiscip Optim 51(5):1017–1033

    Article  Google Scholar 

  • Viana FA, Venter G, Balabanov V (2010) An algorithm for fast optimal Latin hypercube design of experiments. Int J Numer Methods Eng 82(2):135–156

    MathSciNet  MATH  Google Scholar 

  • Viana FA, Simpson TW, Balabanov V, Toropov V (2014) Special Section on Multidisciplinary Design Optimization: Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come?.AIAA. Journal 52(4):670–690

    Google Scholar 

  • Wang H, Tang L, Li GY (2011) Adaptive MLS-HDMR metamodeling techniques for high dimensional problems. Expert Syst Appl 38(11):14117–14126

    Google Scholar 

  • Xu J, Zhang S, Huang E, Chen CH, Lee LH, Celik N (2015) Mo2tos: Multi-fidelity optimization with ordinal transformation and optimal sampling. Asia-Pacif J Operat Res 1650017

  • Zhao D, Xue D (2010) A comparative study of metamodeling methods considering sample quality merits. Struct Multidiscip Optim 42(6):923–938

    Article  Google Scholar 

  • Zheng J, Shao X, Gao L, Jiang P, Li Z (2013) A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction. J Eng Des 24(8):604–622

    Article  Google Scholar 

  • Zheng J, Shao X, Gao L, Jiang P, Qiu H (2015) Difference mapping method using least square support vector regression for variable-fidelity metamodelling. Eng Optim 47(6):719–736

    Article  Google Scholar 

  • Ziehn T, Tomlin AS (2008) A global sensitivity study of sulfur chemistry in a premixed methane flame model using HDMR. In J Chem Kinet 40(11):742–753

    Article  Google Scholar 

Download references

Acknowledgements

Financial support from the National Natural Science Foundation of China under Grant No.51675198, 973 National Basic Research Program of China under Grant No 2014CB046705, and National Natural Science Foundation of China under Grant No. 51421062 are gratefully acknowledged.

Author information

Authors and Affiliations

  1. The State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, 1037 Luoyu Road, 430074, Wuhan, People’s Republic of China

    Xiwen Cai, Haobo Qiu, Liang Gao & Xinyu Shao

Authors
  1. Xiwen Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haobo Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liang Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xinyu Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haobo Qiu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cai, X., Qiu, H., Gao, L. et al. Metamodeling for high dimensional design problems by multi-fidelity simulations. Struct Multidisc Optim 56, 151–166 (2017). https://doi.org/10.1007/s00158-017-1655-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00158-017-1655-y

Keywords

Search

Navigation