Skip to main content
Log in

An effective gradient and geometry enhanced sequential sampling approach for Kriging modeling

  • Research Paper
  • Published:
Structural and Multidisciplinary Optimization Aims and scope Submit manuscript

Abstract

Surrogates have been widely used for replacing computationally costly computer simulations. To improve the prediction accuracy with less sampling cost, sequential sampling is often used to seek targeted training samples for surrogate modeling. Previous methods often integrate gradient information to improve the sampling effect, but the increase of prediction accuracy is still limited for complicated problems. It is intractable how to better exploit the useful gradient information to sample potential highly nonlinear regions. In this paper, an effective gradient and geometry enhanced Kriging sequential sampling approach is proposed to handle this problem. First, a novel improvement function, which combines the approximate gradient and prediction variance, is constructed to measure the improvement of a candidate sampling point. Second, the design domain is partitioned into multiple Voronoi subdomains according to design points, and an adaptive and efficient cross-validation-based criterion is introduced to determine the candidate sampling regions and reduce the optimization cost. Finally, the improvement function is maximized in the selected Voronoi subdomains to sample a new point, which can effectively achieve great accuracy improvement in the nonlinear area. The proposed approach is tested on several highly nonlinear functions and an application-related example, and the experimental results confirm its effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Aute V, Saleh K, Abdelaziz O, Azarm S, Radermacher R (2013) Cross-validation based single response adaptive design of experiments for kriging metamodeling of deterministic computer simulations. Struct Multidiscip Optim 48(3):581–605

    Article  Google Scholar 

  • Beck J, Guillas S (2016) Sequential design with mutual information for computer experiments (mice): emulation of a tsunami model. SIAM/ASA J Uncertain Quantif 4(1):739–766

    Article  MathSciNet  Google Scholar 

  • Ben Salem M, Roustant O, Gamboa F, Tomaso L (2017) Universal prediction distribution for surrogate models. SIAM/ASA J Uncertain Quantif 5(1):1086–1109

    Article  MathSciNet  Google Scholar 

  • Bouhlel MA, Hwang JT, Bartoli N, Lafage R, Morlier J, Martins JRRA (2019) A python surrogate modeling framework with derivatives. Adv Eng Softw pp 102662

  • Busby D (2009) Hierarchical adaptive experimental design for gaussian process emulators. Reliab Eng Syst Saf 94(7):1183–1193

    Article  Google Scholar 

  • Crombecq K, Gorissen D, Deschrijver D, Dhaene T (2011) A novel hybrid sequential design strategy for global surrogate modeling of computer experiments. SIAM J Sci Comput 33(4):1948–1974

    Article  MathSciNet  Google Scholar 

  • Dubrule O (1983) Cross validation of kriging in a unique neighborhood. J Int Assoc Math Geol 15(6):687–699

    Article  MathSciNet  Google Scholar 

  • Gorissen D, De Tommasi L, Crombecq K, Dhaene T (2009) Sequential modeling of a low noise amplifier with neural networks and active learning. Neural Comput Appl 18(5):485–494

    Article  Google Scholar 

  • Handcock MS, Stein ML (1993) A Bayesian analysis of kriging. Technometrics 35(4):403–410

    Article  Google Scholar 

  • Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In: 2002 ASME international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers Digital Collection, pp 539–548

  • Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492

    Article  MathSciNet  Google Scholar 

  • Kaminsky AL, Wang Y, Pant K, Hashii WN, Atachbarian A (2018) Adaptive sampling techniques for surrogate modeling to create high-dimension aerodynamic loading response surfaces. In: 2018 applied aerodynamics conference, p 4199

  • Lam CQ (2008) Sequential adaptive designs in computer experiments for response surface model fit. PhD thesis The Ohio State University, Columbus

  • Li G, Aute V, Azarm S (2010) An accumulative error based adaptive design of experiments for offline metamodeling. Struct Multidiscip Optim 40(1-6):137

    Article  Google Scholar 

  • Lin Y, Mistree F, Allen JK, Tsui KL, Chen VC (2004) A sequential exploratory experimental design method: development of appropriate empirical models in design. In: ASME 2004 international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers Digital Collection, pp 1021–1035

  • Liu H, Xu S, Ma Y, Chen X, Wang X (2016) An adaptive bayesian sequential sampling approach for global metamodeling. J Mech Des 138(1):011404

    Article  Google Scholar 

  • Liu H, Cai J, Ong YS (2017) An adaptive sampling approach for kriging metamodeling by maximizing expected prediction error. Comput Chem Eng 106:171–182

    Article  Google Scholar 

  • Liu H, Ong YS, Cai J (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416

    Article  Google Scholar 

  • Lophaven SN, Nielsen HB, Søndergaard J (2002) Dace–a matlab kriging toolbox–version 2.0. Tech. rep., Technical University of Denmark

  • Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808

    Article  Google Scholar 

  • Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060

    Article  Google Scholar 

  • Mu R, Dai L, Xu J (2017) Sequential design for response surface model fit in computer experiments using derivative information. Commun Stat-Simul Comput 46(2):1148–1155

    Article  MathSciNet  Google Scholar 

  • Romero DA, Marin VE, Amon CH (2015) Error metrics and the sequential refinement of kriging metamodels. J Mech Des 137(1)

  • Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423

    MathSciNet  MATH  Google Scholar 

  • Santner TJ, Williams BJ, Notz W, Williams BJ (2018) The design and analysis of computer experiments. Springer Series in Statistics, Springer, New York

    Book  Google Scholar 

  • Sasena M, Papalambros PY, Goovaerts P (2002) Exploration of metamodeling sampling criteria for constrained global optimization. Eng Optim 34(3):263–278

    Article  Google Scholar 

  • Schöbi R, Sudret B, Wiart J (2015) Polynomial-chaos-based kriging. Int J Uncertain Quantif 5(2):171–193

    Article  MathSciNet  Google Scholar 

  • van der Herten J, Couckuyt I, Deschrijver D, Dhaene T (2015) A fuzzy hybrid sequential design strategy for global surrogate modeling of high-dimensional computer experiments. SIAM J Sci Comput 37(2):A1020–A1039

    Article  MathSciNet  Google Scholar 

  • Viana FAC (2011) SURROGATES toolbox user’s guide. Gainesville, FL Version 3.0. https://sites.google.com/site/srgtstoolbox/

  • Viana FAC, Simpson TW, Balabanov V, Toropov V (2014) Metamodeling in multidisciplinary design optimization: how far have we really come? AIAA J 52(4):670–690

    Article  Google Scholar 

  • Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on voronoi diagram and cross validation. J Mech Des 136(7):071009

    Article  Google Scholar 

  • Yao W, Chen X, Zhao Y, Tooren MV (2012) Concurrent subspace width optimization method for rbf neural network modeling. IEEE Trans Neural Netw Learn Syst 23(2):247–259

    Article  Google Scholar 

  • Yao W, Chen X, Huang Y, van Tooren M (2014) A surrogate-based optimization method with rbf neural network enhanced by linear interpolation and hybrid infill strategy. Optim Methods Softw 29 (2):406–429

    Article  MathSciNet  Google Scholar 

  • Zhang Y, Kim NH, Park C, Haftka RT (2018) Multifidelity surrogate based on single linear regression. AIAA J 56(12):4944–4952

    Article  Google Scholar 

  • Zhang Y, Neelakantan A, Park C, Kim NH, Lam H, Haftka RT (2019a) Adaptive sampling with varying sampling cost for design space exploration. AIAA J 57(3):1032–1043

    Article  Google Scholar 

  • Zhang Y, Yao W, Ye S, Chen X (2019b) A regularization method for constructing trend function in kriging model. Struct Multidiscip Optim 59(4):1221–1239

    Article  Google Scholar 

  • Zhang Y, Yao W, Chen X, Ye S (2020) A penalized blind likelihood kriging method for surrogate modeling. Struct Multidiscip Optim 61(2):457–474

    Article  MathSciNet  Google Scholar 

Download references

Funding

This work is supported by the National Natural Science Foundation of China (Nos. 11725211 and 51675525).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yi Zhang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Responsible Editor: Shapour Azarm

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Replication of results

The codes are made available as Supplementary material.

Supplementary Information

Below is the link to the electronic supplementary material.

(RAR 797 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, X., Zhang, Y., Zhou, W. et al. An effective gradient and geometry enhanced sequential sampling approach for Kriging modeling. Struct Multidisc Optim 64, 3423–3438 (2021). https://doi.org/10.1007/s00158-021-03016-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00158-021-03016-9

Keywords

Navigation