Skip to main content
SpringerLink
Log in

GAS-AU: an average uncertainty-based general adaptive sampling approach

  • Original Article
  • Published:
Engineering with Computers Aims and scope Submit manuscript

Abstract

Currently, surrogate models have been used in various fields due to their ability to save high computational cost of simulation. However, in practical engineering applications, the surrogate model constructed from the initial sample set may suffer from insufficient accuracy. Therefore, building a usable surrogate model usually requires further infilling with some new samples. The adaptive sampling can be produced new samples to gradually expand the dataset, thereby improving the accuracy of the initial model. Thus, this work develops a general adaptive sampling approach based on the average uncertainty. The new samples are generated at the point with the maximum value of the average uncertainty. Then, the initial model is updated until the updated model achieves acceptable accuracy. Six test functions and an engineering problem are employed to test the performance of the proposed approach. The results show that the proposed approach has higher priority than other approaches under the same number of added samples. Furthermore, the performance of the proposed approach is tested again by setting a stopping criterion. The proposed approach can satisfy the stopping criterion with the least number of iterations, meaning that this approach can save a lot of computational cost compared to other approaches. This work provides a reference for the design and optimization of engineering problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

The results provided in this paper are generated by MATLAB codes developed by the authors. The codes and data can be available upon request by contacting the corresponding author via email.

References

  1. Liu J, Yi J, Zhou Q (2022) A sequential multi-fidelity surrogate model-assisted contour prediction method for engineering problems with expensive simulations. Eng Comput 38:31–49

    Article  Google Scholar 

  2. Qian J, Yi J, Cheng Y (2020) A sequential constraints updating approach for Kriging surrogate model-assisted engineering optimization design problem. Eng Comput 36(3):993–1009

    Article  Google Scholar 

  3. Garud SS, Karimi IA, Kraft M (2017) Design of Computer Experiments: A Review. Comput Chem Eng 106:71–95

    Article  Google Scholar 

  4. Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808

    Article  Google Scholar 

  5. Mckay MD, Beckman RJ, Conover WJ (2000) A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code. Technometrics 42(1):55–61

    Article  Google Scholar 

  6. Gunst RF, Mason RL (2009) Fractional factorial design. Wiley Interdiscip Rev Comput Stat 1(2):234–244

    Article  Google Scholar 

  7. Johnson ME, Moore LM, Ylvisaker D (1990) Minimax and maximin distance designs. J Stat Plan Infer 26(2):131–148

    Article  MathSciNet  Google Scholar 

  8. Currin C, Mitchell T, Morris M (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc 86(416):953–963

    Article  MathSciNet  Google Scholar 

  9. Zhai Z, Li H, Wang X (2022) An adaptive sampling method for Kriging surrogate model with multiple outputs. Eng Comput 38:277–295

    Article  Google Scholar 

  10. Qiao P, Wu Y, Ding J (2021) A new sequential sampling method of surrogate models for design and optimization of dynamic systems. Mech Mach Theory 158:104248

    Article  Google Scholar 

  11. Novák L, Vořechovský M, Sadílek V (2021) Variance-based adaptive sequential sampling for Polynomial Chaos Expansion. Comput Method Appl M 386:114105

    Article  MathSciNet  Google Scholar 

  12. Li X, Han X, Chen Z (2022) A multi-constraint failure-pursuing sampling method for reliability-based design optimization using adaptive Kriging. Eng Comput 38:297–310

    Article  Google Scholar 

  13. Zhang Y, Kim NH, Haftka RT (2020) General-surrogate adaptive sampling using interquartile range for design space exploration. ASME J Mech Des 142(5):051402

    Article  Google Scholar 

  14. Kushner HJ (1964) A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise. J Fluid Eng 86(1):97–106

    Google Scholar 

  15. Forrester AIJ, Keane AJ (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79

    Article  Google Scholar 

  16. Cox DD, John S (1992) SDO: A Statistical Method for Global Optimization. IEEE International Conference on Systems, Man and Cybernetics, Vol. 2, Chicago, IL, Oct. 18–21, IEEE Xplore, pp 1241–1246

  17. Schonlau M, Welch WJ, Jones DR (1998) Global Versus Local Search in Constrained Optimization of Computer Models. New Developments and Applications in Experimental Design, N. Flournoy, W. F. Rosenberger, and W. K. Wong, eds., Institute of Mathematical Statistics, Hayward, CA, pp 11–25

  18. Viana FAC, Haftka RT, Steffen V (2009) Multiple surrogates: how cross-validation errors can help us to obtain the best predictor. Struct Multidiscip Optim 39(4):439–457

    Article  Google Scholar 

  19. Jin R, Chen W, Sudjitanto A (2002) On Sequential Sampling for Global Metamodeling in Engineering Design,” Det02: ASME 2002 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 2, Montreal, Quebec, Canada, Sept. 29–Oct. 2, pp. 539–548.

  20. Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on Voronoi diagram and cross validation. ASME J Mech Des 136(7):071009

    Article  Google Scholar 

  21. Lv LY, Shi ML, Song XG, Sun W, Zhang J (2020) A Fast-converging ensemble infilling approach balancing global exploration and local exploitation: the go-inspired hybrid infilling strategy. ASME J Mech Des 142(2):021403

    Article  Google Scholar 

  22. Kaminsky AL, Wang Y, Pant K (2021) An efficient batch k-fold cross-validation Voronoi adaptive sampling technique for global surrogate modeling. ASME J Mech Des 143(1):011706

    Article  Google Scholar 

  23. Mohammadi H, Challenor P, Williamson D (2022) Cross-validation–based adaptive sampling for Gaussian process models. SIAM/ASA J Uncertain 10(1):294–316

    Article  MathSciNet  Google Scholar 

  24. Le GL, Cannamela C (2015) Cokriging-based sequential design strategies using fast cross-validation techniques for multi-fidelity computer codes. Technometrics 57(3):418–427

    Article  MathSciNet  Google Scholar 

  25. Lam CQ (2008) Sequential adaptive designs in computer experiments for response surface model fit. The Ohio State University, Columbus, OH

    Google Scholar 

  26. Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory. Pittsburgh. ACM, 287–294

  27. Liu HT, Ong YS, Cai JF (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416

    Article  Google Scholar 

  28. Fuhg JN, Fau A, Nackenhorst U (2021) State-of-the-art and comparative review of adaptive sampling methods for kriging. Arch Comput Method E 28(4):2689–2747

    Article  MathSciNet  Google Scholar 

  29. Burbidge R, Rowland JJ, King RD (2007) Active learning for regression based on query by committee. In: International Conference on Intelligent Data Engineering and Automated Learning. Springer, pp 209–218

  30. Settles B (2009) Active Learning Literature Survey. Technical Report TR-1648. University of Wisconsin, Madison, Department of Computer Sciences

  31. Krogh A, Vedelsby J (1994) Neural network ensembles, cross validation, and active learning. In: Advances in Neural Information Processing Systems, pp 231–238

  32. Eason J, Cremaschi S (2014) Adaptive sequential sampling for surrogate model generation with artificial neural networks. Comput Chem Eng 68:220–232

    Article  Google Scholar 

  33. Gazut S, Martinez JM, Dreyfus G, Oussar Y (2008) Towards the optimal design of numerical experiments. IEEE Trans Neural Netw 19(5):874–882

    Article  Google Scholar 

  34. Acar E (2010) Various approaches for constructing an ensemble of metamodels using local measures. Struct Multidiscip Optim 42(6):879–896

    Article  Google Scholar 

  35. Hu J, Peng Y, Lin Q (2022) An ensemble weighted average conservative multi-fidelity surrogate modeling method for engineering optimization. Eng Comput 38:2221–2244

    Article  Google Scholar 

  36. Ferreira WG, Serpa AL (2016) Ensemble of metamodels: the augmented least squares approach. Struct Multidiscip Optim 53(5):1019–1046

    Article  Google Scholar 

  37. Arlot S, Celisse A (2010) A survey of cross-validation procedures for model selection. Stat Surv 4:40–79

    Article  MathSciNet  Google Scholar 

  38. Viana FAC (2010) SURROGATES Toolbox User’s Guide. Gainesville, FL

  39. Kuhnt S, Steinberg DM (2010) Design and analysis of computer experiments. AStA Adv Stat Anal 94(4):307–309

    Article  MathSciNet  Google Scholar 

  40. Forrester DAIJ, Sóbester DA, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide. Wiley, New York

    Book  Google Scholar 

Download references

Acknowledgements

This research is funded by the National Key Research and Development Program of China (No. 2018YFB1700704) and the National Natural Science Foundation of China (No. 52075068).

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Dalian University of Technology, Dalian, 116024, China

    Shuai Zhang, Pengwei Liang, Jianji Li & Xueguan Song

Authors
  1. Shuai Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pengwei Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jianji Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xueguan Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xueguan Song.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, S., Liang, P., Li, J. et al. GAS-AU: an average uncertainty-based general adaptive sampling approach. Engineering with Computers 40, 839–853 (2024). https://doi.org/10.1007/s00366-023-01824-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00366-023-01824-9

Keywords

Search

Navigation