Abstract
Striking the correct balance between global exploration of search spaces and local exploitation of promising basins of attraction is one of the principal concerns in the design of global optimization algorithms. This is true in the case of techniques based on global response surface approximation models as well. After constructing such a model using some initial database of designs it is far from obvious how to select further points to examine so that the appropriate mix of exploration and exploitation is achieved. In this paper we propose a selection criterion based on the expected improvement measure, which allows relatively precise control of the scope of the search. We investigate its behavior through a set of artificial test functions and two structural optimization problems. We also look at another aspect of setting up search heuristics of this type: the choice of the size of the database that the initial approximation is built upon.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
D.H. Ackley (1987) A Connectionist Machine for Genetic Hillclimbing Kluwer Academic Publishers Boston
Audet, C., Dennis, J.E., Moore, D.W., Booker, A. and Frank P.D. (2000), A surrogate-model-based method for constrained optimization, In: 8th Proceedings of the AIAA/NASA/USAF/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Long Beach, CA.
M. Björkman K. Holström (1999) ArticleTitleGlobal optimization using the DIRECT algorithm in Matlab Advanced Modeling and Optimization 1 IssueID2 17–28
Dixon, L.C.W. and Szegö, G. (1978), The Global optimization problem: an introduction, In Dixon, L.C.W. and Szego, G. (EDS.), Towards Global Optimization, North Holland, Amsterdam, 2, pp. 1–15.
A.V. Fiacco G.P. McCormick (1968) Nonlinear Programming: Sequential Unconstrained Minimization Techniques Wiley New York
Gibbs, M.N. (1997), Bayesian Gaussian Processes for Regression and Classification, PhD thesis, University of Cambridge.
H.M. Gutmann (2001) ArticleTitleA radial basis function method for global optimization Journal of Global Optimization 19 IssueID3 201–227 Occurrence Handle10.1023/A:1011255519438
D.R. Jones (2001) ArticleTitleA taxonomy of global optimization methods based on response surfaces Journal of Global Optimization 21 345–383 Occurrence Handle10.1023/A:1012771025575
D.R. Jones M. Schonlau W.J. Welch (1998) ArticleTitleEfficient global optimization of expensive black-box functions Journal of Global Optimization 13 455–492 Occurrence Handle10.1023/A:1008306431147
A.J. Keane (1995) ArticleTitlePassive vibration control via unusual geometries: the application of genetic algorithm optimization to structural design Journal of Sound and Vibrations 185 IssueID3 441–453 Occurrence Handle10.1006/jsvi.1995.0391
A.J. Keane A.P. Bright (1996) ArticleTitlePassive vibration control via unusual geometries: experiments on model aerospace structures Journal of Sound and Vibrations 190 IssueID4 713–719 Occurrence Handle10.1006/jsvi.1996.0086
M.D. Mackay R.J. Beckman W.J. Conover (1979) ArticleTitleA comparison of three methods for selecting values of input variables in the analysis of output from a computer code Technometrics 21 239–245
Mockus, J., Tiesis, V. and Zilinskas, A. (1978), The application of bayesian methods for seeking the extremum, Towards Global Optimization, North Holland, Amsterdam, 2, 117–129.
D. Montgomery (2000) Design and Analysis of Experiments, 5th edn Wiley New York
Renton, J.D. (1999), Elastic Beams and Frames, Camford Books.
M.J. Sasena P. Papalambros P. Goovaerts (2002) ArticleTitleExploration of metamodeling sampling criteria for constrained global optimization Engineering Optimization 34 263–278 Occurrence Handle10.1080/03052150211751
Schonlau, M. (1997), Computer Experiments and Global Optimization, PhD thesis, University of Waterloo, Canada.
A. Sóbester S.J. Leary A.J. Keane (2004) ArticleTitleA parallel updating scheme for approximating and optimizing high fidelity computer simulations Structural and Multidisciplinary Optimization 27 371–383
I.M. Sobol (1979) ArticleTitleOn the systematic search in a hypercube SIAM Journal of Numerical Analysis 16 790–793 Occurrence Handle10.1137/0716058
Trosset, M.W. and Torczon V. (1997), Numerical optimization using computer experiments, technical report TR-97-38, ICASE, NASA Langley Research Center, Hampton, Virginia.
A.G. Watson R.J. Barnes (1995) ArticleTitleInfill sampling criteria to locate extremes Mathematical Geology 27 IssueID5 589–608 Occurrence Handle10.1007/BF02093902
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sóbester, A., Leary, S.J. & Keane, A.J. On the Design of Optimization Strategies Based on Global Response Surface Approximation Models. J Glob Optim 33, 31–59 (2005). https://doi.org/10.1007/s10898-004-6733-1
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10898-004-6733-1