Abstract
Approximation methods are often used to construct surrogate models, which can replace expensive computer simulations for the purposes of optimization. One of the most important aspects of such optimization techniques is the choice of model updating strategy. In this paper we employ parallel updates by searching an expected improvement surface generated from a radial basis function model. We look at optimization based on standard and gradient-enhanced models. Given Np processors, the best Np local maxima of the expected improvement surface are highlighted and further runs are performed on these designs. To test these ideas, simple analytic functions and a finite element model of a simple structure are analysed and various approaches compared.
Similar content being viewed by others
References
Chung, H.S.; Alonso, J.J. 2001: Using gradients to construct response surface models for high-dimensional design optimization problems. AIAA 39th Aerosp. Sci. Meeting and Exhibit, Reno, NV, January 8–11, 2001, AIAA-2001-0922
Chung, H.S.; Alonso, J.J. 2002: Design of a low-boom supersonic business jet using cokriging approximation models. 9th AIAA/ISSMO Symp. Multidisc. Anal. Optim., Atlanta, GA, September 4–6, 2002, AIAA-2002-5598
Gibbs, M.N. 1997: Bayesian Gaussian Processes for Regression and Classification. PhD Thesis, University of Cambridge
Haftka, R. 1993: Semi-analytical static non-linear structural sensitivity analysis. AIAA J31, 1307–1312
Jones, D.R. 2001: A taxonomy of global optimization methods based on response surfaces. J Global Optim21, 345–383
Jones, D.R.; Schonlau, M.; Welch, W.J. 1998: Efficient global optimization of expensive black-box functions. J Global Optim13, 455–492
Leary, S.J.; Bhaskar, A.; Keane, A.J. (to appear): A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J Global Optim (to appear)
Mackay, M.D; Beckman, R.J.; Conover, W.J. 1979: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics21, 239–245
Martin, J.D.; Simpson, T.W. 2002: Use of adaptive metamodelling for design optimization. 9th AIAA/ISSMO Symp. Multidisc. Anal. Optim., Atlanta, GA, September 4–6, 2002, AIAA-2002-5631
Morris, M.D.; Mitchell, T.J. 1995: Exploratory designs for computer experiments. J Stat Plan Infer43, 381–402
Morris, M.D.; Mitchell, T.J.; Ylvisaker, D. 1993: Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction. Technometrics35, 243–255
Myers, R.H.; Montgomery, D.C. 1995: Response surface methodology: Process and product optimization using designed experiments New York: Wiley
Powell, M.J.D. 1987: Radial basis functions for multivariable interpolation: a review, In Algorithms for Approximation Oxford: Clarendon, 143–167
Sacks, J.; Welch, W.J.; Mitchell, T.J.; Wynn, H.P. 1989: Design and analysis of computer experiments (with discussion). Stat Sci4, 409–435
Sasena, M.J.; Papalambros, P.; Goovaerts, P. 2002: Exploration of metamodelling sampling criteria for constrained global optimization. Eng Optim34, 263–278
Schonlau, M. 1997: Computer Experiments and Global Optimization. PhD Thesis, University of Waterloo, Canada
Sobol, I.M. 1979: On the systematic search in a hypercube. SIAM J Numer Anal16, 790–793
Trosset, M.W.; Torczon, V. 1997: Numerical Optimization Using Computer Experiments. ICASE Report TR-97-38, NASA Langley Research Center, Hampton, Virginia
van Keulen, F.; Vervenne, K. 2002: Gradient-enhanced response surface building. 9th AIAA/ISSMO Symp. Multidisc. Anal. Optimiz., Atlanta, GA, September 4–6, 2002, AIAA-2002-5455
White, H.; Gallant, A.R.; Kornik, K.; Stinchcombe, M.; Wooldridge, J. 1992: Artificial neural networks: Approximation and learning theory Blackwell publishers
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sóbester, A., Leary, S. & Keane , A. A parallel updating scheme for approximating and optimizing high fidelity computer simulations. Struct Multidisc Optim 27, 371–383 (2004). https://doi.org/10.1007/s00158-004-0397-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-004-0397-9