Bayesian Optimization Using Sequential Monte Carlo
We consider the problem of optimizing a real-valued continuous function f using a Bayesian approach, where the evaluations of f are chosen sequentially by combining prior information about f, which is described by a random process model, and past evaluation results. The main difficulty with this approach is to be able to compute the posterior distributions of quantities of interest which are used to choose evaluation points. In this article, we decide to use a Sequential Monte Carlo (SMC) approach.
KeywordsSequential Monte Carlo Expect Improvement Gaussian Process Model Reference Algorithm Bayesian Optimization
Unable to display preview. Download preview PDF.
- 1.Mockus, J., Tiesis, V., Zilinskas, A.: The application of Bayesian methods for seeking the extremum. In: Dixon, L., Szego, G. (eds.) Towards Global Optimization, vol. 2, pp. 117–129. Elsevier (1978)Google Scholar
- 2.Santner, T.J., Williams, B.J., Notz, W.I.: The design and analysis of computer experiments. Springer (2003)Google Scholar
- 6.Lizotte, D.J., Greiner, R., Schuurmans, D.: An experimental methodology for response surface optimization methods. J. Global Optim., 38 pages (2011)Google Scholar
- 7.Bardenet, R., Kégl, B.: Surrogating the surrogate: accelerating Gaussian-process-based global optimization with a mixture cross-entropy algorithm. In: ICML 2010, Proceedings, Haifa, Israel (2010)Google Scholar
- 10.Ginsbourger, D., Roustant, O.: DiceOptim: Kriging-based optimization for computer experiments, R package version 1.2 (2011)Google Scholar