An adaptive radial basis algorithm (ARBF) for expensive black-box mixed-integer constrained global optimization
- First Online:
- 253 Downloads
Response surface methods based on kriging and radial basis function (RBF) interpolation have been successfully applied to solve expensive, i.e. computationally costly, global black-box nonconvex optimization problems. In this paper we describe extensions of these methods to handle linear, nonlinear, and integer constraints. In particular, algorithms for standard RBF and the new adaptive RBF (ARBF) are described. Note, however, while the objective function may be expensive, we assume that any nonlinear constraints are either inexpensive or are incorporated into the objective function via penalty terms. Test results are presented on standard test problems, both nonconvex problems with linear and nonlinear constraints, and mixed-integer nonlinear problems (MINLP). Solvers in the TOMLAB Optimization Environment (http://tomopt.com/tomlab/) have been compared, specifically the three deterministic derivative-free solvers rbfSolve, ARBFMIP and EGO with three derivative-based mixed-integer nonlinear solvers, OQNLP, MINLPBB and MISQP, as well as the GENO solver implementing a stochastic genetic algorithm. Results show that the deterministic derivative-free methods compare well with the derivative-based ones, but the stochastic genetic algorithm solver is several orders of magnitude too slow for practical use. When the objective function for the test problems is costly to evaluate, the performance of the ARBF algorithm proves to be superior.
KeywordsGlobal optimization Radial basis functions Response surface model Surrogate model Expensive function CPU-intensive Optimization software Splines Mixed-integer nonlinear programming constraints
Radial basis function
Costly global optimization
Mixed-integer nonlinear programming
Unable to display preview. Download preview PDF.
- Gutmann H-M (1999) A radial basis function method for global optimization. Technical Report DAMTP 1999/NA22, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, England Google Scholar
- Gutmann H-M (2001b) Radial basis function methods for global optimization. Doctoral thesis, Department of Numerical Analysis, Cambridge University, Cambridge, UK Google Scholar
- Holmström K, Edvall MM (2004) The TOMLAB optimization environment. In: Kallrath LGJ (ed) Modeling languages in mathematical optimization. Boston Google Scholar
- Powell MJD (1992) The theory of radial basis function approximation in 1990. In: Light W (ed) Advances in numerical analysis, vol. 2: wavelets, subdivision algorithms and radial basis functions. Oxford University Press, Oxford, pp 105–210 Google Scholar
- Powell MJD (1999) Recent research at Cambridge on radial basis functions. In: Buhmann MD, Felten M, Mache D, Müller MW (eds) New developments in approximation theory. Birkhäuser, Basel, pp 215–232 Google Scholar