Journal of Global Optimization

, Volume 19, Issue 3, pp 201–227 | Cite as

A Radial Basis Function Method for Global Optimization

  • H.-M. Gutmann


We introduce a method that aims to find the global minimum of a continuous nonconvex function on a compact subset of \(\mathbb{R}^d \). It is assumed that function evaluations are expensive and that no additional information is available. Radial basis function interpolation is used to define a utility function. The maximizer of this function is the next point where the objective function is evaluated. We show that, for most types of radial basis functions that are considered in this paper, convergence can be achieved without further assumptions on the objective function. Besides, it turns out that our method is closely related to a statistical global optimization method, the P-algorithm. A general framework for both methods is presented. Finally, a few numerical examples show that on the set of Dixon-Szegö test functions our method yields favourable results in comparison to other global optimization methods.

Global optimization radial basis functions interpolation P-algorithm 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alotto, P., Caiti, A., Molinari, G. and Repetto, M. (1996), A Multiquadrics-based Algorithm for the Acceleration of Simulated Annealing Optimization Procedures, IEEE Transactions on Magnetics 32(3): 1198-1201.Google Scholar
  2. 2.
    Dixon, L.C.W. and Szegö, G. (1978), The Global Optimization Problem: An Introduction, in: Dixon, L. and Szegö, G. (eds), Towards Global Optimization 2, North-Holland, Amsterdam, pp. 1-15.Google Scholar
  3. 3.
    Gutmann, H.-M. On the semi-norm of radial basis function interpolants, Report DAMTP2000/NA04, University of Cambridge.Google Scholar
  4. 4.
    Horst, R. and Pardalos, P.M. (1994), Handbook of Global Optimization, Kluwer, Dordrecht.Google Scholar
  5. 5.
    Huyer, W. and Neumaier, A. (1999), Global optimization by multilevel coordinate search, Journal of Global Optimization 14(4): 331-355.Google Scholar
  6. 6.
    Ishikawa, T. and Matsunami, M. (1997), An Optimization Method Based on Radial Basis Functions, IEEE Transactions on Magnetics 33(2): 1868-1871.Google Scholar
  7. 7.
    Ishikawa, T., Tsukui, Y. and Matsunami, M. (1999), A Combined Method for the Global Optimization Using Radial Basis Function and Deterministic Approach, IEEE Transactions on Magnetics 35(3): 1730-1733.Google Scholar
  8. 8.
    Jones, D.R. (1996), Global optimization with response surfaces, presented at the Fifth SIAM Conference on Optimization, Victoria, Canada.Google Scholar
  9. 9.
    Jones, D.R., Perttunen, C. and Stuckman, B.E. (1993), Lipschitz Optimization Without the Lipschitz Constant, Journal of Optimization Theory and Applications 78(1): 157-181.Google Scholar
  10. 10.
    Jones, D.R., Schonlau, M. and Welch,W.J. (1998), Efficient Global Optimization of Expensive Black-Box Functions, Journal of Global Optimization 13(4): 455-492.Google Scholar
  11. 11.
    Kushner, H.J. (1962), A Versatile Model of a Function of Unknown and Time Varying Form, Journal of Mathematical Analysis and Applications 5: 150-167.Google Scholar
  12. 12.
    Kushner, H.J. (1964), A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise, Journal of Basic Engineering 86: 97-106.Google Scholar
  13. 13.
    Levy, A.V. and Montalvo, A. (1985), The Tunneling Algorithm for the Global Minimization of Functions, SIAM Journal on Scientific and Statistical Computing 6(1): 15-29.Google Scholar
  14. 14.
    Powell, M.J.D. (1981), Approximation Theory and Methods, Cambridge University Press.Google Scholar
  15. 15.
    Powell, M.J.D. (1992), The Theory of Radial Basis Function Approximation in 1990, in: Light, W. (ed.), Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions, Oxford University Press, pp. 105-210.Google Scholar
  16. 16.
    Powell, M.J.D. (1999), Recent research at Cambridge on radial basis functions, in: M. Müller, M. Buhmann, D. Mache and M. Felten (eds), New Developments in Approximation Theory, International Series of Numerical Mathematics, Vol. 132, Birkhauser Verlag, Basel, pp. 215-232.Google Scholar
  17. 17.
    Schaback, R. (1993), Comparison of radial basis function interpolants, in: K. Jetter and F. Utreras (eds), Multivariate Approximations: From CAGD to Wavelets, World Scientific, Singapore, pp. 293-305.Google Scholar
  18. 18.
    Storn, R. and Price, K. (1997), Differential Evolution-A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces, Journal of Global Optimization 11(4): 341-359.Google Scholar
  19. 19.
    Törn, A. and Žilinskas, A. (1987), Global Optimization, Springer, Berlin.Google Scholar
  20. 20.
    Whitney, H. (1934), Analytic extension of differentiable functions defined in closed sets, Transactions of the American Mathematical Society 36: 63-89.Google Scholar
  21. 21.
    Žilinskas, A. (1982), Axiomatic Approach to Statistical Models and their Use in Multimodal Optimization Theory, Mathematical Programming 22(1): 104-116.Google Scholar
  22. 22.
    Žilinskas, A. (1985), Axiomatic Characterization of a Global Optimization Algorithm and Investigation of its Search Strategy, Operations Research Letters 4(1): 35-39.Google Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • H.-M. Gutmann
    • 1
  1. 1.Department of Applied Mathematics and Theoretical PhysicsUniversity of CambridgeCambridgeUK

Personalised recommendations