Skip to main content

SPT: a stochastic tunneling algorithm for global optimization

Abstract

A stochastic approach to solving unconstrained continuous-function global optimization problems is presented. It builds on the tunneling approach to deterministic optimization presented by Barhen and co-workers (Bahren and Protopopescu, in: State of the Art in Global Optimization, Kluwer, 1996; Barhen et al., Floudas and Pardalos (eds.), TRUST: a deterministic algorithm for global optimization, 1997) by combining a series of local descents with stochastic searches. The method uses a rejection-based stochastic procedure to locate new local minima descent regions and a fixed Lipschitz-like constant to reject unpromising regions in the search space, thereby increasing the efficiency of the tunneling process. The algorithm is easily implemented in low-dimensional problems and scales easily to large problems. It is less effective without further heuristics in these latter cases, however. Several improvements to the basic algorithm which make use of approximate estimates of the algorithms parameters for implementation in high-dimensional problems are also discussed. Benchmark results are presented, which show that the algorithm is competitive with the best previously reported global optimization techniques. A successful application of the approach to a large-scale seismology problem of substantial computational complexity using a low-dimensional approximation scheme is also reported.

This is a preview of subscription content, access via your institution.

References

  • Aluffi-Pentini, F., Parisi, V. and Zirilli, F. (1985), ‘Global Optimization and Stochastic Differential Equations,’ Journal of Optimization Theory and Applications 47: 1.

    Google Scholar 

  • Barhen, J. and Protopopescu, V. (1996), ‘Generalized TRUST Algorithm for Global Optimization,’ State of the Art in Global Optimization, C.A. Floudas and P.M. Pardalos eds., pp. 163-180. Kluwer.

  • Barhen, J., Protopopescu, V. and Reister, D. (1997), ‘TRUST: A Deterministic Algorithm for Global Optimization,’ 276: 1094-1097.

    Google Scholar 

  • Barhen, J. Reister, D. Oblow, E. and DuBose, J. accepted for publication in Geophysics.

  • Baritompa, W. (1993), ‘Customizing Methods for Global Optimization-A Geometric Viewpoint,’ J. of Global Optimization 3: 193-212.

    Google Scholar 

  • Cetin, B., Barhen, J. and Burdick, J. (1993), ‘Terminal Repeller Unconstrained Subenergy Tunneling (TRUST) for Fast Global Optimization,’ Journal of Optimization Theory and Applications 77: 97.

    Google Scholar 

  • Cvijovic D. and Klinowski, J. (1995), ‘Taboo Search: An Approach to theMultiple Minima Problem,’ Science 267: 664.

    Google Scholar 

  • DuBose, J. (1993), ‘Practical Steps Toward Realizing the Potential of Monte Carlo Automatic Statics,’ Geophysics, 58: 399.

    Google Scholar 

  • Evtushenko, Yu.G. (1985), ‘Numerical Optimization Techniques,’ Optimization Software Inc., New York, p. 561.

  • Floudas, C.A. and Pardalos, P.M. (1996), State of the Art in Global Optimization: Computational Methods and Applications. Kluwer.

  • Horst R. and Pardalos, P.M. (1995), Handbook of Global Optimization Kluwer.

  • Horst, R., Pardalos, P.M. and Thoai, N.V. (1996), Introduction to Global Optimization. Kluwer.

  • Horst, R. and Tuy, H. (1993), Global Optimization, 2nd ed. Springer-Verlag.

  • Horst, R. and Tuy, H. (1993), Global Optimization, 2nd ed. Springer-Verlag.

  • Kan, A.H.G.R. and Timmer, G.T. (1985), ‘A Stochastic Approach to Global Optimization,’ in Numerical Optimization, eds. P. T. Boggs, R. H. Byrd, and R. B. Schnabel, pp. 245-262. SIAM.

  • Levy, A. and Montalvo, A. (1985), ‘The Tunneling Algorithm for the Global Minimization of Functions,’ SIAM Journal on Scientific and Statistical Computing 6: 15.

    Google Scholar 

  • Mladineo, R.H. (1986), ‘An Algorithm for Finding the Global Maximum of a Multimodal, Multivariate Function,’ Mathematical Programming 34: 188-200.

    Google Scholar 

  • Oblow, E.M. (1992), ‘Implementing Valiant's Learnability Theory Using Random Sets,’ Machine Learning 9: 45-73.

    Google Scholar 

  • Pijavskij, S. (1972), ‘An Algorithm for Finding the Absolute Extremum of a Function,’ USSR Computational Mathematics and Mathematical Physics 12: 57-67.

    Google Scholar 

  • Ratschek, H. and Rokne, J. (1988), New Computer Methods for Global Optimization Ellis Horwood.

  • Ratschek, H. and Rokne, J. (1988), New Computer Methods for Global Optimization Ellis Horwood.

  • Rothman, D. (1985), ‘Nonlinear Inversion, Statistical Mechanics and Residual Statics Estimation,’ Geophysics 50: 2784.

    Google Scholar 

  • Schneider, G. Schuchhardt, J. and Wrede, P. (1996), ‘Evolutionary Optimization in Multimodal Search Space,’ Biological Cybernetics 74: 203.

    Google Scholar 

  • Sen, M. and Stoffa, P.L. (1995), Global Optimization Methods in Geophysical Inversion Elsevier.

  • Shubert, B.O. (1972), ‘A Sequential Method Seeking the Global Extremum of a Function,’ SIAM Journal of Numerical Analysis 9: 379-388.

    Google Scholar 

  • Stephens, C.P. and Baritompa, W. (1998), ‘Global Optimization Requires Global Information,’ J. of Global Optimization 96: 575-588.

    Google Scholar 

  • Törn, A. and Zilinskas, A. (1989), Global Optimization pp. 66-67. Springer-Verlag.

  • Törn, A. and Zilinskas, A. (1989), Global Optimization pp. 30-38. Springer-Verlag.

  • Törn, A. and Zilinskas, A. (1989), Global Optimization Springer-Verlag.

  • Wood, G.R. (1992), ‘The Bisection Method in Higher Dimensions’, Mathematical Progrramming 55: 319-337.

    Google Scholar 

  • Yilmaz, O. (1988), Seismic Data Processing, Society of Exploration Geophysicists Tulsa.

  • Yong, L., Lishan, K. and Evans, D.J. (1995), ‘The Annealing Evolution Algorithm as Function Optimizer,’ Parallel Computing 21: 389.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Oblow, E. SPT: a stochastic tunneling algorithm for global optimization. Journal of Global Optimization 20, 191–208 (2001). https://doi.org/10.1023/A:1011265010691

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1011265010691

  • Global optimization
  • Tunneling
  • Stochastic
  • Pijavskij