Abstract
A stochastic approach to solving unconstrained continuous-function global optimization problems is presented. It builds on the tunneling approach to deterministic optimization presented by Barhen and co-workers (Bahren and Protopopescu, in: State of the Art in Global Optimization, Kluwer, 1996; Barhen et al., Floudas and Pardalos (eds.), TRUST: a deterministic algorithm for global optimization, 1997) by combining a series of local descents with stochastic searches. The method uses a rejection-based stochastic procedure to locate new local minima descent regions and a fixed Lipschitz-like constant to reject unpromising regions in the search space, thereby increasing the efficiency of the tunneling process. The algorithm is easily implemented in low-dimensional problems and scales easily to large problems. It is less effective without further heuristics in these latter cases, however. Several improvements to the basic algorithm which make use of approximate estimates of the algorithms parameters for implementation in high-dimensional problems are also discussed. Benchmark results are presented, which show that the algorithm is competitive with the best previously reported global optimization techniques. A successful application of the approach to a large-scale seismology problem of substantial computational complexity using a low-dimensional approximation scheme is also reported.
Similar content being viewed by others
References
Aluffi-Pentini, F., Parisi, V. and Zirilli, F. (1985), ‘Global Optimization and Stochastic Differential Equations,’ Journal of Optimization Theory and Applications 47: 1.
Barhen, J. and Protopopescu, V. (1996), ‘Generalized TRUST Algorithm for Global Optimization,’ State of the Art in Global Optimization, C.A. Floudas and P.M. Pardalos eds., pp. 163-180. Kluwer.
Barhen, J., Protopopescu, V. and Reister, D. (1997), ‘TRUST: A Deterministic Algorithm for Global Optimization,’ 276: 1094-1097.
Barhen, J. Reister, D. Oblow, E. and DuBose, J. accepted for publication in Geophysics.
Baritompa, W. (1993), ‘Customizing Methods for Global Optimization-A Geometric Viewpoint,’ J. of Global Optimization 3: 193-212.
Cetin, B., Barhen, J. and Burdick, J. (1993), ‘Terminal Repeller Unconstrained Subenergy Tunneling (TRUST) for Fast Global Optimization,’ Journal of Optimization Theory and Applications 77: 97.
Cvijovic D. and Klinowski, J. (1995), ‘Taboo Search: An Approach to theMultiple Minima Problem,’ Science 267: 664.
DuBose, J. (1993), ‘Practical Steps Toward Realizing the Potential of Monte Carlo Automatic Statics,’ Geophysics, 58: 399.
Evtushenko, Yu.G. (1985), ‘Numerical Optimization Techniques,’ Optimization Software Inc., New York, p. 561.
Floudas, C.A. and Pardalos, P.M. (1996), State of the Art in Global Optimization: Computational Methods and Applications. Kluwer.
Horst R. and Pardalos, P.M. (1995), Handbook of Global Optimization Kluwer.
Horst, R., Pardalos, P.M. and Thoai, N.V. (1996), Introduction to Global Optimization. Kluwer.
Horst, R. and Tuy, H. (1993), Global Optimization, 2nd ed. Springer-Verlag.
Horst, R. and Tuy, H. (1993), Global Optimization, 2nd ed. Springer-Verlag.
Kan, A.H.G.R. and Timmer, G.T. (1985), ‘A Stochastic Approach to Global Optimization,’ in Numerical Optimization, eds. P. T. Boggs, R. H. Byrd, and R. B. Schnabel, pp. 245-262. SIAM.
Levy, A. and Montalvo, A. (1985), ‘The Tunneling Algorithm for the Global Minimization of Functions,’ SIAM Journal on Scientific and Statistical Computing 6: 15.
Mladineo, R.H. (1986), ‘An Algorithm for Finding the Global Maximum of a Multimodal, Multivariate Function,’ Mathematical Programming 34: 188-200.
Oblow, E.M. (1992), ‘Implementing Valiant's Learnability Theory Using Random Sets,’ Machine Learning 9: 45-73.
Pijavskij, S. (1972), ‘An Algorithm for Finding the Absolute Extremum of a Function,’ USSR Computational Mathematics and Mathematical Physics 12: 57-67.
Ratschek, H. and Rokne, J. (1988), New Computer Methods for Global Optimization Ellis Horwood.
Ratschek, H. and Rokne, J. (1988), New Computer Methods for Global Optimization Ellis Horwood.
Rothman, D. (1985), ‘Nonlinear Inversion, Statistical Mechanics and Residual Statics Estimation,’ Geophysics 50: 2784.
Schneider, G. Schuchhardt, J. and Wrede, P. (1996), ‘Evolutionary Optimization in Multimodal Search Space,’ Biological Cybernetics 74: 203.
Sen, M. and Stoffa, P.L. (1995), Global Optimization Methods in Geophysical Inversion Elsevier.
Shubert, B.O. (1972), ‘A Sequential Method Seeking the Global Extremum of a Function,’ SIAM Journal of Numerical Analysis 9: 379-388.
Stephens, C.P. and Baritompa, W. (1998), ‘Global Optimization Requires Global Information,’ J. of Global Optimization 96: 575-588.
Törn, A. and Zilinskas, A. (1989), Global Optimization pp. 66-67. Springer-Verlag.
Törn, A. and Zilinskas, A. (1989), Global Optimization pp. 30-38. Springer-Verlag.
Törn, A. and Zilinskas, A. (1989), Global Optimization Springer-Verlag.
Wood, G.R. (1992), ‘The Bisection Method in Higher Dimensions’, Mathematical Progrramming 55: 319-337.
Yilmaz, O. (1988), Seismic Data Processing, Society of Exploration Geophysicists Tulsa.
Yong, L., Lishan, K. and Evans, D.J. (1995), ‘The Annealing Evolution Algorithm as Function Optimizer,’ Parallel Computing 21: 389.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Oblow, E. SPT: a stochastic tunneling algorithm for global optimization. Journal of Global Optimization 20, 191–208 (2001). https://doi.org/10.1023/A:1011265010691
Issue Date:
DOI: https://doi.org/10.1023/A:1011265010691