Bayesian stopping rules for multistart global optimization methods
- 345 Downloads
By far the most efficient methods for global optimization are based on starting a local optimization routine from an appropriate subset of uniformly distributed starting points. As the number of local optima is frequently unknown in advance, it is a crucial problem when to stop the sequence of sampling and searching. By viewing a set of observed minima as a sample from a generalized multinomial distribution whose cells correspond to the local optima of the objective function, we obtain the posterior distribution of the number of local optima and of the relative size of their regions of attraction. This information is used to construct sequential Bayesian stopping rules which find the optimal trade off between reliability and computational effort.
Key wordsGlobal optimization multistart methods clustering methods Bayesian stopping rules multinomial distribution
Unable to display preview. Download preview PDF.
- R.W. Becker and G.V. Lago, “A global optimization algorithm”, in:Proceedings of the 8th Allerton Conference on Circuits and System Theory (1970).Google Scholar
- H.C.P. Berbee, C.G.E. Boender, A.H.G. Rinnooy Kan, C.L. Scheffer, R.L. Smith and J. Telgen, “Hit-andrun algorithms for the identification of nonredundant linear inequalities” (1985), to appear inMathematical Programming.Google Scholar
- C.G.E. Boender and R. Zielinski, “A sequential Bayesian approach to estimating the dimension of multinomial distribution”, in: R. Zielinski, (ed.)Sequential Methods in Statistics (Banach Center Publications (vol. 16), PWN-Polish Scientific Publishers, Warsaw, 1982).Google Scholar
- C.G.E. Boender and A.H.G. Rinnooy Kan (1983b), “Bayesian multinomial estimation of animal population size”, Report 8322/0, Econometric Institute, Erasmus University (Rotterdam, 1983b).Google Scholar
- C.G.E. Boender “The generalized multinomial distribution: A Bayesian analysis and applications”, Ph.D. Thesis, Erasmus University, (Rotterdam, 1984).Google Scholar
- M.H. De Groot,Optimal Statistical Decisions (McGraw-Hill, New York, 1970).Google Scholar
- A.H.G. Rinnooy Kan and G.T. Timmer, “A stochastic approach to global optimization”, Report 8419/0, Econometric Institute, Erasmus University (Rotterdam, 1984).Google Scholar
- A.H.G. Rinnooy Kan and G.T. Timmer (1985), “Stochastic global optimization methods, Parts I & II”, Econometric Institute, Erasmus University (Rotterdam, 1985).Google Scholar
- G.T. Timmer, “Global optimization: A stochastic approach” Ph.D. Thesis, Erasmus University (Rotterdam, 1984).Google Scholar