Stochastic Models of Parallel Systems for Global Optimization

  • D. A. Dawson
Part of the The IMA Volumes in Mathematics and Its Applications book series (IMA, volume 9)


Random search methods provide a natural approach to the problem of finding a global extremum of a function which has many critical points. Recently some basic ideas of statistical physics have been exploited in the development of the “annealing algorithm” which has been successfully applied to certain combinatorial optimization problems. The objective of this paper is to consider an interacting particle system model of a many searcher system and to reformulate some simple ideas from statistical physics in this context.


Local Maximum Stochastic Differential Equation Global Maximum Interact Particle System Martingale Problem 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. E. Bonomi and J.L. Lutton (1984). The N-city travelling salesman problem: statistical mechanics and the Metropolis algorithm, SIAM Review 26, 551–568.MathSciNetMATHCrossRefGoogle Scholar
  2. M. Cassandro, A. Calves, E. Olivieri, M.E. Vares (1984). Metastable behavior of stochastic dynamics: a pathwise approach, J. Stat. Phys. 35, 603–634.MATHCrossRefGoogle Scholar
  3. F. Comets (1985). Tunnelling and nucleation for a local mean-field model, preprint.Google Scholar
  4. V. Černý (1982). A thermodynamical approach to the travelling salesman problem: an efficient simulation algorithm. Preprint, Institut of Physics and Biophysics, Comenius Univ., Bratislava.Google Scholar
  5. D. Dawson (1983). Critical dynamics and fluctuations for a mean-field model of cooperative behavior, J. Stat. Physics 31, 29–85.CrossRefGoogle Scholar
  6. D. Dawson (1985). Asymptotic analysis of multilevel stochastic systems, Lecture Notes in Control and Information Sciences 69, eds. M. Metivier and E. Pardoux, Springer-Verlag, 79–90.Google Scholar
  7. D. Dawson and J. Gärtner (1986). Large deviations from the McKean-Vlasov limit for weakly interacting diffusions, Stochastics, to appear.Google Scholar
  8. D. Dawson and J. Gärtner, in preparation.Google Scholar
  9. C.C. Y. Dorea (1986). Limiting distribution for random optimization methods, SIAM J. Control, Vol. 24, 76–82.MathSciNetMATHCrossRefGoogle Scholar
  10. M.I. Freidlin and A.D. Wentzell (1984). Random perturbations of Dynamical Systems, Springer-Verlag.Google Scholar
  11. A. Galves, E. Olivieri, M.E. Vares (1984). Metastability for a class of dynamical systems subject to small random perturbations, preprint, I. H.E.S., Bures-sur-Yvette, France.Google Scholar
  12. J. Gärtner (1985). Large deviations and tunnelling behavior of interacting particle systems, Abstract, Vilnius Conference.Google Scholar
  13. J. Gärtner (1985). On the McKean-Vlasov limit for interacting diffusions, preprint. S. Geman and C.R. Hwang (1985). Diffusions for global optimization, preprint.Google Scholar
  14. M. Hitsuda and I. Mitoma (1985). Tightness problem and stochastic evolution equation arising from fluctuation phenomena for interacting diffusions, to appear.Google Scholar
  15. S. Kirkpatrick, C.D. Gelatt and M.P. Vecchi (1983). Optimization by simulated annealing, Science 220, 671–680.MathSciNetMATHCrossRefGoogle Scholar
  16. C. Léonard (1985). Une loi des grandes nombres pour des systèmes de diffusions avec interactions et à coefficients non bornés, LRSP Tech Rep. 48, Ottawa.Google Scholar
  17. C. Léonard (1985). Large deviations and law of large numbers for a mean-field type infinite particle system, preprint.Google Scholar
  18. H.P. McKean (1969). Propagation of chaos for a class of nonlinear parabolic equations, in Lecture Series in Differential Equations, Vol. 2, 41–57, Van Nostrand Reinhold, New York.Google Scholar
  19. I. Mitoma (1985). An -dimensional inhomogeneous Langevin equation, J. Fncl. Anal. 60.Google Scholar
  20. K. Oëlschläger (1984). A martingale approach to the law of large numbers for weakly interacting stochastic processes, Ann. Prob. 12, 458–479.MATHCrossRefGoogle Scholar
  21. M. Shiino (1985). H-theorem and stability analysis for mean-field models of non-equilibrium phase transitions in Stochastic Systems, Physics Letters Vol.112A, nos. 6, 7, 302–306.MathSciNetGoogle Scholar
  22. Y. Tamura (1984). On the asymptotic behavior of the solution of a nonlinear diffusion equation, J. Fac. Sci. Univ. Tokyo, Sect. 1A, Math. 31, 195–221.MATHGoogle Scholar
  23. Y. Tamura (1985). On the asymptotic behavior of the distribution of a diffusion process of the McKean type, 15th SPA, Nagoya, Japan.Google Scholar
  24. H. Tanaka (1984). Limit theorems for certain diffusion processes with interaction, Proc. Taniguchi Symp. Katata and Kyoto, Japan, 1982, North Holland.Google Scholar

Copyright information

© Springer-Verlag New York Inc. 1987

Authors and Affiliations

  • D. A. Dawson
    • 1
  1. 1.Department of Mathematics & StatisticsCarleton UniversityOttawaCanada

Personalised recommendations