The interacting-particle algorithm with dynamic heating and cooling
We consider an interacting-particle algorithm which is population-based like genetic algorithms and also has a temperature parameter analogous to simulated annealing. The temperature parameter of the interacting-particle algorithm has to cool down to zero in order to achieve convergence towards global optima. The way this temperature parameter is tuned affects the performance of the search process and we implement a meta-control methodology that adapts the temperature to the observed state of the samplings. The main idea is to solve an optimal control problem where the heating/cooling rate of the temperature parameter is the control variable. The criterion of the optimal control problem consists of user defined performance measures for the probability density function of the particles’ locations including expected objective function value of the particles and the spread of the particles’ locations. Our numerical results indicate that with this control methodology the temperature fluctuates (both heating and cooling) during the progress of the algorithm to meet our performance measures. In addition our numerical comparison of the meta-control methodology with classical cooling schedules demonstrate the benefits in employing the meta-control methodology.
KeywordsInteracting-particle algorithm Meta-control Optimal control Global optimization Simulated annealing Cooling schedule
Unable to display preview. Download preview PDF.
- (2000). Nonlinear model predictive control. Progress in Systems and Control Theory, vol. 26. Birkhäuser Verlag, Basel Google Scholar
- Bertsekas D.P. (1995). Dynamic Programming and Optimal Control, vol. 1. Athena Scientific, Belmont Google Scholar
- Dunkl C.F. and Xu Y. (2001). Orthogonal Polynomials of Several Variables. Cambridge University Press, Cambridge Google Scholar
- Ingber L. (1996). Adaptive simulated annealing (asa): lessons learned. Control Cybern. 25: 22–54 Google Scholar
- Molvalioglu, O., Zabinsky, Z.B., Kohn, W.: Multi-particle simulated annealing. In: Törn, A., Zilinskas, J.(eds.) Models and Algorithms for Global Optimization. ptimization and its applications, vol. 4. Springer (2006)Google Scholar
- Molvalioglu, O., Zabinsky, Z.B., Kohn, W.: Meta-control of an Interacting-particle Algorithm for Global Optimization. Technical report, University of Washington (2007)Google Scholar
- Moral P.D. (2004). Feynman-Kac Formulae: Genological and Interacting Particle Systems with Applications. Springer-Verlag, New York Google Scholar
- Scott D. (1992). Multivariate Density Estimation: Theory, Practice and Visualization. Wiley, New York Google Scholar
- Srinivas M. and Patnaik L.M. (1994). Genetic algorithms: a survey. IEEE Comp. 27(6): 17–26 Google Scholar
- Zabinsky Z.B. (2003). Stochastic Adaptive Search for Global Optimization. Kluwer Academic Publishers, Boston Google Scholar