Evolutionary Dynamics of Extremal Optimization

  • Stefan Boettcher
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5851)


Dynamic features of the recently introduced extremal optimization heuristic are analyzed. Numerical studies of this evolutionary search heuristic show that it performs optimally at a transition between a jammed and an diffusive state. Using a simple, annealed model, some of the key features of extremal optimization are explained. In particular, it is verified that the dynamics of local search possesses a generic critical point under the variation of its sole parameter, separating phases of too greedy (non-ergodic, jammed) and too random (ergodic, diffusive) exploration. Analytic comparison with other local search methods, such as a fixed temperature Metropolis algorithm, within this model suggests that the existence of the critical point is the essential distinction leading to the optimal performance of the extremal optimization heuristic.


Local Search Spin Glass Spin Glass Model Extremal Optimization Local Search Process 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Boettcher, S., Percus, A.G.: Nature’s way of optimizing. Artificial Intelligence 119, 275 (2000)zbMATHCrossRefGoogle Scholar
  2. 2.
    Boettcher, S., Percus, A.G.: Optimization with extremal dynamics. Phys. Rev. Lett. 86, 5211–5214 (2001)CrossRefGoogle Scholar
  3. 3.
    Boettcher, S., Percus, A.G.: Extremal optimization: Methods derived from co-evolution. In: GECCO 1999: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 825–832. Morgan Kaufmann, San Francisco (1999)Google Scholar
  4. 4.
    Boettcher, S., Percus, A.G.: Extremal optimization for graph partitioning. Phys. Rev. E 64, 026114 (2001)Google Scholar
  5. 5.
    Boettcher, S., Percus, A.G.: Extremal optimization at the phase transition of the 3-coloring problem. Phys. Rev. E 69, 066703 (2004)Google Scholar
  6. 6.
    Hoos, H.H., Stützle, T.: Stochastic Local Search: Foundations and Applications. Morgan Kaufmann, San Francisco (2004)Google Scholar
  7. 7.
    Boettcher, S.: Numerical results for ground states of mean-field spin glasses at low connectivities. Phys. Rev. B 67, R060403 (2003)Google Scholar
  8. 8.
    Boettcher, S.: Extremal optimization for Sherrington-Kirkpatrick spin glasses. Eur. Phys. J. B 46, 501–505 (2005)CrossRefGoogle Scholar
  9. 9.
    Boettcher, S.: Extremal optimization and graph partitioning at the percolation threshold. J. Math. Phys. A: Math. Gen. 32, 5201–5211 (1999)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Dall, J., Sibani, P.: Faster Monte Carlo Simulations at Low Temperatures: The Waiting Time Method. Computer Physics Communication 141, 260–267 (2001)zbMATHCrossRefGoogle Scholar
  11. 11.
    Wang, J.S., Okabe, Y.: Comparison of Extremal Optimization with flat-histogram dynamics for finding spin-glass ground states. J. Phys. Soc. Jpn. 72, 1380 (2003)CrossRefGoogle Scholar
  12. 12.
    Wang, J.: Transition matrix Monte Carlo and flat-histogram algorithm. In: AIP Conf. Proc. 690: The Monte Carlo Method in the Physical Sciences, pp. 344–348 (2003)Google Scholar
  13. 13.
    Boettcher, S., Sibani, P.: Comparing extremal and thermal explorations of energy landscapes. Eur. Phys. J. B 44, 317–326 (2005)CrossRefGoogle Scholar
  14. 14.
    Boettcher, S., Frank, M.: Optimizing at the ergodic edge. Physica A 367, 220–230 (2006)CrossRefGoogle Scholar
  15. 15.
    Shmygelska, A.: An extremal optimization search method for the protein folding problem: the go-model example. In: GECCO 2007: Proceedings of the 2007 GECCO conference companion on Genetic and evolutionary computation, pp. 2572–2579. ACM, New York (2007)CrossRefGoogle Scholar
  16. 16.
    Mang, N.G., Zeng, C.: Reference energy extremal optimization: A stochastic search algorithm applied to computational protein design. J. Comp. Chem. 29, 1762–1771 (2008)CrossRefGoogle Scholar
  17. 17.
    Meshoul, S., Batouche, M.: Robust point correspondence for image registration using optimization with extremal dynamics. In: Van Gool, L. (ed.) DAGM 2002. LNCS, vol. 2449, pp. 330–337. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  18. 18.
    Meshoul, S., Batouche, M.: Ant colony system with extremal dynamics for point matching and pose estimation. In: 16th International Conference on Pattern Recognition (ICPR 2002), vol. 3, p. 30823 (2002)Google Scholar
  19. 19.
    Meshoul, S., Batouche, M.: Combining Extremal Optimization with singular value decomposition for effective point matching. Int. J. Pattern Rec. and AI 17, 1111–1126 (2003)CrossRefGoogle Scholar
  20. 20.
    Yom-Tov, E., Grossman, A., Inbar, G.F.: Movement-related potentials during the performance of a motor task i: The effect of learning and force. Biological Cybernatics 85, 395–399 (2001)CrossRefGoogle Scholar
  21. 21.
    Svenson, P.: Extremal Optimization for sensor report pre-processing. Proc. SPIE 5429, 162–171 (2004)CrossRefGoogle Scholar
  22. 22.
    de Sousa, F.L., Vlassov, V., Ramos, F.M.: Heat pipe design through generalized extremal optimization. Heat Transf. Eng. 25, 34–45 (2004)CrossRefGoogle Scholar
  23. 23.
    Zhou, T., Bai, W.J., Cheng, L.J., Wang, B.H.: Continuous Extremal Optimization for Lennard-Jones clusters. Phys. Rev. E 72, 016702 (2005)Google Scholar
  24. 24.
    Menai, M.E., Batouche, M.: Extremal Optimization for Max-SAT. In: Proceedings of the International Conference on Artificial Intelligence (ICAI), pp. 954–958 (2002)Google Scholar
  25. 25.
    Menai, M.E., Batouche, M.: Efficient initial solution to Extremal Optimization algorithm for weighted MAXSAT problem. In: Chung, P.W.H., Hinde, C.J., Ali, M. (eds.) IEA/AIE 2003. LNCS, vol. 2718, pp. 592–603. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  26. 26.
    Menai, M.E., Batouche, M.: A Bose-Einstein Extremal Optimization method for solving real-world instances of maximum satisfiablility. In: Proceedings of the International Conference on Artificial Intelligence (ICAI), pp. 257–262 (2003)Google Scholar
  27. 27.
    Duch, J., Arenas, A.: Community detection in complex networks using Extremal Optimization. Phys. Rev. E 72, 027104 (2005)Google Scholar
  28. 28.
    Danon, L., Diaz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. J. Stat. Mech.-Theo. Exp., P09008 (2005)Google Scholar
  29. 29.
    Neda, Z., Florian, R., Ravasz, M., Libal, A., Györgyi, G.: Phase transition in an optimal clusterization model. Physica A 362, 357–368 (2006)CrossRefGoogle Scholar
  30. 30.
    Onody, R.N., de Castro, P.A.: Optimization and self-organized criticality in a magnetic system. Physica A 322, 247–255 (2003)zbMATHCrossRefGoogle Scholar
  31. 31.
    Middleton, A.A.: Improved Extremal Optimization for the Ising spin glass. Phys. Rev. E 69, 055701(R) (2004)Google Scholar
  32. 32.
    Iwamatsu, M., Okabe, Y.: Basin hopping with occasional jumping. Chem. Phys. Lett. 399, 396–400 (2004); cond-mat/0410723CrossRefGoogle Scholar
  33. 33.
    de Sousa, F.L., Vlassov, V., Ramos, F.M.: Generalized Extremal Optimization for solving complex optimal design problems. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2723, pp. 375–376. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  34. 34.
    de Sousa, F.L., Ramos, F.M., Galski, R.L., Muraoka, I.: Generalized extremal optimization: A new meta-heuristic inspired by a model of natural evolution. Recent Developments in Biologically Inspired Computing (2004)Google Scholar
  35. 35.
    Heilmann, F., Hoffmann, K.H., Salamon, P.: Best possible probability distribution over Extremal Optimization ranks. Europhys. Lett. 66, 305–310 (2004)CrossRefGoogle Scholar
  36. 36.
    Hoffmann, K.H., Heilmann, F., Salamon, P.: Fitness threshold accepting over Extremal Optimization ranks. Phys. Rev. E 70, 046704 (2004)Google Scholar
  37. 37.
    Hartmann, A.K., Rieger, H.: New Optimization Algorithms in Physics. Wiley-VCH, Berlin (2004)zbMATHCrossRefGoogle Scholar
  38. 38.
    Kauffman, S.A., Johnsen, S.: Coevolution to the edge of chaos: Coupled fitness landscapes, poised states, and coevolutionary avalanches. J. Theor. Biol. 149, 467–505 (1991)CrossRefGoogle Scholar
  39. 39.
    Percus, A., Istrate, G., Moore, C.: Computational Complexity and Statistical Physics. Oxford University Press, New York (2006)zbMATHGoogle Scholar
  40. 40.
    Fischer, K.H., Hertz, J.A.: Spin Glasses. Cambridge University Press, Cambridge (1991)Google Scholar
  41. 41.
    Boettcher, S., Grigni, M.: Jamming model for the extremal optimization heuristic. J. Phys. A: Math. Gen. 35, 1109–1123 (2002)zbMATHCrossRefMathSciNetGoogle Scholar
  42. 42.
    Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by simulated annealing. Science 220, 671–680 (1983)CrossRefMathSciNetGoogle Scholar
  43. 43.
    Salamon, P., Sibani, P., Frost, R.: Facts, Conjectures, and Improvements for Simulated Annealing. Society for Industrial & Applied Mathematics (2002)Google Scholar
  44. 44.
    Palmer, R.G., Stein, D.L., Abraham, E., Anderson, P.W.: Models of hierarchically constrained dynamics for glassy relaxation. Phys. Rev. Lett. 53, 958–961 (1984)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Stefan Boettcher
    • 1
  1. 1.Physics DepartmentEmory UniversityAtlantaUSA

Personalised recommendations