Consensus-Based Global Optimization

  • Claudia Totzeck
Conference paper
Part of the Mathematics in Industry book series (MATHINDUSTRY, volume 26)


We discuss some algorithms for global optimization and opinion formation and their relation to consensus-based optimization (CBO). The proposed CBO algorithm allows to pass to the mean-field limit, resulting in a Fokker-Plank type equation with non-linear, non-local and degenerate drift and diffusion term. We shed some light on the prospects of justifying the efficacy of the CBO algorithm on the PDE level.



The author thanks J. A. Carrillo, Y. P. Choi, R. Pinnau, O. Tse and S. Martin for their constructive comments and suggestions. Moreover, she acknowledges financial support from the Nachwuchsring of the University of Kaiserslautern.


  1. 1.
    Ajmone Marsan, G., Bellomo, N., Gibelli, L.: Stochastic evolutionary differential games toward a systems theory of behavioral social dynamics. Math. Models Methods Appl. Sci. 26, 1051–1093 (2016)Google Scholar
  2. 2.
    Bolley, F., Cañizo, J.A., Carrillo, J.A.: Stochastic mean-field limit: non-lipschitz forces and swarming. Math. Models Methods Appl. Sci. 21, 2179–2210 (2011)Google Scholar
  3. 3.
    Boudin, L., Salvarani, F.: A kinetic approach to the study of opinion formation. ESAIM: Math. Modelling Numer. Anal. 43, 507–522 (2009)Google Scholar
  4. 4.
    Carrillo, J.A., Choi, Y.P., Totzeck, C., Tse O.: An analytical framework for a consensus-based global optimization method. Preprint at (2016)
  5. 5.
    Chatterjee, S., Seneta, E.: Towards consensus: some convergence theorems on repeated averaging. J. Appl. Probab. 14, 89–97 (1977)Google Scholar
  6. 6.
    Emara, H.M., Fattah, H.A.: Continuous swarm optimization technique with stability analysis. In: Proceedings of the American Control Conference, vol. 3, pp. 2811–2817 (2004)Google Scholar
  7. 7.
    French, P. Jr.: A formal theory of social power. Psychol. Rev. 63, 181–194 (1956)Google Scholar
  8. 8.
    Geman, S., Geman, D.: Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)Google Scholar
  9. 9.
    Ha, S.Y., Tadmor, E.: From particle to kinetic and hydrodynamic descriptions of flocking. Kinet. Relat. Models 1, 415–435 (2008)Google Scholar
  10. 10.
    Hegselmann, R., Krause, U.: Opinion dynamics and bounded confidence models, analysis, and simulation. J. Artif. Soc. Soc. Simul. 5(3), 1–33 (2002)Google Scholar
  11. 11.
    Karaboga, D., Gorkemli, B., Ozturk, C., Karaboga, N.: A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif. Intell. Rev. 41, 21–57 (2014)Google Scholar
  12. 12.
    Kennedy, J.: Particle swarm optimization. In: Encyclopedia of Machine Learning, pp. 760–766. Springer, Berlin (2011)Google Scholar
  13. 13.
    Kirkpatrick, S., Gelatt, C.D., Jr., Vecchi, M.P.: Optimization by simulated annealing, Science 220, pp. 671–680 (1983)Google Scholar
  14. 14.
    Locatelli, M., Schoen, F.: Global Optimization. Theory, Algorithms, and Applications. SIAM Series on Optimization. SIAM, Philadelphia (2013)Google Scholar
  15. 15.
    Mohan, B.C., Baskaran, R.: A survey: ant colony optimization based recent research and implementation on several engineering domain. Expert Syst. Appl. 39 4618–4627 (2012)Google Scholar
  16. 16.
    Naldi, G., Pareschi, L., Toscani, G.: Mathematical Modeling of Collective Behavior in Socio-Economic and Life Sciences. Springer Science & Businsess Media, New York (2010)Google Scholar
  17. 17.
    Pinnau, R., Totzeck, C., Tse, O., Martin, S.: A consensus-based model for global optimization and its mean-field limit. Math. Models Methods Appl. Sci. 27, 183 (2017)Google Scholar
  18. 18.
    Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization. In: Swarm Intelligence. Springer, Berlin (2007)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2017

Authors and Affiliations

  1. 1.TU KaiserslauternKaiserslauternGermany

Personalised recommendations