Statistical learning makes the hybridization of particle swarm and differential evolution more efficient—A novel hybrid optimizer



This brief paper reports a hybrid algorithm we developed recently to solve the global optimization problems of multimodal functions, by combining the advantages of two powerful population-based metaheuristics—differential evolution (DE) and particle swarm optimization (PSO). In the hybrid denoted by DEPSO, each individual in one generation chooses its evolution method, DE or PSO, in a statistical learning way. The choice depends on the relative success ratio of the two methods in a previous learning period. The proposed DEPSO is compared with its PSO and DE parents, two advanced DE variants one of which is suggested by the originators of DE, two advanced PSO variants one of which is acknowledged as a recent standard by PSO community, and also a previous DEPSO. Benchmark tests demonstrate that the DEPSO is more competent for the global optimization of multimodal functions due to its high optimization quality.


global optimization statistical learning differential evolution particle swarm optimization hybridization multimodal functions 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Clerc M, Kennedy J. The particle swarm: explosion, stability and convergence in a multi-dimensional complex space. IEEE Trans Evol Comput, 2002, 6(1): 58–73CrossRefGoogle Scholar
  2. 2.
    Price K, Storn R M, Lampinen J A. Differential Evolution: a Practical Approach to Global optimization (Natural Computing Series). New York: Springer, 2005MATHGoogle Scholar
  3. 3.
    Kennedy J, Mendes R. Population structure and particle swarm performance. In: Proceedings of the W-orld Congress on Co- mputational Intelligence, Honolulu, HI, USA, 2002. 1671–1676Google Scholar
  4. 4.
    Chen J, Xin B, Peng Z H, et al. Optimal contraction theorem for exploration-exploitation tradeoff in search and optimization. IEEE Trans Syst Man Cybern-Part A: Syst & Human, 2009, 39(3): 680–691CrossRefGoogle Scholar
  5. 5.
    Eiben A E, Hinterding R, Michalewicz Z. Parameter control in evolutionary algorithms. IEEE Trans Evol Comput, 1999, 3(2): 124–141CrossRefGoogle Scholar
  6. 6.
    Brest J, Greiner S, Boskovic B, et al. Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. IEEE Trans Evol Comput, 2006, 10(6): 646–657CrossRefGoogle Scholar
  7. 7.
    Liang J J, Qin A K, Suganthan P N, et al. Comprehensive learning particle swarm optimizer for global optimization of multimodal funcions. IEEE Trans Evol Comput, 2006, 10(3): 281–295CrossRefGoogle Scholar
  8. 8.
    Zhang W J, Xie X F. DEPSO: Hybrid particle swarm with differential evolution operator. In: Proceedings of IEEE International Conference on System, Man, Cybernetics, Washington, DC, USA, 2003. 3816–3821Google Scholar

Copyright information

© Science in China Press and Springer-Verlag GmbH 2009

Authors and Affiliations

  1. 1.School of Automatic ControlBeijing Institute of TechnologyBeijingChina
  2. 2.Key Laboratory of Complex System Intelligent Control and DecisionMinistry of EducationBeijingChina

Personalised recommendations