Tracking Differential Evolution Algorithms: An Adaptive Approach through Multinomial Distribution Tracking with Exponential Forgetting

  • Michael G. Epitropakis
  • Dimirtis K. Tasoulis
  • Nicos G. Pavlidis
  • Vassilis P. Plagianakos
  • Michael N. Vrahatis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7297)


Several Differential Evolution variants with modified search dynamics have been recently proposed, to improve the performance of the method. This work borrows ideas from adaptive filter theory to develop an “online” algorithmic adaptation framework. The proposed framework is based on tracking the parameters of a multinomial distribution to reflect changes in the evolutionary process. As such, we design a multinomial distribution tracker to capture the successful evolution movements of three Differential Evolution algorithms, in an attempt to aggregate their characteristics and their search dynamics. Experimental results on ten benchmark functions and comparisons with five state-of-the-art algorithms indicate that the proposed framework is competitive and very promising.


Differential Evolution Adaptation Multinomial Distribution Exponential forgetting 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brest, J., Greiner, S., Boskovic, B., Mernik, M., Zumer, V.: Self-Adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. IEEE Transactions on Evolutionary Computation 10(6), 646–657 (2006)CrossRefGoogle Scholar
  2. 2.
    Das, S., Abraham, A., Chakraborty, U.K., Konar, A.: Differential evolution using a Neighborhood-Based mutation operator. IEEE Transactions on Evolutionary Computation 13(3), 526–553 (2009)CrossRefGoogle Scholar
  3. 3.
    Das, S., Suganthan, P.N.: Differential evolution: A survey of the state-of-the-art. IEEE Transactions on Evolutionary Computation 15(1), 4–31 (2011)CrossRefGoogle Scholar
  4. 4.
    Epitropakis, M.G., Tasoulis, D.K., Pavlidis, N.G., Plagianakos, V.P., Vrahatis, M.N.: Enhancing differential evolution utilizing proximity-based mutation operators. IEEE Transactions on Evolutionary Computation 15(1), 99–119 (2011)CrossRefGoogle Scholar
  5. 5.
    Gong, W., Fialho, Á., Cai, Z., Li, H.: Adaptive strategy selection in differential evolution for numerical optimization: An empirical study. Information Sciences 181(24), 5364–5386 (2011)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Lozano, M., Molina, D., Herrera, F.: Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems. Soft Computing - A Fusion of Foundations, Methodologies and Applications 15(11), 2085–2087 (2011)Google Scholar
  7. 7.
    Niedzwiecki, M.: Identification of Time-varying Processes. John Wiley & Sons, New York (2000)Google Scholar
  8. 8.
    Pavlidis, N.G., Tasoulis, D.K., Adams, N.M., Hand, D.J.: λ-perceptron: An adaptive classifier for data streams. Pattern Recognition 44(1), 78–96 (2011)zbMATHCrossRefGoogle Scholar
  9. 9.
    Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Natural Computing Series. Springer-Verlag New York, Inc., Secaucus (2005)zbMATHGoogle Scholar
  10. 10.
    Qin, A.K., Huang, V.L., Suganthan, P.N.: Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Transactions on Evolutionary Computation 13(2), 398–417 (2009)CrossRefGoogle Scholar
  11. 11.
    Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: Opposition-Based differential evolution. IEEE Transactions on Evolutionary Computation 12(1), 64–79 (2008)CrossRefGoogle Scholar
  12. 12.
    Storn, R., Price, K.: Differential evolution – a simple and efficient adaptive scheme for global optimization over continuous spaces. Journal of Global Optimization 11, 341–359 (1997)MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Tang, K., et al.: Benchmark functions for the CEC 2008 special session and competition on large scale global optimization. Tech. rep., Nature Inspired Computation and Applications Laboratory, USTC, China (2007)Google Scholar
  14. 14.
    Zhang, J., Sanderson, A.C.: JADE: adaptive differential evolution with optional external archive. IEEE Transactions on Evolutionary Computation 13(5), 945–958 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Michael G. Epitropakis
    • 1
  • Dimirtis K. Tasoulis
    • 2
  • Nicos G. Pavlidis
    • 3
  • Vassilis P. Plagianakos
    • 4
  • Michael N. Vrahatis
    • 1
  1. 1.Computational Intelligence Laboratory, Department of MathematicsUniversity of PatrasPatrasGreece
  2. 2.Winton Capital ManagementLondonU.K.
  3. 3.Department of Management ScienceLancaster UniversityU.K.
  4. 4.Department of Computer Science and Biomedical InformaticsUniversity of Central GreeceLamiaGreece

Personalised recommendations