Skip to main content
SpringerLink
Log in

Differential evolution algorithm with multiple mutation strategies based on roulette wheel selection

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In this paper, we propose a differential evolution (DE) algorithm variant with a combination of multiple mutation strategies based on roulette wheel selection, which we call MMRDE. We first propose a new, reflection-based mutation operation inspired by the reflection operations in the Nelder–Mead method. We design an experiment to compare its performance with seven mutation strategies, and we prove its effectiveness at balancing exploration and exploitation of DE. Although our reflection-based mutation strategy can balance exploration and exploitation of DE, it is still prone to premature convergence or evolutionary stagnation when solving complex multimodal optimization problems. Therefore, we add two basic strategies to help maintain population diversity and increase the robustness. We use roulette wheel selection to arrange mutation strategies based on their success rates for each individual. MMRDE is tested with some improved DE variants based on 28 benchmark functions for real-parameter optimization that have been recommended by the Institute of Electrical and Electronics Engineers CEC2013 special session. Experimental results indicate that the proposed algorithm shows its effectiveness at cooperative work with multiple strategies. It can obtain a good balance between exploration and exploitation. The proposed algorithm can guide the search for a global optimal solution with quick convergence compared with other improved DE variants.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://www.ntu.edu.sg/home/EPNSugan/index_files/CEC2013/CEC2013.htm

References

  1. Storn R, Price K (1997) Differential evolution – A simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  2. Chang CF et al (2007) Robust searching hybrid differential evolution method for optimal reactive power planning in large-scale distribution systems. Electr Power Syst Res 77(5-6):430–437

    Article  Google Scholar 

  3. Dragoi EN et al (2013) Optimization methodology based on neural networks and self-adaptive differential evolution algorithm applied to an aerobic fermentation process. Appl Soft Comput 13(1):222–238

    Article  Google Scholar 

  4. Iorio AW, Li X (2004) Solving rotated multi-objective optimization problems using differential evolution. AI 2004: Advances in Artificial Intelligence 3339:861–872

    MathSciNet  Google Scholar 

  5. Das S, Konar A, Chakraborty U K (2005) Two improved differential evolution schemes for faster global search. In: Genetic And Evolutionary Computation Conference, pp 991– 998

  6. Chakraborty UK, Das S, Konar A (2006) Differential Evolution with Local Neighborhood. In: 2006 IEEE International Conference on Evolutionary Computation 2042–2049

  7. Qin AK, Suganthan PN (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: 2005 IEEE Congress on Evolutionary Computation 2:1785–1791

  8. Brest J et al (2006) Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(5):646–657

    Article  Google Scholar 

  9. Zhang J, Sanderson A C (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Article  Google Scholar 

  10. Mallipeddi R et al (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696

    Article  Google Scholar 

  11. Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66

    Article  Google Scholar 

  12. Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: 2013 IEEE Congress on Evolutionary Computation 71–78

  13. Yi W et al (2015) A new differential evolution algorithm with a hybrid mutation operator and self-adapting control parameters for global optimization problems. Appl Intell 42(4):642–660

    Article  Google Scholar 

  14. Leon M, Xiong N (2016) Adapting differential evolution algorithms for continuous optimization via greedy adjustment of control parameters. J Artificial Intell Soft Comput Res 6(2):103–118

    Article  Google Scholar 

  15. Wu G et al (2016) Differential evolution with multi-population based ensemble of mutation strategies. Inf Sci 329(C):329– 345

    Article  Google Scholar 

  16. Leon M, Xiong N (2017) Alopex-based mutation strategy in differential evolution. In: 2017 IEEE Congress on Evolutionary Computation 1978–1984

  17. Ronkkonen J, Kukkonen S, Price KV (2005) Real-parameter optimization with differential evolution. In: 2005 IEEE Congress on Evolutionary Computation, vol 1, pp 506–513

  18. Price K, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization (natural computing series). Springer-Verlag, New York, pp 1–24

    MATH  Google Scholar 

  19. Jia D, Zheng G, Khurram Khan M (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187

    Article  Google Scholar 

  20. Ali MZ et al (2017) An Adaptive Multipopulation Differential Evolution with Dynamic Population Reduction. IEEE Trans Cybern 47(7):2768–2779

    Article  Google Scholar 

  21. Lampinen J (2002) A Fuzzy Adaptive Differential Evolution Algorithm. Soft Comput 9(5):448–462

    MATH  Google Scholar 

  22. Ghosh A et al (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765

    Article  MathSciNet  Google Scholar 

  23. Mezura-Montes E, Velazquez-Reyes J, Coello Coello CA (2006) A comparative study of differential evolution variants for global optimization. In: 8th Annual Genetic and Evolutionary Computation Conference 485–492

  24. Dorronsoro B, Bouvry P (2011) Improving classical and decentralized differential evolution with new mutation operator and population topologies. IEEE Trans Evol Comput 15(1):67–98

    Article  Google Scholar 

  25. Islam SM et al (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst Man Cybern B Cybern 42(2):482–500

    Article  Google Scholar 

  26. Mohamed AW (2015) An improved differential evolution algorithm with triangular mutation for global numerical optimization. Comput Ind Eng 85(C):359–375

    Article  Google Scholar 

  27. Wang S et al (2017) Self-adaptive differential evolution algorithm with improved mutation strategy. Soft Computing, pp 1–15. Springer Berlin Heidelberg. https://doi.org/10.1007/s00500-017-2588-5. Online ISSN: 1433-7479

  28. Piotrowski AP (2013) Adaptive memetic differential evolution with global and local neighborhood-based mutation operators. Inf Sci 241(10):164–194

    Article  Google Scholar 

  29. Gong W et al (2011) Adaptive strategy selection in differential evolution for numerical optimization: An empirical study. Inf Sci 181(24):5364–5386

    Article  MathSciNet  Google Scholar 

  30. Tasoulis DK, Plagianakos VP, Vrahatis MN (2005) Clustering in Evolutionary Algorithms to efficiently compute simultaneously local and global minima. In: 2005 IEEE Congress on Evolutionary Computation, vol 2, pp 1847–1854

  31. Epitropakis MG, Plagianakos VP, Vrahatis MN (2008) Balancing the exploration and exploitation capabilities of the differential evolution algorithm. In: 2008 IEEE Congress on Evolutionary Computation 2686–2693

  32. Ali MZ, Awad NH, Suganthan PN (2015) Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization. Appl Soft Comput 33(C):304–327

    Article  Google Scholar 

  33. Piotrowski AP, Napiorkowski JJ, Kiczko A (2012) Differential Evolution algorithm with Separated Groups for multi-dimensional optimization problems. Eur J Oper Res 216(1):33–46

    Article  MathSciNet  MATH  Google Scholar 

  34. Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417

    Article  Google Scholar 

  35. Das S et al (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Trans Evol Comput 13(3):526–553

    Article  Google Scholar 

  36. Pencheva T, Atanassov K, Shannon A (2009) Modelling of a roulette wheel selection operator in genetic algorithms using generalized nets. Int J Bio 13(4):101–105

    Google Scholar 

  37. Lipowski A, Lipowska D (2012) Roulette-wheel selection via stochastic acceptance. Physica A: Stat Mech Appl 391(5):2193–2196

    Article  Google Scholar 

  38. Ho-Huu V et al (2018) An improved differential evolution based on roulette wheel selection for shape and size optimization of truss structures with frequency constraints. Neural Comput Applic 29(1):167–185

    Article  MathSciNet  Google Scholar 

  39. Peng F et al (2009) Multi-start JADE with knowledge Transfer for numerical optimization. In: 2009 IEEE Congress on Evolutionary Computation 1889–1895

  40. Liang J et al (2013) Problem definitions and evaluation criteria for the CEC 2013 Special Session on Real-Parameter Optimization

  41. Alcala-Fdez J et al (2009) KEEL: A software tool to assess evolutionary algorithms for data mining problems. Soft Comput 13(3):307–318

    Article  Google Scholar 

Download references

Acknowledgments

We thank Miguel Leon (from the School of Innovation, Design and Engineering, Malardalen University) for his great help with this study. We greatly appreciate the reviewers for their thoughtful and encouraging comments on our manuscript, which we all think is helpful for improving the quality of our paper. This study was supported by program 2013KCT-15 of the Shanxi Provincial Key Innovative Research Team and the National Natural Science Foundation of China (51409206). We thank LetPub (www.letpub.com) for its linguistic assistance during the preparation of this manuscript.

Author information

Authors and Affiliations

  1. State Key Laboratory of Eco-hydraulics in Northwest Arid Region of China (Xi’an University of Technology), Xi’an, 710048, China

    Wuwen Qian, Junrui Chai, Zengguang Xu & Ziying Zhang

Authors
  1. Wuwen Qian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junrui Chai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zengguang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ziying Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wuwen Qian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qian, W., Chai, J., Xu, Z. et al. Differential evolution algorithm with multiple mutation strategies based on roulette wheel selection. Appl Intell 48, 3612–3629 (2018). https://doi.org/10.1007/s10489-018-1153-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-1153-y

Keywords

Search

Navigation