Skip to main content
SpringerLink
Log in

Ensemble of differential evolution and gaining–sharing knowledge with exchange of individuals chosen based on fitness and lifetime

  • Optimization
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Real-parameter single objective optimization has been studied for decades. In recent, a new setting is applied in this field based on the consideration that solving difficulty scales exponentially with the increase in dimensionality. Under the new setting, differential evolution (DE) still outstands in performance as before. Meanwhile, a new type of population-based metaheuristic—gaining–sharing knowledge-based algorithm, becomes a dark horse. Furthermore, ensemble of the above two types of algorithm is proposed in the literature. Although such ensemble shows good performance, provided that a more reasonable scheme is used for the communication between the constituent algorithms, better ensemble can be obtained. We believe that the new scheme should be with adaptiveness. In this paper, we propose an adaptive scheme for the communication. According to the scheme, individuals chosen based on fitness and lifetime are exchanged. In fact, in the field of DE, it is rare to consider lifetime of individual. However, lifetime is no less important than fitness in our scheme. In our experiment, our ensemble is compared with seven state-of-the-art algorithms. According to experimental results, our ensemble is comparable to one of the peers and better than the other ones.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

The data and materials of our work have been given in the manuscript.

Code Availability

We will upload our code as soon as our manuscript is accepted.

References

  • Adnan RM, Mostafa RR, Kisi O, Yaseen ZM, Shahid S, Zounemat-Kermani M (2021) Improving streamflow prediction using a new hybrid elm model combined with hybrid particle swarm optimization and grey wolf optimization. Knowl Based Syst 230:107379

    Article  Google Scholar 

  • Adnan RM, Mostafa RR, Elbeltagi A, Yaseen ZM, Shahid S, Kisi O (2022a) Development of new machine learning model for streamflow prediction: case studies in Pakistan. Stoch Environ Res Risk Assess 36:1–35

  • Adnan RM, Kisi O, Mostafa RR, Ahmed AN, El-Shafie A (2022b) The potential of a novel support vector machine trained with modified mayfly optimization algorithm for streamflow prediction. Hydrol Sci J 67(2):161–174

  • Agushaka JO, Chinwokwo C, Yakmut DI (2022a) An intelligent crime management system for lafia metropolis. FUDMA J Sci 6(3):138–150

  • Agushaka JO, Ezugwu AE, Olaide ON, Akinola O, Zitar RA, Abualigah L (2022b) Improved dwarf mongoose optimization for constrained engineering design problems. J Bionic Eng 20:1–33

  • Agushaka JO, Akinola O, Ezugwu AE, Oyelade ON, Saha AK (2022c) Advanced dwarf mongoose optimization for solving CEC 2011 and CEC 2017 benchmark problems. PLoS One 17(11):0275346

  • Agushaka JO, Ezugwu AE, Abualigah L, Alharbi SK, Khalifa HAE-W (2022d) Efficient initialization methods for population-based metaheuristic algorithms: a comparative study. Arch Comput Methods Eng 30:1–61

  • Agushaka JO, Ezugwu AE, Abualigah L (2022e) Gazelle optimization algorithm: a novel nature-inspired metaheuristic optimizer. Neural Comput Appl 35:1–33

  • Ahmadi M, Taghavirashidizadeh A, Javaheri D, Masoumian A, Ghoushchi SJ, Pourasad Y (2022) DQRE-SCnet: a novel hybrid approach for selecting users in federated learning with deep-q-reinforcement learning based on spectral clustering. J King Saud Univ Comput Inf Sci 34(9):7445–7458

    Google Scholar 

  • Biedrzycki R, Arabas J, Warchulski E (2022) A version of NL-SHADE-RSP algorithm with midpoint for CEC 2022 single objective bound constrained problems. In: 2022 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657

    Article  Google Scholar 

  • Brest J, Maučec MS, Bošković B (2017) Single objective real-parameter optimization: Algorithm jSO. In: Proceedings of CEC, IEEE, pp 1311–1318

  • Brest J, Maučec MS, Bošković B (2019) The 100-digit challenge: algorithm jde100. In: 2019 IEEE congress on evolutionary computation (CEC), IEEE, pp 19–26

  • Brest J, Maučec, MS, Bošković B (2020) Differential evolution algorithm for single objective bound-constrained optimization: Algorithm j2020. In: 2020 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Brest J, Maučec MS, Bošković B (2021) Self-adaptive differential evolution algorithm with population size reduction for single objective bound-constrained optimization: Algorithm j21. In: 2021 IEEE congress on evolutionary computation (CEC), IEEE, pp 817–824

  • Bujok P and Kolenovsky P (2022) Eigen crossover in cooperative model of evolutionary algorithms applied to CEC 2022 single objective numerical optimisation. In: 2022 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Bujok P, Tvrdík J (2017) Enhanced individual-dependent differential evolution with population size adaptation. In: 2017 IEEE congress on evolutionary computation (CEC), IEEE, pp 1358–1365

  • Bujok P, Zamuda A (2019) Cooperative model of evolutionary algorithms applied to cec 2019 single objective numerical optimization. In: 2019 IEEE congress on evolutionary computation (CEC), IEEE, pp 366–371

  • Elsayed S, Hamza N, Sarker R (2016) Testing united multi-operator evolutionary algorithms-II on single objective optimization problems. In: Proceedings of CEC, IEEE, pp 2966–2973

  • Hansen N, Ostermeier A (1996) Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In: Proceedings of IEEE international conference on evolutionary computation, IEEE, pp 312–317

  • Hansen N, Müller SD, Koumoutsakos P (2003) Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol Comput 11(1):1–18

    Article  Google Scholar 

  • Ikram RMA, Dai H-L, Ewees AA, Shiri J, Kisi O, Zounemat-Kermani M (2022) Application of improved version of multi verse optimizer algorithm for modeling solar radiation. Energy Rep 8:12063–12080

    Article  Google Scholar 

  • Ikram RMA, Dai H-L, Al-Bahrani M, Mamlooki M (2022) Prediction of the FRP reinforced concrete beam shear capacity by using ELM-CRFOA. Measurement 205:112230

    Article  Google Scholar 

  • Ikram RMA, Ewees AA, Parmar KS, Yaseen ZM, Shahid S, Kisi O (2022) The viability of extended marine predators algorithm-based artificial neural networks for streamflow prediction. Appl Soft Comput 131:109739

    Article  Google Scholar 

  • Ke C, Weng NT, Yang Y, Yang ZM, Sumari P, Abualigah L, Kamel S, Ahmadi M, Al-Qaness MA, Forestiero A (2022) Mango varieties classification-based optimization with transfer learning and deep learning approaches. In: Classification applications with deep learning and machine learning technologies, Springer, pp 45–65

  • Mohamed AW, Hadi AA, Mohamed AK, Awad NH (2020) Evaluating the performance of adaptive gaining sharing knowledge based algorithm on CEC 2020 benchmark problems. In: 2020 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Mohamed AW, Hadi AA, Mohamed AK (2020) Gaining-sharing knowledge based algorithm for solving optimization problems: a novel nature-inspired algorithm. Int J Mach Learn Cybern 11(7):1501–1529

    Article  Google Scholar 

  • Mohamed AW, Hadi AA, Agrawal P, Sallam KM, Mohamed AK (2021) Gaining-sharing knowledge based algorithm with adaptive parameters hybrid with imode algorithm for solving CEC 2021 benchmark problems. In: 2021 IEEE congress on evolutionary computation (CEC), IEEE, pp 841–848

  • Pant M, Zaheer H, Garcia-Hernandez L, Abraham A (2020) Differential evolution: a review of more than two decades of research. Eng Appl Artif Intell 90:103479

    Article  Google Scholar 

  • Rajeena PP, Orban R, Vadivel KS, Subramanian M, Muthusamy S, Elminaam DSA, Nabil A, Abulaigh L, Ahmadi M, Ali MA (2022) A novel method for the classification of butterfly species using pre-trained CNN models. Electronics 11(13):2016

    Article  Google Scholar 

  • Sallam KM, Elsayed SM, Chakrabortty RK, Ryan MJ (2020) Improved multi-operator differential evolution algorithm for solving unconstrained problems. In: 2020 IEEE congress on evolutionary computation (CEC), IEEE, pp 1–8

  • Sharifi A, Ahmadi M, Mehni MA, Jafarzadeh Ghoushchi S, Pourasad Y (2021) Experimental and numerical diagnosis of fatigue foot using convolutional neural network. Comput Methods Biomech Biomed Eng 24(16):1828–1840

    Article  Google Scholar 

  • Stanovov V, Akhmedova S, Semenkin E (2018) LSHADE algorithm with rank-based selective pressure strategy for solving CEC 2017 benchmark problems. In: Proceedings of CEC, IEEE, pp 1–8

  • Stanovov V, Akhmedova S, Semenkin E (2021) NL-SHADE-RSP algorithm with adaptive archive and selective pressure for CEC 2021 numerical optimization. In: 2021 IEEE congress on evolutionary computation (CEC), IEEE, pp 809–816

  • Stanovov V, Akhmedova S, Semenkin E (2022) NL-SHADE-LBC algorithm with linear parameter adaptation bias change for CEC 2022 numerical optimization. In: 2022 IEEE congress on evolutionary computation (CEC), IEEE, pp 01–08

  • Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  • Sun G, Yang B, Yang Z, Xu G (2020) An adaptive differential evolution with combined strategy for global numerical optimization. Soft Comput 24(9):6277–6296

    Article  Google Scholar 

  • Tan Z, Li K (2021) Differential evolution with mixed mutation strategy based on deep reinforcement learning. Appl Soft Comput 111:107678

    Article  Google Scholar 

  • Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. In: Proceedings of CEC, IEEE, pp 1658–1665

  • Wang Y, Li H-X, Huang T, Li L (2014) Differential evolution based on covariance matrix learning and bimodal distribution parameter setting. Appl Soft Comput 18:232–247

    Article  Google Scholar 

  • Wang X, Li C, Zhu J, Meng Q (2021) L-shade-e: ensemble of two differential evolution algorithms originating from l-shade. Inf Sci 552:201–219

    Article  MathSciNet  Google Scholar 

  • Xia X, Gui L, Zhang Y, Xu X, Yu F, Wu H, Wei B, He G, Li Y, Li K (2021) A fitness-based adaptive differential evolution algorithm. Inf Sci 549:116–141

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans. on Evo. Comput. 13(5):945–958

    Article  Google Scholar 

Download references

Funding

None.

Author information

Authors and Affiliations

  1. School of Computer Science, China University of Geosciences, Jincheng Road, Wuhan, 430078, Hubei, China

    Xuanyu Zhu, Chenxi Ye, Hongbo Zhu, Tingzi Chi & Jinghan Hu

  2. School of Mechanical Electronic and Electronic Information, China University of Geosciences, Lumo Road, Wuhan, 430074, Hubei, China

    Luqi He

Authors
  1. Xuanyu Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chenxi Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luqi He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongbo Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tingzi Chi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jinghan Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Xuanyu Zhu realized algorithm. Chenxi Ye executed experiment. Luqi He and Hongbo Zhu wrote the manuscript. Tingzi Chi and Jinghan Hu revised the manuscript.

Corresponding author

Correspondence to Xuanyu Zhu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Consent to participate

All authors consent to participate this work.

Consent for publication

All authors consent to have the work published.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, X., Ye, C., He, L. et al. Ensemble of differential evolution and gaining–sharing knowledge with exchange of individuals chosen based on fitness and lifetime. Soft Comput 27, 14953–14968 (2023). https://doi.org/10.1007/s00500-023-08580-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-08580-4

Keywords

Search

Navigation