Skip to main content
SpringerLink
Log in

Chaotic gaining sharing knowledge-based optimization algorithm: an improved metaheuristic algorithm for feature selection

  • Optimization
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The gaining sharing knowledge based optimization algorithm (GSK) is recently developed metaheuristic algorithm, which is based on how humans acquire and share knowledge during their life-time. This paper investigates a modified version of the GSK algorithm to find the best feature subsets. Firstly, it represents a binary variant of GSK algorithm by employing a probability estimation operator (Bi-GSK) on the two main pillars of GSK algorithm. And then, the chaotic maps are used to enhance the performance of the proposed algorithm. Ten different types of chaotic maps are considered to adapt the parameters of the GSK algorithm that make a proper balance between exploration and exploitation and save the algorithm from premature convergence. To check the performance of proposed approaches of GSK algorithm, twenty-one benchmark datasets are taken from the UCI repository for feature selection. The performance is measured by calculating different type of measures, and several metaheuristic algorithms are adopted to compare the obtained results. The results indicate that Chebyshev chaotic map shows the best result among all chaotic maps which improve the performance accuracy and convergence rate of the original algorithm. Moreover, it outperforms the other metaheuristic algorithms in terms of efficiency, fitness value and the minimum number of selected features.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Abedi M, Gharehchopogh FS (2020) An improved opposition based learning firefly algorithm with dragonfly algorithm for solving continuous optimization problems. Intell Data Anal 24(2):309–338

    Article  Google Scholar 

  • Agrawal P, Ganesh T, Mohamed AW (2020) A novel binary gaining–sharing knowledge-based optimization algorithm for feature selection. Neural Comput Appl pp 1–20

  • Agrawal P, Ganesh T, Mohamed AW (2021)Solving knapsack problems using a binary gaining sharing knowledge-based optimization algorithm. Complex Intell Syst pp 1–21

  • Ahmed S, Mafarja M, Faris H, Aljarah I (2018) Feature selection using salp swarm algorithm with chaos. In: Proceedings of the 2nd international conference on intelligent systems, metaheuristics and swarm intelligence, pp 65–69

  • Al-Tashi Q, Kadir SJA, Rais HM, Mirjalili S, Alhussian H (2019) Binary optimization using hybrid grey wolf optimization for feature selection. IEEE Access 7:39496–39508

    Article  Google Scholar 

  • Arora S, Anand P (2019) Chaotic grasshopper optimization algorithm for global optimization. Neural Comput Appl 31(8):4385–4405

    Article  Google Scholar 

  • Bharti KK, Singh PK (2016) Chaotic gradient artificial bee colony for text clustering. Soft Comput 20(3):1113–1126

    Article  Google Scholar 

  • Bing X, Mengjie Z, Will NB (2014) Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl Soft Comput 18:261–276

    Article  Google Scholar 

  • Chuang LY, Chang HW, Tu CJ, Yang CH (2008) Improved binary pso for feature selection using gene expression data. Comput Biol Chem 32(1):29–38

    Article  MATH  Google Scholar 

  • Chuang LY, Yang CH, Li JC (2011) Chaotic maps based on binary particle swarm optimization for feature selection. Appl Soft Comput 11(1):239–248

    Article  Google Scholar 

  • Coello CAC (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41(2):113–127

    Article  Google Scholar 

  • Dizaji ZA, Gharehchopogh FS (2015) A hybrid of ant colony optimization and chaos optimization algorithms approach for software cost estimation. Indian J Scie Technol 8(2):128

    Article  Google Scholar 

  • Emary E, Zawbaa HM (2016) Impact of chaos functions on modern swarm optimizers. PloS One 11(7):e0158738

    Article  Google Scholar 

  • Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65

    Article  Google Scholar 

  • Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381

    Article  Google Scholar 

  • Ewees AA, Abd El Aziz M, Hassanien AE (2019) Chaotic multi-verse optimizer-based feature selection. Neural Comput Appl 31(4):991–1006

    Article  Google Scholar 

  • Faris H, Mafarja MM, Heidari AA, Aljarah I, Ala’M AZ, Mirjalili S, Fujita H (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67

    Article  Google Scholar 

  • Frank A, Asuncion A, et al (2011) Uci machine learning repository, 2010. http://archive.ics.uci.edu/ml 15, 22

  • Gandomi AH, Yang XS, Alavi AH, Talatahari S (2013) Bat algorithm for constrained optimization tasks. Neural Comput Appl 22(6):1239–1255

    Article  Google Scholar 

  • Gao XZ, Wang X, Ovaska SJ, Xu H (2010) A modified harmony search method in constrained optimization. Int J Innov Comput Inf Control 6(9):4235–4247

    Google Scholar 

  • Gharehchopogh FS, Gholizadeh H (2019) A comprehensive survey: whale optimization algorithm and its applications. Swarm Evol Comput 48:1–24

    Article  Google Scholar 

  • Gharehchopogh FS, Maleki I, Dizaji ZA (2021) Chaotic vortex search algorithm: metaheuristic algorithm for feature selection. Evol Intell pp 1–32

  • Gharehchopogh FS, Shayanfar H, Gholizadeh H (2019) A comprehensive survey on symbiotic organisms search algorithms. Artif Intell Rev pp 1–48

  • Hafez AI, Zawbaa HM, Emary E, Hassanien AE (2016) Sine cosine optimization algorithm for feature selection. In: 2016 International symposium on innovations in intelligent systems and applications (INISTA), pp 1–5. IEEE

  • Hamidzadeh J, Namaei N (2019) Belief-based chaotic algorithm for support vector data description. Soft Comput 23(12):4289–4314

    Article  MATH  Google Scholar 

  • He Y, Zhou J, Li C, Yang J, Li Q (2008) A precise chaotic particle swarm optimization algorithm based on improved tent map. In: 2008 Fourth international conference on natural computation, vol 7, pp 569–573. IEEE

  • He Y, Zhou J, Lu N, Qin H, Lu Y (2010) Differential evolution algorithm combined with chaotic pattern search. Kybernetika 46(4):684–696

    MathSciNet  MATH  Google Scholar 

  • He YY, Zhou JZ, Xiang XQ, Chen H, Qin H (2009) Comparison of different chaotic maps in particle swarm optimization algorithm for long-term cascaded hydroelectric system scheduling. Chaos Solitons Fractals 42(5):3169–3176

    Article  MATH  Google Scholar 

  • Hekimoğlu B (2019) Optimal tuning of fractional order pid controller for dc motor speed control via chaotic atom search optimization algorithm. IEEE Access 7:38100–38114

    Article  Google Scholar 

  • Ibrahim RA, Abd Elaziz M, Lu S (2018) Chaotic opposition-based grey-wolf optimization algorithm based on differential evolution and disruption operator for global optimization. Expert Syst Appl 108:1–27

    Article  Google Scholar 

  • JIANG BLW (1998) Optimizing complex functions by chaos search. Cybern Syst 29(4):409–419

    Article  MATH  Google Scholar 

  • Kaveh A (2017) Chaos embedded metaheuristic algorithms. Advances in metaheuristic algorithms for optimal design of structures. Springer, Berlin, pp 375–398

    Chapter  MATH  Google Scholar 

  • Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95-international conference on neural networks, vol 4, pp.1942–1948. IEEE

  • Mafarja MM, Eleyan D, Jaber I, Hammouri A, Mirjalili S (2017) Binary dragonfly algorithm for feature selection. In: 2017 International conference on new trends in computing sciences (ICTCS), pp 12–17. IEEE

  • Mirjalili S (2015) The ant lion optimizer. Adv Eng Softw 83:80–98

    Article  Google Scholar 

  • Mirjalili S (2016) Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput Appl 27(4):1053–1073

    Article  MathSciNet  Google Scholar 

  • Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017) Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191

    Article  Google Scholar 

  • Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  • Mohamed AW, Hadi AA, Mohamed AK (2019) Gaining-sharing knowledge based algorithm for solving optimization problems: a novel nature-inspired algorithm. Int J Mach Learn Cybern pp 1–29

  • Mohammadzadeh H, Gharehchopogh FS (2021) A novel hybrid whale optimization algorithm with flower pollination algorithm for feature selection: Case study email spam detection. Comput Intell 37(1):176–209

    Article  MathSciNet  Google Scholar 

  • Mohmmadzadeh, H, Gharehchopogh, F.S(2021) An efficient binary chaotic symbiotic organisms search algorithm approaches for feature selection problems. J Supercomput pp 1–43

  • Nakamura RY, Pereira LA, Costa KA, Rodrigues D, Papa JP, Yang XS (2012) Bba: a binary bat algorithm for feature selection. In: 2012 25th SIBGRAPI conference on graphics, patterns and images, pp 291–297. IEEE

  • Oliva D, Abd Elaziz M (2020) An improved brainstorm optimization using chaotic opposite-based learning with disruption operator for global optimization and feature selection. Soft Comput pp 1–22

  • Pham TT, Luo J, Hong TP, Vo B (2014) An efficient method for mining non-redundant sequential rules using attributed prefix-trees. Eng Appl Artif Intell 32:88–99

    Article  Google Scholar 

  • Rahnema N, Gharehchopogh FS (2020) An improved artificial bee colony algorithm based on whale optimization algorithm for data clustering. Multimed Tools Appl 79(43):32169–32194

    Article  Google Scholar 

  • Rao RV, Savsani V, Balic J (2012) Teaching-learning-based optimization algorithm for unconstrained and constrained real-parameter optimization problems. Eng Optim 44(12):1447–1462

    Article  Google Scholar 

  • Rashedi E, Nezamabadi-Pour H, Saryazdi S (2010) Bgsa: binary gravitational search algorithm. Nat Comput 9(3):727–745

    Article  MathSciNet  MATH  Google Scholar 

  • Salesi S, Cosma G(2017) A novel extended binary cuckoo search algorithm for feature selection. In: 2017 2nd international conference on knowledge engineering and applications (ICKEA), pp 6–12. IEEE

  • Saremi S, Mirjalili S, Lewis A (2014) Biogeography-based optimisation with chaos. Neural Comput Appl 25(5):1077–1097

    Article  Google Scholar 

  • Sayed GI, Hassanien AE, Azar AT (2019) Feature selection via a novel chaotic crow search algorithm. Neural Comput Appl 31(1):171–188

    Article  Google Scholar 

  • Sayed GI, Khoriba G, Haggag MH (2018) A novel chaotic salp swarm algorithm for global optimization and feature selection. Appl Intell 48(10):3462–3481

    Article  Google Scholar 

  • Sayed GI, Tharwat A, Hassanien AE (2019) Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection. Appl Intell 49(1):188–205

    Article  Google Scholar 

  • Sharafi Y, Khanesar MA, Teshnehlab M (2013) Discrete binary cat swarm optimization algorithm. In: 2013 3rd IEEE international conference on computer, control and communication (IC4), pp 1–6. IEEE

  • Singh AP, Kaur A, Pal SK(2020) A novel chaotic flower pollination-based intrusion detection framework. Soft Comput pp 1–19

  • Sivanandam S, Deepa S (2007) Principles of soft computing (with CD). John Wiley and Sons, New Jersey

    Google Scholar 

  • Storn, R(1996) On the usage of differential evolution for function optimization. In: Proceedings of North American fuzzy information processing, pp 519–523. IEEE

  • Tang R, Fong S, Dey N (2018) Metaheuristics and chaos theory. Chaos Theory pp 182–196

  • Tavazoei MS, Haeri M (2007) Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms. Appl Math Comput 187(2):1076–1085

    MathSciNet  MATH  Google Scholar 

  • Too J, Abdullah AR(2020) Chaotic atom search optimization for feature selection. Arab J Sci Eng pp 1–17

  • Too J, Abdullah AR, Mohd Saad N, Mohd Ali N (2018) Feature selection based on binary tree growth algorithm for the classification of myoelectric signals. Machines 6(4):65

    Article  Google Scholar 

  • Wang GG, Deb S, Gandomi AH, Zhang Z, Alavi AH (2016) Chaotic cuckoo search. Soft Comput 20(9):3349–3362

    Article  Google Scholar 

  • Wang GG, Guo L, Gandomi AH, Hao GS, Wang H (2014) Chaotic krill herd algorithm. Inf Sci 274:17–34

    Article  MathSciNet  Google Scholar 

  • Wang L, Fu X, Mao Y, Menhas MI, Fei M (2012) A novel modified binary differential evolution algorithm and its applications. Neurocomputing 98:55–75

    Article  Google Scholar 

  • Wang M, Wan Y, Ye Z, Gao X, Lai X (2018) A band selection method for airborne hyperspectral image based on chaotic binary coded gravitational search algorithm. Neurocomputing 273:57–67

    Article  Google Scholar 

  • Yang D, Li G, Cheng G (2007) On the efficiency of chaos optimization algorithms for global optimization. Chaos Solitons Fractals 34(4):1366–1375

    Article  MathSciNet  Google Scholar 

  • Yang XS, Gandomi AH (2012) Bat algorithm: a novel approach for global engineering optimization. Engineering computations

  • Yuan X, Wang Y, Wu L (2007) Pattern search algorithm using chaos and its application. J Hunan Univ Nat Sci 34(9):30–33

    MATH  Google Scholar 

  • Zawbaa HM, Emary E, Grosan C (2016) Feature selection via chaotic antlion optimization. PloS One 11(3):e0150652

    Article  Google Scholar 

  • Zhang L, Mistry K, Lim CP, Neoh SC (2018) Feature selection using firefly optimization for classification and regression models. Decis Support Syst 106:64–85

    Article  Google Scholar 

  • Zhang L, Zhang C (2008) Hopf bifurcation analysis of some hyperchaotic systems with time-delay controllers. Kybernetika 44(1):35–42

    MathSciNet  MATH  Google Scholar 

  • Zhang, X, Cao, Y (2014) A novel chaotic map and an improved chaos-based image encryption scheme. Sci World J

  • Zhang X, Xu Y, Yu C, Heidari AA, Li S, Chen H, Li C (2020) Gaussian mutational chaotic fruit fly-built optimization and feature selection. Expert Syst Appl 141:112976

    Article  Google Scholar 

  • Zhu Z, Li S, Yu H (2008) A new approach to generalized chaos synchronization based on the stability of the error system. Kybernetika 44(4):492–500

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the Editors and anonymous reviewers for providing their valuable comments and suggestions.

Author information

Authors and Affiliations

  1. Department of Mathematics and Scientific Computing, National Institute of Technology Hamirpur, 177005, Himachal Pradesh, India

    Prachi Agrawal & Talari Ganesh

  2. Operations Research Department, Faculty of Graduate Studies for Statistical Research Cairo University, 12613, Giza, Egypt

    Ali Wagdy Mohamed

  3. Wireless Intelligent Networks Center (WINC), School of Engineering and Applied Sciences Nile University, Giza, Egypt

    Ali Wagdy Mohamed

Authors
  1. Prachi Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Talari Ganesh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ali Wagdy Mohamed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Wagdy Mohamed.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Agrawal, P., Ganesh, T. & Mohamed, A.W. Chaotic gaining sharing knowledge-based optimization algorithm: an improved metaheuristic algorithm for feature selection. Soft Comput 25, 9505–9528 (2021). https://doi.org/10.1007/s00500-021-05874-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-021-05874-3

Keywords

Search

Navigation