Skip to main content
SpringerLink
Log in

Embedded chaotic whale survival algorithm for filter–wrapper feature selection

  • Foundations
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Classification accuracy provided by a machine learning model depends a lot on the feature set used in the learning process. Feature selection (FS) is an important and challenging preprocessing technique which helps to identify only the relevant features from a dataset, thereby reducing the feature dimension as well as improving the classification accuracy at the same time. The binary version of whale optimization algorithm (WOA) is a popular FS technique which is inspired from the foraging behavior of humpback whales. In this paper, an embedded version of WOA called embedded chaotic whale survival algorithm (ECWSA) has been proposed which uses its wrapper process to achieve high classification accuracy and a filter approach to further refine the selected subset with low computation cost. Chaos has been introduced in the ECWSA to guide selection of the type of movement followed by the whales while searching for prey. A fitness-dependent death mechanism has also been introduced in the system of whales which is inspired from the real-life scenario in which whales die if they are unable to catch their prey. The proposed method has been evaluated on 18 well-known UCI datasets and compared with its predecessors as well as some other popular FS methods. The source code of ECWSA can be found in https://github.com/Ritam-Guha/ECWSA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Ahmed S, Mafarja M, Faris H, Aljarah I (2018) Feature selection using salp swarm algorithm with chaos. In: Proceedings of the 2nd international conference on intelligent systems, metaheuristics and swarm intelligence, pp 65–69

  • Alatas B, Akin E, Ozer AB (2009) Chaos embedded particle swarm optimization algorithms. Chaos, Solitons Fractals 40(4):1715–1734

    MathSciNet  MATH  Google Scholar 

  • Aljarah I, Faris H, Mirjalili S (2018) Optimizing connection weights in neural networks using the whale optimization algorithm. Soft Comput 22(1):1–15

    Google Scholar 

  • Al-Tashi Q, Kadir SJA, Rais HM, Mirjalili S, Alhussian H (2019) Binary optimization using hybrid grey wolf optimization for feature selection. IEEE Access 7:39496–39508

    Google Scholar 

  • Basiri ME, Nemati S (2009) A novel hybrid ACO-GA algorithm for text feature selection, pp 2561–2568

  • Biesiada J, Duch W (2007) Feature selection for high-dimensional data: a Pearson redundancy based filter, pp 242–249

  • Cadenas JM, Garrido MC, MartíNez R (2013) Feature subset selection filter–wrapper based on low quality data. Expert Syst Appl 40(16):6241–6252

    Google Scholar 

  • Chatterjee I, Ghosh M, Singh PK, Sarkar R, Nasipuri M (2019a) A clustering-based feature selection framework for handwritten Indic script classification. Expert Syst 36(6):e12459

    Google Scholar 

  • Chatterjee R, Maitra T, Islam SKH, Hassan MM, Alamri A, Fortino G (2019b) A novel machine learning based feature selection for motor imagery EEG signal classification in Internet of medical things environment. Future Gener Comput Syst 98:419–434

    Google Scholar 

  • Chatterjee B, Bhattacharyya T, Ghosh KK, Singh PK, Geem ZW, Sarkar R (2020) Late acceptance hill climbing based social ski driver algorithm for feature selection. IEEE Access 8:75393–75408

    Google Scholar 

  • Chen B, Zeng W, Lin Y, Zhang D (2015) A new local search-based multiobjective optimization algorithm. IEEE Trans Evol Comput 19(1):50–73

    Google Scholar 

  • Chen H, Xu Y, Wang M, Zhao X (2019) A balanced whale optimization algorithm for constrained engineering design problems. Appl Math Model 71:45–59

    MathSciNet  MATH  Google Scholar 

  • Chuang L-Y, Chang H-W, Tu C-J, Yang C-H (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32(1):29–38

    MATH  Google Scholar 

  • Dhargupta S, Ghosh M, Mirjalili S, Sarkar R (2020) Selective opposition based grey wolf optimization. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2020.113389

    Article  Google Scholar 

  • Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, MHS’95, pp 39–43

  • Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65

    Google Scholar 

  • Fahad A, Tari Z, Khalil I, Almalawi A, Zomaya AY (2014) An optimal and stable feature selection approach for traffic classification based on multi-criterion fusion. Future Gener Comput Syst 36:156–169

    Google Scholar 

  • Ghosh M, Begum S, Sarkar R, Chakraborty D, Maulik U (2019a) Recursive memetic algorithm for gene selection in microarray data. Expert Syst Appl 116:172–185

    Google Scholar 

  • Ghosh M, Adhikary S, Ghosh KK, Sardar A, Begum S, Sarkar R (2019b) Genetic algorithm based cancerous gene identification from microarray data using ensemble of filter methods. Med Biol Eng Comput 57(1):159–176

    Google Scholar 

  • Ghosh M, Malakar S, Bhowmik S, Sarkar R, Nasipuri M (2019c) Feature selection for handwritten word recognition using memetic algorithm. In: Advances in intelligent computing, Springer, pp 103–124

  • Ghosh M, Guha R, Sarkar R, Abraham A (2019d) A wrapper-filter feature selection technique based on ant colony optimization. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04171-3

    Article  Google Scholar 

  • Ghosh M, Guha R, Alam I, Lohariwal P, Jalan D, Sarkar R (2019e) Binary genetic swarm optimization: a combination of GA and PSO for feature selection. J Intell Syst 29(1):1598–1610

    Google Scholar 

  • Ghosh M, Guha R, Singh PK, Bhateja V, Sarkar R (2019f) A histogram based fuzzy ensemble technique for feature selection. Evol Intell 12:713–724

    Google Scholar 

  • Ghosh M, Bera SK, Guha R, Sarkar R (2019g) Contrast enhancement of degraded document image using partitioning based genetic algorithm. In: International conference on emerging technologies for sustainable development (ICETSD’19), pp 431–435

  • Ghosh M, Kundu T, Ghosh D, Sarkar R (2019h) Feature selection for facial emotion recognition using late hill-climbing based memetic algorithm. Multimed Tools Appl 78:25753–25779

    Google Scholar 

  • Ghosh KK, Ahmed S, Singh PK, Geem ZW, Sarkar R (2020) Improved binary sailfish optimizer based on adaptive β-hill climbing for feature selection. IEEE Access 8:83548–83560

    Google Scholar 

  • Guha R et al (2019a) Deluge based Genetic Algorithm for feature selection. Evol Intell./. https://doi.org/10.1007/s12065-019-00218-5

    Article  Google Scholar 

  • Guha R, Ghosh M, Singh PK, Sarkar R, Nasipuri M (2019b) M-HMOGA: a new multi-objective feature selection algorithm for handwritten numeral classification. J Intell Syst 29(1):1453–1467

    Google Scholar 

  • Guha R, Ghosh KK, Bhowmik S, Sarkar R (2020) Mutually informed correlation coefficient (MICC)—a new filter based feature selection method. In: IEEE CALCON

  • Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182

    MATH  Google Scholar 

  • Han J, Pei J, Kamber M (2011) Data mining: concepts and techniques. Elsevier, Amsterdam

    MATH  Google Scholar 

  • Heidari AA, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872

    Google Scholar 

  • Huang J (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recognit Lett 28:1825–1844

    Google Scholar 

  • Hussien AG, Houssein EH, Hassanien AE (2017) A binary whale optimization algorithm with hyperbolic tangent fitness function for feature selection. In: 2017 Eighth international conference on intelligent computing and information systems (ICICIS), pp 166–172

  • Hussien AG, Hassanien AE, Houssein EH, Bhattacharyya S, Amin M (2019) S-shaped binary whale optimization algorithm for feature selection. In: Recent trends in signal and image processing, Springer, pp 79–87

  • Jensen R (2005) Combining rough and fuzzy sets for feature selection. Princeton, Citeseer

    Google Scholar 

  • Kabir MM, Shahjahan M, Murase K (2011) A new local search based hybrid genetic algorithm for feature selection. Neurocomputing 74(17):2914–2928

    Google Scholar 

  • Kabir MM, Shahjahan M, Murase K (2012) A new hybrid ant colony optimization algorithm for feature selection. Expert Syst Appl 39(3):3747–3763

    Google Scholar 

  • Kashef S, Nezamabadi-pour H (2015) An advanced ACO algorithm for feature subset selection. Neurocomputing 147(1):271–279

    Google Scholar 

  • Kaur G, Arora S (2018) Chaotic whale optimization algorithm. J Comput Des Eng 5(3):275–284

    Google Scholar 

  • Kaveh A, Ghazaan MI (2017) Enhanced whale optimization algorithm for sizing optimization of skeletal structures. Mech Based Des Struct Mach 45(3):345–362

    Google Scholar 

  • Kushwaha N, Pant M (2018) Link based BPSO for feature selection in big data text clustering. Future Gener Comput Syst 82:190–199

    Google Scholar 

  • Liu H, Motoda H (2007) Computational methods of feature selection. CRC Press, BocaRaton

    MATH  Google Scholar 

  • Mafarja MM, Mirjalili S (2017) Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312

    Google Scholar 

  • Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453

    Google Scholar 

  • Mafarja MM, Mirjalili S (2019) Hybrid binary ant lion optimizer with rough set and approximate entropy reducts for feature selection. Soft Comput 23(15):6249–6265

    Google Scholar 

  • Malakar S, Ghosh M, Bhowmik S, Sarkar R, Nasipuri M (2019) A GA based hierarchical feature selection approach for handwritten word recognition. Neural Comput Appl 32:1–20

    Google Scholar 

  • Markid HY, Dadaneh BZ, Moghaddam ME (2015) Bidirectional ant colony optimization for feature selection. In: 2015 The international symposium on artificial intelligence and signal processing (AISP), pp 53–58

  • Mirjalili S, Hashim SZM (2010) A new hybrid PSOGSA algorithm for function optimization. In: Proceedings of ICCIA 2010—2010 International conference on computer science and application, pp 374–377

  • Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Google Scholar 

  • Mitra P, Murthy CA, Pal SK (2002) Unsupervised feature selection using feature similarity. IEEE Trans Pattern Anal Mach Intell 24(3):301–312

    Google Scholar 

  • Mohanty F, Rup S, Dash B (2018) An improved CAD framework for digital mammogram classification using compound local binary pattern and chaotic whale optimization-based kernel extreme learning machine. In: International conference on artificial neural networks, pp 14–23

  • Oliva D, El Aziz MA, Hassanien AE (2017) Parameter estimation of photovoltaic cells using an improved chaotic whale optimization algorithm. Appl Energy 200:141–154

    Google Scholar 

  • Prakash DB, Lakshminarayana C (2017) Optimal siting of capacitors in radial distribution network using whale optimization algorithm. Alex Eng J 56(4):499–509

    Google Scholar 

  • Prasad D, Mukherjee A, Shankar G, Mukherjee V (2017a) Application of chaotic whale optimisation algorithm for transient stability constrained optimal power flow. IET Sci Meas Technol 11(8):1002–1013

    Google Scholar 

  • Prasad D, Mukherjee A, Mukherjee V (2017b) Transient stability constrained optimal power flow using chaotic whale optimization algorithm. In: Handbook of neural computation. Academic Press, pp 311–332

  • Priyanka K, Kavita BD (2016) Feature selection using genetic algorithm and classification using weka for ovarian cancer. Int J Comput Sci Inf Technol 7(1):194–196

    Google Scholar 

  • Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci (Ny) 179(13):2232–2248

    MATH  Google Scholar 

  • Sen S, Mitra M, Bhattacharyya A, Sarkar R, Schwenker F, Roy K (2019) Feature selection for recognition of online handwritten bangla characters. Neural Process Lett 50(3):2281–2304

    Google Scholar 

  • Saha S et al (2020) Feature Selection for facial emotion recognition using cosine similarity-based harmony search algorithm. Appl Sci 10(8):2816

    Google Scholar 

  • Sánchez-Maroño N, Alonso-Betanzos A, Tombilla-Sanromán M (2007) Filter methods for feature selection: a comparative study. In: Intelligent data engineering and automated learning—IDEAL 2007, Springer, Berlin, pp 178–187

  • Santana CJ Jr, Macedo M, Siqueira H, Gokhale A, Bastos-Filho CJA (2019) A novel binary artificial bee colony algorithm. Future Gener Comput Syst 98:180–196

    Google Scholar 

  • Sayed GI, Darwish A, Hassanien AE (2018) A new chaotic whale optimization algorithm for features selection. J Classif 35(2):300–344

    MathSciNet  MATH  Google Scholar 

  • Sayed GI, Tharwat A, Hassanien AE (2019a) Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection. Appl Intell 49(1):188–205

    Google Scholar 

  • Sayed GI, Hassanien AE, Azar AT (2019b) Feature selection via a novel chaotic crow search algorithm. Neural Comput Appl 31(1):171–188

    Google Scholar 

  • Shang WQ, Qu YL, Huang HK, Zhu HB, Lin YM, Dong HB (2006) Fuzzy knn text classifier based on gini index. J Guangxi Normal Univ (Nat Sci Ed) 24(4):87–90

    MATH  Google Scholar 

  • Sharawi M, Zawbaa HM, Emary E (2017) Feature selection approach based on whale optimization algorithm. In: 2017 Ninth international conference on advanced computational intelligence (ICACI), pp 163–168

  • Shi XH, Liang YC, Lee HP, Lu C, Wang LM (2005) An improved GA and a novel PSO-GA-based hybrid algorithm. Inf Process Lett 93(5):255–261

    MathSciNet  MATH  Google Scholar 

  • Sun WZ, Wang JS (2017) Elman neural network soft-sensor model of conversion velocity in polymerization process optimized by chaos whale optimization algorithm. IEEE Access 5:13062–13076

    Google Scholar 

  • Sun G, Li J, Dai J, Song Z, Lang F (2018) Feature selection for IoT based on maximal information coefficient. Future Gener Comput Syst 89:606–616

    Google Scholar 

  • Tanyildizi E, Cigal T (2018) Continuous time chaotic systems for whale optimization algorithm. Adv Electr Comput Eng 18(4):49–57

    Google Scholar 

  • van den Bergh F, Engelbrecht AP (2002) A new locally convergent particle swarm optimiser. In: IEEE International conference on systems, man and cybernetics, vol 3, p 6

  • Vieira SM, Mendonça LF, Farinha GJ, Sousa JMC (2013) Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients. Appl Soft Comput 13(8):3494–3504

    Google Scholar 

  • Wang M, Chen H (2020) Chaotic multi-swarm whale optimizer boosted support vector machine for medical diagnosis. Appl Soft Comput 88:105946

    Google Scholar 

  • Wang J, Du P, Niu T, Yang W (2017) A novel hybrid system based on a new proposed algorithm—multi-objective whale optimization algorithm for wind speed forecasting. Appl Energy 208:344–360

    Google Scholar 

  • Wei J et al (2017) A BPSO-SVM algorithm based on memory renewal and enhanced mutation mechanisms for feature selection. Appl Soft Comput J 58:176–192

    Google Scholar 

  • Xue B, Zhang M, Browne WN (2012) Multi-objective particle swarm optimisation (PSO) for feature selection. In: Proceedings of the 14th annual conference on Genetic and evolutionary computation, pp 81–88

  • Yang CS, Chuang LY, Li JC, Yang CH (2008) Chaotic maps in binary particle swarm optimization for feature selection. In: 2008 IEEE conference on soft computing in industrial applications, pp 107–112

  • Zawbaa HM, Emary E, Parv B (2015) Feature selection based on antlion optimization algorithm. In: 2015 Third world conference on complex systems (WCCS), pp 1–7

  • Zawbaa HM, Emary E, Grosan C (2016) Feature selection via chaotic antlion optimization. PLoS ONE 11(3):e0150652

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Jadavpur University, 188, Raja S.C. Mallick Road, Kolkata, West Bengal, 700032, India

    Ritam Guha, Manosij Ghosh, Shyok Mutsuddi & Ram Sarkar

  2. Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Fortitude Valley, Brisbane, QLD, 4006, Australia

    Seyedali Mirjalili

Authors
  1. Ritam Guha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manosij Ghosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shyok Mutsuddi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ram Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Seyedali Mirjalili
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyedali Mirjalili.

Ethics declarations

Conflict of interest

The authors have no conflict of interest to declare.

Additional information

Communicated by A. Di Nola.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guha, R., Ghosh, M., Mutsuddi, S. et al. Embedded chaotic whale survival algorithm for filter–wrapper feature selection. Soft Comput 24, 12821–12843 (2020). https://doi.org/10.1007/s00500-020-05183-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-05183-1

Keywords

Search

Navigation