Skip to main content
Log in

Sine–cosine algorithm for feature selection with elitism strategy and new updating mechanism

  • New Trends in data pre-processing methods for signal and image classification
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Pattern recognition is the task of choosing the pertinent and descriptive features that best describes the target concept during feature selection (FS). Choosing such descriptive features becomes a daunting task in large-volume datasets which have high dimensionality. In such cases, selecting the discriminative features with better classification accuracy is tedious. To overcome this issue, in recent times, many search heuristics have been used to select the best features from these large-volume datasets. In this work, a sine–cosine algorithm (SCA) with Elitism strategy and new best solution update mechanism is proposed to select best features/attributes to improve the classification accuracy. Improved version of SCA is named as improved sine–cosine algorithm (ISCA). Wrapper-based FS approach is used. ELM with radial basis function kernel is used as the learning algorithm. For experimentation, ISCA is tested with ten benchmark datasets. Experimental results have proved the efficiency of ISCA in achieving better classification performance along with less number of features. Both computational and time complexity has been handled by this algorithm in an expedite manner. The potency of this algorithm is proved by comparing its results with three well-known meta-heuristics such as GA, PSO and basic SCA. Finally, it can be seen that pattern classification using ISCA has been commendable in achieving better classification performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Zawbaa HM, Emary E, Grosan C (2016) Feature selection via chaotic antlion optimization. PLoS ONE 11:e0150652

    Article  Google Scholar 

  2. Ebrahim zadeh R, Jampour M (2013) Chaotic genetic algorithm based on lorenz chaotic system for optimization problems. Int J Intell Syst Appl (IJISA) 5:19–24

    Google Scholar 

  3. Mishra G, Ananth V, Shelke K, Sehgal D, Valadi J (2015) Hybrid ACO chaos-assisted support vector machines for classification of medical datasets. In: Proceedings of fourth international conference on soft computing for problem solving, pp 91–101

  4. Muthusamy H, Polat K, Yaacob S (2015) Particle swarm optimization based feature enhancement and feature selection for improved emotion recognition in speech and glottal signals. PLoS ONE 10:e0120344

    Article  Google Scholar 

  5. Yurtkuran A, Emel E (2014) A modified artificial bee colony algorithm for p-center problems. Sci World J 2014:1–9

    Google Scholar 

  6. Wang F, Xu J, Li L (2014) A novel rough set reduct algorithm to feature selection based on artificial fish swarm algorithm. In: Advances in swarm intelligence, Springer, Berlin, pp 24–33

  7. Gao S, Vairappan C, Wang Y, Cao Q, Tang Z (2014) Gravitational search algorithm combined with chaos for unconstrained numerical optimization. Appl Math Comput 231:48–62

    MathSciNet  Google Scholar 

  8. Kuang F, Jin Z, Xu W, Zhang S (2014) A novel chaotic artificial bee colony algorithm based on tent map. In: 2014 IEEE congress on evolutionary computation (CEC), pp 235–241

  9. Abdel-Raouf O, Abdel-Baset M, El-henawy I (2014) Chaotic firefly algorithm for solving definite integral. Int J Inf Technol Comput Sci (IJITCS) 6:19

    Google Scholar 

  10. Dhal KG, Quraishi MI, Das S (2015) Performance analysis of Chaotic Lévy Bat algorithm and chaotic cuckoo search algorithm for gray level image enhancement. In: Information systems design and intelligent applications. Springer, Berlin, pp 233–244

  11. Bhandari AK, Singh VK, Kumar A, Singh GK (2014) Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur’s entropy. Expert Syst Appl 41:3538–3560

    Article  Google Scholar 

  12. Gandomi AH, Yang X-S (2014) Chaotic bat algorithm. J Comput Sci 5:224–232

    Article  MathSciNet  Google Scholar 

  13. Abd-Alsabour N (2014) A review on evolutionary feature selection. In: Modelling symposium (EMS), 2014 European, 2014, pp 20–26

  14. Sayadi M, Ramezanian R, Ghaffari-Nasab N (2010) A discrete firefly meta-heuristic with local search for makespan minimization in permutation flow shop scheduling problems. Int J Ind Eng Comput 1:1–10

    Google Scholar 

  15. Chuang L-Y, Yang C-H, Li J-C, Yang C-H (2012) A hybrid BPSO-CGA approach for gene selection and classification of microarray data. J Comput Biol 19:68–82

    Article  MathSciNet  Google Scholar 

  16. Imani MB, Pourhabibi T, Keyvanpour MR, Azmi R (2012) A new feature selection method based on ant colony and genetic algorithm on persian font recognition. Int J Mach Learn Comput 2:278

    Article  Google Scholar 

  17. Prasad Y, Biswas KK, Jain CK (2010) SVM classifier based feature selection using GA, ACO and PSO for siRNA design. In: International conference in swarm intelligence, pp 307–314

  18. Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl Based Syst 96:120–133

    Article  Google Scholar 

  19. Lin K-C, Hsu S-H, Hung JC (2012) Adaptive SVM-based classification systems based on the improved endocrine-based PSO algorithm. In: International conference on active media technology, pp 543–552

  20. Xue B, Zhang M, Browne WN (2014) Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl Soft Comput 18:261–276

    Article  Google Scholar 

Download references

Acknowledgements

This research is supported by a grant received under Fundamental Research Grant Scheme (FRGS) from Ministry of Higher Education, Malaysia. [Grant Number: 9003-00485].

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Sindhu.

Ethics declarations

Conflict of interest

All the authors declare that there is no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sindhu, R., Ngadiran, R., Yacob, Y.M. et al. Sine–cosine algorithm for feature selection with elitism strategy and new updating mechanism. Neural Comput & Applic 28, 2947–2958 (2017). https://doi.org/10.1007/s00521-017-2837-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-2837-7

Keywords

Navigation