Skip to main content

Advertisement

SpringerLink
Log in

Brain storm optimization for feature selection using new individual clustering and updating mechanism

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Feature selection is an important preprocessing technique for data. Brain storm optimization (BSO) is one of the latest swarm intelligence algorithms, which simulates the collective behavior of human beings. However, traditional updating mechanisms in BSO limit its application in feature selection. We study a new individual clustering technology and two individual updating mechanisms in BSO for developing novel feature selection algorithms with the purpose of maximizing the classification performance. The proposed individual updating mechanisms are compared with each other. The more promising updating mechanism and the new individual clustering technology are combined into the BSO framework to form a new wrapper feature selection algorithm, called BBSOFS. Compared with existing algorithms including particle swarm optimization, firefly algorithm and BSO algorithm, experimental results on benchmark datasets show that with the help of the proposed individual clustering and updating mechanism, the proposed BBSOFS algorithm can obtain feature subsets with good classification accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Jensen R, Mac Parthalain N (2015) Towards scalable fuzzy-rough feature selection. Inf Sci 323:1–15

    Article  MathSciNet  Google Scholar 

  2. Cai J, Luo JW, Wang SL, Yang S (2018) Feature selection in machine learning: a new perspective. Neurocomputing 300:70–79

    Article  Google Scholar 

  3. Zhang Y, Wang Q, Gong DW, Song XF (2019) Nonnegative Laplacian embedding guided subspace learning for unsupervised feature selection. Pattern Recogn. https://doi.org/10.1016/j.patcog.2019.04.020

    Article  Google Scholar 

  4. Barani F, Mirhosseini M, Nezamabadi-pour H (2017) Application of binary quantum-inspired gravitational search algorithm in feature subset selection. Appl Intell 47(2):304–318

    Article  Google Scholar 

  5. Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502

    Article  Google Scholar 

  6. Xue B, Zhang MJ, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626

    Article  Google Scholar 

  7. Zhang Y, Gong DW, Zhang WQ (2016) Feature selection of unreliable data using an improved multi-objective PSO algorithm. Neurocomputing 171:1281–1290

    Article  Google Scholar 

  8. Peng HC, Long FH, Ding C (2005) Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238

    Article  Google Scholar 

  9. Ding S (2009) Feature selection based F-score and ACO algorithm in support vector machine. In: Proceedings of the 2nd International Symposium on Knowledge Acquisition and Modeling, p 19–23

  10. Seyed Reza S, Ali Akbar A (2018) A hybrid soft computing approach based on feature selection for estimation of filtration combustion characteristics. Neural Comput Applic 30(12):3749–3757

    Article  Google Scholar 

  11. Unler A, Murat A (2010) A discrete particle swarm optimization method for feature selection in binary classification problems. Eur J Oper Res 206(3):528–539

    Article  Google Scholar 

  12. Wu B, Qian CH, Ni WH, Fan SH (2012) Hybrid harmony search and artificial bee colony algorithm for global optimization problems. Comput Math Appl 64(8):2621–2634

    Article  MathSciNet  Google Scholar 

  13. Xue Y, Jiang JM, Zhao BP, Ma TH (2018) A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft Comput 22:2935–2952

    Article  Google Scholar 

  14. Wu B, Qian CH, Ni WH, Fan SH (2012) The improvement of glowworm swarm optimization for continuous optimization problems. Expert Syst Appl 39(7):6335–6342

    Article  Google Scholar 

  15. Diao R, Shen Q (2015) Nature inspired feature selection meta-heuristics. Artif Intell Rev 44:311–340

    Article  Google Scholar 

  16. Sayed GI, Khoriba G, Haggag MH (2018) A novel chaotic salp swarm algorithm for global optimization and feature selection. Appl Intell 48(10):3462–3481

    Article  Google Scholar 

  17. Mafarja MM, Mirjalili S (2017) Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312

    Article  Google Scholar 

  18. Sina T, Parham M (2015) Relevance-redundancy feature selection based on ant colony optimization. Pattern Recogn 48(9):2798–2811

    Article  Google Scholar 

  19. Wang G, Chu HS, Zhang YX (2016) Multiple parameter control for ant colony optimization applied to feature selection problem. Neural Comput Applic 26(7):1693–1708

    Article  Google Scholar 

  20. Zorarpaci E, Ozel SA (2016) A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst Appl 62:91–103

    Article  Google Scholar 

  21. Hancer E, Xue B, Zhang MJ (2018) Pareto front feature selection based on artificial bee colony optimization. Inf Sci 422:462–479

    Article  Google Scholar 

  22. Wang Y, Feng LZ, Zhu JM (2018) Novel artificial bee colony based feature selection method for filtering redundant information. Appl Intell 48(4):868–885

    Article  Google Scholar 

  23. Zhang Y, Song XF, Gong DW (2017) A return-cost-based binary firefly algorithm for feature selection. Inf Sci 418-419:561–574

    Article  Google Scholar 

  24. Zhang J, Chai HT, Ma ZQ, Yang GF (2016) Identification of DNA-binding proteins using multi-features fusion and binary firefly optimization algorithm. BMC Bioinf 17, ID: 323

  25. Zhang Y, Li HG, Wang Q, Peng C (2019) A filter-based bare-bone particle swarm optimization algorithm for unsupervised feature selection. Appl Intell. https://doi.org/10.1007/s10489-019-01420-9

    Article  Google Scholar 

  26. Zhang Y, Gong DW, Hu Y (2015) Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148:150–157

    Article  Google Scholar 

  27. Xue B, Zhang MJ, Browne WN (2013) Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans Cybern 43(6):1656–1671

    Article  Google Scholar 

  28. Zhang Y, Gong DW, Cheng J (2017) Multi-objective particle swarm optimization approach for cost-based feature selection in classification. IEEE/ACM Trans Comput Biol Bioinform 22(99):64–75

    Article  Google Scholar 

  29. Shi YH (2011) Brain storm optimization algorithm. Proceedings of the 2nd International Conference on Swarm Intelligence, Lecture Notes in Computer Science, 6728:303–309

    Google Scholar 

  30. Cheng S, Qin QD, Chen JF, Shi YH (2016) Brain storm optimization algorithm: a review. Artif Intell Rev 46(4):445–458

    Article  Google Scholar 

  31. Yu Y, Gao SC, Cheng S, Wang YR, Song SY, Yuan FG (2019) CBSO: a memetic brain storm optimization with chaotic local search. Memet Comput 10(4):353–367

    Article  Google Scholar 

  32. Pal PS, Kar R, Mandal D, Ghoshal SP (2017) Parametric identification with performance assessment of wiener systems using brain storm optimization algorithm. Circ Syst Signal Pr 36(8):3143–3181

    Article  Google Scholar 

  33. Ma XJ, Jin Y, Dong QL (2017) A generalized dynamic fuzzy neural network based on singular spectrum analysis optimized by brain storm optimization for short-term wind speed forecasting. Appl Soft Comput 54:296–312

    Article  Google Scholar 

  34. Dash S, Joshi D, Trivedi G (2018) Multiobjective analog/RF circuit sizing using an improved brain storm optimization algorithm. Memet Comput 10(4):423–440

    Article  Google Scholar 

  35. Duan HB, Li C (2015) Quantum-behaved brain storm optimization approach to solving loney's solenoid problem. IEEE Trans Magn 51(1), ID: 7000307

  36. Xiong GJ, Shi DY, Zhang J, Zhang Y (2018) A binary coded brain storm optimization for fault section diagnosis of power systems. Electr Power Syst Res 163(A):441–451

    Article  Google Scholar 

  37. Zhang XT, Zhang Y, Gao HR, He CL (2018) A wrapper feature selection algorithm based on brain storm optimization. The 13th International Conference on Bio-inspired Computing: Theories and Applications, CCIS 952, p 308–315

    Google Scholar 

  38. Li X (2004) Adaptively choosing neighbourhood bests using species in a particle swarm optimizer for multimodal function optimization. The Genetic and Evolutionary Computation Conference (GECCO 2004), Lecture Notes in Computer Science, vol. 3102, p 105–116

    Chapter  Google Scholar 

  39. Kennedy J, Eberhart RC (1997) A discrete binary version of the particle swarm algorithm. Proceedings of 1997 Conference Systems Man and Cybernetics p 4104–4108

  40. Mirjalili S, Lewis A (2013) S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm Evol Comput 9:1–14

    Article  Google Scholar 

  41. Murphy PM, Aha DW (2018) UCI repository of machine learning databases. Technical report, Department of Information and Computer Science, University of California, Irvine, Calif. Available at: <http://www.ics.uci.edu/~mlearn/MLRepository.html>

  42. Mohammad HK, Parsa B (2019) A new method for feature selection based on intelligent water drops. Appl Intell 49(3):1172–1184

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Fundamental Research Funds for the Central Universities (No. 2018XKQYMS03).

Author information

Authors and Affiliations

  1. School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, 221116, China

    Wan-qiu Zhang, Yong Zhang & Chao Peng

Authors
  1. Wan-qiu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chao Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yong Zhang.

Ethics declarations

Conflict of interest

The authors declare that the writing of this paper does not cause any competing interests to them.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Wq., Zhang, Y. & Peng, C. Brain storm optimization for feature selection using new individual clustering and updating mechanism. Appl Intell 49, 4294–4302 (2019). https://doi.org/10.1007/s10489-019-01513-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-019-01513-5

Keywords

Search

Navigation