Skip to main content
SpringerLink
Log in

Binary Peacock Algorithm: A Novel Metaheuristic Approach for Feature Selection

  • Published:
Journal of Classification Aims and scope Submit manuscript

Abstract

Binary metaheuristic algorithms prove to be invaluable for solving binary optimization problems. This paper proposes a binary variant of the peacock algorithm (PA) for feature selection. PA, a recent metaheuristic algorithm, is built upon lekking and mating behaviors of peacocks and peahens. While designing the binary variant, two major shortcomings of PA (lek formation and offspring generation) were identified and addressed. Eight binary variants of PA are also proposed and compared over mean fitness to identify the best variant, called binary peacock algorithm (bPA). To validate bPA’s performance experiments are conducted using 34 benchmark datasets and results are compared with eight well-known binary metaheuristic algorithms. The results show that bPA classifies 30 datasets with highest accuracy and extracts minimum features in 32 datasets, achieving up to 99.80% reduction in the feature subset size in the dataset with maximum features. bPA attained rank 1 in Friedman rank test over all parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Fig. 1
Algorithm 2
Algorithm 3
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Agrawal, P., Abutarboush, H. F., Ganesh, T., et al. (2021). Metaheuristic algorithms on feature selection: A survey of one decade of research (2009–2019). IEEE Access, 9, 26766–26791. https://doi.org/10.1109/ACCESS.2021.3056407

    Article  Google Scholar 

  • Agrawal, R., Kaur, B., & Sharma, S. (2020). Quantum based whale optimization algorithm for wrapper feature selection. Applied Soft Computing, 89, 106092. https://doi.org/10.1016/j.asoc.2020.106092

    Article  Google Scholar 

  • Al-Tashi, Q., Rais, H., & Jadid, S. (2018). Feature selection method based on grey wolf optimization for coronary artery disease classification. In International conference of reliable information and communication technology (pp. 257–266). Springer. https://doi.org/10.1007/978-3-319-99007-1_25

  • Al-Tashi, Q., Abdulkadir, S. J., Rais, H. M., et al. (2020). Binary multi-objective grey wolf optimizer for feature selection in classification. IEEE Access, 8, 106247–106263. https://doi.org/10.1109/ACCESS.2020.3000040

    Article  Google Scholar 

  • Allam, M., & Nandhini, M. (2022). Optimal feature selection using binary teaching learning based optimization algorithm. Journal of King Saud University - Computer and Information Sciences, 34(2), 329–341. https://doi.org/10.1016/j.jksuci.2018.12.001

    Article  Google Scholar 

  • Banati, H., & Bajaj, M. (2012). Promoting products online using firefly algorithm. In A. Abraham, A. Y. Zomaya, & S. Ventura, et al. (Eds.) 12th International Conference on Intelligent Systems Design and Applications, ISDA 2012, Kochi, India, November 27-29, 2012. IEEE, pp 580–585. https://doi.org/10.1109/ISDA.2012.6416602

  • Chandrashekar, G., & Sahin, F. (2014). A survey on feature selection methods. Computers & Electrical Engineering, 40(1), 16–28. https://doi.org/10.1016/j.compeleceng.2013.11.024, 40th-year commemorative issue

  • Chaudhary, R., & Banati, H. (2019). Peacock algorithm. 2019 IEEE Congress on Evolutionary Computation (CEC) (pp. 2331–2338). Wellington, New Zealand: IEEE.

    Chapter  Google Scholar 

  • Cherrington, M., Thabtah, F., Lu, J., et al. (2019). Feature selection: Filter methods performance challenges. In 2019 International Conference on Computer and Information Sciences (ICCIS) (pp. 1–4). IEEE

  • Crawford, B., Soto, R., Astorga, G., et al. (2017). Putting continuous metaheuristics to work in binary search spaces. Complexity, 2017,. https://doi.org/10.1155/2017/8404231

  • Deniz, A., Kiziloz, H. E., Dokeroglu, T., et al. (2017). Robust multiobjective evolutionary feature subset selection algorithm for binary classification using machine learning techniques. Neurocomputing, 241, 128–146. https://doi.org/10.1016/j.neucom.2017.02.033

    Article  Google Scholar 

  • Dokeroglu, T., Sevinc, E., Kucukyilmaz, T., et al. (2019). A survey on new generation metaheuristic algorithms. Computers & Industrial Engineering, 137, 106040. https://doi.org/10.1016/j.cie.2019.106040

    Article  Google Scholar 

  • Dua, D., & Graff, C. (2017). UCI machine learning repository. http://archive.ics.uci.edu/ml

  • Eberhart, R., & Kennedy, J. (1995). Particle swarm optimization. In Proceedings of the IEEE international conference on neural networks (pp. 1942–1948). Citeseer

  • El Aboudi, N., & Benhlima, L. (2016). Review on wrapper feature selection approaches. In 2016 International Conference on Engineering & MIS (ICEMIS) (pp. 1–5). IEEE

  • Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2016). Binary grey wolf optimization approaches for feature selection. Neurocomputing, 172, 371–381. https://doi.org/10.1016/j.neucom.2015.06.083

    Article  Google Scholar 

  • Faris, H., Aljarah, I., Mirjalili, S., et al. (2016). Evolopy: An open-source nature-inspired optimization framework in python. In Evolutionary machine learning techniques (pp. 131–173). Springer. https://doi.org/10.5220/0006048201710177

  • García, S., Molina, D., Lozano, M., et al. (2009). A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: A case study on the CEC’2005 special session on real parameter optimization. Journal of Heuristics, 15, 617–644.

    Article  Google Scholar 

  • Gharehchopogh, F. S. (2023). Quantum-inspired metaheuristic algorithms: Comprehensive survey and classification. Artificial Intelligence Review, 56(6), 5479–5543.

    Article  Google Scholar 

  • Gharehchopogh, F. S., Maleki, I., & Dizaji, Z. A. (2022). Chaotic vortex search algorithm: Metaheuristic algorithm for feature selection. Evolutionary Intelligence, 15(3), 1777–1808.

    Article  Google Scholar 

  • Gharehchopogh, F. S., Namazi, M., Ebrahimi, L., et al. (2023). Advances in sparrow search algorithm: A comprehensive survey. Archives of Computational Methods in Engineering, 30(1), 427–455.

    Article  PubMed  Google Scholar 

  • Hameed, S. S., Hassan, R., Hassan, W. H., et al. (2021). The microarray dataset of prostate cancer in csv format.https://doi.org/10.1371/journal.pone.0246039.s003. https://plos.figshare.com/articles/dataset/The microarray_dataset_of_prostate_cancer_in_csv_format_/13658793

  • Han, S., Hong, G., Kim, J., et al. (2024). Optimal feature selection for firewall log analysis using machine learning and hybrid metaheuristic algorithms. https://doi.org/10.31224/osf.io/pm3hy

  • Hu, P., Pan, J. S., & Chu, S. C. (2020). Improved binary grey wolf optimizer and its application for feature selection. Knowledge-Based Systems, 195, 105746. https://doi.org/10.1016/j.knosys.2020.105746

    Article  Google Scholar 

  • Hussien, A. G., Hassanien, A. E., Houssein, E. H., Bhattacharyya, S., et al. (2019). S-shaped binary whale optimization algorithm for feature selection. In S. Bhattacharyya, A. Mukherjee, H. Bhaumik, et al. (Eds.), Recent Trends in Signal and Image Processing (pp. 79–87). Singapore: Springer Singapore.

  • Jović, A., Brkić, K., Bogunović, N. (2015). A review of feature selection methods with applications. 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (pp. 1200–1205). Opatija: IEEE.

  • Kaur, T., Saini, B. S., & Gupta, S. (2018). A novel feature selection method for brain tumor MR image classification based on the fisher criterion and parameter-free bat optimization. Neural Computing and Applications, 29(8), 193–206. https://doi.org/10.1007/s00521-017-2869-z

    Article  Google Scholar 

  • Kigsirisin, S., & Miyauchi, H. (2021). Short-term operational scheduling of unit commitment using binary alternative moth-flame optimization. IEEE Access, 9, 12267–12281. https://doi.org/10.1109/ACCESS.2021.3051175

    Article  Google Scholar 

  • Kohavi, R., & John, G. H. (1997). Wrappers for feature subset selection. Artificial Intelligence, 97(1), 273–324. https://doi.org/10.1016/S0004-3702(97)00043-X

    Article  Google Scholar 

  • Laamari, M. A., & Kamel, N. (2014). A hybrid bat based feature selection approach for intrusion detection. In International Conference on Bio-Inspired Computing: Theories and Applications. China, Springer

  • Luo, J., Li, X., Yu, C., et al. (2023). Multiclass sparse discriminant analysis incorporating graphical structure among predictors. Journal of Classification, 40(3), 614–637.

    Article  MathSciNet  Google Scholar 

  • Mafarja, M., & Mirjalili, S. (2018). Whale optimization approaches for wrapper feature selection. Applied Soft Computing, 62, 441–453. https://doi.org/10.1016/j.asoc.2017.11.006

    Article  Google Scholar 

  • Marie-Sainte, S. L., & Alalyani, N. (2020). Firefly algorithm based feature selection for Arabic text classification. Journal of King Saud University-Computer and Information Sciences, 32(3), 320–328. https://doi.org/10.1016/j.jksuci.2018.06.004

    Article  Google Scholar 

  • Mirjalili, S. (2015). Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowledge-Based Systems, 89, 228–249. https://doi.org/10.1016/j.knosys.2015.07.006. https://www.sciencedirect.com/science/article/pii/S0950705115002580

  • Mirjalili, S., & Lewis, A. (2013). S-shaped versus v-shaped transfer functions for binary particle swarm optimization. Swarm and Evolutionary Computation, 9, 1–14. https://doi.org/10.1016/j.swevo.2012.09.002

    Article  Google Scholar 

  • Mirjalili, S., & Lewis, A. (2016a). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67.

    Article  Google Scholar 

  • Mirjalili, S., & Lewis, A. (2016b). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67.

    Article  Google Scholar 

  • Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014a). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

  • Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007. https://www.sciencedirect.com/science/article/pii/S0965997813001853

  • Mohammadzadeh, H., & Gharehchopogh, F. S. (2021a). Feature selection with binary symbiotic organisms search algorithm for email spam detection. International Journal of Information Technology & Decision Making, 20(01), 469–515.

    Article  Google Scholar 

  • Mohammadzadeh, H., & Gharehchopogh, F. S. (2021b). A multi-agent system based for solving high-dimensional optimization problems: A case study on email spam detection. International Journal of Communication Systems, 34(3), e4670.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2020). MTDE: An effective multi-trial vector-based differential evolution algorithm and its applications for engineering design problems. Applied Soft Computing, 97,

  • Nadimi-Shahraki, M. H., Banaie-Dezfouli, M., Zamani, H., et al. (2021a). B-MFO: A binary moth-flame optimization for feature selection from medical datasets. Computers, 10(11), 136.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Moeini, E., Taghian, S., et al. (2021b). DMFO-CD: A discrete moth-flame optimization algorithm for community detection. Algorithms, 14(11), 314.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Taghian, S., & Mirjalili, S. (2021c). An improved grey wolf optimizer for solving engineering problems. Expert Systems with Applications, 166, 113917.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Fatahi, A., Zamani, H., et al. (2022a). Binary approaches of quantum-based avian navigation optimizer to select effective features from high-dimensional medical data. Mathematics, 10(15), 2770.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2022b). Binary aquila optimizer for selecting effective features from medical data: A COVID-19 case study. Mathematics, 10(11), 1929.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Taghian, S., Mirjalili, S., et al. (2022). GGWO: Gaze cues learning-based grey wolf optimizer and its applications for solving engineering problems. Journal of Computational Science, 61, 101636.

    Article  Google Scholar 

  • Nadimi-Shahraki, M. H., Taghian, S., Zamani, H., et al. (2023). MMKE: Multi-trial vector-based monkey king evolution algorithm and its applications for engineering optimization problems. PloS One, 18(1), e0280006.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Nakamura, R. Y. M., Pereira, L. A. M., Costa, K. A., et al. (2012). BBA: A binary bat algorithm for feature selection. In 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (pp. 291–297). IEEE. https://doi.org/10.1109/SIBGRAPI.2012.47

  • Naseri, T. S., & Gharehchopogh, F. S. (2022). A feature selection based on the farmland fertility algorithm for improved intrusion detection systems. Journal of Network and Systems Management, 30(3), 40.

    Article  Google Scholar 

  • Pandey, A. C., Rajpoot, D. S., & Saraswat, M. (2020). Feature selection method based on hybrid data transformation and binary binomial cuckoo search. Journal of Ambient Intelligence and Humanized Computing, 11(2), 719–738. https://doi.org/10.1007/s12652-019-01330-1

    Article  Google Scholar 

  • Pashaei, E., Pashaei, E., & Aydin, N. (2019). Gene selection using hybrid binary black hole algorithm and modified binary particle swarm optimization. Genomics, 111(4), 669–686. https://doi.org/10.1016/j.ygeno.2018.04.004

    Article  CAS  PubMed  Google Scholar 

  • Qasim, O. S., & Algamal, Z. Y. (2018). Feature selection using particle swarm optimization-based logistic regression model. Chemometrics and Intelligent Laboratory Systems, 182, 41–46. https://doi.org/10.1016/j.chemolab.2018.08.016

    Article  CAS  Google Scholar 

  • Qiu, J., Wu, Q., Ding, G., et al. (2016). 2016 A survey of machine learning for big data processing. EURASIP Journal on Advances in Signal Processing, 1, 1–16. https://doi.org/10.1186/s13634-016-0355-x

    Article  Google Scholar 

  • Reddy, S., Panwar, L. K., Panigrahi, B. K., et al. (2018). Solution to unit commitment in power system operation planning using binary coded modified moth flame optimization algorithm (BMMFOA): A flame selection based computational technique. Journal of Computational Science, 25, 298–317. https://doi.org/10.1016/j.jocs.2017.04.011

    Article  MathSciNet  Google Scholar 

  • Rodrigues, D., Pereira, L. A. M., Almeida, T. N. S., et al. (2013). BCS: A binary cuckoo search algorithm for feature selection. In 2013 IEEE International Symposium on Circuits and Systems (ISCAS) (pp. 465–468). IEEE. https://doi.org/10.1109/ISCAS.2013.6571881

  • Rodrigues, D., Pereira, L. A., Nakamura, R. Y., et al. (2014). A wrapper approach for feature selection based on bat algorithm and optimum-path forest. Expert Systems with Applications, 41(5), 2250–2258. https://doi.org/10.1016/j.eswa.2013.09.023

    Article  Google Scholar 

  • Salesi, S., Cosma, G. (2017). A novel extended binary cuckoo search algorithm for feature selection. In 2017 2nd International Conference on Knowledge Engineering and Applications (ICKEA) (pp. 6–12). IEEE. https://doi.org/10.1109/ICKEA.2017.8169893

  • Selvakumar, B., & Muneeswaran, K. (2019). Firefly algorithm based feature selection for network intrusion detection. Computers & Security, 81, 148–155. https://doi.org/10.1016/j.cose.2018.11.005

    Article  Google Scholar 

  • Sudha, M., & Selvarajan S,. (2016). Feature selection based on enhanced cuckoo search for breast cancer classification in mammogram image. Circuits and Systems, 7, 327. https://doi.org/10.4236/cs.2016.74028

  • Tiwari, V. (2012). Face recognition based on cuckoo search algorithm. Indian Journal of Computer Science and Engineering, 3, 401–405.

    Google Scholar 

  • Tubishat, M., Abushariah, M. A., Idris, N., et al. (2019). Improved whale optimization algorithm for feature selection in Arabic sentiment analysis. Applied Intelligence, 49(5), 1688–1707. https://doi.org/10.1007/s10489-018-1334-8

    Article  Google Scholar 

  • Tumar, I., Hassouneh, Y., Turabieh, H., et al. (2020). Enhanced binary moth flame optimization as a feature selection algorithm to predict software fault prediction. IEEE Access, 8, 8041–8055. https://doi.org/10.1109/ACCESS.2020.2964321

    Article  Google Scholar 

  • Vahidi, M., Aghakhani, S., Martín, D., et al. (2023). Optimal band selection using evolutionary machine learning to improve the accuracy of hyper-spectral images classification: A novel migration-based particle swarm optimization. Journal of Classification, 1–36.

  • Wong, W., & Ming, C. I. (2019). A review on metaheuristic algorithms: Recent trends, benchmarking and applications. In 2019 7th International Conference on Smart Computing & Communications (ICSCC) (pp. 1–5). IEEE. https://doi.org/10.1109/ICSCC.2019.8843624

  • Xin-She, Y., & Slowik, A. (2008). Firefly algorithm. Nature-inspired Metaheuristic Algorithms, 20, 79–90.

    Google Scholar 

  • Xue, Y., Tang, T., Pang, W., et al. (2020). Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers. Applied Soft Computing, 88, 106031. https://doi.org/10.1016/j.asoc.2019.106031

    Article  Google Scholar 

  • Yang, X. S. (2010a). A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010) (pp. 65–74). Springer

  • Yang, X. S. (2010b). A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010) (pp. 65–74). Springer

  • Yang, X. S., & Deb, S. (2009a). Cuckoo search via lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC) (pp. 210–214). IEEE

  • Yang, X. S., & Deb, S. (2009b). Cuckoo search via lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC) (pp. 210–214). IEEE

  • Zhang, L., Mistry, K., Lim, C. P., et al. (2018). Feature selection using firefly optimization for classification and regression models. Decision Support Systems, 106, 64–85. https://doi.org/10.1016/j.dss.2017.12.001

    Article  Google Scholar 

  • Zhang, Y., Xf, Song, & Dw, Gong. (2017). A return-cost-based binary firefly algorithm for feature selection. Information Sciences, 418, 561–574. https://doi.org/10.1016/j.ins.2017.08.047

    Article  Google Scholar 

Download references

Author information

Author notes

  1. All authors have contributed equally to this work.

Authors and Affiliations

  1. Department of Computer Science, Dyal Singh College, Delhi, 110003, India

    Hema Banati

  2. Department of Computer Science, Keshav Mahavidyalaya, Delhi, 110034, India

    Richa Sharma

  3. Department of Computer Science, University of Delhi, Delhi, 110007, India

    Asha Yadav

Authors
  1. Hema Banati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Richa Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Asha Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Asha Yadav.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Banati, H., Sharma, R. & Yadav, A. Binary Peacock Algorithm: A Novel Metaheuristic Approach for Feature Selection. J Classif (2024). https://doi.org/10.1007/s00357-024-09468-0

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00357-024-09468-0

Keywords

Search

Navigation