Skip to main content

A Binary Cuckoo Search and Its Application for Feature Selection

  • Chapter
  • First Online:
Cuckoo Search and Firefly Algorithm

Abstract

In classification problems, it is common to find datasets with a large amount of features, some of theses features may be considered as noisy. In this context, one of the most used strategies to deal with this problem is to perform a feature selection process in order to build a subset of features that can better represents the dataset. As feature selection can be modeled as an optimization problem, several studies have to attempted to use nature-inspired optimization techniques due to their large generalization capabilities. In this chapter, we use the Cuckoo Search (CS) algorithm in the context of feature selection tasks. For this purpose, we present a binary version of the Cuckoo Search, namely BCS, as well as we evaluate it with different transfer functions that map continuous solutions to binary ones. Additionally, the Optimum-Path Forest classifier accuracy is used as the fitness function. We conducted simulations comparing BCS with binary versions of the Bat Algorithm, Firefly Algorithm and Particle Swarm Optimization. BCS has obtained reasonable results when we consider the compared techniques for feature selection purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/

References

  1. Banati, H., Bajaj, M.: Fire fly based feature selection approach. Int. J. Comput. Sci. Issues 8(4), 473–480 (2011)

    Google Scholar 

  2. Dijkstra, E.W.: A note on two problems in connexion with graphs. Numer. Math. 1, 269–271 (1959)

    Google Scholar 

  3. Valian, E., Mohanna, S., Tavakoli, S.: On the mean accuracy of statistical pattern recognizers. Int. J. Artif. Intell. Appl. 2(3), 36–43 (2011)

    Google Scholar 

  4. Falcão, A., Stolfi, J., Lotufo, R.: The image foresting transform theory, algorithms, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 19–29 (2004)

    Google Scholar 

  5. Firpi, H.A., Goodman, E.: Swarmed feature selection. Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop, pp. 112–118. IEEE Computer Society, Washington, DC, USA (2004)

    Google Scholar 

  6. Gandomi, A., Yang, X.S., Alavi, A.: Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Engineering with Computers 29(1), 17–35 (2013)

    Google Scholar 

  7. Geem, Z.W.: Music-Inspired Harmony Search Algorithm: Theory and Applications, 1st edn. Springer Publishing Company, Berlin (2009)

    Google Scholar 

  8. Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)

    Google Scholar 

  9. Kaveh, A., Bakhshpoori, T.: Optimum design of steel frames using cuckoo search algorithm with lvy flights. The Structural Design of Tall and Special Buildings pp. n/a-n/a (2011).

    Google Scholar 

  10. Kennedy, J., Eberhart, R.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  11. Kennedy, J., Eberhart, R.C.: A discrete binary version of the particle swarm algorithm. In: IEEE International Conference on Systems, Man, and. Cybernetics, vol. 5, pp. 4104–4108 (1997)

    Google Scholar 

  12. Layeb, A.: A novel quantum inspired cuckoo search for knapsack problems. Int. J. Bio-Inspired Comput. 3(5), 297–305 (2011)

    Google Scholar 

  13. Nakamura, R.Y.M., Pereira, C.R., Papa, J.P., Falcão, A.: Optimum-path forest pruning parameter estimation through harmony search. In: Proceedings of the 24th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 181–188. IEEE Computer Society, Washington, DC, USA (2011)

    Google Scholar 

  14. Papa, J., Pagnin, A., Schellini, S., Spadotto, A., Guido, R., Ponti, M., Chiachia, G., Falcão, A.: Feature selection through gravitational search algorithm. In: Proceedings of the 36th IEEE International Conference on Acoustics, Speech and, Signal Processing, pp. 2052–2055 (2011).

    Google Scholar 

  15. Papa, J.P., Falcão, A.X., Albuquerque, V.H.C., Tavares, J.M.R.S.: Efficient supervised optimum-path forest classification for large datasets. Pattern Recogn. 45(1), 512–520 (2012)

    Article  Google Scholar 

  16. Papa, J.P., Falcão, A.X., Suzuki, C.T.N.: Supervised pattern classification based on optimum-path forest. Int. J. Imaging Syst. Technol. 19(2), 120–131 (2009)

    Article  Google Scholar 

  17. Ramos, C., Souza, A., Chiachia, G., Falcão, A., Papa, J.: A novel algorithm for feature selection using harmony search and its application for non-technical losses detection. Comput. Electr. Eng. 37(6), 886–894 (2011)

    Article  Google Scholar 

  18. Rashedi, E., Nezamabadi-pour, H., Saryazdi, S.: GSA: A gravitational search algorithm. Inf. Sci. 179(13), 2232–2248 (2009)

    Article  MATH  Google Scholar 

  19. Rashedi, E., Nezamabadi-pour, H., Saryazdi, S.: BGSA: binary gravitational search algorithm. Nat. Comput. 9, 727–745 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  20. Rodrigues, D., Pereira, L.A.M., Almeida, T.N.S., Ramos, C.C.O., Souza, A.N., Yang, X.S., Papa, J.P.: BCS: A binary cuckoo search algorithm for feature selection. In: Proceedings of the IEEE International Symposium on Circuits and Systems. Beijing, China (2013).

    Google Scholar 

  21. Senthilnath, J., Das, V., Omkar, S., Mani, V.: Clustering using levy flight cuckoo search. In: J.C. Bansal, P. Singh, K. Deep, M. Pant, A. Nagar (eds.) Proceedings of Seventh International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA 2012), Advances in Intelligent Systems and Computing, vol. 202, pp. 65–75. Springer India (2013)

    Google Scholar 

  22. Tein, L.H., Ramli, R.: Recent advancements of nurse scheduling models and a potential path. In: Proceedings of 6th IMT-GT conference on mathematics, statistics and its applications (ICMSA 2010) (2010)

    Google Scholar 

  23. Vazquez, R.: Training spiking neural models using cuckoo search algorithm. In: IEEE Congress on Evolutionary Computation (CEC), pp. 679–686 (2011)

    Google Scholar 

  24. Yang, X.S., Deb, S.: Cuckoo search via lévy flights. In: World Congress on Nature Biologically Inspired Computing (NaBIC 2009), pp. 210–214 (2009)

    Google Scholar 

  25. Yang, X.S., Deb, S.: Engineering optimisation by cuckoo search. Int. J. Math. Model. Numer. Optimisation 1, 330–343 (2010)

    Article  MATH  Google Scholar 

  26. Yang, X.S., Deb, S.: Cuckoo search: recent advances and applications. Neural Comput. Appl. 1–6 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. P. Papa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Pereira, L.A.M. et al. (2014). A Binary Cuckoo Search and Its Application for Feature Selection. In: Yang, XS. (eds) Cuckoo Search and Firefly Algorithm. Studies in Computational Intelligence, vol 516. Springer, Cham. https://doi.org/10.1007/978-3-319-02141-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02141-6_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02140-9

  • Online ISBN: 978-3-319-02141-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics