Abstract
In classification problems, it is common to find datasets with a large amount of features, some of theses features may be considered as noisy. In this context, one of the most used strategies to deal with this problem is to perform a feature selection process in order to build a subset of features that can better represents the dataset. As feature selection can be modeled as an optimization problem, several studies have to attempted to use nature-inspired optimization techniques due to their large generalization capabilities. In this chapter, we use the Cuckoo Search (CS) algorithm in the context of feature selection tasks. For this purpose, we present a binary version of the Cuckoo Search, namely BCS, as well as we evaluate it with different transfer functions that map continuous solutions to binary ones. Additionally, the Optimum-Path Forest classifier accuracy is used as the fitness function. We conducted simulations comparing BCS with binary versions of the Bat Algorithm, Firefly Algorithm and Particle Swarm Optimization. BCS has obtained reasonable results when we consider the compared techniques for feature selection purposes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Banati, H., Bajaj, M.: Fire fly based feature selection approach. Int. J. Comput. Sci. Issues 8(4), 473–480 (2011)
Dijkstra, E.W.: A note on two problems in connexion with graphs. Numer. Math. 1, 269–271 (1959)
Valian, E., Mohanna, S., Tavakoli, S.: On the mean accuracy of statistical pattern recognizers. Int. J. Artif. Intell. Appl. 2(3), 36–43 (2011)
Falcão, A., Stolfi, J., Lotufo, R.: The image foresting transform theory, algorithms, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 19–29 (2004)
Firpi, H.A., Goodman, E.: Swarmed feature selection. Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop, pp. 112–118. IEEE Computer Society, Washington, DC, USA (2004)
Gandomi, A., Yang, X.S., Alavi, A.: Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Engineering with Computers 29(1), 17–35 (2013)
Geem, Z.W.: Music-Inspired Harmony Search Algorithm: Theory and Applications, 1st edn. Springer Publishing Company, Berlin (2009)
Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)
Kaveh, A., Bakhshpoori, T.: Optimum design of steel frames using cuckoo search algorithm with lvy flights. The Structural Design of Tall and Special Buildings pp. n/a-n/a (2011).
Kennedy, J., Eberhart, R.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)
Kennedy, J., Eberhart, R.C.: A discrete binary version of the particle swarm algorithm. In: IEEE International Conference on Systems, Man, and. Cybernetics, vol. 5, pp. 4104–4108 (1997)
Layeb, A.: A novel quantum inspired cuckoo search for knapsack problems. Int. J. Bio-Inspired Comput. 3(5), 297–305 (2011)
Nakamura, R.Y.M., Pereira, C.R., Papa, J.P., Falcão, A.: Optimum-path forest pruning parameter estimation through harmony search. In: Proceedings of the 24th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 181–188. IEEE Computer Society, Washington, DC, USA (2011)
Papa, J., Pagnin, A., Schellini, S., Spadotto, A., Guido, R., Ponti, M., Chiachia, G., Falcão, A.: Feature selection through gravitational search algorithm. In: Proceedings of the 36th IEEE International Conference on Acoustics, Speech and, Signal Processing, pp. 2052–2055 (2011).
Papa, J.P., Falcão, A.X., Albuquerque, V.H.C., Tavares, J.M.R.S.: Efficient supervised optimum-path forest classification for large datasets. Pattern Recogn. 45(1), 512–520 (2012)
Papa, J.P., Falcão, A.X., Suzuki, C.T.N.: Supervised pattern classification based on optimum-path forest. Int. J. Imaging Syst. Technol. 19(2), 120–131 (2009)
Ramos, C., Souza, A., Chiachia, G., Falcão, A., Papa, J.: A novel algorithm for feature selection using harmony search and its application for non-technical losses detection. Comput. Electr. Eng. 37(6), 886–894 (2011)
Rashedi, E., Nezamabadi-pour, H., Saryazdi, S.: GSA: A gravitational search algorithm. Inf. Sci. 179(13), 2232–2248 (2009)
Rashedi, E., Nezamabadi-pour, H., Saryazdi, S.: BGSA: binary gravitational search algorithm. Nat. Comput. 9, 727–745 (2010)
Rodrigues, D., Pereira, L.A.M., Almeida, T.N.S., Ramos, C.C.O., Souza, A.N., Yang, X.S., Papa, J.P.: BCS: A binary cuckoo search algorithm for feature selection. In: Proceedings of the IEEE International Symposium on Circuits and Systems. Beijing, China (2013).
Senthilnath, J., Das, V., Omkar, S., Mani, V.: Clustering using levy flight cuckoo search. In: J.C. Bansal, P. Singh, K. Deep, M. Pant, A. Nagar (eds.) Proceedings of Seventh International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA 2012), Advances in Intelligent Systems and Computing, vol. 202, pp. 65–75. Springer India (2013)
Tein, L.H., Ramli, R.: Recent advancements of nurse scheduling models and a potential path. In: Proceedings of 6th IMT-GT conference on mathematics, statistics and its applications (ICMSA 2010) (2010)
Vazquez, R.: Training spiking neural models using cuckoo search algorithm. In: IEEE Congress on Evolutionary Computation (CEC), pp. 679–686 (2011)
Yang, X.S., Deb, S.: Cuckoo search via lévy flights. In: World Congress on Nature Biologically Inspired Computing (NaBIC 2009), pp. 210–214 (2009)
Yang, X.S., Deb, S.: Engineering optimisation by cuckoo search. Int. J. Math. Model. Numer. Optimisation 1, 330–343 (2010)
Yang, X.S., Deb, S.: Cuckoo search: recent advances and applications. Neural Comput. Appl. 1–6 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Pereira, L.A.M. et al. (2014). A Binary Cuckoo Search and Its Application for Feature Selection. In: Yang, XS. (eds) Cuckoo Search and Firefly Algorithm. Studies in Computational Intelligence, vol 516. Springer, Cham. https://doi.org/10.1007/978-3-319-02141-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-02141-6_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02140-9
Online ISBN: 978-3-319-02141-6
eBook Packages: EngineeringEngineering (R0)