Skip to main content
SpringerLink
Log in

Improving Evolutionary Algorithm Performance for Feature Selection in High-Dimensional Data

  • Conference paper
  • First Online:
Applications of Evolutionary Computation (EvoApplications 2018)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10784))

  • 2395 Accesses

Abstract

In classification and clustering problems, selecting a subset of discriminative features is a challenging problem, especially when hundreds or thousands of features are involved. In this framework, Evolutionary Computation (EC) techniques have received a growing scientific interest in the last years, because they are able to explore large search spaces without requiring any a priori knowledge or assumption on the considered domain. Following this line of thought, we developed a novel strategy to improve the performance of EC-based algorithms for feature selection. The proposed strategy requires to rank the whole set of available features according to a univariate evaluation function; then the search space represented by the first M ranked features is searched using an evolutionary algorithm for finding feature subsets with high discriminative power. Results of comparisons demonstrated the effectiveness of the proposed approach in improving the performance obtainable with three effective and widely used EC-based algorithm for feature selection in high dimensional data problems, namely Ant Colony Optimization (ACO), Particle Swarm Optimization (PSO) and Artificial Bees Colony (ABC).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note that the same holds also for the feature-class correlation.

References

  1. Dash, M., Liu, H.: Feature selection for classification. Intell. Data Anal. 1(1–4), 131–156 (1997)

    Article  Google Scholar 

  2. Xue, B., Zhang, M., Browne, W.N., Yao, X.: A survey on evolutionary computation approaches to feature selection. IEEE Trans. Evol. Comput. 20(4), 606–626 (2016)

    Article  Google Scholar 

  3. Bevilacqua, V., Mastronardi, G., Piscopo, G.: Evolutionary approach to inverse planning in coplanar radiotherapy. Image Vis. Comput. 25(2), 196–203 (2007). Soft Computing in Image Analysis

    Article  MATH  Google Scholar 

  4. Menolascina, F., Tommasi, S., Paradiso, A., Cortellino, M., Bevilacqua, V., Mastronardi, G.: Novel data mining techniques in acgh based breast cancer subtypes profiling: the biological perspective. In: 2007 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology, pp. 9–16, April 2007

    Google Scholar 

  5. Menolascina, F., Bellomo, D., Maiwald, T., Bevilacqua, V., Ciminelli, C., Paradiso, A., Tommasi, S.: Developing optimal input design strategies in cancer systems biology with applications to microfluidic device engineering. BMC Bioinform. 10(12) (2009)

    Google Scholar 

  6. Bevilacqua, V., Brunetti, A., Triggiani, M., Magaletti, D., Telegrafo, M., Moschetta, M.: An optimized feed-forward artificial neural network topology to support radiologists in breast lesions classification. In: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, GECCO 2016 Companion, pp. 1385–1392. ACM, New York (2016). https://doi.org/10.1145/2908961.2931733

  7. Manimala, K., Selvi, K., Ahila, R.: Hybrid soft computing techniques for feature selection and parameter optimization in power quality data mining. Appl. Soft Comput. 11(8), 5485–5497 (2011)

    Article  Google Scholar 

  8. Xue, B., Zhang, M., Browne, W.N.: Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans. Cybern. 43(6), 1656–1671 (2013)

    Article  Google Scholar 

  9. Spolaôr, N., Lorena, A.C., Lee, H.D.: Multi-objective genetic algorithm evaluation in feature selection. In: Takahashi, R.H.C., Deb, K., Wanner, E.F., Greco, S. (eds.) EMO 2011. LNCS, vol. 6576, pp. 462–476. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19893-9_32

    Chapter  Google Scholar 

  10. Lanzi, P.: Fast feature selection with genetic algorithms: a filter approach. In: IEEE International Conference on Evolutionary Computation, pp. 537–540, April 1997

    Google Scholar 

  11. Cordella, L.P., De Stefano, C., Fontanella, F., Marrocco, C., Scotto di Freca, A.: Combining single class features for improving performance of a two stage classifier. In: 20th International Conference on Pattern Recognition (ICPR 2010), pp. 4352–4355. IEEE Computer Society (2010)

    Google Scholar 

  12. De Stefano, C., Fontanella, F., Marrocco, C.: A GA-based feature selection algorithm for remote sensing images. In: Giacobini, M., et al. (eds.) EvoWorkshops 2008. LNCS, vol. 4974, pp. 285–294. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78761-7_29

    Chapter  Google Scholar 

  13. Ahmed, S., Zhang, M., Peng, L.: Feature selection and classification of high dimensional mass spectrometry data: a genetic programming approach. In: Vanneschi, L., Bush, W.S., Giacobini, M. (eds.) EvoBIO 2013. LNCS, vol. 7833, pp. 43–55. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37189-9_5

    Chapter  Google Scholar 

  14. Oreski, S., Oreski, G.: Genetic algorithm-based heuristic for feature selection in credit risk assessment. Expert Syst. Appl. 41(4, Part 2), 2052–2064 (2014)

    Article  Google Scholar 

  15. Tan, F., Fu, X., Zhang, Y., Bourgeois, A.G.: A genetic algorithm-based method for feature subset selection. Soft. Comput. 12(2), 111–120 (2007)

    Article  Google Scholar 

  16. Ugolotti, R., Mesejo, P., Zongaro, S., Bardoni, B., Berto, G., Bianchi, F., Molineris, I., Giacobini, M., Cagnoni, S., Cunto, F.D.: Visual search of neuropil-enriched rnas from brain in situ hybridization data through the image analysis pipeline hippo-atesc. PLOS ONE 8(9) (2013)

    Google Scholar 

  17. De Stefano, C., Fontanella, F., Scotto di Freca, A.: Feature selection in high dimensional data by a filter-based genetic algorithm. In: Squillero, G., Sim, K. (eds.) EvoApplications 2017. LNCS, vol. 10199, pp. 506–521. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55849-3_33

    Chapter  Google Scholar 

  18. Liu, H., Setiono, R.: Chi2: Feature selection and discretization of numeric attributes. In: ICTAI, pp. 88–91. IEEE Computer Society, Washington, DC (1995)

    Google Scholar 

  19. Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the Seventeenth International Conference on Machine Learning, pp. 359–366. Morgan Kaufmann Publishers Inc., San Francisco (2000)

    Google Scholar 

  20. De Stefano, C., Fontanella, F., Maniaci, M., Scotto di Freca, A.: A method for scribe distinction in medieval manuscripts using page layout features. In: Maino, G., Foresti, G.L. (eds.) ICIAP 2011. LNCS, vol. 6978, pp. 393–402. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-24085-0_41

    Chapter  Google Scholar 

  21. Huang, J., Cai, Y., Xu, X.: A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recogn. Lett. 28(13), 1825–1844 (2007)

    Article  Google Scholar 

  22. Karaboga, D.: An idea based on Honey Bee Swarm for Numerical Optimization. Technical report TR06, Erciyes University, October 2005

    Google Scholar 

  23. Gütlein, M., Frank, E., Hall, M., Karwath, A.: Large scale attribute selection using wrappers. In: Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM 2009) (2009)

    Google Scholar 

  24. Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: Proceedings of the Twentieth International Conference on International Conference on Machine Learning, ICML 2003, pp. 856–863. AAAI Press (2003)

    Google Scholar 

  25. Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Patt. Anal. Mach. Intell. 27(8), 1226–1238 (2005)

    Article  Google Scholar 

  26. Babiloni, C., Triggiani, A.I., Lizio, R., Cordone, S., Tattoli, G., Bevilacqua, V., Soricelli, A., Ferri, R., Nobili, F., Gesualdo, L., Millán-Calenti, J.C., Buján, A., Tortelli, R., Cardinali, V., Barulli, M.R., Giannini, A., Spagnolo, P., Armenise, S., Buenza, G., Scianatico, G., Logroscino, G., Frisoni, G.B., del Percio, C.: Classification of single normal and alzheimer’s disease individuals from cortical sources of resting state eeg rhythms. Front. Neurosci. 10, 47 (2016)

    Article  Google Scholar 

  27. Bria, A., Marrocco, C., Molinara, M., Tortorella, F.: An effective learning strategy for cascaded object detection. Inf. Sci. 340, 17–26 (2016)

    Article  MathSciNet  Google Scholar 

  28. Marrocco, C., Molinara, M., Tortorella, F.: On linear combinations of dichotomizers for maximizing the area under the ROC curve. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 41(3), 610–620 (2011)

    Article  Google Scholar 

  29. Marrocco, C., Tortorella, F.: Exploiting coding theory for classification: an ldpc-based strategy for multiclass-to-binary decomposition. Inf. Sci. 357, 88–107 (2016)

    Article  Google Scholar 

  30. Ricamato, M.T., Marrocco, C., Tortorella, F.: MCS-based balancing techniques for skewed classes: an empirical comparison. In: IEEE 19th International Conference on Pattern Recognition, ICPR 2008, pp. 1–4 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Ingegneria Elettrica e dell’Informazione (DIEI), Università di Cassino e del Lazio meridionale, Via G. Di Biasio, 43, 03043, Cassino, FR, Italy

    N. Cilia, C. De Stefano, F. Fontanella & A. Scotto di Freca

Authors
  1. N. Cilia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. De Stefano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. F. Fontanella
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. A. Scotto di Freca
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to F. Fontanella .

Editor information

Editors and Affiliations

  1. Edinburgh Napier University, Edinburgh, United Kingdom

    Kevin Sim

  2. Johannes Gutenberg University of Mainz, Mainz, Germany

    Paul Kaufmann

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cilia, N., De Stefano, C., Fontanella, F., Scotto di Freca, A. (2018). Improving Evolutionary Algorithm Performance for Feature Selection in High-Dimensional Data. In: Sim, K., Kaufmann, P. (eds) Applications of Evolutionary Computation. EvoApplications 2018. Lecture Notes in Computer Science(), vol 10784. Springer, Cham. https://doi.org/10.1007/978-3-319-77538-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77538-8_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77537-1

  • Online ISBN: 978-3-319-77538-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation