Enhancing Incremental Feature Subset Selection in High-Dimensional Databases by Adding a Backward Step

  • Pablo BermejoEmail author
  • Luis de La Ossa
  • Jose A. GamezEmail author
  • Jose M. PuertaEmail author
Conference paper


Feature subset selection has become an expensive process due to the relatively recent appearance of high-dimensional databases. Thus, the need has arisen not only for reducing the dimensionality of these datasets, but also for doing it in an efficient way. We propose the design of a new backward search which performs better than other state-of-the-art algorithms in terms of size of the selected subsets and in the number of evaluations, by removing attributes given a smart decremental approach and, besides, it is guided using a heuristic which reduces the needed number of evaluations commonly expected from a backward search.



This work has been partially supported by the JCCM under project PCI08-0048-8577 and CICYT under project TIN2010-20900-C04-03.


  1. 1.
    Bermejo, P., Gámez, J., Puerta, J.: On incremental wrapper-based attribute selection: experimental analysis of the relevance criteria. In: IPMU’08: Proceedings of the 12th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Málaga (2008)Google Scholar
  2. 2.
    Bermejo, P., Gámez, J.A., Puerta, J.M.: Incremental wrapper-based subset selection with replacement: an advantageous alternative to sequential forward selection. In: Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM-2009), Málaga (2009)Google Scholar
  3. 3.
    Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)zbMATHGoogle Scholar
  4. 4.
    Liu, H., Motoda, H.: Feature Extraction Construction and Selection: A Data Mining Perspective. Kluwer Academic Publishers, Boston (1998)CrossRefzbMATHGoogle Scholar
  5. 5.
    Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Incremental wrapper-based gene selection from microarray data for cancer classification. Pattern Recogn. 39, 2383–2392 (2006)CrossRefGoogle Scholar
  6. 6.
    Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bulletin 1, 80–83 (1945)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited  2011

Authors and Affiliations

  1. 1.Castilla-La Mancha UniversityAlbaceteSpain

Personalised recommendations