Two Floating Search Strategies to Compute the Support Sets System for ALVOT
Abstract
In this paper, two strategies to compute the support sets system for the supervised classifier ALVOT (voting algorithms) using sequential floating selection are presented. ALVOT is a supervised classification model based on the partial precedence principle, therefore, it needs, as feature selection, a set of features subsets, this set is called support sets system. The sequential floating selection methods for feature selection find only one relevant features subset. The introduced strategies search for a set of features subsets to generate a support sets system. Both strategies are compared between them and against the feature selection method based on testor theory, which is commonly used to compute this system. Results obtained with both strategies on different databases from UCI and on the faces database from Olivetti Research Laboratory (ORL) in Cambridge are presented.
Keywords
Feature Selection Feature Subset Feature Selection Method Typical Testors Testor TheoryReferences
- 1.Ruiz Shulcloper, J., Adolfo Guzmán Arenas y J. Fco. Martínez Trinidad: Enfoque Lógico Combinatorio al Reconocimiento de Patrones, Editorial Politécnica (1999) ISBN: 970-18-2384-1Google Scholar
- 2.Pudil, P., Ferri, F.J., Novovièová, J., Kittler, J.: Floating Search Methods for Feature Selection with Nonmonotonic Criterion Functions. In: Proceedings of the 12th International Conference on Pattern Recognition, Jerusalem, Israel, pp. 279–283. IEEE Computer Society Press, Los Alamitos (1994)Google Scholar
- 3.Lazo-Cortes, M., Ruiz-Shulcloper, J., Alba-Cabrera, E.: An overview of the evolution of the concept of testor. Pattern Recognition 34(4), 753–762 (2001)zbMATHCrossRefGoogle Scholar
- 4.Machine Learning Databases, University of California, Irivne, Deparment of Information & Computation Science, http://ftp.ics.uci.edu/pub/machine-learning-databases/
- 5.Cambridge, A.L.: Olivetti Research Laboratory face database, http://www.uk.research.att.com/facedatabase.html
- 6.Sirovich, L., Kirby, M.: Low-Dimensional Procedure for the Characterization of Human Faces. Journal of the Optical Society of America A 4, 519 (1987)CrossRefGoogle Scholar
- 7.Kirby, M., Sirovich, L.: Application of the Karhunen-Loève Procedure for the Characterization of Human Faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(1) (1990)Google Scholar
- 8.Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3, 71–86 (1991)CrossRefGoogle Scholar