Combined Classifier Optimisation via Feature Selection
We propose a new method for performance-constraining the feature selection process as it relates to combined classifiers, and assert that the resulting technique provides an alternative to the more familiar optimisation methodology of weight adjustment. The procedure then broadly involves the prior selection of features via performan-ceconstrained sequential forward selection applied to the classifiers individually, with a subsequent forward selection process applied to the classifiers acting in combination, the selection criterion in the latter case deriving from the combined classification performance. We also provide a number of parallel investigations to indicate the performance enhancement expected of the technique, including an exhaustive weight optimisation procedure of the customary type, as well as an alternative backward selection technique applied to the individually optimised feature sets.
KeywordsFeature Selection Synthetic Data Investigation Number Pattern Space Pattern Recognition Letter
- 4.A F R Rahman and M C Fairhurst, An evaluation of multi-expert configurations for the recognition of handwritten numerals, Pattern Recognition Letters, 31, pp 1255–1273, 1998Google Scholar
- 7.A. Hojjatoleslami and J. Kittler, Strategies for weighted combination of classifiers employing shared and distinct representations, International Conference on Pattern Recognition, pp 338–340, 1998Google Scholar
- 8.P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach, 1982, Prentice-Hall International, Inc. ISBN 0-13-654236-0.Google Scholar