On Feature Selection with Measurement Cost and Grouped Features

  • Pavel Paclík
  • Robert P. W. Duin
  • Geert M. P. van Kempen
  • Reinhard Kohlus
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2396)


Feature selection is an important tool reducing necessary feature acquisition time in some applications. Standard methods, proposed in the literature, do not cope with the measurement cost issue. Including the measurement cost into the feature selection process is difficult when features are grouped together due to the implementation. If one feature from a group is requested, all others are available for zero additional measurement cost. In the paper, we investigate two approaches how to use the measurement cost and feature grouping in the selection process. We show, that employing grouping improves the performance significantly for low measurement costs. We discuss an application where limiting the computation time is a very important topic: the segmentation of backscatter images in product analysis.


Feature Selection Discrete Cosine Transform Feature Subset Feature Selection Algorithm Measurement Cost 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    C.L. Blake and C. J. Merz. UCI repository of machine learning databases, 1998.
  2. 2.
    F. Ferri, P. Pudil, M. Hatef, and J. Kittler. Comparative study of techniques for large-scale feature selection, 1994.Google Scholar
  3. 3.
    Anil Jain and Douglas Zongker. Feature selection: Evaluation, application, and small sample performance. IEEE Trans. Pattern Analysis and Machine Inteligence, 19(2):153–158, February 1997.Google Scholar
  4. 4.
    Pavel Paclík, Robert P.W. Duin, and Geert M.P. van Kempen. Multi-spectral Image Segmentation Algorithm Combining Spatial and Spectral Information. In Proceedings of SCIA 2001 conference, pages 230–235, 2001.Google Scholar
  5. 5.
    Pavel Paclík, Robert P.W. Duin, Geert M.P. van Kempen, and Reinhard Kohlus. Supervised segmentation of backscatter images for product analysis. accepted for International Conference on Pattern Recognition, ICPR2002, Quebec City, Canada, August 11–15, 2002.Google Scholar
  6. 6.
    P. Pudil, J. Novovicová, and Kittler J. Floating search methods in feature selection. Pattern Recognition Letters, 15:1119–1125, 1994.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Pavel Paclík
    • 1
  • Robert P. W. Duin
    • 1
  • Geert M. P. van Kempen
    • 2
  • Reinhard Kohlus
    • 2
  1. 1.Pattern Recognition GroupDelft University of TechnologyThe Netherlands
  2. 2.Unilever R&D VlaardingenThe Netherlands

Personalised recommendations