Feature Ranking Methods Used for Selection of Prototypes

  • Marcin Blachnik
  • Włodzisław Duch
  • Tomasz Maszczyk
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7553)


Prototype selection, as a preprocessing step in machine learning, is effective in decreasing the computational cost of classification task by reducing the number of retained instances. This goal is obtained by shrinking the level of noise and rejecting the irrelevant data. Prototypes may be also used to understand the data through improving comprehensibility of results. In the paper we discus an approach for instance selection based on techniques known from feature selection pointing out the dualism between feature and instance selection. Finally some experiments are shown which uses feature ranking methods for instance selection.


Feature Selection Mutual Information Feature Ranking Instance Selection Ranking Criterion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Grochowski, M., Jankowski, N.: Comparison of Instance Selection Algorithms II. Results and Comments. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds.) ICAISC 2004. LNCS (LNAI), vol. 3070, pp. 580–585. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  2. 2.
    Duch, W., Grudziński, K.: Prototype based rules - new way to understand the data. In: IEEE International Joint Conference on Neural Networks, pp. 1858–1863. IEEE Press, Washington D.C. (2001)Google Scholar
  3. 3.
    Duch, W., Blachnik, M.: Fuzzy Rule-Based Systems Derived from Similarity to Prototypes. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds.) ICONIP 2004. LNCS, vol. 3316, pp. 912–917. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  4. 4.
    Wilson, D.L.: Asymptotic properties of nearest neighbor rules using edited data. IEEE Trans. Systems, Man and Cybernetics 2, 408–421 (1972)CrossRefzbMATHGoogle Scholar
  5. 5.
    Hart, P.E.: The condensed nearest neighbor rule. IEEE Transactions on Information Theory 114, 515–516 (1968)CrossRefGoogle Scholar
  6. 6.
    Aha, D., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Machine Learning 6, 37–66 (1991)Google Scholar
  7. 7.
    Salvador, G., Joaquin, D., Cano, J.R., Herrera, F.: Prototype selection for nearest neighbor classification: Taxonomy and empirical study. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(3), 417–435 (2010)Google Scholar
  8. 8.
    Guyon, I., Gunn, S., Nikravesh, M., Zadeh, L.: Feature extraction, foundations and applications. Springer, Heidelberg (2006)CrossRefzbMATHGoogle Scholar
  9. 9.
    Duch, W.: Filter methods. In: Guyon, I., Gunn, S., Nikravesh, M., Zadeh, L. (eds.) Feature Extraction, Foundations and Applications, pp. 89–118. Springer, Physica Verlag, Heidelberg, Berlin (2006)CrossRefGoogle Scholar
  10. 10.
    Duch, W., Wieczorek, T., Biesiada, J., Blachnik, M.: Comparision of feature ranking methods based on information entropy. In: Proc. of International Joint Conference on Neural Networks, pp. 1415–1420. IEEE Press, Budapest (2004)Google Scholar
  11. 11.
    Battiti, R.: Using mutual information for selecting features in supervised neural net learning. IEEE Trans. on Neural Networks 5, 537–550 (1994)CrossRefGoogle Scholar
  12. 12.
    Asuncion, A., Newman, D.:UCI machine learning repository (2007),
  13. 13.
    Duch, W., Maszczyk, T., Jankowski, N.: Make it cheap: learning with o(nd) complexity. In: 2012 IEEE World Congress on Computational Intelligence, Brisbane, Australia, pp. 132–135 (2012)Google Scholar
  14. 14.
    Bhattacharya, B.K., Poulsen, R.S., Toussaint, G.T.: Application of proximity graphs to editing nearest neighbor decision rule. In: Proc. Int. Symposium on Information Theory, Santa Monica, CA, pp. 1–25 (1981)Google Scholar
  15. 15.
    Toussaint, G.T.: The relative neighborhood graph of a finite planar set. Pattern Recognition 12(4), 261–268 (1980)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Marcin Blachnik
    • 3
  • Włodzisław Duch
    • 1
    • 2
  • Tomasz Maszczyk
    • 1
  1. 1.Department of InformaticsNicolaus Copernicus UniversityToruńPoland
  2. 2.School of Computer EngineeringNanyang Technological UniversitySingapore
  3. 3.Dept. of Management & InformaticsSilesian University of TechnologyKatowicePoland

Personalised recommendations