Experiments with Supervised Fuzzy LVQ

  • Christian Thiel
  • Britta Sonntag
  • Friedhelm Schwenker
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5064)


Prototype based classifiers so far can only work with hard labels on the training data. In order to allow for soft labels as input label and answer, we enhanced the original LVQ algorithm. The key idea is adapting the prototypes depending on the similarity of their fuzzy labels to the ones of training samples. In experiments, the performance of the fuzzy LVQ was compared against the original approach. Of special interest was the behaviour of the two approaches, once noise was added to the training labels, and here a clear advantage of fuzzy versus hard training labels could be shown.


Radial Basis Function Training Sample Training Label Fruit Data Input Label 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Powell, M.J.D.: Radial basis functions for multivariate interpolation: A review. In: Mason, J.C., Cox, M.G. (eds.) Algorithms for Approximation, pp. 143–168. Clarendon Press, Oxford (1987)Google Scholar
  2. 2.
    Thiel, C., Scherer, S., Schwenker, F.: Fuzzy-Input Fuzzy-Output One-Against-All Support Vector Machines. In: Apolloni, B., Howlett, R.J., Jain, L. (eds.) KES 2007, Part III. LNCS (LNAI), vol. 4694, pp. 156–165. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Seo, S.: Clustering and Prototype Based Classification. PhD thesis, Fakultät IV Elektrotechnik und Informatik, Technische Universität Berlin, Germany (November 2005)Google Scholar
  4. 4.
    Villmann, T., Schleif, F.M., Hammer, B.: Fuzzy Labeled Soft Nearest Neigbor Classification with Relevance Learning. In: Fourth International Conference on Machine Learning and Applications, pp. 11–15 (2005)Google Scholar
  5. 5.
    Karayiannis, N.B., Bezdek, J.C.: An integrated approach to fuzzy learning vector quantization andfuzzy c-means clustering. IEEE Transactions on Fuzzy Systems 5(4), 622–628 (1997)CrossRefGoogle Scholar
  6. 6.
    Wu, K.L., Yang, M.S.: A fuzzy-soft learning vector quantization. Neurocomputing 55(3), 681–697 (2003)CrossRefGoogle Scholar
  7. 7.
    Kohonen, T.: Self-organizing maps. Springer, Heidelberg (1995)Google Scholar
  8. 8.
    Dubois, D., Prade, H.: Fuzzy Sets and Systems: Theory and Applications. Academic Press, London (1980)zbMATHGoogle Scholar
  9. 9.
    Kuncheva, L.I.: Using measures of similarity and inclusion for multiple classifier fusion by decision templates. Fuzzy Sets and Systems 122(3), 401–407 (2001)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Fay, R., Kaufmann, U., Schwenker, F., Palm, G.: Learning Object Recognition in a NeuroBotic System. In: Groß, H.M., Debes, K., Böhme, H.J. (eds.) 3rd Workshop on SelfOrganization of AdaptiVE Behavior SOAVE 2004. Fortschritt-Berichte VDI, Reihe 10, vol. 743, pp. 198–209. VDI (2004)Google Scholar
  11. 11.
    Fay, R.: Feature Selection and Information Fusion in Hierarchical Neural Networks for Iterative 3D-Object Recognition. PhD thesis, University of Ulm, Germany (2007)Google Scholar
  12. 12.
    MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–298. University of California Press (1967)Google Scholar
  13. 13.
    Keller, J., Gray, M., Givens, J.: A Fuzzy K Nearest Neighbor Algorithm. IEEE Transactions on Systems, Man and Cybernetics 15(4), 580–585 (1985)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Christian Thiel
    • 1
  • Britta Sonntag
    • 1
  • Friedhelm Schwenker
    • 1
  1. 1.Institute of Neural Information ProcessingUniversity of UlmUlmGermany

Personalised recommendations