Advertisement

A Fuzzy Integral Method of Applying Support Vector Machine for Multi-class Problem

  • Yanning Zhang
  • Hejin Yuan
  • Jin Pan
  • Ying Li
  • Runping Xi
  • Lan Yao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4222)

Abstract

This paper proposed a novel method of applying support vector machine for multi-class problem based on fuzzy integral. Firstly, the fuzzy measure of each binary classifier is constructed based on its classification accuracy during training and its agreement degrees to other support vector machines. Then the testing instances are classified by calculating the fuzzy integral between the fuzzy measures and the outputs of the binary support vector machines. The experiment results on iris and glass datasets from UCI machine learning repository and real plane dataset show that the new method is effective. And the experiment results ulteriorly indicate that the method with Choquet fuzzy integral has better performance than that with Sugeno integral.

Keywords

Support Vector Machine Binary Classifier Fuzzy Measure Multiclass Classification Binary Support Vector Machine 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Vapnik: The Nature of Statistical Learning Theory. Springer, New York (1995)MATHGoogle Scholar
  2. 2.
    Cortesc, V.: Supporter Vector Networks. Machine Learning 20, 273–297 (1995)Google Scholar
  3. 3.
    Kecman, V.: Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models. MIT Press, Cambridge (2001)MATHGoogle Scholar
  4. 4.
    Wang, L.P. (ed.): Support Vector Machines: Theory and Application. Springer, Heidelberg (2005)Google Scholar
  5. 5.
    Botton, L., Cortes, C., Denker, J., et al.: Comparison of Classifier methods: A Case Study in Handwritten Digit Recognition. In: Proc of the Int. Conf. on Pattern Recognition, Jerusalem, pp. 77–87 (1994)Google Scholar
  6. 6.
    Platt, J., Cristianini, N., Shawe-Taylor, J.: Large Margin DAG’s for Multiclass Classification. In: Advances in Neural Information Processing Systems, pp. 547–553. MIT Press, Cambridge (2000)Google Scholar
  7. 7.
    Takahashi, F., Abe, S.: Decision-Tree-Based Multiclass Support Vector Machines. In: Proc. of the 9th Int. Conf. on Neural Information Processing, Singapore, pp. 1418–1422 (2002)Google Scholar
  8. 8.
    Sungmoon, C., Sang, H.O., Soo-Young, L.: Support Vector Machines with Binary Tree Architecture for Multi-Class Classification. Neural Information Processing-Letters and Reviews 2(3), 47–51 (2004)Google Scholar
  9. 9.
    Weston, J., Watkins, C.: Mult-class Support Vector Machines. Technical Report. CSD-TR-98-04. Department of Computer Science. Royal Holloway University of London, England (May 1998)Google Scholar
  10. 10.
    Dietterich, T.G., Bakiri, G.: Solving Multiclass Learning Problems via Error-correcting Output Codes. Journal of Artificial Intelligence, 263–286 (1995)Google Scholar
  11. 11.
    Moreira, M., Mayoraz, E.: Improved Pairwise Coupling Classification with Correcting Classifiers. In: Proceedings of the ECML 1998, Chemnitz, Germany, pp. 160–171 (1998)Google Scholar
  12. 12.
    Platt, J.: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In: Advances in Large Margin Classifiers. MIT Press, Cambridge (1999)Google Scholar
  13. 13.
    Guermeur, Y., Elisseeff, A., Paugam-Moisy, H.: A New Multi-class SVM Based on a Uniform Convergence Result. In: Proceedings of the IJCNN 2000, Como, Italy (2000)Google Scholar
  14. 14.
    Angulo, C., Parra, X., Catala, A.: K-SVCR A Support Vector Machine for Multi-class Classification. Neurocomputing, 55–77 (2003)Google Scholar
  15. 15.
    Sugeno, M.: Fuzzy Measure and Fuzzy Integrals—A Survey. In: Fuzzy Automation and Decision Processes., New York, North-Holland, pp. 89–102 (1977)Google Scholar
  16. 16.
    Murofushi, T., Sugeno, M.: A Theory of Fuzzy Measures: Representations, the Choquet Integral, and Null Sets. Journal of Math. Analysis and Applications 32(2), 532–549 (1991)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Yong, D., Kang, S., Chunjiang, Z.: A Method to Aggregate Fuzzy Sensor Data. Journal of Shanghai Jiaotong University 37(1), 1–4 (2003)MATHGoogle Scholar
  18. 18.

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yanning Zhang
    • 1
  • Hejin Yuan
    • 1
  • Jin Pan
    • 2
  • Ying Li
    • 1
  • Runping Xi
    • 1
  • Lan Yao
    • 1
  1. 1.School of Computer ScienceNorthwestern Polytechnical UniversityXi’anChina
  2. 2.Lab of Network Security and CountermeasureXi’an Communication InstituteXi’anChina

Personalised recommendations