A Novel Multi-class Support Vector Machine Based on Fuzzy Theories

  • Yong Zhang
  • Zhongxian Chi
  • Yu Sun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4113)


Support vector machine (SVM), proposed by Vapnik based on statistical learning theory, is a novel machine learning method. However, there are two problems to be solved in this field: one is the multi-class classification problem, and the other is the sensitivity to the noisy data. In order to overcome these difficulties, a novel method of fuzzy compensation multi-class support vector machine, named as FC-SVM, is proposed in this paper. This method imports a fuzzy compensation function to the penalty in the straightly construction multi-class SVM classification problem proposed by Weston and Watkins. Aim at the dual affects to classification results by each input data, this method has punish item be fuzzy, compensates weight to classification, reconstructs the optimization problem and its restrictions, reconstructs Langrage formula, and presents the theories deduction. This method is applied to the benchmark data sets. The experiment presents our method is feasible.


Support Vector Machine Support Vector Machine Algorithm Support Vector Machine Training Fuzzy Support Vector Machine Theory Deduction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Burges, J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)CrossRefGoogle Scholar
  2. 2.
    Hsu, C.W., Lin, C.J.: A Comparison of Methods for Multi-class Support Vector Machines. IEEE Transactions on Neural Networks 2, 415–425 (2002)Google Scholar
  3. 3.
    Xu, J.H., Zhang, X.G., Li, Y.D.: Advances in Support Vector Machines. Control and Decision 5, 481–484 (2004)Google Scholar
  4. 4.
    Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large Margin DAG’s for Multiclass Classification. In: Advances in Neural Information Processing Systems, vol. 12, pp. 547–553. MIT Press, Cambridge (2000)Google Scholar
  5. 5.
    Weston, J., Watkins, C.: Multi-class Support Vector Machines. Department of Computer Science, Royal Holloway University of London Technical Report, SD2TR298204 (1998)Google Scholar
  6. 6.
    Platt, J.C.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Advances in Kernel Methods –Support Vector Learning, pp. 185–208. MIT Press, Cambridge (1999)Google Scholar
  7. 7.
    Vapnik, V.N.: The Nature of Statistical Learning Theory, 2nd edn. Springer, Heidelberg (1999)Google Scholar
  8. 8.
    Suykens, J., Vandewalle, J.: Least Squares Support Vector Machines. Neural Processing Letters 3, 293–300 (1999)CrossRefGoogle Scholar
  9. 9.
    Scholkopf, B., Smola, A.J., Williamson, R.C., et al.: New Support Vector Algorithms. Neural Computation 5, 1207–1245 (2000)CrossRefGoogle Scholar
  10. 10.
    Huang, H.P., Liu, Y.H.: Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems 4, 826–835 (2002)MathSciNetGoogle Scholar
  11. 11.
    Inoue, T., Abe, S.: Fuzzy Support Vector Machines for Pattern Classification. In: Proceedings of International Joint Conference on Neural Networks, pp. 1449–1454 (2001)Google Scholar
  12. 12.
    Lin, C.F., Wang, S.D.: Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks 2, 464–471 (2002)Google Scholar
  13. 13.
    Sun, Z.H., Sun, Y.X.: Fuzzy Support Vector Machine for Regression Estimation. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3336–3341 (2003)Google Scholar
  14. 14.
    Hong, D.H., Hwang, C.: Support Vector Fuzzy Regression Machines. Fuzzy Sets and Systems 2, 271–281 (2003)CrossRefMathSciNetGoogle Scholar
  15. 15.
    Huang, Z., Chen, H.C., Hsu, C.J., Chen, W.H., Wu, S.S.: Credit Rating Analysis with Support Vector Machines and Neural Networks: a Market Comparative Study. Decision Support Systems 37, 543–558 (2004)CrossRefGoogle Scholar
  16. 16.
    Kecman, V.: Learning and Soft Computing. In: Support Vector Machines, Neural Networks and Fuzzy Logic Models, The MIT Press, Cambridge (2001)Google Scholar
  17. 17.
    Xie, Z.X., Hu, Q.H., Yu, D.: Fuzzy Output Support Vector Machines for Classification. In: Wang, L., Chen, K., S. Ong, Y. (eds.) ICNC 2005. LNCS, vol. 3612, pp. 1190–1197. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  18. 18.
    Wang, L.P. (ed.): Support Vector Machines: Theory and Application. Springer, Heidelberg (2005)Google Scholar
  19. 19.

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yong Zhang
    • 1
    • 2
  • Zhongxian Chi
    • 2
  • Yu Sun
    • 2
  1. 1.Department of ComputerLiaoning Normal UniversityDalianChina
  2. 2.Department of Computer Science and EngineeringDalian University of TechnologyDalianChina

Personalised recommendations