Skip to main content
SpringerLink
Log in

A new maximal-margin spherical-structured multi-class support vector machine

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Support vector machines (SVMs), initially proposed for two-class classification problems, have been very successful in pattern recognition problems. For multi-class classification problems, the standard hyperplane-based SVMs are made by constructing and combining several maximal-margin hyperplanes, and each class of data is confined into a certain area constructed by those hyperplanes. Instead of using hyperplanes, hyperspheres that tightly enclosed the data of each class can be used. Since the class-specific hyperspheres are constructed for each class separately, the spherical-structured SVMs can be used to deal with the multi-class classification problem easily. In addition, the center and radius of the class-specific hypersphere characterize the distribution of examples from that class, and may be useful for dealing with imbalance problems. In this paper, we incorporate the concept of maximal margin into the spherical-structured SVMs. Besides, the proposed approach has the advantage of using a new parameter on controlling the number of support vectors. Experimental results show that the proposed method performs well on both artificial and benchmark datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Blake CL, Merz CJ (1998) UCI repository of machine learning databases. Dept Inform Comput Sci, Univ California, Irvine, CA (online). Available: http://kdd.ics.uci.edu/

  2. Bottou L, Cortes C, Denker J, Drucker H, Guyon I, Jackel L, LeCun Y, Muller U, Sackinger E, Simard P, Vapnik V (1994) Comparison of classifier methods: a case study in handwriting digit recognition. In: Proceediongs of the international conference on pattern recognition, pp 77–87

  3. Chang CC, Lin CJ (2001) LIBSVM: a library for support vector machines (online). Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm/

  4. Chen CC (2005) Computational mathematics. Univ Tsing Hua, Institute of Information Systems & Applications. Data available at http://www.cs.nthu.edu.tw/~cchen/ISA5305/isa5305.html

  5. Chiang J-H, Hao P-Y (2003) A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE Trans Fuzzy Syst 11:518–527

    Article  Google Scholar 

  6. Cooper PW (1962) The hypersphere in pattern recognition. Inf Control 5:324–346

    Article  MATH  Google Scholar 

  7. Cooper PW (1966) Note on adaptive hypersphere decision boundary. IEEE Trans Electron Comput 948–949

  8. Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297

    MATH  Google Scholar 

  9. Crammer K, Singer Y (2000) On the ability and design of output codes for multiclass problems. In: Computational learning theory, pp 35–46

  10. Fan RE, Chen PH, Lin CJ (2005) Working set selection using second order information for training support vector machines. J Mach Learn Res 6:1889–1918

    MathSciNet  Google Scholar 

  11. Fukunaga K (1990) Introduction to statistical pattern recognition, 2nd edn. Academic Press, New York

    MATH  Google Scholar 

  12. Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Netw 13:415–425

    Article  Google Scholar 

  13. Kreßel U (1999) Pairwise classification and support vector machines. In: Schölkopf, B, Burges CJC, Smola AJ (eds) Advances in kernel methods—support vector learning. MIT Press, Cambridge, pp 255–268

    Google Scholar 

  14. M Manevitz L, Yousef M (2001) One-class SVMs for document classification. J Mach Learn Res 2:139–154

    Article  Google Scholar 

  15. Marchand M, Shawe-Taylor J (2002) The set covering machine. J Mach Learn Res 3:723–746

    Article  MathSciNet  Google Scholar 

  16. Michie D, Spiegelhalter DJ, Taylor CC (1994) Machine learning, neural and statistical classification. Ellis Horwood, Chichester Available: http://www.maths.leeds.ac.uk/~charles/statlog/

    MATH  Google Scholar 

  17. Mitchell T (1997) Machine Learning. McGraw-Hill, New York Data available at http://www.cs.cmu.edu/afs/cs.cmu.edu/user/mitchell/ftp/faces.html

    MATH  Google Scholar 

  18. Mukherjee S, Vapnik V (1999) Multivariate density estimation: A support vector machine approach. Technical Report: AI Memo No 1653, MIT AI Lab

  19. Platt JC (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf, B, Burges CJC, Smola AJ (eds) Advances in kernel methods—support vector learning. MIT Press, Cambridge, pp 185–208

    Google Scholar 

  20. Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAG’s for multiclass classification. In: Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553

    Google Scholar 

  21. Reilly DL, Cooper LN, Elbaum C (1982) A neural model for category learning. Biol Cybern 45:35–41

    Article  Google Scholar 

  22. Schölkopf B, Burges C, Vapnik V (1995) Extracting support data for a given task. In: Proceedings of first international conference on knowledge discovery and data mining, pp 252–257

  23. Schölkopf B, Platt JC, Shawe-Taylor J, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13:1443–1471

    Article  MATH  Google Scholar 

  24. Tax D, Duin R (1999) Support vector domain description. Pattern Recognit Lett 20:11–13

    Article  Google Scholar 

  25. Tax D, Duin R (2004) Support vector data description. Mach Learn 54:45–66

    Article  MATH  Google Scholar 

  26. Vapnik V (1998) Statistical learning theory. Wiley, New York

    MATH  Google Scholar 

  27. Wang J, Neskovic P, Cooper LN (2005) Pattern classification via single spheres. In: Lecture notes in artificial intelligence, vol 3735, pp 241–252

  28. Weston J, Watkins C (1999) Multi-class Support machines. In: Verleysen M (ed) Proceedings of ESANN99, Brussels

  29. Wu Q, Shen X, Li Y, Xu G, Yan W, Dong G, Yang Q (2005) Classifying the multiplicity of the EEG source models using sphere-shaped support vector machines. IEEE Trans Magn 41:1912–1915

    Article  Google Scholar 

  30. Zhu ML, Chen SF, Liu XD (2003) Sphere-structured support vector machines for multi-class pattern recognition. In: Lecture notes in computer science, vol 2639, pp 589–593

Download references

Author information

Authors and Affiliations

  1. Department of Information Management, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan

    Pei-Yi Hao

  2. Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan

    Jung-Hsien Chiang & Yen-Hsiu Lin

Authors
  1. Pei-Yi Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jung-Hsien Chiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yen-Hsiu Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pei-Yi Hao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hao, PY., Chiang, JH. & Lin, YH. A new maximal-margin spherical-structured multi-class support vector machine. Appl Intell 30, 98–111 (2009). https://doi.org/10.1007/s10489-007-0101-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-007-0101-z

Keywords

Search

Navigation