Skip to main content
SpringerLink
Log in

Multiclass Lagrangian support vector machine

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

A support vector machine (SVM) has been developed for two-class problems, although its application to multiclass problems is not straightforward. This paper proposes a new Lagrangian SVM (LSVM) for application to multiclass problems. The multiclass Lagrangian SVM is formulated as a single optimization problem considering all the classes together, and a training method tailored to the multiclass problem is presented. A multiclass output representation matrix is defined to simplify the optimization formulation and associated training method. The proposed method is applied to some benchmark datasets in repository, and its effectiveness is demonstrated via simulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  2. Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300

    Article  MathSciNet  Google Scholar 

  3. Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1(3):161–177

    MathSciNet  MATH  Google Scholar 

  4. Fung GM, Mangasarian OL (2005) Multicategory proximal support vector machine classifiers. Mach Learn 59(1–2):77–97

    Article  MATH  Google Scholar 

  5. Hwang JP, Park S, Kim E (2011) Dual margin approach on a Lagrangian support vector machine. Int J Comput Math 88(4):695–708

    Article  MathSciNet  MATH  Google Scholar 

  6. Hwang JP, Park S, Kim E (2011) A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function. Expert Syst Appl 38(7):8580–8585

    Article  Google Scholar 

  7. Szedmak S, Shawe-Taylor J (2005) Multiclass learning at one class complexity. Technical report. School of Electronics and Computer Science, University of Southampton, UK

    Google Scholar 

  8. Bala M, Agrawal RK (2011) Optimal decision tree based multi-class support vector machine. Infomatica 35:197–209

    MathSciNet  MATH  Google Scholar 

  9. Gonen M, Tanugar AG, Alpaydin E (2008) Multiclass posterior probability support vector machine. IEEE Trans Neural Netw 19(1):130–139

    Article  Google Scholar 

  10. Suykens JAK, Vandewalle J (1999) Multiclass least squares support vector machines. International joint conference on neural networks (IJCNN’99), pp 900–903

  11. Duan H, Liu Q, He G (2007) Two multi-class lagrangian support vector machine algorithms. Lecture Notes in Computer Science, ICIC 2007, pp 891–899

  12. Frank A, Asuncion A (2010) UCI machine learning repository (http://archive.ics.uci.edu/ml), University of California, School of Information and Computer Science, Irvine

  13. Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks 13(2):415–425

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education, Science and Technology (2011-0005274).

Author information

Authors and Affiliations

  1. School of Electrical and Electronic Engineering, Yonsei University, C613, Sinchon-dong, Seodaemun-gu, Seoul, 120-749, Korea

    Jae Pil Hwang, Baehoon Choi & Euntai Kim

  2. Korea Electronics Technology Institute, #68 Yatap-dong, Bundang-gu, 463-816, Korea

    In Wha Hong

Authors
  1. Jae Pil Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Baehoon Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. In Wha Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Euntai Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Euntai Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hwang, J.P., Choi, B., Hong, I.W. et al. Multiclass Lagrangian support vector machine. Neural Comput & Applic 22, 703–710 (2013). https://doi.org/10.1007/s00521-011-0755-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0755-7

Keywords

Search

Navigation