Skip to main content
SpringerLink
Log in

Improved twin support vector machine

  • Articles
  • Published:
Science China Mathematics Aims and scope Submit manuscript

Abstract

We improve the twin support vector machine (TWSVM) to be a novel nonparallel hyperplanes classifier, termed as ITSVM (improved twin support vector machine), for binary classification. By introducing the different Lagrangian functions for the primal problems in the TWSVM, we get an improved dual formulation of TWSVM, then the resulted ITSVM algorithm overcomes the common drawbacks in the TWSVMs and inherits the essence of the standard SVMs. Firstly, ITSVM does not need to compute the large inverse matrices before training which is inevitable for the TWSVMs. Secondly, different from the TWSVMs, kernel trick can be applied directly to ITSVM for the nonlinear case, therefore nonlinear ITSVM is superior to nonlinear TWSVM theoretically. Thirdly, ITSVM can be solved efficiently by the successive overrelaxation (SOR) technique or sequential minimization optimization (SMO) method, which makes it more suitable for large scale problems. We also prove that the standard SVM is the special case of ITSVM. Experimental results show the efficiency of our method in both computation time and classification accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Adankon M M, Cheriet M, Biem A. Semisupervised least squares support vector machine. IEEE Trans Neural Netw, 2009, 20: 1858–1870

    Article  Google Scholar 

  2. Blake C L, Merz C J. UCI Repository for Machine Learning Databases. Dept Inf Comput Sci, Univ California, Irvine, 1998. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html

    Google Scholar 

  3. Cao L J, Tong F E H. Support vector machine with adaptive parameters in financial time series forecasting. IEEE Trans Neural Netw, 2013, 14: 1506–1518

    Article  Google Scholar 

  4. Chen P H, Fan R E, Lin C J. A study on SMO-type decomposition methods for support vector machines. IEEE Trans Neural Netw, 2006, 17: 893–908

    Article  Google Scholar 

  5. Cortes C, Vapnik V N. Support-vector networks. Mach Learn, 1995, 20: 273–297

    MATH  Google Scholar 

  6. Deng N Y, Tian Y J, Zhang C H. Support Vector Machines Optimization Based Theory, Algorithms, and Extensions. Boca Raton: CRC Press, 2012

    Google Scholar 

  7. Golub G H, Van Loan C F. Matrix Computations, 3rd ed. Baltimore: The John Hopkins Univ Press, 1996

    MATH  Google Scholar 

  8. Jayadeva R K, Khemchandani R, Chandra S. Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell, 2007, 29: 905–910

    Article  Google Scholar 

  9. Karsten M B. Kernel methods in bioinformatics. In: Handbook of Statistical Bioinformatics, Part 3. New York: Springer, 2011, 317–334

    Google Scholar 

  10. Khemchandani R, Jayadeva R K, Chandra S. Optimal kernel selection in twin support vector machines. Optim Lett, 2009, 3: 77–88

    Article  MATH  MathSciNet  Google Scholar 

  11. Kumar M A, Gopal M. Application of smoothing technique on twin support vector machines. Pattern Recognit Lett, 2008, 29: 1842–1848

    Article  Google Scholar 

  12. Kumar M A, Gopal M. Least squares twin support vector machines for pattern classification. Expert Syst Appl, 2009, 36: 7535–7543

    Article  Google Scholar 

  13. Mangasarian O L, Musicant D R. Successive overrelaxation for support vector machines. IEEE Trans Neural Netw, 1999, 10: 1032–1037

    Article  Google Scholar 

  14. Mangasarian O L, Wild E W. Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell, 2006, 28: 69–74

    Article  Google Scholar 

  15. Muller K R, Mika S, Ratsch G, et al. An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw, 2002, 12: 181–201

    Article  Google Scholar 

  16. Noble W S. Support vector machine applications in computational biology. In: Schökopf B, Tsuda K, Vert J P, eds. Kernel Methods in Computational Biology. Cambridge, MA: MIT Press, 2004

    Google Scholar 

  17. Peng X. TSVR: An efficient twin support vector machine for regression. Neural Networks, 2010, 23: 365–372

    Article  Google Scholar 

  18. Platt J. Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges C J C, Smola A J, eds. Advances in Kernel Methods Support Vector Learning. Cambridge, MA: MIT Press, 2000

    Google Scholar 

  19. Qi Z Q, Tian Y J, Shi Y. Laplacian twin support vector machine for semi-supervised classification. Neural Networks, 2012, 35: 46–53

    Article  MATH  Google Scholar 

  20. Qi Z Q, Tian Y J, Shi Y. Twin support vector machine with universum data. Neural Networks, 2012, 36: 112–119

    Article  MATH  Google Scholar 

  21. Qi Z Q, Tian Y J, Shi Y. Robust twin support vector machine for pattern classification. Pattern Recognition, 2013, 46: 305–316

    Article  MATH  Google Scholar 

  22. Shao Y H, Zhang C H, Wang X B, et al. Improvements on twin support vector machines. IEEE Trans Neural Netw, 2011, 22: 962–968

    Article  Google Scholar 

  23. Shao Y H, Deng N Y. A coordinate descent margin based-twin support vector machine for classification. Neural Networks, 2012, 25: 114–121

    Article  MATH  Google Scholar 

  24. Tian Y J, Shi Y, Liu X H. Recent advances on support vector machines research. Tech Econ Develop Econ, 2012, 18: 5–33

    Article  Google Scholar 

  25. Vapnik V N. The Nature of Statistical Learning Theory. New York: Springer, 1996

    Google Scholar 

  26. Vapnik V N. Statistical Learning Theory. New York: John Wiley and Sons, 1998

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Center on Fictitious Economy and Data Science, Chinese Academy of Sciences, Beijing, 100190, China

    YingJie Tian, XuChan Ju, ZhiQuan Qi & Yong Shi

  2. School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, 100049, China

    XuChan Ju

  3. College of Information Science and Technology, University of Nebraska at Omaha, Omaha, NE, 68182, USA

    Yong Shi

Authors
  1. YingJie Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. XuChan Ju
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. ZhiQuan Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yong Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to YingJie Tian.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tian, Y., Ju, X., Qi, Z. et al. Improved twin support vector machine. Sci. China Math. 57, 417–432 (2014). https://doi.org/10.1007/s11425-013-4718-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11425-013-4718-6

Keywords

MSC(2010)

Search

Navigation