Skip to main content
SpringerLink
Log in

An overview on twin support vector machines

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Twin support vector machines (TWSVM) is based on the idea of proximal SVM based on generalized eigenvalues (GEPSVM), which determines two nonparallel planes by solving two related SVM-type problems, so that its computing cost in the training phase is 1/4 of standard SVM. In addition to keeping the superior characteristics of GEPSVM, the classification performance of TWSVM significantly outperforms that of GEPSVM. However, the stand-alone method requires the solution of two smaller quadratic programming problems. This paper mainly reviews the research progress of TWSVM. Firstly, it analyzes the basic theory and the algorithm thought of TWSVM, then tracking describes the research progress of TWSVM including the learning model and specific applications in recent years, finally points out the research and development prospects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Arjunan SP, Kumar DK, Naik GR (2010) A machine learning based method for classification of fractal features of forearm sEMG using twin support vector machines. Engineering in Medicine and Biology Society (EMBC), 2010 Annual international conference of the IEEE, pp 4821–4824

  • Chen C, Mangasarian OL (1995) Smoothing methods for convex inequalitiesand linear complementarity problems [J]. Math Program 71(1): 51–69

    Article  MATH  MathSciNet  Google Scholar 

  • Chen J, Ji GR (2010) Weighted least squares twin support vector machines for pattern classification. 2010 The 2nd international conference on computer and automation engineering, Singapore: [s.n.], vol 2, pp 242–246

  • Cong HH, Yang CF, Pu XR (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. 2008 IEEE conference on robotics, automation and mechatronics, pp 348–352

  • Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Li G, Wang M, Zeng H). Publishing House of Electronics Industry, Beijing

  • Ding SF, Qi BJ, Tan HY (2011) An overview on theory and algorithm of support vector machines. J Univ Electron Sci Technol China 40(1): 2–10

    Google Scholar 

  • Ding XJ, Zhang GL, Ke YZ, Ma BL, Li ZC (2008) High efficient intrusion detection methodology with twin support vector machines. 2008 International symposium on information science and engieering, vol 1, pp 560–564

  • Fine S, Navratil J, Gopinath R (2001) A hybrid GMM/SVM approach to speaker identification. 2001 IEEE international conference on acoustics, speech, and signal processing, vol 1, pp 417–420

  • Fung G, Mangasarian OL (2011) Proximal support vector machine classifiers. In: Proc 7th ACMSIFKDD Intl Conf on knowledge discovery and data mining, pp 77–86

  • Ganesh RN, Dinesh KK, Jayadeva (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2): 301–308

    Article  Google Scholar 

  • Gao W, Wang N (2008) Prediction of shallow-water reverberation time series using support vector machine. Comput Eng 34(6): 25–27

    Google Scholar 

  • Gao SB, Ye QL, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17): 3590–3597

    Article  Google Scholar 

  • Ghorai S, Hossian SJ, Mukherjee A, Dutta PK (2010) Unity norm twin support vector machine classifier. 2010 Annual IEEE India conference, pp 1–4(2011)

  • Jayadeva , Khemchandni R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5): 905–910

    Article  Google Scholar 

  • Khan NM, Ksantini R, Ahmad IS, Boufama B (2012) A novel SVM plus NDA model for classification with an application to face recognition. Pattern Recognit 45(1): 66–79

    Article  MATH  Google Scholar 

  • Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines [J]. Pattern Recognit Lett 29(13): 1842–1848

    Article  Google Scholar 

  • Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4): 7535–7543

    Article  Google Scholar 

  • Kumar MA, Khemchandani R, Gopal M, Chandra S (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23): 4606–4618

    Article  MATH  Google Scholar 

  • Lee YJ, Mangasarian OL (2001) A smooth support vector machine for classification. SSVM: Comput Optinm Appl 20(1): 5–22

    MATH  MathSciNet  Google Scholar 

  • Li K, Lu XX (2011) Twin support vector machine algorithm with fuzzy weighting. [EB/OL]. http://www.cnki.net/kcms/detail/11.2127.TP.20111114.0949.06.html

  • Lin KB, Wang ZJ (2006) The method of fax receiver’s name recognition based on SVM. Comput Eng Appl 42(7): 156–158

    Google Scholar 

  • Liu MH, Dai BQ, Xie YL et al (2006a) Improved GMM-UBM/SVM for speaker verification. 2006 IEEE international conference on acoustics, speech, and signal processing, vol 1, pp 1925–1928

  • Liu MH, Xie YL, Yao ZQ et al (2006b) A new Hybrid GMM/SVM for speaker verification. Int Conf Pattern Recognit 4: 314–317

    Google Scholar 

  • Liu XL, Ding SF (2010) Appropriateness in applying SVMs to text classification. Comput Eng Sci 32(6): 106–108

    Google Scholar 

  • Luo Q, Tseng P (1993) Error bounds and convergence analysis of feasible descent methods: a general approach. Ann Oper Res 46-47(1): 157–178

    Article  MathSciNet  Google Scholar 

  • Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1): 69–74

    Article  Google Scholar 

  • Peng XJ (2010) A v-twin support vector machine (v-TWSVM) classifier and its geometric algorithms. Inf Sci 180(20): 3863–3875

    Article  MATH  Google Scholar 

  • Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recognit 44(10-11): 2678–2692

    Article  MATH  Google Scholar 

  • Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25: 114–121

    Article  MATH  Google Scholar 

  • Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6): 962–968

    Article  Google Scholar 

  • Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, Beijing

  • Vapnik VN (2004) Statistical learning theory (trans: Xu J, Zhang X). Publishing House of Electronics Industry, Beijing

  • Wang D, Ye N, Ye QL (2010a) Twin support vector machines via fast generalized Newton refinement. 2010 The 2nd international conference on intelligent human-machine systems and cybernetics. Nanjing, Jiangsu [s.n.], vol 2, pp 62–65

  • Wang D, Ye QL, Ye N (2010b) Localized multi-plane TWSVM classifier via manifold regularization. 2010 2nd international conference on intelligent human-machine systems and cybernetics (IHMSC), vol 2, pp 70–73

  • Xie JY, Zhang BQ, Wang WZ (2011) A partial binary tree algorithm for multiclass classification based on twin support vector machines. J Nanjing Univ (Nat Sci) 47(4): 354–363

    MathSciNet  Google Scholar 

  • Xie SQ, Shen FM, Qiu XN (2009) Face recognition using support vector machines. Comput Eng 35(16): 186–188

    Google Scholar 

  • Yang CF, Zhang Y, Lin Z (2008) Function approximation based on twin support vector machines. 2008 IEEE conference on cybernetics and intelligent systems, pp 259–264

  • Ye QL, Zhao CX, Chen XB (2011) A feature selection method for TWSVM via a regularization technique. J Comput Res Dev 48(6): 1029–1037

    Google Scholar 

  • Zhang XS (2009) Boosting twin support vector machine approach for MCs detection. Asia-Pac Conf Inf Process 46: 149–152

    Google Scholar 

  • Zhang XS, Gao XB, Wang Y (2009) Twin support vector machine for MCs detection. J Electron (China) 26(3): 318–325

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Technolog, China University of Mining and Technology, Xuzhou, 221116, China

    Shifei Ding, Junzhao Yu, Bingjuan Qi & Huajuan Huang

  2. Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Science, Beijing, 100190, China

    Shifei Ding

  3. Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia, Beijing University of Posts and Telecommunications, Beijing, 100876, China

    Shifei Ding

Authors
  1. Shifei Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junzhao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bingjuan Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huajuan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shifei Ding.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ding, S., Yu, J., Qi, B. et al. An overview on twin support vector machines. Artif Intell Rev 42, 245–252 (2014). https://doi.org/10.1007/s10462-012-9336-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-012-9336-0

Keywords

Search

Navigation