Artificial Intelligence Review

, Volume 42, Issue 2, pp 245–252 | Cite as

An overview on twin support vector machines

  • Shifei Ding
  • Junzhao Yu
  • Bingjuan Qi
  • Huajuan Huang
Article

Abstract

Twin support vector machines (TWSVM) is based on the idea of proximal SVM based on generalized eigenvalues (GEPSVM), which determines two nonparallel planes by solving two related SVM-type problems, so that its computing cost in the training phase is 1/4 of standard SVM. In addition to keeping the superior characteristics of GEPSVM, the classification performance of TWSVM significantly outperforms that of GEPSVM. However, the stand-alone method requires the solution of two smaller quadratic programming problems. This paper mainly reviews the research progress of TWSVM. Firstly, it analyzes the basic theory and the algorithm thought of TWSVM, then tracking describes the research progress of TWSVM including the learning model and specific applications in recent years, finally points out the research and development prospects.

Keywords

Support vector machines Twin support vector machines Least squares twin support vector machines Fuzzy twin support vector machines 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arjunan SP, Kumar DK, Naik GR (2010) A machine learning based method for classification of fractal features of forearm sEMG using twin support vector machines. Engineering in Medicine and Biology Society (EMBC), 2010 Annual international conference of the IEEE, pp 4821–4824Google Scholar
  2. Chen C, Mangasarian OL (1995) Smoothing methods for convex inequalitiesand linear complementarity problems [J]. Math Program 71(1): 51–69CrossRefMATHMathSciNetGoogle Scholar
  3. Chen J, Ji GR (2010) Weighted least squares twin support vector machines for pattern classification. 2010 The 2nd international conference on computer and automation engineering, Singapore: [s.n.], vol 2, pp 242–246Google Scholar
  4. Cong HH, Yang CF, Pu XR (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. 2008 IEEE conference on robotics, automation and mechatronics, pp 348–352Google Scholar
  5. Cristianini N, Taylor JS (2004) An introduction to support vector machines and other kernel-based learning methods (trans: Li G, Wang M, Zeng H). Publishing House of Electronics Industry, BeijingGoogle Scholar
  6. Ding SF, Qi BJ, Tan HY (2011) An overview on theory and algorithm of support vector machines. J Univ Electron Sci Technol China 40(1): 2–10Google Scholar
  7. Ding XJ, Zhang GL, Ke YZ, Ma BL, Li ZC (2008) High efficient intrusion detection methodology with twin support vector machines. 2008 International symposium on information science and engieering, vol 1, pp 560–564Google Scholar
  8. Fine S, Navratil J, Gopinath R (2001) A hybrid GMM/SVM approach to speaker identification. 2001 IEEE international conference on acoustics, speech, and signal processing, vol 1, pp 417–420Google Scholar
  9. Fung G, Mangasarian OL (2011) Proximal support vector machine classifiers. In: Proc 7th ACMSIFKDD Intl Conf on knowledge discovery and data mining, pp 77–86Google Scholar
  10. Ganesh RN, Dinesh KK, Jayadeva (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2): 301–308CrossRefGoogle Scholar
  11. Gao W, Wang N (2008) Prediction of shallow-water reverberation time series using support vector machine. Comput Eng 34(6): 25–27Google Scholar
  12. Gao SB, Ye QL, Ye N (2011) 1-Norm least squares twin support vector machines. Neurocomputing 74(17): 3590–3597CrossRefGoogle Scholar
  13. Ghorai S, Hossian SJ, Mukherjee A, Dutta PK (2010) Unity norm twin support vector machine classifier. 2010 Annual IEEE India conference, pp 1–4(2011)Google Scholar
  14. Jayadeva , Khemchandni R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5): 905–910CrossRefGoogle Scholar
  15. Khan NM, Ksantini R, Ahmad IS, Boufama B (2012) A novel SVM plus NDA model for classification with an application to face recognition. Pattern Recognit 45(1): 66–79CrossRefMATHGoogle Scholar
  16. Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines [J]. Pattern Recognit Lett 29(13): 1842–1848CrossRefGoogle Scholar
  17. Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4): 7535–7543CrossRefGoogle Scholar
  18. Kumar MA, Khemchandani R, Gopal M, Chandra S (2010) Knowledge based least squares twin support vector machines. Inf Sci 180(23): 4606–4618CrossRefMATHGoogle Scholar
  19. Lee YJ, Mangasarian OL (2001) A smooth support vector machine for classification. SSVM: Comput Optinm Appl 20(1): 5–22MATHMathSciNetGoogle Scholar
  20. Li K, Lu XX (2011) Twin support vector machine algorithm with fuzzy weighting. [EB/OL]. http://www.cnki.net/kcms/detail/11.2127.TP.20111114.0949.06.html
  21. Lin KB, Wang ZJ (2006) The method of fax receiver’s name recognition based on SVM. Comput Eng Appl 42(7): 156–158Google Scholar
  22. Liu MH, Dai BQ, Xie YL et al (2006a) Improved GMM-UBM/SVM for speaker verification. 2006 IEEE international conference on acoustics, speech, and signal processing, vol 1, pp 1925–1928Google Scholar
  23. Liu MH, Xie YL, Yao ZQ et al (2006b) A new Hybrid GMM/SVM for speaker verification. Int Conf Pattern Recognit 4: 314–317Google Scholar
  24. Liu XL, Ding SF (2010) Appropriateness in applying SVMs to text classification. Comput Eng Sci 32(6): 106–108Google Scholar
  25. Luo Q, Tseng P (1993) Error bounds and convergence analysis of feasible descent methods: a general approach. Ann Oper Res 46-47(1): 157–178CrossRefMathSciNetGoogle Scholar
  26. Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1): 69–74CrossRefGoogle Scholar
  27. Peng XJ (2010) A v-twin support vector machine (v-TWSVM) classifier and its geometric algorithms. Inf Sci 180(20): 3863–3875CrossRefMATHGoogle Scholar
  28. Peng XJ (2011) TPMSVM: a novel twin parametric-margin support vector machine for pattern recognition. Pattern Recognit 44(10-11): 2678–2692CrossRefMATHGoogle Scholar
  29. Shao YH, Deng NY (2012) A coordinate descent margin based-twin support vector machine for classification. Neural Netw 25: 114–121CrossRefMATHGoogle Scholar
  30. Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6): 962–968CrossRefGoogle Scholar
  31. Vapnik VN (2000) The nature of statistical learning theory (trans: Zhang X). Tsinghua University Press, BeijingGoogle Scholar
  32. Vapnik VN (2004) Statistical learning theory (trans: Xu J, Zhang X). Publishing House of Electronics Industry, BeijingGoogle Scholar
  33. Wang D, Ye N, Ye QL (2010a) Twin support vector machines via fast generalized Newton refinement. 2010 The 2nd international conference on intelligent human-machine systems and cybernetics. Nanjing, Jiangsu [s.n.], vol 2, pp 62–65Google Scholar
  34. Wang D, Ye QL, Ye N (2010b) Localized multi-plane TWSVM classifier via manifold regularization. 2010 2nd international conference on intelligent human-machine systems and cybernetics (IHMSC), vol 2, pp 70–73Google Scholar
  35. Xie JY, Zhang BQ, Wang WZ (2011) A partial binary tree algorithm for multiclass classification based on twin support vector machines. J Nanjing Univ (Nat Sci) 47(4): 354–363MathSciNetGoogle Scholar
  36. Xie SQ, Shen FM, Qiu XN (2009) Face recognition using support vector machines. Comput Eng 35(16): 186–188Google Scholar
  37. Yang CF, Zhang Y, Lin Z (2008) Function approximation based on twin support vector machines. 2008 IEEE conference on cybernetics and intelligent systems, pp 259–264Google Scholar
  38. Ye QL, Zhao CX, Chen XB (2011) A feature selection method for TWSVM via a regularization technique. J Comput Res Dev 48(6): 1029–1037Google Scholar
  39. Zhang XS (2009) Boosting twin support vector machine approach for MCs detection. Asia-Pac Conf Inf Process 46: 149–152Google Scholar
  40. Zhang XS, Gao XB, Wang Y (2009) Twin support vector machine for MCs detection. J Electron (China) 26(3): 318–325CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2012

Authors and Affiliations

  • Shifei Ding
    • 1
    • 2
    • 3
  • Junzhao Yu
    • 1
  • Bingjuan Qi
    • 1
  • Huajuan Huang
    • 1
  1. 1.School of Computer Science and TechnologChina University of Mining and TechnologyXuzhouChina
  2. 2.Key Laboratory of Intelligent Information Processing, Institute of Computing TechnologyChinese Academy of ScienceBeijingChina
  3. 3.Beijing Key Laboratory of Intelligent Telecommunications Software and MultimediaBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations