Neural Processing Letters

, Volume 48, Issue 2, pp 1187–1200 | Cite as

A Novel Least Square Twin Support Vector Regression

  • Zhiqiang Zhang
  • Tongling Lv
  • Hui Wang
  • Liming Liu
  • Junyan TanEmail author


This paper proposes a new method for regression named lp norm least square twin support vector regression (PLSTSVR), which is formulated by the idea of twin support vector regression (TSVR). Different from TSVR, our new model is an adaptive learning procedure with p-norm SVM (\({{0<p\le 2}}\)), where p is viewed as an adjustable parameter and can be automatically chosen by data. An iterative algorithm is suggested to solve PLSTSVR efficiently. In each iteration, only a series systems of linear equations (LEs) are solved. Experiments carried out on several standard UCI datasets and synthetic datasets show the feasibility and effectiveness of the proposed method.


LSTSVR TWSVR p-norm Sparsity Feature selection 


  1. 1.
    Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkCrossRefGoogle Scholar
  2. 2.
    Tian Y, Shi Y, Liu X (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18(1):5–33CrossRefGoogle Scholar
  3. 3.
    Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRefGoogle Scholar
  4. 4.
    Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semisupervised classification. Neural Netw 35:46–53CrossRefGoogle Scholar
  5. 5.
    Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with Universum data. Neural Netw 36:112–119CrossRefGoogle Scholar
  6. 6.
    Deng N, Tian Y, Zhang C (2012) Support vector machines C optimization based theory, algorithms and extensions. CRC Press, Boca RatonCrossRefGoogle Scholar
  7. 7.
    Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefGoogle Scholar
  8. 8.
    Mangasarian O, Wild E (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRefGoogle Scholar
  9. 9.
    Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRefGoogle Scholar
  10. 10.
    Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRefGoogle Scholar
  11. 11.
    Khemchandani R, Jayadeva, Chandra S (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88MathSciNetCrossRefGoogle Scholar
  12. 12.
    Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRefGoogle Scholar
  13. 13.
    Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRefGoogle Scholar
  14. 14.
    Shao YH, Wang Z, Chen WJ, Deng NY (2013) Least squares twin parametric-margin support vector machines for classification. Appl Intell 39(3):451–464CrossRefGoogle Scholar
  15. 15.
    Chen W-J, Shao YH, Xu DK, Fu YF (2014) Manifold proximal support vector machine for semi-supervised classification. Appl Intell 40(4):623–638CrossRefGoogle Scholar
  16. 16.
    Xu YT, Guo R (2014) An improved _\(\varepsilon \)-twin support vector machine. Appl Intell 41:42–54CrossRefGoogle Scholar
  17. 17.
    Xu YT, Wang LS (2014) K-nearest neighbor-based weighted twin support vector regression. Appl Intell 41:299–309CrossRefGoogle Scholar
  18. 18.
    Zhang ZQ, Zhen L, Deng NY, Tan JY (2014) Sparse least square twin support vector machine with adaptive norm. Appl Intell 41:1097–1107CrossRefGoogle Scholar
  19. 19.
    Peng XTSVR (2010) an efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRefGoogle Scholar
  20. 20.
    Lu ZX, Yang ZX, Gao XY (2014) Least square twin support vector regression. Comput Eng Appl 50(23):140–144Google Scholar
  21. 21.
    Chen WJ, Tian YJ (2010) Lp-norm proximal support vector machine and its applications. Proced Comput Sci ICCS 1(1):2417–2423CrossRefGoogle Scholar
  22. 22.
    Tian YJ , Yu J, Chen WJ (2010) Lp-norm support vector machine with CCCP. In: Proceedings of the 7th FSKD, pp 1560–1564Google Scholar
  23. 23.
    Tan JY, Zhang CH, Deng NY (2010) Cancer related gene identification via \(p\)-norm support vector machine. In: The 4th international conference on computational systems biology, pp. 101-108Google Scholar
  24. 24.
    Tan J-Y, Zhang Z-Q, Zhen L, Zhang C-H, Deng N (2013) Adaptive feature selection via a new version of support vector machine. Neural Comput Appl 23:937–945CrossRefGoogle Scholar
  25. 25.
    Zhang C-H, Shao Y-H, Tan J-Y, Deng N-Y (2013) A mixed-norm linear support vector machine. Neural Comput Appl 23:2159–2166CrossRefGoogle Scholar
  26. 26.
    Saad Y (2003) Iterative methods for sparse linear systems. SIAM Press, PhiladelphiaCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2017

Authors and Affiliations

  • Zhiqiang Zhang
    • 1
  • Tongling Lv
    • 2
  • Hui Wang
    • 3
  • Liming Liu
    • 4
  • Junyan Tan
    • 2
    Email author
  1. 1.School of Mechanical EngineeringBeijing Institute of TechnologyBeijingChina
  2. 2.College of ScienceChina Agricultural UniversityBeijingChina
  3. 3.College of Mathematical ScienceHarbin Normal UniversityHarbinChina
  4. 4.School of StatisticsCapital University of Economics and BusinessBeijingChina

Personalised recommendations