Applied Intelligence

, Volume 41, Issue 4, pp 1097–1107

Sparse least square twin support vector machine with adaptive norm

  • Zhiqiang Zhang
  • Ling Zhen
  • Naiyang Deng
  • Junyan Tan
Article

DOI: 10.1007/s10489-014-0586-1

Cite this article as:
Zhang, Z., Zhen, L., Deng, N. et al. Appl Intell (2014) 41: 1097. doi:10.1007/s10489-014-0586-1
  • 306 Downloads

Abstract

By promoting the parallel hyperplanes to non-parallel ones in SVM, twin support vector machines (TWSVM) have attracted more attention. There are many modifications of them. However, most of the modifications minimize the loss function subject to the I2-norm or I1-norm penalty. These methods are non-adaptive since their penalty forms are fixed and pre-determined for any types of data. To overcome the above shortcoming, we propose lp norm least square twin support vector machine (lpLSTSVM). Our new model is an adaptive learning procedure with lp-norm (0<p<1), where p is viewed as an adjustable parameter and can be automatically chosen by data. By adjusting the parameter p, lpLSTSVM can not only select relevant features but also improve the classification accuracy. The solutions of the optimization problems in lpLSTSVM are obtained by solving a series systems of linear equations (LEs) and the lower bounds of the solution is established which is extremely helpful for feature selection. Experiments carried out on several standard UCI data sets and synthetic data sets show the feasibility and effectiveness of the proposed method.

Keywords

Least square twin support vector machineTwin support vector machinelp-normSparsityFeature selection

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Zhiqiang Zhang
    • 1
  • Ling Zhen
    • 2
  • Naiyang Deng
    • 2
  • Junyan Tan
    • 2
  1. 1.School of Mechanical Engineering, Beijing Institute of TechnologyBeijingChina
  2. 2.College of ScienceChina Agricultural UniversityBeijingChina