Least Squares Support Vector Machines Based on Support Vector Degrees

  • Lijuan Li
  • Youfeng Li
  • Hongye Su
  • Jian Chu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4113)


A modified least squares support vector machines (LS-SVM) approach, which treats the training data points differently according to their different degrees of importance, is proposed in this paper. On each data point, a support vector degree is defined and it is associated with the corresponding absolute value of Lagrange multiplier. The experiment of identification of pH neutralization process with polluted measuring data is shown in this paper and the result indicates that the method is effective in identification of nonlinear system. By contrast with the basic LS-SVM, the result also shows the priority of the presented new algorithm.


Support Vector Machine Support Vector Lagrange Multiplier Little Square Support Vector Machine Little Square Support Vector Machine Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vapnik, V.: Statistical Learning Theory. John Wiley, New York (1998)MATHGoogle Scholar
  2. 2.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)MATHGoogle Scholar
  3. 3.
    Smola, A.J., Schökopf, B.: A Tutorial on Support Vector Regression. online Available:
  4. 4.
    Gestel, T.V., Suykens, J.A.K.: Benchmarking Least Squares Support Vector Machine Classifiers. Kluwer Academic Publishers, Netherlands (2001)Google Scholar
  5. 5.
    Lin, C., Wang, S.: Fuzzy Support Vector Machines. Neural Networks 13, 464–471 (2002)CrossRefGoogle Scholar
  6. 6.
    Suykens, J.A.K., Vandewalle, J.: Least Squares Support Vector Machine Classifiers. Neural Processing Letters 9, 293–300 (1999)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Suykens, J.A.K., Lukas, L., Vandewalle, J.: Sparse Approximation Using Least Squares Support Vector Machines. In: IEEE International Symposium on Circuits and Systems, Geneva, Swizerland, pp. 757–760 (2000)Google Scholar
  8. 8.
    Nie, J.H., Loh, A.P., Hang, C.C.: Modeling pH Neutralization Process Using Fuzzy-neutral Approaches. Fuzzy Set and Systems 78, 5–22 (1996)CrossRefGoogle Scholar
  9. 9.
    Lin, C., Wang, S.: Training Algorithms for Fuzzy Support Vector Machines with Noisy Data. Pattern Recognition Letters 25, 1647–1656 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Lijuan Li
    • 1
    • 2
  • Youfeng Li
    • 1
  • Hongye Su
    • 1
  • Jian Chu
    • 1
  1. 1.National Laboratory of Industrial Control Technology, Institute of Advanced Process ControlZhejiang UniversityHangzhouP.R. China
  2. 2.College of AutomationNanjing University of TechnologyNanjingP.R. China

Personalised recommendations