Interval Regression Analysis with Soft-Margin Reduced Support Vector Machine

  • Chia-Hui Huang
  • Han-Ying Kao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5579)


The support vector machine (SVM) has shown to be an efficient approach for a variety of classification problems. It has also been widely used in pattern recognition, regression and distribution estimation for crisp data. However, there are three main problems while using SVM model: (1) Large-scale: when dealing with large-scale data sets, the solution by using SVM with nonlinear kernels may be difficult to find; (2) Unbalance: the number of samples from one class is much larger than the number of samples from other classes. It causes the excursion of separation margin; (3) Noises and Interaction: the distribution of data becomes hard to be described and the separation margin between classes becomes a “gray” zone. Under this circumstance, to develop an efficient method is necessary. Recently the reduced support vector machine (RSVM) was proposed as an alternative of the standard SVM. It has been proved more efficient than the traditional SVM in processing large-scaled data. In this paper we introduce the principle of RSVM to evaluate interval regression analysis. In addition the soft margin method is proposed to modify the excursion of separation margin and to be effective in the gray zone.


Interval regression analysis reduced support vector machine soft margin 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)CrossRefGoogle Scholar
  2. 2.
    Cortes, C., Vapnik, V.N.: Support Vector Networks. Machine Learning 20, 273–297 (1995)zbMATHGoogle Scholar
  3. 3.
    Drucker, H., Burges, C.J.C., Kaufman, L., Smola, A., Vapnik, V.N.: Support Vector Regression Machines. In: Mozer, M., Jordan, M., Petsche, T. (eds.) Advances in Neural Information Processing Systems, vol. 9, pp. 155–161. MIT Press, Cambridge (1997)Google Scholar
  4. 4.
    Hong, D.H., Hwang, C.H.: Support Vector Fuzzy Regression Machines. Fuzzy Sets and Systems 138, 271–281 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Hong, D.H., Hwang, C.H.: Interval Regression Analysis using Quadratic Loss Support Vector Machine. IEEE Transactions on Fuzzy Systems 13, 229–237 (2005)CrossRefGoogle Scholar
  6. 6.
    Jeng, J.T., Chuang, C.C., Su, S.F.: Support Vector Interval Regression Networks for Interval Regression Analysis. Fuzzy Sets and Systems 138, 283–300 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Kacprzyk, J., Fedrizzi, M.: Fuzzy Regression Analysis. Physica-Verlag, Heidelberg (1992)zbMATHGoogle Scholar
  8. 8.
    Lee, Y.J., Mangasarian, O.L.: RSVM: Reduced Support Vector Machines. In: Proceedings of 1st SIAM International Conference on Data Mining (2001)Google Scholar
  9. 9.
    Mangasarian, O.L.: Generalized Support Vector Machines. In: Smola, A.J., Bartlett, P.L., Schölkopf, B., Schuurmans, D. (eds.) Advances in Large Margin Classifiers, pp. 135–146. MIT Press, Cambridge (2000)Google Scholar
  10. 10.
    Micchelli, C.A.: Interpolation of Scattered Data: Distance Matrices and Conditionally Positive Definite Functions. Constructive Approximation 2, 11–22 (1986)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.): Advances in Kernel Methods: Support Vector Learning. MIT Press, Cambridge (1999)Google Scholar
  12. 12.
    Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2002)Google Scholar
  13. 13.
    Smola, A.J., Schölkopf, B.: A Tutorial on Support Vector Regression. NeuroCOLT2 Tech. Report, NeuroCOLT (1998); Statistics and Computing 14, 199–222 (2004)Google Scholar
  14. 14.
    Tanaka, H., Lee, H.: Interval Regression Analysis by Quadratic Programming Approach. IEEE Transactions on Fuzzy Systems 6, 473–481 (1998)CrossRefGoogle Scholar
  15. 15.
    Tanaka, H., Uejima, S., Asai, K.: Fuzzy Linear Regression Model. IEEE Transactions on Systems, Man and Cybernetics 10, 2933–2938 (1980)Google Scholar
  16. 16.
    Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, Inc., New York (1998)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Chia-Hui Huang
    • 1
  • Han-Ying Kao
    • 2
  1. 1.Department of Information ManagementKainan UniversityTaoyuanTaiwan
  2. 2.Department of Computer and Information ScienceNational Dong Hwa UniversityHualienTaiwan

Personalised recommendations