Interval Regression Analysis with Soft-Margin Reduced Support Vector Machine
The support vector machine (SVM) has shown to be an efficient approach for a variety of classification problems. It has also been widely used in pattern recognition, regression and distribution estimation for crisp data. However, there are three main problems while using SVM model: (1) Large-scale: when dealing with large-scale data sets, the solution by using SVM with nonlinear kernels may be difficult to find; (2) Unbalance: the number of samples from one class is much larger than the number of samples from other classes. It causes the excursion of separation margin; (3) Noises and Interaction: the distribution of data becomes hard to be described and the separation margin between classes becomes a “gray” zone. Under this circumstance, to develop an efficient method is necessary. Recently the reduced support vector machine (RSVM) was proposed as an alternative of the standard SVM. It has been proved more efficient than the traditional SVM in processing large-scaled data. In this paper we introduce the principle of RSVM to evaluate interval regression analysis. In addition the soft margin method is proposed to modify the excursion of separation margin and to be effective in the gray zone.
KeywordsInterval regression analysis reduced support vector machine soft margin
Unable to display preview. Download preview PDF.
- 3.Drucker, H., Burges, C.J.C., Kaufman, L., Smola, A., Vapnik, V.N.: Support Vector Regression Machines. In: Mozer, M., Jordan, M., Petsche, T. (eds.) Advances in Neural Information Processing Systems, vol. 9, pp. 155–161. MIT Press, Cambridge (1997)Google Scholar
- 8.Lee, Y.J., Mangasarian, O.L.: RSVM: Reduced Support Vector Machines. In: Proceedings of 1st SIAM International Conference on Data Mining (2001)Google Scholar
- 9.Mangasarian, O.L.: Generalized Support Vector Machines. In: Smola, A.J., Bartlett, P.L., Schölkopf, B., Schuurmans, D. (eds.) Advances in Large Margin Classifiers, pp. 135–146. MIT Press, Cambridge (2000)Google Scholar
- 11.Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.): Advances in Kernel Methods: Support Vector Learning. MIT Press, Cambridge (1999)Google Scholar
- 12.Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2002)Google Scholar
- 13.Smola, A.J., Schölkopf, B.: A Tutorial on Support Vector Regression. NeuroCOLT2 Tech. Report, NeuroCOLT (1998); Statistics and Computing 14, 199–222 (2004)Google Scholar
- 15.Tanaka, H., Uejima, S., Asai, K.: Fuzzy Linear Regression Model. IEEE Transactions on Systems, Man and Cybernetics 10, 2933–2938 (1980)Google Scholar