Advertisement

Multi-scale Support Vector Machine for Regression Estimation

  • Zhen Yang
  • Jun Guo
  • Weiran Xu
  • Xiangfei Nie
  • Jian Wang
  • Jianjun Lei
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3971)

Abstract

Recently, SVMs are wildly applied to regression estimation, but the existing algorithms leave the choice of the kernel type and kernel parameters to the user. This is the main reason for regression performance degradation, especially for the complicated data even the nonlinear and non-stationary data. By introducing the ‘empirical mode decomposition (EMD)’ method, with which any complicated data set can be decomposed into a finite and often small number of ‘intrinsic mode functions’ (IMFs) based on the local characteristic time scale of the data, this paper propose an important extension to the SVM method: multi-scale support vector machine based on EMD, in which several kernels of different scales can be used simultaneously to approximate the target function in different scales. Experiment results demonstrate the effectiveness of the proposed method.

Keywords

Support Vector Machine Target Function Empirical Mode Decomposition Regression Estimation Intrinsic Mode Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1999)Google Scholar
  2. 2.
    Tan, Y., Wang, J.: A Support Vector Machine with a Hybrid Kernel. IEEE Transactions on Knowledge and Data Engineering 16, 385–395 (2004)CrossRefGoogle Scholar
  3. 3.
    Schoelkopf, B., Smola, A., Mueller, K.R.: Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation 10, 1299–1319 (1998)CrossRefGoogle Scholar
  4. 4.
    Shao, X., Cherkassky, V.: Multi-Resolution Support Vector Machine. International Joint Conference on Neural Networks 2, 1065–1070 (1999)Google Scholar
  5. 5.
    Huang, N.E., Shen, Z., Long, S.R., et al.: The Empirical Mode Decomposition and the Hilbert Spectrum for Nonlinear and Non-Stationary Time Series Analysis, pp. 903–995. The Royal Society (1998)Google Scholar
  6. 6.
    Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 121–167 (1998)Google Scholar
  7. 7.
    Zhang, L., Zhou, W., Jiao, L.: Wavelet Support Vector Machine. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 34, 34–39 (2004)CrossRefGoogle Scholar
  8. 8.
    Poggio, T., Rifkin, R., Mukherjee, S., Niyogi, P.: General Conditions for Predictivity in Learning Theory. NATURE 428, 419–422 (2004)CrossRefGoogle Scholar
  9. 9.
    Chen, S., Hong, X., Harris, C.J.: Sparse Kernel Density Construction Using Orthogonal Forward Regression with Leave-One-Out Test Score and Local Regularization. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 34, 1708–1717 (2004)CrossRefGoogle Scholar
  10. 10.
    Joachims, T.: Estimating the Generalization Performance of a SVM Efficiently. In: Proc. 17th Int. Conf. Machine Learning, San Francisco (2000)Google Scholar
  11. 11.
    Kearns, M., Ron, D.: Algorithmic Stability and Sanity-Check Bounds for Leave-one-out Cross Validation. In: Proc. Tenth Conf. Compute Learning Theory, pp. 152–162 (1997)Google Scholar
  12. 12.
    Zheng, C., Jiao, L.: Automatic Parameters Selection for SVM Based on GA. In: Proceedings of the Fifth World Congress on Intelligent Control and Automation, pp. 1869–1872 (2004)Google Scholar
  13. 13.
    Liao, S.P., Lin, H.T., Lin, C.J.: A Note on the Decomposition Methods for Support Vector Regression. Neural Networks, 1474–1479 (2001)Google Scholar
  14. 14.
    Li, J., Zhang, B., Lin, F.: Nonlinear Speech Model Based on Support Vector Machine and Wavelet Transform. Tools with Artificial Intelligence, 259–263 (2003)Google Scholar
  15. 15.
    Chen, C.H., Li, C.P., Teng, T.L.: Surface-Wave Dispersion Measurements Using Hilbert-Huang Transform. Terrestrial, Atmospheric and Oceanic Sciences (TAO) 13, 171–184 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Zhen Yang
    • 1
  • Jun Guo
    • 1
  • Weiran Xu
    • 1
  • Xiangfei Nie
    • 1
  • Jian Wang
    • 1
  • Jianjun Lei
    • 1
  1. 1.PRIS Lab, School of Information EngineeringBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations