Abstract
A novel admissible support vector kernel, namely the wavelet kernel satisfying wavelet frames, is presented based on the wavelet theory. The wavelet kernel can approximate arbitrary functions, and is especially suitable for local signal analysis, hence the generalization ability of the support vector machines (SVM) is improved. Based on the wavelet kernel and the least squares support vector machines, the least squares wavelet support vector machines (LS-WSVM) are constructed. In order to validate the performance of the wavelet kernel, LS-WSVM is applied to a nonlinear system identification problem, and the computational process is compared with that of the Gaussian kernel. The results show that the wavelet kernel is more efficient than the Gaussian kernel.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Narendra, K., Parthasarathy, K.: Identification and Control of Dynamical Systems Using Neural Networks. IEEE Trans. on Neural Networks 1, 4–27 (1990)
Benveniste, A., Juditsky, A., Delyon, B., Zhang, Q., Glorennec, P.Y.: Wavelets in Identification. In: 10th IFAC Symposim System Identification, Copenhagen, Denmark (1994)
Zhang, Q., Benveniste, A.: Wavelet Networks. IEEE Trans. on Neural Networks 3, 889–898 (1992)
Zhang, Q.: Using Wavelet Network in Nonparametric Estimation. IEEE Trans. On Neural Networks 8, 227–236 (1997)
Suykens, J.A.K., Vandewalle, J.: Least Squares Support Vector Machine Classifiers. Neural Processing Letters 9, 293–300 (1999)
Saunders, C., Gammerman, A., Vovk, V.: Ridge Regression Learning Algorithm in Dual Variables. In: Proceedings of the 15th International Conference on Machine Learning, Morgan Kaufmann, pp. 515–521. Morgan Kaufmann, San Francisco (1998)
Suykens, J.A.K., Brabanter, J.D., Lukas, L., Vandewalle, J.: Weighted Least Squares Support Vector Machines Robustness and Sparse Approximation. Neurocomputing 48, 85–105 (2002)
de Kruif, B.J., de Vries, T.J.A.: Pruning Error Minimization in Least Squares Support Vector Machines. IEEE Trans. On Neural Networks 14, 696–702 (2003)
Mercer, J.: Functions of Positive and Negative Type and Their Connection with the Theory of Integral Equation. Transactions of the London Philosophical Society A-209, 415–446 (1909)
Smola, A., Schölkopf, B., Müller, K.R.: The Connection Between Regularization Operators and Support Vector Kernels. Neural Networks 11, 637–649 (1998)
Zhang, L., Zhou, W.D., Jiao, L.C.: Wavelet Support Vector Machine. IEEE Trans. On Systems, Man, and Cybernetics-Part B: Cybernetics 34, 1–6 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yu, Z., Cai, Y. (2005). Least Squares Wavelet Support Vector Machines for Nonlinear System Identification. In: Wang, J., Liao, XF., Yi, Z. (eds) Advances in Neural Networks – ISNN 2005. ISNN 2005. Lecture Notes in Computer Science, vol 3497. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427445_71
Download citation
DOI: https://doi.org/10.1007/11427445_71
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25913-8
Online ISBN: 978-3-540-32067-8
eBook Packages: Computer ScienceComputer Science (R0)