A Method to Construct the Mapping to the Feature Space for the Dot Product Kernels
Dot product kernels are a class of important kernel in the theory of support vector machine. This paper develops a method to construct the mapping that map the original data set into the high dimensional feature space, on which the inner product is defined by a dot product kernel. Our method can also be applied to the Gaussian kernels. Via this mapping, the structure of features in the feature space is easy to be observed, and the linear separability of data sets in the feature space is studied. We obtain that any two finite sets of data with empty overlap in the original space will become linearly separable in an infinite dimensional feature space, and a sufficient and necessary condition is also developed for two infinite sets of data in the original data space being linearly separable in the feature space, this condition can be applied to examine the existences and uniqueness of the hyperplane which can separate all the possible inputs correctly.
KeywordsSupport Vector Machine Feature Space Gaussian Kernel Reproduce Kernel Hilbert Space Polynomial Kernel
Unable to display preview. Download preview PDF.
- 4.Schurmann, J.: Pattern Classification: A Unified View of Statistical and Neural Approaches. Wiley, New York (1996)Google Scholar
- 5.Micchelli, C.A.: Algebraic Aspects of Interpolation. In: Proceedings of Symposia in Applied Mathematics, vol. 36, pp. 81–102 (1986)Google Scholar
- 6.Scholkopf, B., Smola, A.J.: Learning with Kernels. MIT Press, Cambridge (2002)Google Scholar
- 7.Smola, A.J.: Regression Estimation with Support Vector Learning Machines, Diplomarbeit, Technische Universitat Munchen (1996)Google Scholar
- 10.Saunders, C., Stitson, M.O., Weston, J., Bottou, L., Scholkopf, B., Smola, A.J.: Support Vector Machine Reference Manual. Technical Report CSD-TR-98-03, Department of Computer Science, Royal Holloway, University of London, Egham, UK (1998)Google Scholar
- 13.Micchelli, C.A.: Algebraic aspects of interpolation. In: Proceedings of Symposia in Applied Mathematics, vol. 36, pp. 81–102 (1986)Google Scholar