Classification with Invariant Distance Substitution Kernels
Kernel methods offer a flexible toolbox for pattern analysis and machine learning. A general class of kernel functions which incorporates known pattern invariances are invariant distance substitution (IDS) kernels. Instances such as tangent distance or dynamic time-warping kernels have demonstrated the real world applicability. This motivates the demand for investigating the elementary properties of the general IDS-kernels. In this paper we formally state and demonstrate their invariance properties, in particular the adjustability of the invariance in two conceptionally different ways. We characterize the definiteness of the kernels. We apply the kernels in different classification methods, which demonstrates various benefits of invariance.
KeywordsKernel Method Optical Character Recognition Kernel Principal Component Analysis Total Invariance Transformation Knowledge
Unable to display preview. Download preview PDF.
- HAASDONK, B. (2005): Transformation Knowledge in Pattern Analysis with Kernel Methods - Distance and Integration Kernels. PhD thesis, University of Freiburg.Google Scholar
- HAASDONK, B. and BAHLMANN, B. (2004): Learning with distance substitution kernels. In: Proc. of 26th DAGM-Symposium. Springer, 220-227.Google Scholar
- SCHÖLKOPF, B. and SMOLA, A. J. (2002): Learning with Kernels: Support Vector Ma-chines, Regularization, Optimization and Beyond. MIT Press.Google Scholar
- SHAWE-TAYLOR, J. and CRISTIANINI, N. (2004): Kernel Methods for Pattern Analysis. Cambridge University Press.Google Scholar