Some Marginal Learning Algorithms for Unsupervised Problems
In this paper, we investigate one-class and clustering problems by using statistical learning theory. To establish a universal framework, a unsupervised learning problem with predefined threshold η is formally described and the intuitive margin is introduced. Then, one-class and clustering problems are formulated as two specific η-unsupervised problems. By defining a specific hypothesis space in η-one-class problems, the crucial minimal sphere algorithm for regular one-class problems is proved to be a maximum margin algorithm. Furthermore, some new one-class and clustering marginal algorithms can be achieved in terms of different hypothesis spaces. Since the nature in SVMs is employed successfully, the proposed algorithms have robustness, flexibility and high performance. Since the parameters in SVMs are interpretable, our unsupervised learning framework is clear and natural. To verify the reasonability of our formulation, some synthetic and real experiments are conducted. They demonstrate that the proposed framework is not only of theoretical interest, but they also has a legitimate place in the family of practical unsupervised learning techniques.
KeywordsLearning Problem Unsupervised Learning Cluster Problem Hypothesis Space Machine Learn Research
Unable to display preview. Download preview PDF.
- 3.Cristianini, N., Schawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge Univ. Press, Cambridge (2000)Google Scholar
- 7.Rätsch, G.: Robust boosting via convex optimization. Ph. D. thesis, University of Posdam (2001)Google Scholar
- 8.Kégl, B.: Principal curves: learning, design, and applications. Ph. D. Thesis, Concordia University (1999)Google Scholar
- 14.Tao, Q., Wu, G., Wang, J.: A new maximum margin algorithm for one-class problems and its boosting implementation. Pattern Recognition (2005) (accepted)Google Scholar
- 16.Ben-Hur, A., Horn, D., Siegelmann, H.T., Vapnik, V.: Support Vector Clustering. Journal of Machine Learning Research 2, 135–137 (2001)Google Scholar