Semi-supervised Learning Based on Label Propagation through Submanifold
A semi-supervised learning algorithm is proposed based on label propagation through submanifold. The algorithm assumes that samples lying in a local neighborhood share the same labels and the global labels changing among submanifolds is sufficiently smooth. The algorithm firstly introduces a k-nearest neighbor graph to describe local neighborhood among the data set. And then, a cost function and a constraint equation are proposed, which stand for the global smoothness of the class labels’ changing and the labeled samples’ information respectively. The final semi-supervised learning task is converted to a typical quadratic program, whose optimal solution can minimize the cost function and satisfy the supervised constraint. Experimental results of the algorithm on toy data, digit recognition, and text classification demonstrate the feasibility and efficiency of the proposed algorithm.
KeywordsSemi-supervised learning K-nearest neighbor graph Quadratic program Classification
Unable to display preview. Download preview PDF.
- 1.Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with Local and Global Consistency. In: Advances in Neural Information Processing Systems(NIPS), pp. 321–328 (2003)Google Scholar
- 2.Chapelle, O., Weston, J., Scholkopf, B.: Cluster Kernels for Semi-Supervised Learning. In: Advances in Neural Information Processing Systems(NIPS), pp. 585–592 (2002)Google Scholar
- 3.Belkin, M., Niyogi, P., Sindhwani, V.: On Manifold Regularization. In: Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics (2005)Google Scholar
- 4.Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised Learning Using Gaussian Fields and Harmonic Functions. In: Proceedings of ICML, 20th International Conference on Machine Learning, pp. 912–919 (2003)Google Scholar
- 6.Joachims, T.: Transductive Learning via Spectral Graph Partitioning. In: Proceedings of ICML, 20th International Conference on Machine Learning, pp. 290–297 (2003)Google Scholar
- 7.Chung, F.R.K.: Spectral Graph Theory. American Mathematical Society (1997)Google Scholar
- 8.Blum, A., Chawla, S.: Learning from Labeled and Unlabeled Data Using Graph Mincuts. Proceedings of ICML. In: 18th International Conference on Machine Learning, pp. 19–26 (2001)Google Scholar