Semi-supervised Dynamic Counter Propagation Network
Semi-supervised classification uses a large amount of unlabeled data to help a little amount of labeled data for designing classifiers, which has good potential and performance when the labeled data are difficult to obtain. This paper mainly discusses semi-supervised classification based on CPN (Counter-propagation Network). CPN and its revised models have merits such as simple structure, fast training and high accuracy. Especially, its training scheme combines supervised learning and unsupervised learning, which makes it very conformable to be extended to semi-supervised classification problem. According to the characteristics of CPN, we propose a semi-supervised dynamic CPN, and compare it with other two semi-supervised CPN models using Expectation Maximization and Co-Training/Self-Training techniques respectively. The experimental results show the effectiveness of CPN based semi-supervised classification methods.
KeywordsClass Label Label Data Unlabeled Data Handwritten Digit Supervise Algorithm
Unable to display preview. Download preview PDF.
- 1.Bennett, K.P., Demiriz, A.: Semi-Supervised Support Vector Machines. In: Proceedings of Neural Information Processing Systems, pp. 368–374. MIT Press, Denver (1999)Google Scholar
- 4.Avrim, B., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100. ACM Press, Madison, Wisconsin, United States (1998)Google Scholar
- 5.Nigam, K., Ghani, R.: Analyzing the Effectiveness and Applicability of Co-training. In: Ninth International Conference on Information and Know ledge Management, pp. 86–93. ACM Press, McLean, Virginia, United States (2000)Google Scholar
- 8.Zhongzhi, S.: Knowledge Discovery (in Chinese). Tsinghua University Press, Beijing (2002)Google Scholar
- 9.Chan, J., Koprinska, I., Poon, J.: Co-training on Textual Documents with a Single Natural Feature. In: Set Proceedings of the 9th Australasian Document Computing Symposium, pp. 47–54. ADSC, Melbourne, Australia (2004)Google Scholar
- 11.Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine, CA, http://www.ics.uci.edu/~mlearn/MLRepository.html