A Semi-supervised Online Sequential Extreme Learning Machine Method
Online sequential ELM (OS-ELM) provides a solution for streaming data application by only learning the newly arrived single or chunk of observations, and presents outstanding performance for learning problems. However, the algorithm relies on the labeled data, which usually involves high cost in labor and time. Moreover, manually labeled data suffers from inaccuracy caused by individual bias. Considering the semi-supervised ELM (SS-ELM) provides a way to fully utilize the easily acquired unlabeled data, the paper proposes a semi-supervised online sequential ELM, denoted as SOS-ELM. The proposed SOS-ELM not only has the advantage of learning in a sequential way, but also makes the most use of unlabeled data. Experiments have been done on benchmark problems of regression and classification and the results show that the proposed SOS-ELM outperforms OS-ELM in generalization performance with similar training speed and outperforms SS-ELM with much lower training time cost.
KeywordsOnline Sequential ELM (OS-ELM) Semi-supervised ELM (SS-ELM) Semi-supervised online sequential ELM (SOS-ELM)
Unable to display preview. Download preview PDF.
- 1.Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of International Joint Conference on Neural Networks (IJCNN 2004), vol. 2, pp. 985–990 (2004)Google Scholar
- 8.Lan, Y., Soh, Y.C., Huang, G.-B.: Two-stage extreme learning machine for regression Neurocomputing 73(16), 3028–3038 (2010)Google Scholar
- 9.Huang, G.-B.: An insight into extreme learning machines: random neurons, random features and kernels. Cognitive Computation, pp. 1–15 (2014)Google Scholar
- 12.Huang, G., Song, S., Gupta, J.N.D., et al.: Semi-supervised and unsupervised extreme learning machines. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics (2014)Google Scholar
- 15.Blake, C., Merz, C.: UCI repository of machine learning databases Dept. Inf. Comp. Sci. Univ.California, Irvine (1998)Google Scholar
- 16.Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 469–501 (2006)Google Scholar
- 17.Vapnik, V.: The nature of statistical learning theory. Springer (2000)Google Scholar
- 18.Chapelle, O., Sch, B., Zien, A.: Semi-Supervised Learning. MIT Press (2006), http://www.kyb.tuebingen.mpg.de/ssl-book