IC2IT 2017: Recent Advances in Information and Communication Technology 2017 pp 160-168 | Cite as
A New Streaming Learning for Stream Chunk Data Classification Based on Incremental Learning and Adaptive Boosting Algorithm
Abstract
Currently, stream data classification is a challenge task to discover new useful knowledge from massive and dynamic data in big data era. This paper proposes a streaming learning method based on the incremental learning using a new adaptive boosting algorithm for stream data. The proposed adaptive boosting consists of a new method for updating distribution weight and the new weight voting. This learning method concentrates on learning from sequential chunks of data stream. The distribution weight updating method uses error of previous hypothesis to update the weight. The learning method uses only one data chunk to create a new hypothesis at a time and after learning, the learned data chunk can be thrown away and can learn the new data chunk without using the previous learned data. The experimental results show that the accuracy of the proposed method is higher than other methods in all datasets.
Keywords
Incremental learning Adaptive boosting Stream data ClassificationReferences
- 1.Oza, N.C.: Online bagging and boosting. In: IEEE International Conference on Systems, Man and Cybernetics, pp. 2340–2345 (2005)Google Scholar
- 2.Polikar, R., Upda, L., Honavar, V.: Learn++: an incremental learning algorithm for supervised neural networks. IEEE Syst. Man Cybern. 31, 497–508 (2001)CrossRefGoogle Scholar
- 3.Topalis, M.A., Polikar, R., Learn, N.C.: Combining ensemble of classifiers with dynamically weighted consult-and-vote for efficient incremental learning of new classes. IEEE Neural Netw. 20, 152–168 (2008)Google Scholar
- 4.Junsawang, P., Phimoltares, S., Lursinsap, C.: A fast learning method for streaming and randomly ordered multi-class data chunks by using one-pass-throw-away class-wise learning concept. Expert Syst. Appl. 26, 249–266 (2016)CrossRefGoogle Scholar
- 5.Jaiyen, S., Lursinsap, C., Phimoltares, S.: A very fast neural learning for classification using only new incoming datum. IEEE Neural Netw. 21, 381–392 (2010)CrossRefGoogle Scholar
- 6.Xu, S., Wang, J.: A fast incremental extreme learning machine algorithm for data streams classification. Expert Syst. Appl. 65, 332–344 (2016)CrossRefGoogle Scholar
- 7.Pang, S., Ozawa, S., Kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Syst. Man Cybern. 25, 1901–1914 (2005)Google Scholar
- 8.Nguyen, H.L., Woon, Y.K., Ng, W.K.: A survey on data stream clustering and classification. Knowl. Inf. Syst. 45, 535–569 (2015)CrossRefGoogle Scholar
- 9.Sun, Y., Tang, K., Minku, L.L., Wang, S., Yao, X.: Online ensemble learning of data streams with gradually evolved classes. IEEE Knowl. Data Eng. 28, 1532–1545 (2016)CrossRefGoogle Scholar
- 10.Asuncion, A., Newman, D.J.: UCI Machine Learning Repository [Online] (2007). http://www.ics.uci.edu/∼mlearn/MLRepository.html
- 11.Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. IEEE Syst. Man Cybern. 42, 463–484 (2012)CrossRefGoogle Scholar