Adaptive Classifier Selection Based on Two Level Hypothesis Tests for Incremental Learning
Recently, the importance of incremental learning in changing environments has been acknowledged. This paper proposes a new ensemble learning method based on two level hypothesis tests for incremental learning in concept changing environments. We analyze the classification error as a stochastic variable, and introduce hypothesis test as mechanism for adaptively selecting classifiers. Hypothesis tests are used to distinguish between useful and useless individual classifiers and to identify classifier to be updated. Classifiers deemed as useful by the hypothesis test are integrated to form the final prediction. Experiments with simulated concept changing scenarios show that the proposed method could adaptively choose proper classifiers and adapt quickly to different concept changes to maintain its performance level.
KeywordsConcept Change Base Classifier Incremental Learning Concept Drift Target Concept
Unable to display preview. Download preview PDF.
- 1.Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23, 69–101 (1996)Google Scholar
- 4.Schlimmer, J.C., Granger Jr., R.H.: Incremental learning from noisy data. Machine Learning 1, 317–354 (1986)Google Scholar
- 7.Street, W., Kim, Y.: A streaming ensemble algorithm (SEA) for large-scale classification. In: Proc. 7th ACM SIGKDD, pp. 377–382. ACM Press, New York (2001)Google Scholar
- 8.Wang, H., Fan, W., Yu, P.S., Han, J.: Mining concept-drifting data streams using ensemble classifiers. In: SIGKDD 2003, Washington, DC, USA, August 24-27 (2003)Google Scholar
- 10.Klinkenberg, R., Renz, I.: Adaptive information filtering: Learning in the presence of concept drifts. In: Learning for Text Categorization, pp. 33–40. AAAI Press, Menlo Park (1998)Google Scholar
- 14.Duda, R.O., Hart, P.E.: Pattern classification and scene analysis, 2nd edn. Willey and Sons, New York (2001)Google Scholar
- 16.Hulten, G., Spencer, L., Domingos, P.: Mining time-changing data streams. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, pp. 97–106 (2001)Google Scholar