Adaptive Mechanisms for Classification Problems with Drifting Data
Most work on supervised learning is undertaken on static problems. However, in many real world classification problems, the environment in which the classifiers operate is dynamic i.e. the descriptions of classes change with time. In this paper, the process of generating drifting data is introduced in order to assess two adaptive approaches that deal with dynamically changing data. These approaches are: retraining on evolving data set and incremental learning. The empirical evaluation has shown that both these approaches improve the performance compared to the non-adaptive mode though a number of outstanding research issues remain.
KeywordsConcept drift adaptive classification Incremental learning
Unable to display preview. Download preview PDF.
- 1.Kelly, M.G., Hand, D.J., Adams, N.M.: The impact of changing populations on classifier performance. In: Proc of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 367–371 (1999)Google Scholar
- 3.Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23(1), 69–101 (1996)Google Scholar
- 4.Salganicoff, M.: Density-adaptive learning and forgetting. In: Proceedings of the Tenth International Conference on Machine Learning, pp. 276–283 (1993)Google Scholar
- 7.Lim, C.P., Harrison, R.F.: Online pattern classification with multiple neural network systems: an experimental study. Systems, Man and Cybernetics, Part C, IEEE Transactions 33(2), 235–247 (2003)Google Scholar
- 9.Bouchachia, A., Gabrys, B., Sahel, Z.: Overview of some incremental learning algorithms (2007)Google Scholar
- 10.Hettich, S., Blake, C., Merz, C.: UCI repository of machine learning databases (1998), www.ics.uci.edu/~mlearn/MLRepository.html
- 11.Duin, R.P.W.: PRTools 3 Manual, provided with PRTools 3.1.6 Toolkit (2000)Google Scholar
- 14.Salzberg, S.: A nearest hyperrectangle learning method. Machine learning 6, 277–309 (1991)Google Scholar
- 16.Fritzke, B.: A growing neural gas network learns topologies. In: Advances in neural information processing systems, pp. 625–632 (1995)Google Scholar
- 17.Bouchachia, A.: Incremental learning via function decomposition. In: Proceedings of the 5th ICMLA, pp. 63–68. IEEE Computer Society, Los Alamitos (2006)Google Scholar