Abstract
Classification of evolving data stream requires adaptation during exploitation of algorithms to follow the changes in data. One of the approaches to provide the classifier the ability to adapt changes is usage of sliding window - learning on the basis of the newest data samples. Active learning is the paradigm in which algorithm decides on its own which data will be used as training samples; labels of only these samples need to be obtained and delivered as the learning material. This paper will investigate the error of classic sliding window algorithm and its active version, as well as its learning curve after sudden drift occurs. Two novel performance measures will be introduces and some of their features will be highlighted.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Machine Learning 6, 37–66 (1991)
Asuncion, A., Newman, D.J.: UCI ML Repository. University of California, School of Information and Computer Science, Irvine, CA (2007), http://www.ics.uci.edu/~mlearn/MLRepository.html
Black, M.M., Hickey, R.J.: Classification of customer call data in the presence of concept drift and noise. In: Bustard, D.W., Liu, W., Sterritt, R. (eds.) Soft-Ware 2002. LNCS, vol. 2311, p. 74–87. Springer, Heidelberg (2002)
Delany, S., Cunningham, P., Tsymbal, A.: A comparison of ensemble and case-base main- tenance techniques for handling concept drift in spam filtering. In: Proc. of the 19th Int. Conf. on Artificial Intelligence. AAAI Press, Menlo Park (2006)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, NY (2001)
Hilas, C.: Designing an expert system for fraud detection in private telecommunications networks. Expert Syst. 36(9), 11559–11569 (2009)
Kelly, M., Hand, D., Adams, N.: The impact of changing populations on classifier performance. In: Proc. of the 5th ACM SIGKDD Int. Conf. on Knowledge discovery and data mining. ACM, New York (1999); Kurlej, B., Woźniak, M.: Active Learning Approach to Concept Drift Problem. Logic Journal of IGPL, Oxford Journals; doi: 10.1093/jigpal/JZR011 (in-press)
Lattner, A., Miene, A., Visser, U., Herzog, O.: Sequential pattern mining for situation and behavior prediction in simulated robotic soccer. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, pp. 118–129. Springer, Heidelberg (2006)
Patcha, A., Park, J.: An overview of anomaly detection techniques: Existing solutions and latest technological trends. Comput. Netw. 51(12), 3448–3470 (2007)
Procopio, M., Mulligan, J., Grudic, G.: Learning terrain segmentation with classifier ensembles for autonomous robot navigation in unstructured environments. J. Field Robot. 26(2), 145–175 (2009)
Schlimmer, J., Granger, R.: Incremental learning from noisy data. Machine Learning 1(3), 317–354 (1986)
Thrun, S., et al.: Winning the DARPA Grand Challenge. Journal of Field Robotics 23(9), 661–692 (2006)
Tsymbal, A.: The problem of concept drift: definitions and related work, Technical Report TCD-CS-2004-15, Department of Computer Science, Trinity College Dublin (2004)
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23(1), 69–101 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kurlej, B., Woźniak, M. (2011). Learning Curve in Concept Drift While Using Active Learning Paradigm. In: Bouchachia, A. (eds) Adaptive and Intelligent Systems. ICAIS 2011. Lecture Notes in Computer Science(), vol 6943. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23857-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-23857-4_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23856-7
Online ISBN: 978-3-642-23857-4
eBook Packages: Computer ScienceComputer Science (R0)