Abstract
Adapting classification models to concept changes is one of the main challenges associated with learning in dynamic environments, where the definition of the target concept may change over time under the influence of varying contextual factors. Existing adaptive approaches, however, are limited in terms of the extent to which such contextual factors are explicitly identified and utilised, despite their importance. In response, we propose an informationtheoretic- based approach for systematic context identification, aiming to learn from data the contextual characteristics of the domain by identifying the context variables contributing to concept changes. Such explicit identification of context enables capturing the causes of drift, and hence facilitating more effective adaptation. We conduct experimental analyses to demonstrate the effectiveness of the approach on both simulated datasets with various change scenarios, and on an actual benchmark dataset from an electricity market.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, New York (2006)
Chen, A.: Context-Aware Collaborative Filtering System: Predicting the User’s Preference in the Ubiquitous Computing Environment. In: Strang, T., Linnhoff-Popien, C. (eds.) LoCA 2005. LNCS, vol. 3479, pp. 244–253. Springer, Heidelberg (2005)
Dey, A.: Understanding and Using Context. Personal and Ubiquitous Computing 5(1), 4–7 (2001)
Francois, D., Wertz, V., Verleysen, M.: The Permutation Test for Feature Selection by Mutual Information. In: Proc. of the 14th European Symposium on Artificial Neural Networks, pp. 239–244 (2006)
Gomes, J.B., Sousa, P.A., Menasalvas, E.: Tracking Recurrent Concepts Using Context. Intelligent Data Analysis 16(5), 803–825 (2012)
Gama, J., Medas, P., Castillo, G., Rodrigues, P.: Learning with Drift Detection. In: Bazzan, A.L.C., Labidi, S. (eds.) SBIA 2004. LNCS (LNAI), vol. 3171, pp. 286–295. Springer, Heidelberg (2004)
Harries, M., Sammut, C., Horn, K.: Extracting Hidden Context. Machine Learning 32(2), 101–126 (1998)
Harries, M.: Splice-2 Comparative Evaluation: Electricity Pricing. Technical report, University of New South Wales (1999)
Kraskov, A., Stögbauer, H., Grassberger, P.: Estimating Mutual Information. Physics Review E 69(6), 66138–66154 (2004)
Pavlidis, N.G., Tasoulis, D.K., Adams, N.M., Hand, D.J.: Adaptive Consumer Credit Classification. Journal of the Operational Research Society 63(12), 1645–1654 (2012)
Shannon, C.: A Mathematical Theory of Communication. The Bell System Technical Journal 27(7), 379–423 (1948)
Street, W.N., Kim, Y.S.: A Streaming Ensemble Algorithm (SEA) for Large-Scale Classification. In: Proc. of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 377–382. ACM, New York (2001)
Turney, P.: The Identification of Context-Sensitive Features: A Formal Definition of Context for Concept Learning. In: Proc. of the ICML Workshop on Learning in Context-Sensitive Domains, Bari, Italy, pp. 53–59 (1996)
Tsimpiris, A., Vlachos, I., Kugiumtzis, D.: Nearest Neighbor Estimate of Conditional Mutual Information in Feature Selection. Expert Systems with Applications 39, 12697–12708 (2012)
Widmer, G.: Tracking Context Changes through Meta-Learning. Machine Learning 27(3), 259–286 (1997)
Zliobaite, I., Kuncheva, L.: Determining the Training Window for Small Sample Size Classification with Concept Drift. In: Proc. of the IEEE International Conference on Data Mining Workshop, pp. 447–452. IEEE, Washington, DC (2009)
Žliobaitė, I.: Identifying Hidden Contexts in Classification. In: Huang, J.Z., Cao, L., Srivastava, J. (eds.) PAKDD 2011, Part I. LNCS, vol. 6634, pp. 277–288. Springer, Heidelberg (2011)
Zliobaite, I.: How Good is the Electricity Benchmark for Evaluating Concept Drift Adaptation. CoRR, abs/1301-3524 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Barakat, L. (2014). Context Identification and Exploitation in Dynamic Data Mining - An Application to Classifying Electricity Price Changes. In: Bouchachia, A. (eds) Adaptive and Intelligent Systems. ICAIS 2014. Lecture Notes in Computer Science(), vol 8779. Springer, Cham. https://doi.org/10.1007/978-3-319-11298-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-11298-5_9
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11297-8
Online ISBN: 978-3-319-11298-5
eBook Packages: Computer ScienceComputer Science (R0)