Unsupervised Change Analysis Using Supervised Learning

  • Shohei Hido
  • Tsuyoshi Idé
  • Hisashi Kashima
  • Harunobu Kubo
  • Hirofumi Matsuzawa
Conference paper

DOI: 10.1007/978-3-540-68125-0_15

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5012)
Cite this paper as:
Hido S., Idé T., Kashima H., Kubo H., Matsuzawa H. (2008) Unsupervised Change Analysis Using Supervised Learning. In: Washio T., Suzuki E., Ting K.M., Inokuchi A. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2008. Lecture Notes in Computer Science, vol 5012. Springer, Berlin, Heidelberg

Abstract

We propose a formulation of a new problem, which we call change analysis, and a novel method for solving the problem. In contrast to the existing methods of change (or outlier) detection, the goal of change analysis goes beyond detecting whether or not any changes exist. Its ultimate goal is to find the explanation of the changes. While change analysis falls in the category of unsupervised learning in nature, we propose a novel approach based on supervised learning to achieve the goal. The key idea is to use a supervised classifier for interpreting the changes. A classifier should be able to discriminate between the two data sets if they actually come from two different data sources. In other words, we use a hypothetical label to train the supervised learner, and exploit the learner for interpreting the change. Experimental results using real data show the proposed approach is promising in change analysis as well as concept drift analysis.

Keywords

change analysis two-sample test concept drift 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Shohei Hido
    • 1
  • Tsuyoshi Idé
    • 1
  • Hisashi Kashima
    • 1
  • Harunobu Kubo
    • 1
  • Hirofumi Matsuzawa
    • 1
  1. 1.IBM ResearchTokyo Research LaboratoryKanagawaJapan

Personalised recommendations