Knowledge and Information Systems

, Volume 29, Issue 2, pp 249–272

The ClusTree: indexing micro-clusters for anytime stream mining

  • Philipp Kranen
  • Ira Assent
  • Corinna Baldauf
  • Thomas Seidl
Regular Paper

Abstract

Clustering streaming data requires algorithms that are capable of updating clustering results for the incoming data. As data is constantly arriving, time for processing is limited. Clustering has to be performed in a single pass over the incoming data and within the possibly varying inter-arrival times of the stream. Likewise, memory is limited, making it impossible to store all data. For clustering, we are faced with the challenge of maintaining a current result that can be presented to the user at any given time. In this work, we propose a parameter-free algorithm that automatically adapts to the speed of the data stream. It makes best use of the time available under the current constraints to provide a clustering of the objects seen up to that point. Our approach incorporates the age of the objects to reflect the greater importance of more recent data. For efficient and effective handling, we introduce the ClusTree, a compact and self-adaptive index structure for maintaining stream summaries. Additionally we present solutions to handle very fast streams through aggregation mechanisms and propose novel descent strategies that improve the clustering result on slower streams as long as time permits. Our experiments show that our approach is capable of handling a multitude of different stream characteristics for accurate and scalable anytime stream clustering.

Keywords

Data mining Clustering Anytime Stream mining 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag London Limited 2010

Authors and Affiliations

  • Philipp Kranen
    • 1
  • Ira Assent
    • 2
  • Corinna Baldauf
    • 1
  • Thomas Seidl
    • 1
  1. 1.RWTH Aachen UniversityAachenGermany
  2. 2.Aarhus UniversityAarhusDenmark

Personalised recommendations