Distributed Pattern Discovery in Multiple Streams

  • Jimeng Sun
  • Spiros Papadimitriou
  • Christos Faloutsos
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3918)


Given m groups of streams which consist of n 1,...,n m co-evolving streams in each group, we want to: (i) incrementally find local patterns within a single group, (ii) efficiently obtain global patterns across groups, and more importantly, (iii) efficiently do that in real time while limiting shared information across groups. In this paper, we present a distributed, hierarchical algorithm addressing these problems. Our experimental case study confirms that the proposed method can perform hierarchical correlation detection efficiently and effectively.


Local Pattern Reconstruction Error Independent Component Analysis Global Pattern Multiple Stream 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agrawal, C., Yu, P.: A condensation approach to privacy preserving data mining. In: Bertino, E., Christodoulakis, S., Plexousakis, D., Christophides, V., Koubarakis, M., Böhm, K., Ferrari, E. (eds.) EDBT 2004. LNCS, vol. 2992, pp. 183–199. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  2. 2.
    Babcock, B., Olston, C.: Distributed Top-K Monitoring. In: SIGMOD (2003)Google Scholar
  3. 3.
    Cheung, D.W., Ng, V.T., Fu, A.W., Fu, Y.: Efficient Mining of Association Rules in Distributed Databases. TKDE 8, 911–922 (1996)Google Scholar
  4. 4.
    Liu, K., Kargupta, H., Ryan, J.: Multiplicative noise, random projection, and privacy preserving data mining from distributed multi-party data. In: TKDE (2005)Google Scholar
  5. 5.
    Loo, K.K., Tong, I., Kao, B.: Online Algorithms for Mining Inter-stream Associations from Large Sensor Networks. In: Ho, T.-B., Cheung, D., Liu, H. (eds.) PAKDD 2005. LNCS, vol. 3518, pp. 143–149. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  6. 6.
    Sun, J., Papadimitriou, S., Faloutsos, C.: Distributed pattern discovery in multiple streams. In: Technical Report CMU-CS-06-100, Carnegie Mellon Univ. (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jimeng Sun
    • 1
  • Spiros Papadimitriou
    • 2
  • Christos Faloutsos
    • 1
  1. 1.Carnegie Mellon UniversityUSA
  2. 2.IBM Watson Research CenterUSA

Personalised recommendations