Skip to main content
SpringerLink
Log in

Clustering Text Data Streams

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Clustering text data streams is an important issue in data mining community and has a number of applications such as news group filtering, text crawling, document organization and topic detection and tracing etc. However, most methods are similarity-based approaches and only use the TF*IDF scheme to represent the semantics of text data and often lead to poor clustering quality. Recently, researchers argue that semantic smoothing model is more efficient than the existing TF*IDF scheme for improving text clustering quality. However, the existing semantic smoothing model is not suitable for dynamic text data context. In this paper, we extend the semantic smoothing model into text data streams context firstly. Based on the extended model, we then present two online clustering algorithms OCTS and OCTSM for the clustering of massive text data streams. In both algorithms, we also present a new cluster statistics structure named cluster profile which can capture the semantics of text data streams dynamically and at the same time speed up the clustering process. Some efficient implementations for our algorithms are also given. Finally, we present a series of experimental results illustrating the effectiveness of our technique.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Dou Shen, Qiang Yang, JianTao Sun, Zheng Chen. Thread detection in dynamic text message streams. In Proc. ACM SIGIR 2006, Seattle, Washington, August 6–11, pp.35–42.

  2. Aggarwal C C. A framework for diagnosing changes in evolving data streams. In Proc. ACM SIGMOD 2003, San Diego, June 9–12, pp.575–586.

  3. Agrawal C C, Han J, Wang J, Yu P S. A framework for clustering evolving data streams. In Proc. VLDB 2003, Berlin, September 9–12, 2003, pp.81–92.

  4. Agrawal C C, Han J, Wang J, Yu P S. A framework for projected clustering of high dimensional data streams. In Proc. VLDB 2004, Toronto, August 31-September 3, pp.852–863.

  5. O’Callaghan L, Mishra N, Meyerson A, Guha S. Streaming data algorithms for high-quality clustering. In Proc. ICDE 2002, San Jose, CA, February 26-March 1, pp.685–704.

  6. Aggarwal C C, Yu P S, A framework for clustering massive text and categorical data streams. In Proc. SIAM Conference on Data Mining, Bethesda, MD, April 20–22, 2006, pp.407–411.

  7. Yang Y, Pierce T, Carbonell J. A study of retrospective and on-line event detection. In Proc. ACM SIGIR, Melbourne, August 24–28, 1998, pp.28–36.

  8. Arindam Banerjee, Sugato Basu. Topic models over text streams: A study of batch and online unsupervised learning. In Proc. SIAM Conference on Data Mining, Minneapolis, April 26–28, 2007, pp.437–442.

  9. Xiaodan Zhang, Xiaohua Zhou, Xiaohua Hu. Semantic smoothing for model-based document clustering. In Proc. ICDM06, Hong Kong, December 18–22, pp.1193–1198.

  10. Zhou X, Hu X, Zhang X, Lin X, Song I Y. Context-sensitive semantic smoothing for the language modeling approach to genomic IR. In Proc. ACM SIGIR, Seattle, Washington, August 6–11, 2006, pp.170–177.

  11. Zhai C, Lafferty J. Two-stage language models for information retrieval. In Proc. ACM SIGIR, Tampere, August 11–15, 2002, pp.49–56.

  12. Zhai C, Lafferty J. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proc. ACM SIGIR, New Orleans, September 9–13, 2001, pp.334–342.

  13. Yubao Liu, Jiarong Cai, Jian Yin, Ada Wai-Chee Fu. Clustering massive text data streams by semantic smoothing model. In Proc. ADMA, Harbin, August 6–8, 2007, pp.389–400.

  14. Zhong S, Ghosh J. Generative model-based document clustering: A comparative study. Knowledge and Information Systems, 2005, 8(3): 374–384.

    Article  Google Scholar 

  15. Steinbach M, Karypis G, Kumar V. A comparison of document clustering techniques. In Proc. Text Mining Workshop, KDD 2000, Boston, August 20–23, pp.1–20.

  16. Guha S, Mishra N, Motwani R, O’Callaghan L. Clustering data streams. In Proc. FOCS 2000, California, November 12–14, pp.359–366.

  17. Shi Zhong. Efficient streaming text clustering. Neural Networks, 2005, 18(5–6): 790–798.

    Article  MATH  Google Scholar 

  18. Fung G P C, Yu J X, Yu P S, Lu H. Parameter free bursty events detection in text streams. In Proc. VLDB 2005, Trondheim, August 30-September 2, pp.181–192

  19. Qi He, Kuiyu Chang, Ee-Peng Lim, Jun Zhang. Bursty feature representation for clustering text streams. In Proc. SIAM Conference on Data Mining 2007, Minneapolis, April 26–28, pp.491–496.

  20. Xu-Bin Deng, Yang-Yong Zhu. L-tree match: A new data extraction model and algorithm for huge text stream with noises. Journal of Computer Science and Technology, 2005, 20(6): 763–773.

    Article  MathSciNet  Google Scholar 

  21. Gabriel Pui Cheong Fung, Jeffery Xu Yu, Hongjun Lu. Classifying text streams in the presence of concept drifts. In Proc. PAKDD 2004, Sydney, May 26–28, pp.373–383.

  22. Haixun Wang, Jian Yin, Jian Pei, Philip S Yu, Jeffrey Xu Yu. Suppressing model over-fitting in mining concept-drifting data streams. In Proc. KDD 2006, Philadelphia, August 20–23, pp.736–741.

  23. Weiheng Zhu, Jian Pei, Jian Yin, Yihuang Xie. Granularity adaptive density estimation and on demand clustering of concept-drifting data streams. In Proc. DaWaK 2006, Krakow, September 4–8, pp.322–331.

  24. Qiaozhu Mei, Chengxiang Zhai. Discovering evolutionary theme patterns from text–An exploration of temporal text mining. In Proc. KDD 2005, Chicago, August 21–24, pp.198–207.

  25. Shouke Qin, Weining Qian, Aoying Zhou. Approximately processing multi-granularity aggregate queries over data streams. In Proc. ICDE 2006, Atlanta, April 3–8, p.67.

  26. Dong-Hong Han, Guo-Ren Wang, Chuan Xiao, Rui Zhou. Load shedding for window joins over streams. Journal of Computer Science and Technology, 2007, 22(2): 182–189.

    Article  Google Scholar 

  27. Zhi-Hong Chong, Jeffrey Xu Yu, Zhen-Jie Zhang, Xue-Min Lin, Wei Wang, Ao-Ying Zhou. Efficient computation of k-medians over data streams under memory constraints. Journal of Computer Science and Technology, 2006, 21(2): 284–296.

    Article  Google Scholar 

  28. Jian Pei, Haixun Wang, Philip S Yu. Online mining of data streams: Applications, techniques and progress. In Proc. KDD 2004 (Tutorials), Seattle, WA, August 22–25, pp.1–60.

  29. Joong Hyuk Chang, Won Suk Lee. Effect of count estimation in finding frequent itemsets over online transactional data streams. Journal of Computer Science and Technology, 2005, 20(1): 63–69.

    Article  Google Scholar 

  30. Jiawei Han, Yixin Chen, Guozhu Dong, Jian Pei, Benjamin W Wah, Jianyong Wang, Y Dora Cai. Stream cube: An architecture for multi-dimensional analysis of data streams. Distributed and Parallel Databases, 2005, 18(2): 173–197.

    Article  Google Scholar 

  31. Yixin Chen, Guozhu Dong, Jiawei Han, Benjamin W Wah, Jianyong Wang. Multi-dimensional regression analysis of time-series data streams. In Proc. VLDB 2002, August 20–23, Hong Kong, pp.323–334.

  32. Yubao Liu, Jiarong Cai, Jian Yin, Zhilan Huang. Document clustering based on semantic smoothing approach. In Proc. AWIC 2007, Fontainebleau, June 25–27, pp.217–222.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Sun Yat-Sen University, Guangzhou, 510275, China

    Yu-Bao Liu, Jia-Rong Cai & Jian Yin

  2. Department of Computer Science and Engineering, the Chinese University of Hong Kong, Hong Kong, China

    Ada Wai-Chee Fu

Authors
  1. Yu-Bao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jia-Rong Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jian Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ada Wai-Chee Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yu-Bao Liu.

Additional information

Supported by the National Natural Science Foundation of China under Grant Nos. 60573097, 60703111, 60773198, the Natural Science Foundation of Guangdong Province under Grant No. 06104916, the Specialized Research Foundation for the Doctoral Program of Higher Education under Grant No. 20050558017 and the Program for New Century Excellent Talents in University of China under Grant No. NCET–06–0727.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(PDF 62 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, YB., Cai, JR., Yin, J. et al. Clustering Text Data Streams. J. Comput. Sci. Technol. 23, 112–128 (2008). https://doi.org/10.1007/s11390-008-9115-1

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-008-9115-1

Keywords

Search

Navigation