Evaluating Hard and Soft Flat-Clustering Algorithms for Text Documents

  • Vivek Kumar Singh
  • Tanveer Jahan Siddiqui
  • Manoj Kumar Singh
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 179)

Abstract

Document clustering refers to unsupervised classification (categorization) of documents into groups (clusters) in such a way that the documents in a cluster are similar, whereas dissimilar documents are assigned in different clusters. The documents may be web pages, blog posts, news articles, or other text files. A popular and computationally efficient clustering technique is flat clustering. Unlike hierarchical techniques, flat clustering algorithms aim to partition the document space into groups of similar documents. The cluster assignments however may be hard or soft. This paper presents our experimental work on evaluating some hard and soft flat-clustering algorithms, namely K-means, heuristic k-means and fuzzy C-means, for categorizing text documents. We experimented with different representations (tf, tf.idf, Boolean) and feature selection schemes (with or without stop word removal and with or without stemming) on some standard datasets. The results indicate that tf.idf representation and the use of stemming obtains better clustering. Moreover, fuzzy clustering obtains better results than K-means on almost all datasets, and is also a more stable method.

Keywords

Fuzzy Cluster Cosine Similarity Vector Space Model Cluster Quality Stop Word 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31(31) 477–488 (1995)Google Scholar
  2. 2.
    Jain, A.K.: 50 years beyond K-means. In: 19th International Conference on Pattern Recognition, Tampa, FL (2008)Google Scholar
  3. 3.
    Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice-Hall Advanced Reference Series, Prentice Hall, NJ (1988)Google Scholar
  4. 4.
    Manning, C.D., Raghvan, P., Schutze, H.: Introduction to Information Retrieval, Cambridge University Press, Cambridge (2008)Google Scholar
  5. 5.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2th edn. Wiley-Interscience, New York (2000)Google Scholar
  6. 6.
    Valente De Oliviera, J., Pedrycz, W.: Advances in Fuzzy Clustering and its Applications, pp. 3–30. Wiley, Hoboken (2007)Google Scholar
  7. 7.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)Google Scholar
  8. 8.
    Alag, S.: Collective Intelligence in Action. Manning, New York (2009)Google Scholar
  9. 9.
    Rand, W.M.: Objective criteria for evaluation of clustering methods. J. Am. Stat. Assoc. 36(31), pp. 846–850 (1971)Google Scholar
  10. 10.
    Bjorner, L., Aone, C,: Fast and Effective Text Mining Using Liner time Document Clustering. In: Knowledge and Data Discovery’ 1999, California. (1999)Google Scholar
  11. 11.
    Van Rijsbergen, C.J.: Information Retrieval. 2nd edn, Butterworths, London (1979)Google Scholar
  12. 12.
    Lewis, D., Reuters-21578. http://www.research.att.com/lewis/reuters21578.html. Accessed Jan 2011
  13. 13.
    Classic 4 (7095). ftp://ftp.cs.cornell.edu/pub/smart. Accessed Jan 2011
  14. 14.
  15. 15.
    Porter, M.F.: An Algorithm for Suffix Stripping. Program 14(3), 130–137 (1980)Google Scholar
  16. 16.
    Steinbach, M., Karypis, G., Kumar, V.: A comparison of document clustering techniques. In: KDD Workshop on Text Mining (2002)Google Scholar
  17. 17.
    Xiong, H., Wu, J., Chen, J.: K-means clustering versus validation measures—a data distribution perspective. In: KDD’06, ACM Press (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Vivek Kumar Singh
    • 1
  • Tanveer Jahan Siddiqui
    • 2
  • Manoj Kumar Singh
    • 3
  1. 1.Department of Computer ScienceBanaras Hindu University (BHU)VaranasiIndia
  2. 2.Institute of Applied Physics and TechnologyUniversity of AllahabadAllahabadIndia
  3. 3.DST-Centre for Interdisciplinary Mathematical Sciences(DST-CIMS)Banaras Hindu University (BHU)VaranasiIndia

Personalised recommendations