Skip to main content
SpringerLink
Log in

Distance Measures for Clustering of Documents in a Topic Space

  • Conference paper
  • First Online:
Engineering in Dependability of Computer Systems and Networks (DepCoS-RELCOMEX 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 987))

Included in the following conference series:

Abstract

Topic modeling is a method for discovery of topics (groups of words). In this paper we focus on clustering documents in a topic space obtained using the MALLET tool. We tested several different distance measures with two clustering algorithm (spectral clustering, agglomerative hierarchical clustering) and described those that served better (cosine distance, correlation distance, bhattacharyya distance) than the Euclidean metric for k-means algorithm. For evaluation purpose we used Adjusted Mutual Information (AMI) score. The need for such experiments comes from the difficulty of choosing appropriate grouping methods for the given data, which is specific in our case.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agarwal, P., Alam, M.A., Biswas, R.: Issues, challenges and tools of clustering algorithms. arXiv preprint arXiv:1110.2610 (2011)

  2. Aherne, F.J., Thacker, N.A., Rockett, P.I.: The Bhattacharyya metric as an absolute similarity measure for frequency coded data. Kybernetika 34(4), 363–368 (1998)

    MathSciNet  MATH  Google Scholar 

  3. Barde, B.V., Bainwad, A.M.: An overview of topic modeling methods and tools. In: International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 745–750 (2017)

    Google Scholar 

  4. Beyer, K., Goldstein, J., Ramakrishnan, R., Shaft, U.: When is “nearest neighbor” meaningful? In: ICDT 1999 Proceedings of the 7th International Conference on Database Theory, pp. 217–235 (1999)

    Google Scholar 

  5. Blei, D.M.: Probabilistic topic models. Commun. ACM 55(4), 77–84 (2012)

    Article  Google Scholar 

  6. Day, W.H.E., Edelsbrunner, H.: Efficient algorithms for agglomerative hierarchical clustering methods. J. Classif. 1(1), 7–24 (1984)

    Article  Google Scholar 

  7. Dueck, D., Frey, B.J.: Non-metric affinity propagation for unsupervised image categorization. In: 2007 IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE (2007)

    Google Scholar 

  8. Fung, G.: A comprehensive overview of basic clustering algorithms (2001)

    Google Scholar 

  9. Huang, A.: Similarity measures for text document clustering. In: Proceedings of the 6th New Zealand Computer Science Research Student Conference (2008)

    Google Scholar 

  10. K. Khan, S. U. Rehman, K.A.S.F., Sarasvady, S.: DBSCAN: past, present and future. In: The Fifth International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2014), pp. 232–238 (2014)

    Google Scholar 

  11. Keim D. A., Hinneburg A., A.C.C.: On the surprising behavior of distance metrics in high dimensional space. In: ICDT 2001 Proceedings of the 8th International Conference on Database Theory, pp. 420–434 (2001)

    Google Scholar 

  12. Jain, A.K.: Data clustering: 50 years beyond k-means. Pattern Recognit. Lett. 31(8), 651–666 (2009)

    Article  Google Scholar 

  13. Kriegel, H.-P., Schubert, E., Zimek, A.: A survey on unsupervised outlier detection. Stat. Anal. Data Min. 5, 363–387 (2012)

    Article  MathSciNet  Google Scholar 

  14. Milligan Ian, Weingart Scott, G.S.: Getting started with topic modeling and mallet. Technical report (2012). http://hdl.handle.net/10012/11751

  15. Młynarczyk, K., Piasecki, M.: Wiki test - 34 categories (2015). http://hdl.handle.net/11321/217. CLARIN-PL digital repository

  16. Młynarczyk, K., Piasecki, M.: Wiki train - 34 categories (2015). http://hdl.handle.net/11321/222. CLARIN-PL digital repository

  17. Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in neural information processing systems, pp. 849–856 (2002)

    Google Scholar 

  18. Subhashini, R., Kumar, V.J.: Evaluating the performance of similarity measures used in document clustering and information retrieval. In: Integrated Intelligent Computing, pp. 27–31 (2010)

    Google Scholar 

  19. Vinh, N.X., Epps, J., Bailey, J.: Information theoretic measures for clusterings comparison: is a correction for chance necessary? In: Proceedings of the 26th Annual International Conference on Machine Learning, ICML 2009, pp. 1073–1080. ACM, New York, NY, USA (2009). http://doi.acm.org/10.1145/1553374.1553511

  20. Vinh, N.X., Epps, J., Bailey, J.: Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J. Mach. Learn. Res. 11(Oct), 2837–2854 (2010)

    MathSciNet  MATH  Google Scholar 

  21. Walkowiak, T., Malak, P.: Polish texts topic classification evaluation. In: Proceedings of the 10th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, pp. 515–522. INSTICC, SciTePress (2018)

    Google Scholar 

  22. Wallach, H.M.: Topic modeling: Beyond bag-of-words. In: Proceedings of the 23rd International Conference on Machine Learning, ICML 2006, pp. 977–984. ACM, New York, NY, USA (2006). http://doi.acm.org/10.1145/1143844.1143967

Download references

Acknowledgements

The work was funded by the Polish Ministry of Science and Higher Education within CLARIN-PL Research Infrastructure.

Author information

Authors and Affiliations

  1. Faculty of Electronics, Wrocław University of Science and Technology, Wrocław, Poland

    Tomasz Walkowiak

  2. Faculty of Computer Science and Management, Wrocław University of Science and Technology, Wrocław, Poland

    Mateusz Gniewkowski

Authors
  1. Tomasz Walkowiak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mateusz Gniewkowski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tomasz Walkowiak .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wroclaw, Poland

    Wojciech Zamojski

  2. Wrocław University of Science and Technology, Wroclaw, Poland

    Jacek Mazurkiewicz

  3. Wrocław University of Science and Technology, Wroclaw, Poland

    Jarosław Sugier

  4. Wrocław University of Science and Technology, Wroclaw, Poland

    Tomasz Walkowiak

  5. Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland

    Janusz Kacprzyk

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Walkowiak, T., Gniewkowski, M. (2020). Distance Measures for Clustering of Documents in a Topic Space. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Engineering in Dependability of Computer Systems and Networks. DepCoS-RELCOMEX 2019. Advances in Intelligent Systems and Computing, vol 987. Springer, Cham. https://doi.org/10.1007/978-3-030-19501-4_54

Download citation

Publish with us

Policies and ethics

Search

Navigation