Skip to main content

Multilingual News Document Clustering: Two Algorithms Based on Cognate Named Entities

  • Conference paper
Text, Speech and Dialogue (TSD 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4188))

Included in the following conference series:

Abstract

This paper presents an approach for Multilingual News Document Clustering in comparable corpora. We have implemented two algorithms of heuristic nature that follow the approach. They use as unique evidence for clustering the identification of cognate named entities between both sides of the comparable corpora. In addition, no information about the right number of clusters has to be provided to the algorithms. The applicability of the approach only depends on the possibility of identifying cognate named entities between the languages involved in the corpus. The main difference between the two algorithms consists of whether a monolingual clustering phase is applied at first or not. We have tested both algorithms with a comparable corpus of news written in English and Spanish. The performance of both algorithms is slightly different; the one that does not apply the monolingual phase reaches better results. In any case, the obtained results with both algorithms are encouraging and show that the use of cognate named entities can be enough knowledge for deal with multilingual clustering of news documents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mathieu, B., Besancon, R., Fluhr, C.: Multilingual Document clusters discovery. In: RIAO 2004, pp. 1–10 (2004)

    Google Scholar 

  2. Chen, H.-H., Lin, C.-J.: A Multilingual News Summarizer. In: Proceedings of 18th International Conference on Computational Linguistics, pp. 159–165 (2000)

    Google Scholar 

  3. Karypis, G.: CLUTO: A Clustering Toolkit. Technical Report: 02-017. University of Minnesota, Department of Computer Science, Minneapolis, MN 55455 (2002)

    Google Scholar 

  4. Gang, W.: Named Entity Recognition and An Apply on Document Clustering. MCSc Thesis. Dalhousie University, Faculty of Computer Science, Canada (2004)

    Google Scholar 

  5. García, M., Martínez, F., Ureñay, L.A., Martín, M.T.: Generación de un tesauro multilingue a partir de un corpus comparable aplicado a CLIR. Procesamiento de Lenguaje Natural 28, 55–62 (2002)

    Google Scholar 

  6. Gliozzo, A., Strapparava, C.: Cross language Text Categorization by acquiring Multilingual Domain Models from Comparable Corpora. In: Proceedings of the ACL Workshop on Building and Using Parallel Texts, pp. 9–16 (2005)

    Google Scholar 

  7. Leftin, L.J.: Newsblaster Russian-English Clustering Performance Analysis. Columbia computer science Technical Reports (2003)

    Google Scholar 

  8. Montalvo, S., Martínez, R., Casillas, A., Fresno, V.: Multilingual Document Clustering: an Heuristic Approach Based on Cognate Named Entities. In: COLING-ACL 2006 (to be published, 2006)

    Google Scholar 

  9. Pouliquen, B., Steinberger, R., Ignat, C., Käsper, E., Temikova, I.: Multilingual and cross-lingual news topic tracking. In: Proceedings of the 20th International Conference on Computational Linguistics, pp. 23–27 (2004)

    Google Scholar 

  10. Rauber, A., Dittenbach, M., Merkl, D.: Towards Automatic Content-Based Organization of Multilingual Digital Libraries: An English, French, and German View of the Russian Information Agency Novosti News. In: Third All-Russian Conference Digital Libraries: Advanced Methods and Technologies, Digital Collections Petrozavodsk, RCDI 2001 (2001)

    Google Scholar 

  11. van Rijsbergen, C.J.: Foundations of evaluation. Journal of Documentation 30, 365–373 (1974)

    Article  Google Scholar 

  12. Silva, J., Mexia, J., Coelho, C., Lopes, G.: A Statistical Approach for Multilingual Document Clustering and Topic Extraction form Clusters. Pliska Studia Mathematica Bulgarica 16, 207–228 (2004)

    MathSciNet  Google Scholar 

  13. Steinberger, R., Pouliquen, B., Scheer, J.: Cross-Lingual Document Similarity Calculation Using the Multilingual Thesaurus EUROVOC. In: Gelbukh, A. (ed.) CICLing 2002. LNCS, vol. 2276, p. 415. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  14. Steinberger, R., Pouliquen, B., Ignat, C.: Exploting multilingual nomenclatures and language-independent text features as an interlingua for cross-lingual text analysis applications. In: SILTC (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Montalvo, S., Martínez, R., Casillas, A., Fresno, V. (2006). Multilingual News Document Clustering: Two Algorithms Based on Cognate Named Entities. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2006. Lecture Notes in Computer Science(), vol 4188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11846406_21

Download citation

  • DOI: https://doi.org/10.1007/11846406_21

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-39090-9

  • Online ISBN: 978-3-540-39091-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics