Clustering Abstracts Instead of Full Texts

  • Pavel Makagonov
  • Mikhail Alexandrov
  • Alexander Gelbukh
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3206)


Accessibility of digital libraries and other web-based repositories has caused the illusion of accessibility of the full texts of scientific papers. However, in the majority of cases such an access (at least free access) is limited only to abstracts having no more then 50–100 words. Traditional keyword-based approach for clustering this type of documents gives unstable and imprecise results. We show that they can be easy improved with more adequate keyword selection and document similarity evaluation. We suggest simple procedures for this. We evaluate our approach on the data from two international conferences. One of our conclusions is the suggestion for the digital libraries and other repositories to provide document images of full texts of the papers along with their abstracts for open access via Internet.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alexandrov, M., Gelbukh, A., Makagonov, P.: On metrics for keyword-based document selection and classification. In: CICLing 2000, Proceedings of the 1st Intern. Conf. on Intelligent Text Processing and Computational Linguistics, Mexico, pp. 373–389 (2000)Google Scholar
  2. 2.
    Baeza-Yates, R., Ribero-Neto, B.: Modern Information Retrieval. Addison Wesley, Reading (1999)Google Scholar
  3. 3.
    Gelbukh, A. (ed.): CICLing 2002. LNCS, vol. 2276. Springer, Heidelberg (2002)zbMATHGoogle Scholar
  4. 4.
    Hartigan, J.: Clustering Algorithms. Wiley, Chichester (1975)zbMATHGoogle Scholar
  5. 5.
    Hynek, J., Ježek, K., Rohlik, O.: Short Document Categorization – Itemsets Method. In: PKDD 2000. LNCS, vol. 1910, p. 6. Springer, Heidelberg (2000)Google Scholar
  6. 6.
    Kiers, H., et al. (eds.): IFCS 2000, Proceedings of 7th Intern. Conf. on Data Analysis, Classification, and Related Methods. Studies in classification, data analysis, and knowledge organization. Springer, Heidelberg (2000)Google Scholar
  7. 7.
    Makagonov, P., Alexandrov, M., Sboychakov, K.: Keyword-based technology for clustering short documents. In: Selected Papers. Computing Research, CIC-IPN, Mexico, pp. 105–114 (2000a)Google Scholar
  8. 8.
    Makagonov, P., Alexandrov, M., Sboychakov, K.: A toolkit for development of the domainoriented dictionaries for structuring document flows. In: Data Analysis, Classification, and Related Methods, Studies in classification, data analysis, and knowledge organization, pp. 83–88. Springer, Heidelberg (2000b)Google Scholar
  9. 9.
    Makagonov, P., Alexandrov, M.: Constructing empirical formulas for testing word similarity by the inductive method of model self-organization. In: Advances in Natural Language Processing, LNAI, vol. 2379, Springer, Heidelberg, pp. 239–247 (2002)Google Scholar
  10. 10.
    Manning, D.C., Schütze, H.: Foundations of statistical natural language processing. MIT Press, Cambridge (1999)zbMATHGoogle Scholar
  11. 11.
    Solomon, G.: Data dependent methods of cluster analysis. In: Classification and Clustering, pp. 129–147. Academic Press, London (1977)Google Scholar
  12. 12.
    Strzalkowski, T. (ed.): Natural Language and Information Retrieval. Kluwer Academic Publishers, Dordrecht (1999)Google Scholar
  13. 13.
    Žižka, J., Bourek, A.: Automated Selection of Interesting Medical Text Documents by the TEA Text Analyzer. In: Gelbukh, A. (ed.) CICLing 2002. LNCS, vol. 2276, pp. 402–404. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Pavel Makagonov
    • 1
  • Mikhail Alexandrov
    • 2
  • Alexander Gelbukh
    • 2
    • 3
  1. 1.Mixteca University of TechnologyMexico
  2. 2.National Polytechnic InstituteCenter for Computing ResearchMexico
  3. 3.Computer Science and Engineering DepartmentChung-Ang UniversitySeoulKorea

Personalised recommendations