Clustering Abstracts Instead of Full Texts
Accessibility of digital libraries and other web-based repositories has caused the illusion of accessibility of the full texts of scientific papers. However, in the majority of cases such an access (at least free access) is limited only to abstracts having no more then 50–100 words. Traditional keyword-based approach for clustering this type of documents gives unstable and imprecise results. We show that they can be easy improved with more adequate keyword selection and document similarity evaluation. We suggest simple procedures for this. We evaluate our approach on the data from two international conferences. One of our conclusions is the suggestion for the digital libraries and other repositories to provide document images of full texts of the papers along with their abstracts for open access via Internet.
Unable to display preview. Download preview PDF.
- 1.Alexandrov, M., Gelbukh, A., Makagonov, P.: On metrics for keyword-based document selection and classification. In: CICLing 2000, Proceedings of the 1st Intern. Conf. on Intelligent Text Processing and Computational Linguistics, Mexico, pp. 373–389 (2000)Google Scholar
- 2.Baeza-Yates, R., Ribero-Neto, B.: Modern Information Retrieval. Addison Wesley, Reading (1999)Google Scholar
- 5.Hynek, J., Ježek, K., Rohlik, O.: Short Document Categorization – Itemsets Method. In: PKDD 2000. LNCS, vol. 1910, p. 6. Springer, Heidelberg (2000)Google Scholar
- 6.Kiers, H., et al. (eds.): IFCS 2000, Proceedings of 7th Intern. Conf. on Data Analysis, Classification, and Related Methods. Studies in classification, data analysis, and knowledge organization. Springer, Heidelberg (2000)Google Scholar
- 7.Makagonov, P., Alexandrov, M., Sboychakov, K.: Keyword-based technology for clustering short documents. In: Selected Papers. Computing Research, CIC-IPN, Mexico, pp. 105–114 (2000a)Google Scholar
- 8.Makagonov, P., Alexandrov, M., Sboychakov, K.: A toolkit for development of the domainoriented dictionaries for structuring document flows. In: Data Analysis, Classification, and Related Methods, Studies in classification, data analysis, and knowledge organization, pp. 83–88. Springer, Heidelberg (2000b)Google Scholar
- 9.Makagonov, P., Alexandrov, M.: Constructing empirical formulas for testing word similarity by the inductive method of model self-organization. In: Advances in Natural Language Processing, LNAI, vol. 2379, Springer, Heidelberg, pp. 239–247 (2002)Google Scholar
- 11.Solomon, G.: Data dependent methods of cluster analysis. In: Classification and Clustering, pp. 129–147. Academic Press, London (1977)Google Scholar
- 12.Strzalkowski, T. (ed.): Natural Language and Information Retrieval. Kluwer Academic Publishers, Dordrecht (1999)Google Scholar