Advertisement

LSI-Based Taxonomy Generation: The Taxonomist System

  • Janusz Wnek
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3495)

Abstract

The following presents a method for constructing taxonomies by utilizing the Latent Semantic Indexing (LSI) technique. The LSI technique enables representation of textual data in a vector space, facilitates access to all documents and terms by contextual queries, and allows for text comparisons. A taxonomy generator downloads collection of documents, creates document clusters, assigns titles to clusters, and organizes the clusters in a hierarchy. The nodes in the hierarchy are ordered from general to specific in the depth of the hierarchy, and from most similar to least similar in the breadth of the hierarchy. This method is capable of producing meaningful classifications in a short time.

Keywords

Singular Value Decomposition Latent Semantic Analysis Candidate Term Latent Semantic Indexing Taxonomist System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by Latent Semantic Analysis. J. Am. Soc. Inf. Sc. 46(4), 391–407 (1990)CrossRefGoogle Scholar
  2. 2.
    Landauer, T., Littman, M.: Fully Automatic Cross-language Document Retrieval Using LSI. In: Proc. 6th Conf. UW Centre New Oxford English Dict. and Text Research, pp. 31–38 (1990)Google Scholar
  3. 3.
    Choi, F.Y.Y., Wiemer-Hastings, P., Moore, J.: Latent Semantic Analysis for Text Segmentation. In: Lee, L., Harman, D. (eds.) Proc. Conf. Emp. Meth in NLP, pp. 109–117 (2001)Google Scholar
  4. 4.
    Dumais, S.: Using LSI for Information Retrieval, Information Filtering, and Other Things. In: Proc. of the Cognitive Technology Workshop (1997)Google Scholar
  5. 5.
    Osinski, S., Stefanowski, J., Weiss, D.: Lingo - Search Results Clustering Algorithm Based on Singular Value Decomposition. In: Proc. IIS: IIPWM Conf., pp. 359–368 (2004)Google Scholar
  6. 6.
    Wnek, J.: Document Ontology Discovery Tool. In: Proc. IIS: IIPWM Conf., pp. 475–480 (2004)Google Scholar
  7. 7.
    Lewis, D.D.: Reuters-21578 Text Categorization Test Collection. Distribution 1.0 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Janusz Wnek
    • 1
  1. 1.Content Analyst Company, LLCRestonUSA

Personalised recommendations