A Combined Phrase and Thesaurus Browser for Large Document Collections

  • Gordon W. Paynter
  • Ian H. Witten
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2163)

Abstract

A browsing interface to a document collection can be constructed automatically by identifying the phrases that recur in the full text of the documents and structuring them into a hierarchy based on lexical inclusion. This provides a good way of allowing readers to browse comfortably through the phrases (all phrases) in a large document collection.

A subject-oriented thesaurus provides a different kind of hierarchical structure, based on deep knowledge of the subject area. If all documents, or parts of documents, are tagged with thesaurus terms, this provides a very convenient way of browsing through a collection. Unfortunately, manual classification is expensive and infeasible for many practical document collections.

This paper describes a browsing scheme that gives the best of both worlds by providing a phrase-oriented browser and a thesaurus browser within the same interface. Users can switch smoothly between the phrases in the collection, which give access to the actual documents, and the thesaurus entries, which suggest new relationships and new terms to seek.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Chang, S.J. and Rice, R.E. (1993) “Browsing: a multidimensional framework.” Annual Review of Information Science and Technology, Vol. 28, pp. 231–276.Google Scholar
  2. 2.
    FAO (1995) AGROVOC: multilingual agricultural thesaurus. Food and Agriculture Organization of the United Nations, Rome, Italy.Google Scholar
  3. 3.
    Giles, C.L., Bollacker, K. and Lawrence, S. (1998) “CiteSeer: An automatic citation indexing system.” Proc ACM Digital Libraries, Pittsburgh, PA, pp, 89–98.Google Scholar
  4. 4.
    Nevill-Manning, C.G., Witten, I.H. and Paynter, G.W. (1999) “Lexically-generated subject hierarchies for browsing large collections.” Int J Digital Libraries, Vol. 2, No. 2/3, pp. 111–123; September.CrossRefGoogle Scholar
  5. 5.
    Paynter, G.W., Witten, I.H., Cunningham, S.J. and Buchanan, G. (2000a) “Scalable browsing for large collections.” Proc ACM Digital Libraries, San Antonio, TX, pp. 215–223.Google Scholar
  6. 6.
    Paynter, G.W., Cunningham, S.J. and Witten, I.H. (2000b) “Evaluating extracted phrases and extending thesauri.” Proc Asian Digital Libraries Conference, Seoul, Korea, pp. 131–138.Google Scholar
  7. 7.
    Witten, I.H., McNab, R.J., Boddie, S., Bainbridge, D. (1999) “Greenstone: a comprehensive open-source digital library software system.” Proc ACM Digital Libraries, San Antonio, TX, pp. 113–121.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Gordon W. Paynter
    • 1
  • Ian H. Witten
    • 1
  1. 1.Department of Computer ScienceUniversity of WaikatoNew Zealand

Personalised recommendations