The VLDB Journal

, Volume 12, Issue 4, pp 320–332

THESUS: Organizing Web document collections based on link semantics

Authors

    • 76 Patision StreetAthens University of Economics and Business
  • Benjamin Nguyen
    • Domaine de VoluceauINRIA
  • Iraklis Varlamis
    • 76 Patision StreetAthens University of Economics and Business
  • Michalis Vazirgiannis
    • 76 Patision StreetAthens University of Economics and Business
Article

DOI: 10.1007/s00778-003-0100-6

Cite this article as:
Halkidi, M., Nguyen, B., Varlamis, I. et al. VLDB (2003) 12: 320. doi:10.1007/s00778-003-0100-6
  • 82 Views

Abstract.

The requirements for effective search and management of the WWW are stronger than ever. Currently Web documents are classified based on their content not taking into account the fact that these documents are connected to each other by links. We claim that a page’s classification is enriched by the detection of its incoming links’ semantics. This would enable effective browsing and enhance the validity of search results in the WWW context. Another aspect that is underaddressed and strictly related to the tasks of browsing and searching is the similarity of documents at the semantic level. The above observations lead us to the adoption of a hierarchy of concepts (ontology) and a thesaurus to exploit links and provide a better characterization of Web documents. The enhancement of document characterization makes operations such as clustering and labeling very interesting. To this end, we devised a system called THESUS. The system deals with an initial sets of Web documents, extracts keywords from all pages’ incoming links, and converts them to semantics by mapping them to a domain’s ontology. Then a clustering algorithm is applied to discover groups of Web documents. The effectiveness of the clustering process is based on the use of a novel similarity measure between documents characterized by sets of terms. Web documents are organized into thematic subsets based on their semantics. The subsets are then labeled, thereby enabling easier management (browsing, searching, querying) of the Web. In this article, we detail the process of this system and give an experimental analysis of its results.

Keywords:

World Wide WebLink analysisSimilarity measureDocument clusteringLink managementSemantics
Download to read the full article text

Copyright information

© Springer-Verlag Berlin/Heidelberg 2003