The Effects of Web Logs and the Semantic Web on Autonomous Web Agents

  • Michael P. Evans
  • Richard Newman
  • Timothy A. Millea
  • Timothy Putnam
  • Andrew Walker
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3280)

Abstract

Search engines exploit the Web’s hyperlink structure to help infer information content. The new phenomenon of personal Web logs, or ‘blogs’, encourage more extensive annotation of Web content. If their resulting link structures bias the Web crawling applications that search engines depend upon, there are implications for another form of annotation rapidly on the rise, the Semantic Web. We conducted a Web crawl of 160 000 pages in which the link structure of the Web is compared with that of several thousand blogs. Results show that the two link structures are significantly different. We analyse the differences and infer the likely effect upon the performance of existing and future Web agents. The Semantic Web offers new opportunities to navigate the Web, but Web agents should be designed to take advantage of the emerging link structures, or their effectiveness will diminish.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Michael P. Evans
    • 1
  • Richard Newman
    • 1
  • Timothy A. Millea
    • 1
  • Timothy Putnam
    • 1
  • Andrew Walker
    • 2
  1. 1.Applied Software Engineering Group, School of Systems EngineeringThe University of ReadingReadingUK
  2. 2.School of MathematicsKingston UniversityKingston-upon-Thames, SurreyUK

Personalised recommendations