Little Knowledge Rules the Web: Domain-Centric Result Page Extraction

  • Tim Furche
  • Georg Gottlob
  • Giovanni Grasso
  • Giorgio Orsi
  • Christian Schallhart
  • Cheng Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6902)

Abstract

Web extraction is the task of turning unstructured HTML into structured data. Previous approaches rely exclusively on detecting repeated structures in result pages. These approaches trade intensive user interaction for precision.

In this paper, we introduce the Amber(“Adaptable Model-based Extraction of Result Pages”) system that replaces the human interaction with a domain ontology applicable to all sites of a domain. It models domain knowledge about (1) records and attributes of the domain, (2) low-level (textual) representations of these concepts, and (3) constraints linking representations to records and attributes. Parametrized with these constraints, otherwise domain-independent heuristics exploit the repeated structure of result pages to derive attributes and records. Amber is implemented in logical rules to allow an explicit formulation of the heuristics and easy adaptation to different domains.

We apply Amber to the UK real estate domain where we achieve near perfect accuracy on a representative sample of 50 agency websites.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tim Furche
    • 1
  • Georg Gottlob
    • 1
  • Giovanni Grasso
    • 1
  • Giorgio Orsi
    • 1
  • Christian Schallhart
    • 1
  • Cheng Wang
    • 1
  1. 1.Department of Computer ScienceUniversity of OxfordUK

Personalised recommendations