Journal of Intelligent Information Systems

, Volume 22, Issue 3, pp 215–235

An Analytical Approach to Concept Extraction in HTML Environments

  • Victor Fresno
  • Angela Ribeiro
Article

Abstract

The core of the Internet and World Wide Web revolution comes from their capacity to efficiently share the huge quantity of data, but the rapid and chaotic growth of the Net has extremely complicated the task of sharing or mining useful information. Each inference process, from Internet information, requires an adequate characterization of the Web pages. The textual part of a page is one of the most important aspects that should be considered to appropriately perform a page characterization. The textual characterization should be made through the extraction of an appropriate set of relevant concepts that properly represent the text included in the Web page. This paper presents a method to obtain such a set of relevant concepts from a Web page, essentially based on a relevance estimation of each word in the text of a Web page. The word-relevance is defined by a combination of criteria that take into account characteristics of the HTML language as well as more classical measures such as the frequency and the position of a word in a document. Besides, heuristic rules to obtain the most suitable fusion of criteria is achieved via a statistical study. Several experiments are conducted to test the performance of the proposed concept extraction method compared to other approaches including a commercial tool. The results obtained here exhibit a greater success in the concept extraction by the proposed technique against other tested methods.

concept extraction feature vector in HTML texts Web page characterization Web page representation Web page classification 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Victor Fresno
    • 1
  • Angela Ribeiro
    • 2
  1. 1.Escuela Superior de Ciencias Experimentales y TecnologiaRey Juan Carlos UniversityMostoles, MadridSpain
  2. 2.Industrial Automation Institute (IAI)Spanish Council for Scientific Research (CSIC)MadridSpain

Personalised recommendations