Towards Large Scale Semantic Annotation Built on MapReduce Architecture

  • Michal Laclavík
  • Martin Šeleng
  • Ladislav Hluchý
Conference paper

DOI: 10.1007/978-3-540-69389-5_38

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5103)
Cite this paper as:
Laclavík M., Šeleng M., Hluchý L. (2008) Towards Large Scale Semantic Annotation Built on MapReduce Architecture. In: Bubak M., van Albada G.D., Dongarra J., Sloot P.M.A. (eds) Computational Science – ICCS 2008. ICCS 2008. Lecture Notes in Computer Science, vol 5103. Springer, Berlin, Heidelberg

Abstract

Automated annotation of the web documents is a key challenge of the Semantic Web effort. Web documents are structured but their structure is understandable only for a human that is the major problem of the Semantic Web. Semantic Web can be exploited only if metadata understood by a computer reach critical mass. Semantic metadata can be created manually, using automated annotation or tagging tools. Automated semantic annotation tools with the best results are built on different machine learning algorithms requiring training sets. Another approach is to use pattern based semantic annotation solutions built on NLP, information retrieval or information extraction methods. Most of developed methods are tested and evaluated on hundreds of documents which cannot prove its real usage on large scale data such as web or email communication in enterprise or community environment. In this paper we present how a pattern based annotation tool can benefit from Google’s MapReduce architecture to process large amount of text data.

Keywords

semantic annotation information extraction metadata MapReduce 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Michal Laclavík
    • 1
  • Martin Šeleng
    • 1
  • Ladislav Hluchý
    • 1
  1. 1.Institute of Informatics, Slovak Academy of SciencesBratislava

Personalised recommendations