Sempala: Interactive SPARQL Query Processing on Hadoop

  • Alexander Schätzle
  • Martin Przyjaciel-Zablocki
  • Antony Neu
  • Georg Lausen
Conference paper

DOI: 10.1007/978-3-319-11964-9_11

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8796)
Cite this paper as:
Schätzle A., Przyjaciel-Zablocki M., Neu A., Lausen G. (2014) Sempala: Interactive SPARQL Query Processing on Hadoop. In: Mika P. et al. (eds) The Semantic Web – ISWC 2014. ISWC 2014. Lecture Notes in Computer Science, vol 8796. Springer, Cham

Abstract

Driven by initiatives like Schema.org, the amount of semantically annotated data is expected to grow steadily towards massive scale, requiring cluster-based solutions to query it. At the same time, Hadoop has become dominant in the area of Big Data processing with large infrastructures being already deployed and used in manifold application fields. For Hadoop-based applications, a common data pool (HDFS) provides many synergy benefits, making it very attractive to use these infrastructures for semantic data processing as well. Indeed, existing SPARQL-on- Hadoop (MapReduce) approaches have already demonstrated very good scalability, however, query runtimes are rather slow due to the underlying batch processing framework. While this is acceptable for data-intensive queries, it is not satisfactory for the majority of SPARQL queries that are typically much more selective requiring only small subsets of the data. In this paper, we present Sempala, a SPARQL-over-SQL-on-Hadoop approach designed with selective queries in mind. Our evaluation shows performance improvements by an order of magnitude compared to existing approaches, paving the way for interactive-time SPARQL query processing on Hadoop.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Alexander Schätzle
    • 1
  • Martin Przyjaciel-Zablocki
    • 1
  • Antony Neu
    • 1
  • Georg Lausen
    • 1
  1. 1.Department of Computer ScienceUniversity of FreiburgFreiburgGermany

Personalised recommendations