FedBench: A Benchmark Suite for Federated Semantic Data Query Processing

  • Michael Schmidt
  • Olaf Görlitz
  • Peter Haase
  • Günter Ladwig
  • Andreas Schwarte
  • Thanh Tran
Conference paper

DOI: 10.1007/978-3-642-25073-6_37

Volume 7031 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Schmidt M., Görlitz O., Haase P., Ladwig G., Schwarte A., Tran T. (2011) FedBench: A Benchmark Suite for Federated Semantic Data Query Processing. In: Aroyo L. et al. (eds) The Semantic Web – ISWC 2011. ISWC 2011. Lecture Notes in Computer Science, vol 7031. Springer, Berlin, Heidelberg

Abstract

In this paper we present FedBench, a comprehensive benchmark suite for testing and analyzing the performance of federated query processing strategies on semantic data. The major challenge lies in the heterogeneity of semantic data use cases, where applications may face different settings at both the data and query level, such as varying data access interfaces, incomplete knowledge about data sources, availability of different statistics, and varying degrees of query expressiveness. Accounting for this heterogeneity, we present a highly flexible benchmark suite, which can be customized to accommodate a variety of use cases and compare competing approaches. We discuss design decisions, highlight the flexibility in customization, and elaborate on the choice of data and query sets. The practicability of our benchmark is demonstrated by a rigorous evaluation of various application scenarios, where we indicate both the benefits as well as limitations of the state-of-the-art federated query processing strategies for semantic data.

Download to read the full conference paper text

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Michael Schmidt
    • 1
  • Olaf Görlitz
    • 2
  • Peter Haase
    • 1
  • Günter Ladwig
    • 3
  • Andreas Schwarte
    • 1
  • Thanh Tran
    • 3
  1. 1.Fluid Operations AGWalldorfGermany
  2. 2.Institute for Web Science and TechnologyUniversity of Koblenz-LandauGermany
  3. 3.Institute AIFBKarlsruhe Institute of TechnologyGermany