Knowledge and Information Systems

, Volume 44, Issue 2, pp 439–474

Compressed vertical partitioning for efficient RDF management

  • Sandra Álvarez-García
  • Nieves Brisaboa
  • Javier D. Fernández
  • Miguel A. Martínez-Prieto
  • Gonzalo Navarro
Regular Paper

Abstract

The Web of Data has been gaining momentum in recent years. This leads to increasingly publish more and more semi-structured datasets following, in many cases, the RDF (Resource Description Framework) data model based on atomic triple units of subject, predicate, and object. Although it is a very simple model, specific compression methods become necessary because datasets are increasingly larger and various scalability issues arise around their organization and storage. This requirement is even more restrictive in RDF stores because efficient SPARQL solution on the compressed RDF datasets is also required. This article introduces a novel RDF indexing technique that supports efficient SPARQL solution in compressed space. Our technique, called \(\hbox {k}^2\)-triples, uses the predicate to vertically partition the dataset into disjoint subsets of pairs (subject, object), one per predicate. These subsets are represented as binary matrices of subjects \(\times \) objects in which 1-bits mean that the corresponding triple exists in the dataset. This model results in very sparse matrices, which are efficiently compressed using \(\hbox {k}^2\)-trees. We enhance this model with two compact indexes listing the predicates related to each different subject and object in the dataset, in order to address the specific weaknesses of vertically partitioned representations. The resulting technique not only achieves by far the most compressed representations, but also achieves the best overall performance for RDF retrieval in our experimental setup. Our approach uses up to 10 times less space than a state-of-the-art baseline and outperforms its time performance by several orders of magnitude on the most basic query patterns. In addition, we optimize traditional join algorithms on \(\hbox {k}^2\)-triples and define a novel one leveraging its specific features. Our experimental results show that our technique also overcomes traditional vertical partitioning for join solution, reporting the best numbers for joins in which the non-joined nodes are provided, and being competitive in most of the cases.

Keywords

RDF Compressed index Vertical partitioning  Memory-based SPARQL solution \(\hbox {k}^2\)-tree 

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  • Sandra Álvarez-García
    • 1
  • Nieves Brisaboa
    • 1
  • Javier D. Fernández
    • 2
    • 3
  • Miguel A. Martínez-Prieto
    • 2
    • 3
    • 4
  • Gonzalo Navarro
    • 3
  1. 1.Database Lab, Facultade de InformáticaUniversity of A CoruñaA CoruñaSpain
  2. 2.DataWeb Research, Department of Computer ScienceUniversity of ValladolidValladolidSpain
  3. 3.Department of Computer ScienceUniversity of ChileSantiagoChile
  4. 4.Escuela Universitaria de InformáticaCampus María ZambranoSegoviaSpain

Personalised recommendations