Abstract
In 2013 property paths were introduced with the release of SPARQL 1.1. These property paths allow for describing complex queries in a more concise and comprehensive way. The W3C introduced a formal specification of the semantics of property paths, to which implementations should adhere. Most commonly used RDF stores claim to support property paths. In order to give insight into how well current implementations of property paths work we have developed BeSEPPI, a benchmark for the semantic-based evaluation of property path implementations. BeSEPPI checks whether RDF stores follow the W3Cs semantics by testing the correctness and completeness of query result sets. The results of our benchmark show that only one out of 5 benchmarked RDF stores returns complete and correct result sets for all benchmark queries.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
We have presented some preliminary results in a non-archival workshop contribution in [11]. For this paper, we have improved the benchmark by creating a larger variety of queries as well as their correct results sets. These queries are a unit test to check whether property paths implementations adhere to the W3C’s semantics.
- 2.
With our definition of paths, we do not allow cycles to appear within a path. We use this definition since the auxiliary function ALP which is used by the transitive and transitive reflexive property path expression in the W3Cs semantics of property paths [9] uses the same definition of paths.
- 3.
The notation of property path semantics presented in this section, is based on the definitions of property paths in [12].
- 4.
In [12] the evaluation of the existential property path expression and the transitive reflexive closure property path expression are defined slightly differently from the definition of the W3C in [9]. We have contacted members of the SPARQL working group in order to resolve these differences [4, 5].
- 5.
Available as open source under https://github.com/Institute-Web-Science-and-Technologies/BeSEPPI.
- 6.
- 7.
- 8.
- 9.
- 10.
References
Arenas, M., Pérez, J.: Federation and navigation in SPARQL 1.1. In: Eiter, T., Krennwallner, T. (eds.) Reasoning Web 2012. LNCS, vol. 7487, pp. 78–111. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33158-9_3
Bizer, C., Schultz, A.: The Berlin SPARQL benchmark. Int. J. Semant. Web Inf. Syst. 5, 1–24 (2009)
https://www.w3.org/2001/sw/DataAccess/rq23/sparql-defns.html#defn_ASK
https://lists.w3.org/Archives/Public/public-sparql-dev/2017OctDec/0009.html
https://lists.w3.org/Archives/Public/public-sparql-dev/2018JanMar/0004.html
DuCharme, B.: Learning SPARQL. O’Reilly Media Inc., Sebastopol (2011). Chap. 2, pp 19–44; Chap. 3. pp 45–100
Gubichev, A., Bedathur, S., Seufert, S.: Sparqling kleene: fast property paths in RDF-3X, June 2013
Guo, Y., Pan, Z., Heflin, J.: LUBM: A benchmark for OWL knowledge base systems. Web Semant. 3(2–3), 158–182 (2005). https://doi.org/10.1016/j.websem.2005.06.005
Harris, S., Seaborne, A.: SPARQL 1.1 query language. https://www.w3.org/TR/sparql11-query/
Hoffart, J., Suchanek, F.M., Berberich, K., Weikum, G.: YAGO2: a spatially and temporally enhanced knowledge base from Wikipedia. Artif. Intell. 194, 28–61 (2013). https://doi.org/10.1016/j.artint.2012.06.001. http://www.sciencedirect.com/science/article/pii/S0004370212000719. artificial Intelligence, Wikipedia and Semi-Structured Resources
Janke, D., Skubella, A., Staab, S.: Evaluating SPARQL 1.1 property path support. In: BLINK/NLIWoD3@ISWC (2017)
Kostylev, E.V., Reutter, J.L., Romero, M., Vrgoč, D.: SPARQL with property paths. In: Arenas, M., Corcho, O., Simperl, E., Strohmaier, M., d’Aquin, M., Srinivas, K., Groth, P., Dumontier, M., Heflin, J., Thirunarayan, K., Staab, S. (eds.) ISWC 2015. LNCS, vol. 9366, pp. 3–18. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25007-6_1
Malyshev, S., Krötzsch, M., González, L., Gonsior, J., Bielefeldt, A.: Getting the most out of Wikidata: semantic technology usage in Wikipedia’s knowledge graph. In: Vrandečić, D., Bontcheva, K., Suárez-Figueroa, M.C., Presutti, V., Celino, I., Sabou, M., Kaffee, L.-A., Simperl, E. (eds.) ISWC 2018. LNCS, vol. 11137, pp. 376–394. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00668-6_23
Morsey, M., Lehmann, J., Auer, S., Ngonga Ngomo, A.-C.: DBpedia SPARQL benchmark – performance assessment with real queries on real data. In: Aroyo, L., Welty, C., Alani, H., Taylor, J., Bernstein, A., Kagal, L., Noy, N., Blomqvist, E. (eds.) ISWC 2011. LNCS, vol. 7031, pp. 454–469. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25073-6_29. http://dl.acm.org/citation.cfm?id=2063016.2063046
Prud’hommeaux, E., Seaborne, A.: SPARQL query language for RDF W3C recommendation (2008). https://www.w3.org/TR/rdf-sparql-query/#ask
Cyganiak, R., Wood, D.,Lanthaler, M.: RDf 1.1 concepts and abstract syntax. Technical report, W3C Recommendation (2014)
Skubella, A., Janke, D., Staab, S.: BeSEPPI: semantic-based benchmarking of property path implementations technical report. Technical report, Institute for Web Science and Technologies (2019)
Thost, V., Dolby, J.: QED: out-of-the-box datasets for SPARQL query evaluation. In: Proceedings of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, USA, 8th–12th October 2018. (2018). http://ceur-ws.org/Vol-2180/paper-69.pdf
Zhang, Y., Duc, P.M., Corcho, O., Calbimonte, J.-P.: SRBench: a streaming RDF/SPARQL benchmark. In: Cudré-Mauroux, P., Heflin, J., Sirin, E., Tudorache, T., Euzenat, J., Hauswirth, M., Parreira, J.X., Hendler, J., Schreiber, G., Bernstein, A., Blomqvist, E. (eds.) ISWC 2012. LNCS, vol. 7649, pp. 641–657. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-35176-1_40
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Skubella, A., Janke, D., Staab, S. (2019). BeSEPPI: Semantic-Based Benchmarking of Property Path Implementations. In: Hitzler, P., et al. The Semantic Web. ESWC 2019. Lecture Notes in Computer Science(), vol 11503. Springer, Cham. https://doi.org/10.1007/978-3-030-21348-0_31
Download citation
DOI: https://doi.org/10.1007/978-3-030-21348-0_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-21347-3
Online ISBN: 978-3-030-21348-0
eBook Packages: Computer ScienceComputer Science (R0)