Skip to main content
SpringerLink
Log in

ADERIS: An Adaptive Query Processor for Joining Federated SPARQL Endpoints

  • Conference paper
On the Move to Meaningful Internet Systems: OTM 2011 (OTM 2011)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7045))

Abstract

Integrating distributed RDF data is facilitated by Linked Data and shared ontologies, however joins over distributed SPARQL services can be costly, time consuming operations. This paper describes the design and implementation of ADERIS, a query processing system for efficiently joining data from multiple distributed SPARQL endpoints. ADERIS decomposes federated SPARQL queries into multiple source queries and integrates the results utilising two techniques: adaptive join reordering, for which a cost model is defined, and the optimisation of subsequent queries to data sources to retrieve further data. The benefit of the approach in terms of minimising response time is illustrated by sample queries containing common SPARQL join patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Linked Data - Connect Distributed Data across the Web, http://linkeddata.org/

  2. SPARQL 1.1 Federation Extensions, http://www.w3.org/2009/sparql/docs/fed/gen.html

  3. Deshpande, A., Ives, Z.G., Raman, V.: Adaptive query processing. Foundations and Trends in Databases 1(1), 1–140 (2007)

    Article  MATH  Google Scholar 

  4. Lynden, S., Kojima, I., Matono, A., Tanimura, Y.: Adaptive Integration of Distributed Semantic Web Data. In: Kikuchi, S., Sachdeva, S., Bhalla, S. (eds.) DNIS 2010. LNCS, vol. 5999, pp. 174–193. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  5. Gounaris, A., Yfoulis, C., Sakellariou, R., Dikaiakos, M.D.: A control theoretical approach to self-optimizing block transfer in web service grids. TAAS 3(2) (2008)

    Google Scholar 

  6. ARQ SPARQL query processing framework, http://jena.sourceforge.net/ARQ/

  7. Carroll, J.J., Dickinson, I., Dollin, C., Seaborne, A., Wilkinson, K., Reynolds, D., Reynolds, D.: Jena: Implementing the semantic web recommendations. Technical Report HPL-2003-146, Hewlett Packard Laboratories (2004)

    Google Scholar 

  8. Buil-Aranda, C., Arenas, M., Corcho, O.: Semantics and Optimization of the SPARQL 1.1 Federation Extension. In: Antoniou, G., Grobelnik, M., Simperl, E., Parsia, B., Plexousakis, D., De Leenheer, P., Pan, J. (eds.) ESWC 2011. LNCS, vol. 6644, pp. 1–15. Springer, Heidelberg (2011)

    Google Scholar 

  9. Quilitz, B., Leser, U.: Querying Distributed RDF Data Sources with SPARQL. In: Bechhofer, S., Hauswirth, M., Hoffmann, J., Koubarakis, M. (eds.) ESWC 2008. LNCS, vol. 5021, pp. 524–538. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  10. Langegger, A., Wöß, W., Blöchl, M.: A Semantic Web Middleware for Virtual Data Integration on the Web. In: Bechhofer, S., Hauswirth, M., Hoffmann, J., Koubarakis, M. (eds.) ESWC 2008. LNCS, vol. 5021, pp. 493–507. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  11. Describing Linked Datasets with the VoID Vocabulary (W3C Interest Group Note March 03, 2011), http://www.w3.org/TR/void/

  12. Tanimura, Y., Matono, A., Kojima, I., Sekiguchi, S.: Storage Scheme for Parallel RDF Database Processing Using Distributed File System and MapReduce. In: International Conference on High Performance Computing in the Asia Pacific Region (2009)

    Google Scholar 

  13. Abadi, D.J., Marcus, A., Madden, S., Hollenbach, K.: SW-Store: a vertically partitioned DBMS for Semantic Web data management. VLDB J. 18(2), 385–406 (2009)

    Article  Google Scholar 

  14. Li, Q., Sha, M., Markl, V., Beyer, K., Colby, L., Lohman, G.: Adaptively Reordering Joins during Query Execution. In: Proc. ICDE, pp. 26–35. IEEE Computer Society, Los Alamitos (2007)

    Google Scholar 

  15. Elsayed, I., Brezany, P.: Towards Large-Scale Scientific Dataspaces for e-Science Applications. In: Yoshikawa, M., Meng, X., Yumoto, T., Ma, Q., Sun, L., Watanabe, C. (eds.) DASFAA 2010. LNCS, vol. 6193, pp. 69–80. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  16. Graefe, G.: Query evaluation techniques for large databases. ACM Comput. Surv. 25(2), 73–170 (1993)

    Article  Google Scholar 

  17. Haas, L.M., Kossmann, D., Wimmers, E.L., Yang, J.: Optimizing queries across diverse data sources. In: 23rd Int. Conference on Very Large Data Bases, VLDB (1997)

    Google Scholar 

  18. Garcia-Molina, H., Widom, J., Ullman, J.D.: Database System Implementation. Prentice-Hall, Inc., Upper Saddle River (1999)

    Google Scholar 

  19. Astrom, K.J., Wittenmark, B.: Adaptive Control. Addison-Wesley (1995)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Information Technology Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan

    Steven Lynden, Isao Kojima, Akiyoshi Matono & Yusuke Tanimura

Authors
  1. Steven Lynden
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isao Kojima
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Akiyoshi Matono
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yusuke Tanimura
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. STAR Lab, Vrije Universiteit Brussel (VUB), Bldg G/10, Pleinlaan 2, 1050, Brussel, Belgium

    Robert Meersman

  2. DEBII, Curtin University of Technology, Technology Park, De Laeter Way, 6102, Bentley, WA, Australia

    Tharam Dillon

  3. Facultad de Informática, Universidad Politécnica de Madrid, Campus de Montegancedo S/N, 28660, Boadilla del Monte, Madrid, Spain

    Pilar Herrero

  4. Smeal College of Business, Pennsylvania State University, University Park, 16802, P.O. Box, PA, U.S.A.

    Akhil Kumar

  5. Institute of Databases and Information Systems, Ulm University, Germany

    Manfred Reichert

  6. City University of Hong Kong, Hong Kong

    Li Qing

  7. National University of Singapore (NUS), Singapore

    Beng-Chin Ooi

  8. Dipartemento Tecnologie dell’Informazione, Universitá degli Studi di Milano, Via Bramante 65, 26013, Crema, Italy

    Ernesto Damiani

  9. Vanderbilt University, VU, Station B #1829, 2015 Terrace Place, 37203, Nashville, TN, USA

    Douglas C. Schmidt

  10. Virginia Tech, 24060, Blacksburg, VA

    Jules White

  11. Digital Enterprise Research Institute (DERI),, National University of Ireland, IDA Business Park, Lower Dangan, Galway, Ireland

    Manfred Hauswirth

  12. Kno.e.sis Center, Wright State University, Dayton,, Ohio

    Pascal Hitzler

  13. IBM India Research Lab, 4, Block C, Institutional Area, 110 070, Vasant Kunj, New Delhi, India

    Mukesh Mohania

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lynden, S., Kojima, I., Matono, A., Tanimura, Y. (2011). ADERIS: An Adaptive Query Processor for Joining Federated SPARQL Endpoints. In: Meersman, R., et al. On the Move to Meaningful Internet Systems: OTM 2011. OTM 2011. Lecture Notes in Computer Science, vol 7045. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25106-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25106-1_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25105-4

  • Online ISBN: 978-3-642-25106-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation