WDFed: Exploiting Cloud Databases Using Metadata and RESTful APIs

  • Xin WangEmail author
  • Thanassis Tiropanis
  • Ramine Tinati
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 672)


As a result of the development of Big Data and cloud databases, a huge amount of data are available on the Web, not only as dump files but also in databases. Due to the volume and heterogeneity of these data, it is a challenging task to find and consume them. To reduce the barrier of data sharing and reuse on the Web, we propose a data cataloguing framework called WDFed that combines the strength of both Linked Data and REST. WDFed adopts the Data Catalog Vocabulary (DCAT) to harmonise database metadata, and develops a two-way mapping between DCAT and a RESTful API. This framework provides an interoperable middle layer that enables humans as well as applications to discover and consume Big Data on the Web in a semi-automatic manner. The framework is implemented in a data portal called Web Observatory and we present several use cases to evaluate the framework.


Linked data Metadata REST DCAT OAuth 2.0 Cloud database Distributed system 


  1. 1.
    Alexander, K., Cyganiak, R., Hausenblas, M., Zhao, J.: Describing linked datasets on the design and usage of VoID, the “Vocabulary of Interlinked Datasets”. In: Proceedings of the Linked Data on the Web Workshop (LDOW), At the International World Wide Web Conference (WWW) (2009)Google Scholar
  2. 2.
    Amundsen, M.: RFC 6573 - The Item and Collection Link Relations (2012)Google Scholar
  3. 3.
    Archer, P., Smith, K., Perego, A.: Protocol for Web Description Resources (POWDER): Description Resources (2009)Google Scholar
  4. 4.
    Berners-Lee, T.: Linked data-design issues (2006)Google Scholar
  5. 5.
    Clinton, D.: OpenSearch 1.1 draft 5 (2014)Google Scholar
  6. 6.
    Difranzo, D., Erickson, J.S., Gloria, M., Luciano, J.S., McGuinness, D.L., Hendler, J.: The web observatory extension: facilitating web science collaboration through semantic markup, pp. 475–480, April 2014Google Scholar
  7. 7.
    Dzmanashvili, I.: RFC 6861 - The “create-form” and “edit-form” Link Relations (2013)Google Scholar
  8. 8.
    Fielding, R.: Architectural styles and the design of network-based software architectures. Ph.D. thesis, University of California, Irvine (2000)Google Scholar
  9. 9.
    Görlitz, O., Thimm, M., Staab, S.: SPLODGE: systematic generation of SPARQL benchmark queries for linked open data. In: Cudré-Mauroux, P., et al. (eds.) ISWC 2012. LNCS, vol. 7649, pp. 116–132. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-35176-1_8 CrossRefGoogle Scholar
  10. 10.
    Hardt, D.: RFC 6749 - The OAuth 2.0 Authorization Framework (2012)Google Scholar
  11. 11.
    Harris, S., Seaborne, A.: SPARQL 1.1 Query Language (2013)Google Scholar
  12. 12.
    Maali, F., Erickson, J.: Data Catalog Vocabulary (DCAT) (2014)Google Scholar
  13. 13.
    Mitchell, I., Wilson, M.: Linked data: connecting and exploiting big data. Technical report, Fujitsu (2012)Google Scholar
  14. 14.
    Nottingham, M.: RFC 5988 - Web Linking (2010)Google Scholar
  15. 15.
    Nottingham, M., Sayre, R.: RFC 4287 - The Atom Syndication Format (2005)Google Scholar
  16. 16.
    Snell, J.: RFC 4946 - Atom License Extension (2007)Google Scholar
  17. 17.
    Tiropanis, T., Hall, W., Hendler, J., de Larrinaga, C.: The web observatory: a middle layer for broad data. Big Data 2(3), 129–133 (2014)CrossRefGoogle Scholar
  18. 18.
    Tiropanis, T., Hall, W., Shadbolt, N., De Roure, D., Contractor, N., Hendler, J.: The web science observatory. IEEE Intell. Syst. 28(2), 100–104 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Web and Internet Science Group, Electronics and Computer ScienceUniversity of SouthamptonSouthamptonUK

Personalised recommendations