Advertisement

The WebDataCommons Microdata, RDFa and Microformat Dataset Series

  • Robert Meusel
  • Petar Petrovski
  • Christian Bizer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8796)

Abstract

In order to support web applications to understand the content of HTML pages an increasing number of websites have started to annotate structured data within their pages using markup formats such as Microdata, RDFa, Microformats. The annotations are used by Google, Yahoo!, Yandex, Bing and Facebook to enrich search results and to display entity descriptions within their applications. In this paper, we present a series of publicly accessible Microdata, RDFa, Microformats datasets that we have extracted from three large web corpora dating from 2010, 2012 and 2013. Altogether, the datasets consist of almost 30 billion RDF quads. The most recent of the datasets contains amongst other data over 211 million product descriptions, 54 million reviews and 125 million postal addresses originating from thousands of websites. The availability of the datasets lays the foundation for further research on integrating and cleansing the data as well as for exploring its utility within different application contexts. As the dataset series covers four years, it can also be used to analyze the evolution of the adoption of the markup formats.

Keywords

Microdata RDFa Microformats Dataset Web Science 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ben Adida and Mark Birbeck. RDFa primer - bridging the human and data webs - W3C recommendation (2008), http://www.w3.org/TR/xhtml-rdfa-primer/
  2. 2.
    Bizer, C., Eckert, K., Meusel, R., Mühleisen, H., Schuhmacher, M., Völker, J.: Deployment of rdfa, microdata, and microformats on the web a quantitative analysis. In: Alani, H., et al. (eds.) ISWC 2013, Part II. LNCS, vol. 8219, pp. 17–32. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  3. 3.
    Goel, K., Guha, R.V., Hansson, O.: Introducing rich snippets (2009), http://googlewebmastercentral.blogspot.de/2009/05/introducing-rich-snippets.html
  4. 4.
    Guha, R.V.: Schema.org support for job postings (2011), http://blog.schema.org/2011/11/schemaorg-support-for-job-postings.html
  5. 5.
  6. 6.
    Haas, K., Mika, P., Tarjan, P., Blanco, R.: Enhanced results for web search. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, pp. 725–734. ACM, New York (2011)Google Scholar
  7. 7.
    Hickson, I.: HTML Microdata, Working Draft (2011), http://www.w3.org/TR/microdata/
  8. 8.
    Lindahl, G.: Blekko donates search data to common crawl (December 2012), http://blog.blekko.com/2012/12/17/common-crawl-donation/
  9. 9.
    Meusel, R., Vigna, S., Lehmberg, O., Bizer, C.: Graph structure in the web - revisited: a trick of the heavy tail. In: Proceedings of the Companion Publication of the 23rd International Conference on World Wide Web Companion, International World Wide Web Conferences Steering, pp. 427–432 (2014)Google Scholar
  10. 10.
    Mika, P.: Microformats and RDFa deployment across the Web (2011), http://tripletalk.wordpress.com/2011/01/25/rdfa-deployment-across-the-web/
  11. 11.
    Mika, P., Potter, T.: Metadata statistics for a large web corpus. In: LDOW 2012: Linked Data on the Web, CEUR Workshop Proceedings, vol. 937, CEUR-ws.org (2012)Google Scholar
  12. 12.
    Petrovski, P., Bryl, V., Bizer, C.: Integrating product data from websites offering microdata markup. In: 4th Workshop on Data Extraction and Object Search, DEOS 2014 (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Robert Meusel
    • 1
  • Petar Petrovski
    • 1
  • Christian Bizer
    • 1
  1. 1.Research Group Data and Web ScienceUniversity of MannheimGermany

Personalised recommendations