Multimedia Tools and Applications

, Volume 59, Issue 2, pp 523–556 | Cite as

Linked Data and multimedia: the state of affairs

  • Bernhard Schandl
  • Bernhard Haslhofer
  • Tobias Bürger
  • Andreas Langegger
  • Wolfgang Halb


Linked Data is a way of exposing and sharing data as resources on the Web and interlinking them with semantically related resources. In the last three years significant amounts of data have been generated, increasingly forming a globally connected, distributed data space. For multimedia content, metadata are a key factor for efficient management, organization, and retrieval. However, the relationship between multimedia and Linked Data has been rarely studied, leading to a lack of mutual awareness and, as a consequence thereof, technological deficiencies. This article introduces the basic concepts of Linked Data in the context of multimedia metadata, and discusses techniques to generate, expose, discover, and consume Linked Data. It shows that a large amount of data sources exist, which are ready to be exploited by multimedia applications. The benefit of Linked Data in two multimedia-related applications is discussed and open research issues are outlined with the goal of bringing the research fields of multimedia and Linked Data closer together in order to facilitate mutual benefit.


Linked Data Semantic Web Multimedia semantics Multimedia metadata 


  1. 1.
    Adida B, Birbeck M, McCarron S, Pemberton S (2008) RDFa in XHTML: syntax and processing. World Wide Web Consortium. Available at
  2. 2.
    Agosti M, Ferro N, Frommholz I, Thiel U (2004) Annotations in digital libraries and collaboratories—facets, models and usage. In: Heery R, Lyon L (eds) ECDL. Lecture notes in computer science, vol 3232. Springer, pp 244–255Google Scholar
  3. 3.
    Alexander K, Cyganiak R, Hausenblas M, Zhao J (2009) Describing linked datasets—on the design and usage of void, the ‘vocabulary of interlinked datasets’. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, SpainGoogle Scholar
  4. 4.
    Anderson O, Berjon R, Dahlström E, Emmons A, Ferraiolo J, Grasso A, Hardy V, Hayman S, Jackson D, Lilley C, McCormack C, Neumann A, Northway C, Quint A, Ramani N, Schepers D, Shellshear A (2008) Scalable Vector Graphics (SVG) tiny 1.2 specification (W3C recommendation 22 December 2008). World Wide Web Consortium. Available at
  5. 5.
    Arndt R, Troncy R, Staab S, Hardman L, Vacura M (2008) COMM: designing a well-founded multimedia ontology for the Web. In: Aberer K, Choi KS, Noy N, Allemang D, Lee KI, Nixon L, Golbeck J, Mika P, Maynard D, Mizoguchi R, Schreiber G, Cudré-Mauroux P (eds) The Semantic Web: ISWC 2007 + ASWC 2007. Lecture notes in computer science, vol 4825. Springer, Berlin, pp 30–43. doi:10.1007/978-3-540-76298-0_3 Google Scholar
  6. 6.
    Auer S, Dietzold S, Lehmann J, Hellmann S, Aumueller D (2009) Triplify—light-weight Linked Data publication from relational databases. In: Proc. of 18th international World Wide Web conferenceGoogle Scholar
  7. 7.
    Auer S, Lehmann J, Hellmann S (2009) LinkedGeoData—adding a spatial dimension to the Web of Data. In: Proc. of 7th international Semantic Web conference (ISWC)Google Scholar
  8. 8.
    Becker C, Bizer C (2008) DBpedia Mobile: a location-enabled Linked Data browser. In: Linked Data on the Web workshop 2008, CEUR-WS, vol 369. Beijing, ChinaGoogle Scholar
  9. 9.
    Beckett D, Berners-Lee T (2008) Turtle—terse RDF triple language (W3C team submission 14 January 2008). World Wide Web Consortium,, retrieved 8 August 2008
  10. 10.
    Berners-Lee T (2006) Linked Data. World Wide Web Consortium. Available at, retrieved 8 August 2008
  11. 11.
    Berners-Lee T, Chen Y, Chilton L, Connolly D, Dhanaraj R, Hollenbach J, Lerer A, Sheets D (2006) Tabulator: exploring and analyzing Linked Data on the Semantic Web. In: Proceedings of the 3rd international Semantic Web user interaction workshop (SWUI’06). Athens, GA, USAGoogle Scholar
  12. 12.
    Berruta D, Phipps J (2008) Best practice recipes for publishing RDF vocabularies. W3C Semantic Web deployment working group. Available at:
  13. 13.
    Bizer C, Cyganiak R (2006) D2R server—publishing relational databases on the Semantic Web. In: 5th international Semantic Web conferenceGoogle Scholar
  14. 14.
    Bizer C, Cyganiak R, Heath T (2007) How to publish Linked Data on the Web. URL:
  15. 15.
    Bizer C, Heath T, Berners-Lee T (2009) Linked Data—the story so far. Int J Semantic Web Inf Syst 5(3):1–22. doi:10.4018/jswis.2009081901 Google Scholar
  16. 16.
    Bizer C, Lehmann J, Kobilarov G, Auer S, Becker C, Cyganiak R, Hellmann S (2009) DBpedia—a crystallization point for the Web of Data. J Web Sem 7(3):154–165CrossRefGoogle Scholar
  17. 17.
    Boardman R, Spence R, Sasse MA (2003) Too many hierarchies? The daily struggle for control of the workspace. In: Proceedings of HCI international 2003, vol 1, pp 616–620Google Scholar
  18. 18.
    Bürger T, Hausenblas M (2008) Interlinking multimedia—principles and requirements. In: First international workshop on interacting with multimedia content on the social Semantic Web, co-located with SAMT 2008, 3–5 December 2008Google Scholar
  19. 19.
    Bürger T, Hausenblas M (2010) Metadata standards and ontologies for multimedia content. In: Handbook of metadata, semantics and ontologies (to be published). World Scientific, SingaporeGoogle Scholar
  20. 20.
    Bush V (1945) As we may think. Atl Mon 176(1):101–108. URL Google Scholar
  21. 21.
    Carroll J, Dickinson I, Dollin C, Reynolds D, Seaborne A, Wilkinson K (2004) Jena: implementing the Semantic Web recommendations. In: Proceedings of the 13th international World Wide Web conference on alternate track papers and posters (WWW’04). New York, NY, USAGoogle Scholar
  22. 22.
    Cheng G, Ge W, Qu Y (2008) Falcons: searching and browsing entities on the Semantic Web. In: Proceedings of the 17th international conference on World Wide Web (WWW’09). Beijing, ChinaGoogle Scholar
  23. 23.
    Corlosquet S, Delbru R, Clark T, Polleres A, Decker S (2009) Produce and consume Linked Data with Drupal! In: Proceedings of the 8th international Semantic Web conference (ISWC 2009)Google Scholar
  24. 24.
    Cyganiak R, Jentzsch A (2009) The linking open data dataset cloud. URL
  25. 25.
    d’Aquin M, Baldassarre C, Gridinoc L, Angeletou S, Sabou M, Motta E (2007) Characterizing knowledge on the Semantic Web with Watson. In: Proceedings of 5th international EON workshop (EON2007) at the 6th international Semantic Web conference. Busan, KoreaGoogle Scholar
  26. 26.
    Erling O, Mikhailov I (2007) RDF support in the virtuoso DBMS. In: CSSW, pp 59–68Google Scholar
  27. 27.
    Fielding RT (2000) Architectural styles and the design of network-based software architectures. PhD thesis, University of California, Irvine. URL
  28. 28.
    Frisse ME (1987) Searching for information in a hypertext medical handbook. In: Hypertext’87 proceedings, 13–15 November 1987. Chapel Hill, North Carolina, USA. ACM, pp 57–66Google Scholar
  29. 29.
    Gruber T (1993) A translation approach to portable ontology specifications. Knowl Acquis 5(2):199–220CrossRefGoogle Scholar
  30. 30.
    Han L, Finin T, Parr C, Sachs J, Joshi A (2008) RDF123: from spreadsheets to RDF. In: 7th international Semantic Web conference (ISWC2008)Google Scholar
  31. 31.
    Harth A, Hogan A, Delbru R, Umbrich J, Decker S (2007) SWSE: answers before links. In: Semantic Web challenge at 6th international Semantic Web conference. Busan, KoreaGoogle Scholar
  32. 32.
    Hartig O, Bizer C, Freytag JC (2009) Executing SPARQL queries over the Web of Linked Data. In: Proceedings of the 8th international Semantic Web conference (ISWC’09). Washington, DC, USAGoogle Scholar
  33. 33.
    Haslhofer B, Schandl B (2008) The OAI2LOD server: exposing OAI-PMH metadata as Linked Data. In: International workshop on Linked Data on the Web (LDOW2008). Beijing, ChinaGoogle Scholar
  34. 34.
    Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the Web. Int J Digit Libr 10(1):15–32CrossRefGoogle Scholar
  35. 35.
    Haslhofer B, Momeni Roochi E, Gay M, Simon R (2010) Augmenting Europeana content with Linked Data resources. In: Linked Data triplification challenge, co-located with I-Semantics 2010. Graz, AustriaGoogle Scholar
  36. 36.
    Hassanzadeh O, Consens M (2009) Linked movie data base. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, SpainGoogle Scholar
  37. 37.
    Hausenblas M, Bailer W, Bürger T, Troncy R (2007) ramm.x: deploying multimedia metadata on the Semantic Web. In: Proceedings of SAMT 2007, December 4–7. Genova, ItalyGoogle Scholar
  38. 38.
    Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply Linked Data principles to multimedia fragments. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, SpainGoogle Scholar
  39. 39.
    Hunter J (2009) Collaborative semantic tagging and annotation systems. In: Cronin B (ed) Annual review of information science and technology, vol 43, chap 2. American Society for Information Science & TechnologyGoogle Scholar
  40. 40.
    ISO/IEC (2006) Multimedia framework (MPEG-21)—part 17: fragment identification of MPEG resources. International Organization for Standardization, Geneva, SwitzerlandGoogle Scholar
  41. 41.
    Jacobs I, Walsh N (2004) Architecture of the World Wide Web, vol 1. URL
  42. 42.
    Kahan J, Koivunen MR (2001) Annotea: an open RDF infrastructure for shared Web annotations. In: WWW ’01: proceedings of the 10th international conference on World Wide Web. ACM Press, New York, pp 623–632CrossRefGoogle Scholar
  43. 43.
    Kobilarov G, Scott T, Raimond Y, Oliver S, Sizemore C, Smethurst M, Bizer C, Lee R (2009) Media meets Semantic Web—how the BBC uses DBpedia and Linked Data to make connections. In: Proceedings of the 6th European Semantic Web conference. Springer, Berlin, pp 723–737Google Scholar
  44. 44.
    Langegger A, Wöß W (2009) XLWrap—querying and integrating arbitrary spreadsheets with SPARQL. In: Proceedings of the 8th international Semantic Web conference (ISWC 2009). SpringerGoogle Scholar
  45. 45.
    Langegger A, WößW, Blöchl M (2008) A Semantic Web middleware for virtual data integration on the Web. In: Proceedings of the European Semantic Web conference 2008. TenerifeGoogle Scholar
  46. 46.
    Lee W, Bürger T, Sasaki F, Malaise V, Stegmaier F, Söderberg J (2009) Ontology for media resource 1.0. W3C working draft, 18 June 2009Google Scholar
  47. 47.
    LODr—a linking open data tagging system. In: Workshop on social data on the Web (SDoW2008), vol 405.
  48. 48.
    Marshall CC (2000) The future of annotation in a digital (paper) world. In: Harum S, Twidale M (eds) Successes and failures of digital libraries. University of Illinois, Urbana-Champaign, pp 97–117Google Scholar
  49. 49.
    Marshall CC, Brush BAJ (2004) Exploring the relationship between personal and public annotations. In: JCDL ’04: proceedings of the 4th ACM/IEEE-CS joint conference on digital libraries. ACM Press, New York, pp 349–357Google Scholar
  50. 50.
    Network Working Group (NWG) (2005) RFC3986—uniform resource identifier (URI): generic syntax. URL
  51. 51.
    Ovsiannikov IA, Arbib MA, McNeill TH (1999) Annotation technology. Int J Hum-Comput Stud 50(4):329–362CrossRefGoogle Scholar
  52. 52.
    Raimond Y, Sandler MB (2008) A Web of musical information. In: Bello JP, Chew E, Turnbull D (eds) ISMIR, pp 263–268Google Scholar
  53. 53.
    Richardson L, Ruby S (2007) RESTful Web services. O’Reilly Media IncGoogle Scholar
  54. 54.
    Rodríguez JB, Corcho O, Gómez-Pérez A (2004) R2O, an extensible and semantically based database-to-ontology mapping language. In: Proceedings of the 2nd workshop on Semantic Web and databases (SWDB2004)Google Scholar
  55. 55.
    Saathoff C, Scherp A (2009) M3O: the multimedia metadata ontology. In: Proceedings of the workshop on semantic multimedia database technologies (SeMuDaTe 2009)Google Scholar
  56. 56.
    Sack H, Baumann B, Groß A, Meinel C (2009) Linking tele-TASK video protal to the Semantic Web. In: Proceeding of the 9th international conference on innovative community systems (IICS), June 15–17. Jena, GermanyGoogle Scholar
  57. 57.
    Sauermann L, Cyganiak R (2008) Cool URIs for the Semantic Web. W3C Semantic Web activity. Available at:
  58. 58.
    Sauermann L, Bernardi A, Dengel A (2005) Overview and outlook on the semantic desktop. In: Proceedings of the 1st semantic desktop workshop, CEUR workshop proceedings, Galway, Ireland, vol 175Google Scholar
  59. 59.
    Schandl B, Popitsch N (2010) Lifting file systems into the Linked Data cloud with TripFS. In: Proceedings of the 3rd international workshop on Linked Data on the Web (LDOW2010). Raleigh, North Carolina, USAGoogle Scholar
  60. 60.
    Scharffe F, Euzenat J (2009) Alignments for data interlinking: analysed systems.
  61. 61.
    Schroeter R, Hunter J (2007) Annotating relationships between multiple mixed-media digital objects by extending annotea. In: Proceedings of the 4th European Semantic Web conference, ESWC 2007Google Scholar
  62. 62.
    Sheth A, Klas W (1998) Multimedia data management: using metadata to integrate and apply digital media. Mcgraw-Hill Education, New YorkGoogle Scholar
  63. 63.
    Simon R, Sadilek C, Korb J, Baldauf M, Haslhofer B (2010) Tag clouds and old maps: annotations as linked spatiotemporal data in the cultural heritage domain. In: Workshop on linked spatiotemporal data 2010, held in conjunction with the 6th international conference on geographic information systems (GIScience 2010). Zurich, SwitzerlandGoogle Scholar
  64. 64.
    Stegmaier F, Bailer W, Bürger T, Döller M, Höffernig M, Lee W, Malaise V, Poppe C, Troncy R, Kosch H, de Walle RV (2009) How to align media metadata schemas? Design and implementation of the media ontology. In: Proceedings of the workshop on semantic multimedia database technologies (SeMuDaTe 2009)Google Scholar
  65. 65.
    Tummarello G, Delbru R, Oren E (2007) weaving the open Linked Data. In: Proceedings of the 6th international the Semantic Web and 2nd Asian conference on Asian Semantic Web conference. Busan, KoreaGoogle Scholar
  66. 66.
    Volz J, Bizer C, Gaedke M, Kobilarov G (2009) Silk—A link discovery framework for the Web of Data. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, SpainGoogle Scholar
  67. 67.
    W3C (2003) XPointer framework. Available at:
  68. 68.
    W3C (2004) RDF vocabulary description language 1.0: RDF schema. W3C Semantic Web activity—RDF core working group. Available at:
  69. 69.
    W3C (2004) RDF/XML syntax specification (revised). W3C Semantic Web activity—RDF core working group. Available at:
  70. 70.
    W3C (2004) Resource Description Framework (RDF). W3C Semantic Web activity—RDF core working group, URL
  71. 71.
    W3C (2008) SPARQL query language for RDF. W3C Semantic Web activity—RDF Data Access working group, URL
  72. 72.
    W3C (2009) OWL 2Web ontology language. W3C Semantic Web activity—OWL working group, URL
  73. 73.
    W3C Media Fragments Working Group (2009) Media fragments URI 1.0. W3C working draft. Available at:
  74. 74.
    W3C Semantic Web Deployment Group (2009) SKOS simple knowledge organization system reference. URL

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Bernhard Schandl
    • 1
  • Bernhard Haslhofer
    • 1
  • Tobias Bürger
    • 2
  • Andreas Langegger
    • 3
  • Wolfgang Halb
    • 4
  1. 1.Department of Distributed and Multimedia SystemsUniversity of ViennaWienAustria
  2. 2.Salzburg Research Forschungsgesellschaft mbHSalzburgAustria
  3. 3.Institute for Application-Oriented Knowledge ProcessingJohann Kepler University LinzLinzAustria
  4. 4.DIGITAL—Institute for Information and Communication TechnologiesJOANNEUM RESEARCH Forschungsgesellschaft mbHGrazAustria

Personalised recommendations