Multimedia Tools and Applications

, Volume 70, Issue 2, pp 949–975 | Cite as

Semantic enhancement for media asset management systems

Integrating the Red Bull Content Pool in the Web of Data
  • Thomas KurzEmail author
  • Georg Güntner
  • Violeta Damjanovic
  • Sebastian Schaffert
  • Manuel Fernandez


The socio-economic development of the World Wide Web gathered a large momentum through Web 2.0 and currently, the Web of Data is adding a further technological driver to this. The tremendous growth of media data combined with structured (linked) data promises further opportunities for digital market places. Although the integration of media content with linked data is only beginning there are already working groups and projects addressing this issue. We show how media and existing data sets can be seamlessly integrated and thus give possibilities for an extended user experience while interacting with media content on the web. We focus on automatic semantic enhancement services that can link arbitrary and open accessible data and introduce opportunities for media annotation, fragmentation and presentation. Our use case scenario is based on the Red Bull Content Pool, a media management system for videos, images and articles about Red Bull related content covering a multitude of sports events.


Linked Data Semantic media pool Linked Media Semantic enhancement Media Annotation 



This research has been funded by the Republic of Austria within the COMET project “Salzburg NewMediaLab - The Next Generation” and by the European Commission within the 7th Framework Programme project KiWi - Knowledge in a Wiki (No. 211932). The latest version of the Linked Media Framework source code is available with a permissive Open Source license at We thank the members of the W3C Linked Data mailing list for their valuable comments on our idea.


  1. 1.
    Arndt R, Troncy R, Staab S, Hardman L (2009) COMM: a core ontology for multimedia annotation, 2nd edn, pp 403–422. SpringerGoogle Scholar
  2. 2.
    Aroyo L, Nicon L, Miller L (2011) NoTube: the television experience enhanced by online social and semantic data. In: IEEE international conference on consumer electronics Berlin ICCEBerlin 2011, pp 269–273Google Scholar
  3. 3.
    Berners-Lee T (2006) Linked data: design issues. Accessed 3 Jan 2012
  4. 4.
    Berners-Lee T, Hendler J, Lassila O (2001) The semantic web. Sci Am 284(5):34–43CrossRefGoogle Scholar
  5. 5.
    Bizer C, Heath T, et al (2007) Interlinking Open Data on the Web (Poster). In: 4th European semantic web conference (ESWC2007), pp 802–815, Stand 12.5.2009Google Scholar
  6. 6.
    Bottoni P, Levialdi S, Labella A, Panizzi E, Trinchese R, Gigli L (2006) MADCOW: a visual interface for annotating web pages. In: AVI ’06: proceedings of the working conference on advanced visual interfaces. ACM Press, New York, NY, USA, pp 314–317Google Scholar
  7. 7.
    Brickley D, Guha RV (2004) RDF vocabulary description language 1.0: RDF schema. W3C RecommendationGoogle Scholar
  8. 8.
    Bürger T (2010) A model of relevance for reuse-driven media retrieval. In: Proceedings of the 2nd workshop on semantic multimedia database technologies, co-located with the 5th international conference on semantic and digital media technologies (SAMT)Google Scholar
  9. 9.
    Bürger T, Hausenblas M (2008) Interlinking Multimedia - Principles and Requirements. In: Proceedings of the first international workshop on interacting with multimedia content on the social semantic web, co-located with SAMT 2008Google Scholar
  10. 10.
    Bürger T, Simperl EPB (2009) A conceptual model for publishing multimedia content on the semantic web. In: SAMT. Lecture notes in computer science, vol 5887. Springer, pp 101–113Google Scholar
  11. 11.
    Carneiro G, Chan AB, Moreno PJ, Vasconcelos N (2007) Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans Pattern Anal Mach Intell 29(3):394–410CrossRefGoogle Scholar
  12. 12.
    Christian Bizer TB-L, Heath T (2009) Linked data - the story so far. IJSWIS 5(3):1–22Google Scholar
  13. 13.
    Damjanovic V, Kurz T, Westenthaler R, Behrendt W, Gruber A, Schaffert S (2011) Semantic enhancement: the key to massive and heterogeneous data pools. In: Proceeding of the 20th international IEEE ERK (electrotechnical and computer science) conference 2011, Portoroz, SloveniaGoogle Scholar
  14. 14.
    DCMI (2008) DCMI metadata terms. Accessed 3 Jan 2012
  15. 15.
    de Sompel HV, Nelson ML, Sanderson R, Balakireva L, Ainsworth S, Shankar H (2009) Memento: time travel for the web. CoRR, abs/0911.1112Google Scholar
  16. 16.
    Enser P (2008) The evolution of visual information retrieval. J Inf Sci 34(4):531–546CrossRefGoogle Scholar
  17. 17.
    Fialho A, Troncy R, Hardman L, Saathoff C, Scherp A, (2010) What’s on this evening? designing user support for event-based annotation and exploration of media. In: Proceedings of the workshop on recognising and tracking events on the web and in real life (located at SETN 2010), Athens, GreeceGoogle Scholar
  18. 18.
    Fielding RT (2000) Architectural styles and the design of network-based software architectures. PhD thesis, University of California, IrvineGoogle Scholar
  19. 19.
    Forrester Research (2009) The value of a Comprehensive integration solution. Forrester Research, Cambridge, MAGoogle Scholar
  20. 20.
    Handschuh S, Staab S, Studer R (2003) Leveraging metadata creation for the semantic web with CREAM. In: Kruse R, et al (eds) Proceedings of KI 2003: advances in artificial intelligence: 26th annual German conference on AI, KI 2003, Hamburg, Germany, vol 2821. Springer, Berlin, pp 19–33Google Scholar
  21. 21.
    Hardman L, Obrenovic Z̆, Nack F, Kerhervé B, Piersol K (2008) Canonical processes of semantically annotated media production. Multimedia systems. SpringerGoogle Scholar
  22. 22.
    Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the web. Int J Digit Libr 10(1):15–32CrossRefGoogle Scholar
  23. 23.
    Haslhofer B, Simon R, Sanderson R, de Sompel HV (2011) The Open Annotation Collaboration (OAC) model. In: Workshop on multimedia on the web (MMWeb2011) in conjunction with iSemantics2011Google Scholar
  24. 24.
    Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply linked data principles to multimedia fragments. In: WWW 2009 workshop: linked data on the web (LDOW2009), Madrid, SpainGoogle Scholar
  25. 25.
    Herlocker JL, Konstan JA, Terveen LG, Riedl JT (2004) An algorithmic framework for performing collaborative filtering. ACM Trans Inf Sys (TOIS) 22(1):230–237Google Scholar
  26. 26.
    Hollink L, Schreiber G, Wielemaker J, Wielinga B (2003) Semantic annotation of image collections. In: Proceedings of the KCAP’03 workshop on knowledge capture and semantic annotation, FloridaGoogle Scholar
  27. 27.
    ISO 16684-1:2012: Graphic technology – Extensible metadata platform (XMP) specification – Part 1: Data model, serialization and core properties. International Organization for Standardization, Geneva, SwitzerlandGoogle Scholar
  28. 28.
    Kahan J, Koivunen M-R (2001) Annotea: an open RDF infrastructure for shared Web annotations. In: WWW ’01: proceedings of the 10th international conference on world wide web. ACM Press New York, NY, USA, pp 623–632Google Scholar
  29. 29.
    Klyne G, Carroll JJ (2004) Resource description framework (RDF): concepts and abstract syntax. Technical report, W3C, 2Google Scholar
  30. 30.
    Kurz T, Schaffert S, Bürger T (2011) LMF - A Framework for Linked Media. In: Workshop on multimedia on the web (MMWeb2011) in conjunction with iSemantics2011Google Scholar
  31. 31.
    Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Strassner J (2010) Ontology for media resource 1.0. W3C Candidate RecommendationGoogle Scholar
  32. 32.
    McGuinness DL, van Harmelen F (2004) OWL web ontology language overview. W3c recommendation, World Wide Web ConsortiumGoogle Scholar
  33. 33.
    Mendes P, Jakob M, García-Silva A, Bizer C (2011) DBpedia spotlight: shedding light on the web of documents. In: The proceedings of the 7th international conference on semantic systems (I-Semantics)Google Scholar
  34. 34.
    Miles A, Bechhofer S (2009) SKOS simple knowledge organization system reference. Accessed 3 Jan 2012
  35. 35.
    Nichols DM, Pemberton D, Dalhoumi S, Larouk O, Belisle C, Twidale M (2000) DEBORA: Developing an Interface to Support Collaboration in a Digital Library. In: Borbinha JL, Baker T (eds) ECDL. Lecture Notes in Computer Science, vol 1923. Springer, pp 239–248Google Scholar
  36. 36.
    (NWG) NWG (2005) RFC3986 - Uniform Resource Identifier (URI): generic syntax. Accessed 13 Aug 2012
  37. 37.
    Phelps TA, Wilensky R (1997) Multivalent Annotations. In: Peters C, Thanos C (eds) ECDL. Lecture notes in computer science, vol 1324. Springer, pp 287–303Google Scholar
  38. 38.
    Pipek V, Rohde M, Cuel R, Herbrechter M, Stein M, Tokarchuk O, Wiedenhöfer T, Yetim F, Zamarian M (2009) Requirements report of the INSEMTIVES Seekda! use case. D2.2.1 of INSEMTIVES projectGoogle Scholar
  39. 39.
    Prud’hommeaux E, Seaborne A (2008) SPARQL query language for RDF. W3C RecommendationGoogle Scholar
  40. 40.
    Saathoff C, Scherp A (2010) Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology. In: Proceedings of the world wide web conference, 2010 (WWW2010)Google Scholar
  41. 41.
    Sanderson R, van de Sompel H (2011) Open Annotation: Beta Data Model Guide. Open annotation. Accessed 3 Jan 2012
  42. 42.
    Scharffe F, Euzenat J (2009) Alignments for data interlinking. Accessed 13 Aug 2012
  43. 43.
    Schaffert S, Kurz T, Glachs D, Bauer C, Dorschel F, Fernandez M. The Linked Media Framework: Integrating and Interlinking Enterprise Media Content and Data. In: Proceedings of the 8th international conference in semantic systems, Graz, Sept 2012Google Scholar
  44. 44.
    Schebella M, Kurz T, Guentner G (2011) Linked Media Interfaces. Graphical User Interfaces for Search and Annotation, Linked Media Lab Reports, vol 2. Salzburg Research, ISBN 978-3-902448-29-3Google Scholar
  45. 45.
    Schroeter R, Hunter J, Guerin J, Khan I, Henderson M (2006) A synchronous multimedia annotation system for secure collaboratories. In: e-Science. IEEE Computer Society, p 41Google Scholar
  46. 46.
    SemanticWebCompany (2011) PoolParty Extractor (PPX). Accessed 3 Jan 2012
  47. 47.
    Siorpaes K, Hepp M (2008) Games with a purpose for the semantic web. IEEE Intell Syst 23(11):50–60CrossRefGoogle Scholar
  48. 48.
    Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22:1349–1380CrossRefGoogle Scholar
  49. 49.
    Spivak N (2008) Semantic wave 2008: industry roadmap to web 3.0 and multibillion dollar market opportunities. In: Mills Davies (Project10X).
  50. 50.
    Stegmaier F, Lee W, Poppe C, Bailer W (2011) API for media resources 1.0. W3C Working Draft. 12 July 2011
  51. 51.
    Steiner T (2010) SemWebVid - making video a first class semantic web citizen and a first class web Bourgeois. In: Proceedings of the ISWC 2010 posters and demonstrations track, Shanghai. Thomas SteinerGoogle Scholar
  52. 52.
    Technical Standardization Committee on AV & IT Storage Systems and Equipment (2002) Exchangeable image file format for digital still cameras: exif version 2.2. Technical Report JEITA CP-3451Google Scholar
  53. 53.
    Troncy R, Mannens E, Pfeiffer S, Deursen DV (2011) Media fragments URI 1.0. Technical report, W3CGoogle Scholar
  54. 54.
    Uren V, Cimiano P, Iria J, Handschuh S, Vargas-Vera M, Motta E, Ciravegna F (2006) Semantic annotation for knowledge management: Requirements and a survey of the state of the art. JWS 4(1):14–28CrossRefGoogle Scholar
  55. 55.
    W3C (2007) Linking open data. Accessed 3 Jan 2012

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Thomas Kurz
    • 1
    Email author
  • Georg Güntner
    • 1
  • Violeta Damjanovic
    • 1
  • Sebastian Schaffert
    • 1
  • Manuel Fernandez
    • 2
  1. 1.Salzburg Research Forschungsgesellschaft mbHSalzburgAustria
  2. 2.Red Bull Media HouseSalzburgAustria

Personalised recommendations