Abstract
The socio-economic development of the World Wide Web gathered a large momentum through Web 2.0 and currently, the Web of Data is adding a further technological driver to this. The tremendous growth of media data combined with structured (linked) data promises further opportunities for digital market places. Although the integration of media content with linked data is only beginning there are already working groups and projects addressing this issue. We show how media and existing data sets can be seamlessly integrated and thus give possibilities for an extended user experience while interacting with media content on the web. We focus on automatic semantic enhancement services that can link arbitrary and open accessible data and introduce opportunities for media annotation, fragmentation and presentation. Our use case scenario is based on the Red Bull Content Pool, a media management system for videos, images and articles about Red Bull related content covering a multitude of sports events.
Similar content being viewed by others
Notes
LOD cloud: http://richard.cyganiak.de/2007/10/lod/
schema.org: http://schema.org/
schema.rdfs.org: http://schema.rdfs.org
Open Annotation Collaboration (OAC): http://www.openannotation.org/
Insemtives Incentives for Semantics: http://www.insemtives.eu/
Salzburg NewMediaLab TNG—Showcases: http://labs.newmedialab.at/
Apache Stanbol: http://incubator.apache.org/stanbol/
GATE: http://gate.ac.uk/
UIMA: http://uima.apache.org/
PoolParty: http://poolparty.biz/
LMF project: http://code.google.com/p/kiwi/
Sesame: http://www.openrdf.org/
Solr Client Libraries: http://wiki.apache.org/solr/IntegratingSolr
SPARQL Clients: http://www.w3.org/wiki/SparqlImplementations
LD Path: http://code.google.com/p/ldpath/
CDI/Weld: http://seamframework.org/Weld
Stanbol Enhancer: http://incubator.apache.org/stanbol/docs/trunk/enhancer.html
Open Link Virtuoso: http://tinyurl.com/virtuoso-ld
Talis Platform: http://www.talis.com/platform/
Red Bull Content Pool: https://www.redbullcontentpool.com/
Red Bull Media House: http://www.redbullmediahouse.com
Red Bull website: http://www.redbull.com
Media Fragments WG: http://www.w3.org/2008/WebVideo/Fragments/
Concept catamaran: http://dbpedia.org/resource/Catamaran
Eclipse SMILA project: http://www.eclipse.org/smila/
THESEUS research program: http://theseus-programm.de/en/index.php
Fluid OperationsTM(fluidOps): http://www.fluidops.com/
References
Arndt R, Troncy R, Staab S, Hardman L (2009) COMM: a core ontology for multimedia annotation, 2nd edn, pp 403–422. Springer
Aroyo L, Nicon L, Miller L (2011) NoTube: the television experience enhanced by online social and semantic data. In: IEEE international conference on consumer electronics Berlin ICCEBerlin 2011, pp 269–273
Berners-Lee T (2006) Linked data: design issues. http://www.w3.org/DesignIssues/LinkedData.html. Accessed 3 Jan 2012
Berners-Lee T, Hendler J, Lassila O (2001) The semantic web. Sci Am 284(5):34–43
Bizer C, Heath T, et al (2007) Interlinking Open Data on the Web (Poster). In: 4th European semantic web conference (ESWC2007), pp 802–815, Stand 12.5.2009
Bottoni P, Levialdi S, Labella A, Panizzi E, Trinchese R, Gigli L (2006) MADCOW: a visual interface for annotating web pages. In: AVI ’06: proceedings of the working conference on advanced visual interfaces. ACM Press, New York, NY, USA, pp 314–317
Brickley D, Guha RV (2004) RDF vocabulary description language 1.0: RDF schema. W3C Recommendation
Bürger T (2010) A model of relevance for reuse-driven media retrieval. In: Proceedings of the 2nd workshop on semantic multimedia database technologies, co-located with the 5th international conference on semantic and digital media technologies (SAMT)
Bürger T, Hausenblas M (2008) Interlinking Multimedia - Principles and Requirements. In: Proceedings of the first international workshop on interacting with multimedia content on the social semantic web, co-located with SAMT 2008
Bürger T, Simperl EPB (2009) A conceptual model for publishing multimedia content on the semantic web. In: SAMT. Lecture notes in computer science, vol 5887. Springer, pp 101–113
Carneiro G, Chan AB, Moreno PJ, Vasconcelos N (2007) Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans Pattern Anal Mach Intell 29(3):394–410
Christian Bizer TB-L, Heath T (2009) Linked data - the story so far. IJSWIS 5(3):1–22
Damjanovic V, Kurz T, Westenthaler R, Behrendt W, Gruber A, Schaffert S (2011) Semantic enhancement: the key to massive and heterogeneous data pools. In: Proceeding of the 20th international IEEE ERK (electrotechnical and computer science) conference 2011, Portoroz, Slovenia
DCMI (2008) DCMI metadata terms. http://dublincore.org/documents/dcmi-terms/. Accessed 3 Jan 2012
de Sompel HV, Nelson ML, Sanderson R, Balakireva L, Ainsworth S, Shankar H (2009) Memento: time travel for the web. CoRR, abs/0911.1112
Enser P (2008) The evolution of visual information retrieval. J Inf Sci 34(4):531–546
Fialho A, Troncy R, Hardman L, Saathoff C, Scherp A, (2010) What’s on this evening? designing user support for event-based annotation and exploration of media. In: Proceedings of the workshop on recognising and tracking events on the web and in real life (located at SETN 2010), Athens, Greece
Fielding RT (2000) Architectural styles and the design of network-based software architectures. PhD thesis, University of California, Irvine
Forrester Research (2009) The value of a Comprehensive integration solution. Forrester Research, Cambridge, MA
Handschuh S, Staab S, Studer R (2003) Leveraging metadata creation for the semantic web with CREAM. In: Kruse R, et al (eds) Proceedings of KI 2003: advances in artificial intelligence: 26th annual German conference on AI, KI 2003, Hamburg, Germany, vol 2821. Springer, Berlin, pp 19–33
Hardman L, Obrenovic Z̆, Nack F, Kerhervé B, Piersol K (2008) Canonical processes of semantically annotated media production. Multimedia systems. Springer
Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the web. Int J Digit Libr 10(1):15–32
Haslhofer B, Simon R, Sanderson R, de Sompel HV (2011) The Open Annotation Collaboration (OAC) model. In: Workshop on multimedia on the web (MMWeb2011) in conjunction with iSemantics2011
Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply linked data principles to multimedia fragments. In: WWW 2009 workshop: linked data on the web (LDOW2009), Madrid, Spain
Herlocker JL, Konstan JA, Terveen LG, Riedl JT (2004) An algorithmic framework for performing collaborative filtering. ACM Trans Inf Sys (TOIS) 22(1):230–237
Hollink L, Schreiber G, Wielemaker J, Wielinga B (2003) Semantic annotation of image collections. In: Proceedings of the KCAP’03 workshop on knowledge capture and semantic annotation, Florida
ISO 16684-1:2012: Graphic technology – Extensible metadata platform (XMP) specification – Part 1: Data model, serialization and core properties. International Organization for Standardization, Geneva, Switzerland
Kahan J, Koivunen M-R (2001) Annotea: an open RDF infrastructure for shared Web annotations. In: WWW ’01: proceedings of the 10th international conference on world wide web. ACM Press New York, NY, USA, pp 623–632
Klyne G, Carroll JJ (2004) Resource description framework (RDF): concepts and abstract syntax. Technical report, W3C, 2
Kurz T, Schaffert S, Bürger T (2011) LMF - A Framework for Linked Media. In: Workshop on multimedia on the web (MMWeb2011) in conjunction with iSemantics2011
Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Strassner J (2010) Ontology for media resource 1.0. W3C Candidate Recommendation
McGuinness DL, van Harmelen F (2004) OWL web ontology language overview. W3c recommendation, World Wide Web Consortium
Mendes P, Jakob M, García-Silva A, Bizer C (2011) DBpedia spotlight: shedding light on the web of documents. In: The proceedings of the 7th international conference on semantic systems (I-Semantics)
Miles A, Bechhofer S (2009) SKOS simple knowledge organization system reference. http://www.w3.org/TR/2009/REC-skos-reference-20090818/. Accessed 3 Jan 2012
Nichols DM, Pemberton D, Dalhoumi S, Larouk O, Belisle C, Twidale M (2000) DEBORA: Developing an Interface to Support Collaboration in a Digital Library. In: Borbinha JL, Baker T (eds) ECDL. Lecture Notes in Computer Science, vol 1923. Springer, pp 239–248
(NWG) NWG (2005) RFC3986 - Uniform Resource Identifier (URI): generic syntax. http://tools.ietf.org/html/rfc3986. Accessed 13 Aug 2012
Phelps TA, Wilensky R (1997) Multivalent Annotations. In: Peters C, Thanos C (eds) ECDL. Lecture notes in computer science, vol 1324. Springer, pp 287–303
Pipek V, Rohde M, Cuel R, Herbrechter M, Stein M, Tokarchuk O, Wiedenhöfer T, Yetim F, Zamarian M (2009) Requirements report of the INSEMTIVES Seekda! use case. D2.2.1 of INSEMTIVES project
Prud’hommeaux E, Seaborne A (2008) SPARQL query language for RDF. W3C Recommendation
Saathoff C, Scherp A (2010) Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology. In: Proceedings of the world wide web conference, 2010 (WWW2010)
Sanderson R, van de Sompel H (2011) Open Annotation: Beta Data Model Guide. Open annotation. http://www.openannotation.org/spec/beta/. Accessed 3 Jan 2012
Scharffe F, Euzenat J (2009) Alignments for data interlinking. http://melinda.inrialpes.fr. Accessed 13 Aug 2012
Schaffert S, Kurz T, Glachs D, Bauer C, Dorschel F, Fernandez M. The Linked Media Framework: Integrating and Interlinking Enterprise Media Content and Data. In: Proceedings of the 8th international conference in semantic systems, Graz, Sept 2012
Schebella M, Kurz T, Guentner G (2011) Linked Media Interfaces. Graphical User Interfaces for Search and Annotation, Linked Media Lab Reports, vol 2. Salzburg Research, ISBN 978-3-902448-29-3
Schroeter R, Hunter J, Guerin J, Khan I, Henderson M (2006) A synchronous multimedia annotation system for secure collaboratories. In: e-Science. IEEE Computer Society, p 41
SemanticWebCompany (2011) PoolParty Extractor (PPX). http://www.w3.org/2001/sw/wiki/PoolPart_Extractor. Accessed 3 Jan 2012
Siorpaes K, Hepp M (2008) Games with a purpose for the semantic web. IEEE Intell Syst 23(11):50–60
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22:1349–1380
Spivak N (2008) Semantic wave 2008: industry roadmap to web 3.0 and multibillion dollar market opportunities. In: Mills Davies (Project10X). http://www.project10x.com/
Stegmaier F, Lee W, Poppe C, Bailer W (2011) API for media resources 1.0. W3C Working Draft. http://www.w3.org/TR/2011/WD-mediaont-api-1.0-20110712/. 12 July 2011
Steiner T (2010) SemWebVid - making video a first class semantic web citizen and a first class web Bourgeois. In: Proceedings of the ISWC 2010 posters and demonstrations track, Shanghai. Thomas Steiner
Technical Standardization Committee on AV & IT Storage Systems and Equipment (2002) Exchangeable image file format for digital still cameras: exif version 2.2. Technical Report JEITA CP-3451
Troncy R, Mannens E, Pfeiffer S, Deursen DV (2011) Media fragments URI 1.0. Technical report, W3C
Uren V, Cimiano P, Iria J, Handschuh S, Vargas-Vera M, Motta E, Ciravegna F (2006) Semantic annotation for knowledge management: Requirements and a survey of the state of the art. JWS 4(1):14–28
W3C (2007) Linking open data. http://tinyurl.com/LinkingOpenDataProject. Accessed 3 Jan 2012
Acknowledgements
This research has been funded by the Republic of Austria within the COMET project “Salzburg NewMediaLab - The Next Generation” and by the European Commission within the 7th Framework Programme project KiWi - Knowledge in a Wiki (No. 211932). The latest version of the Linked Media Framework source code is available with a permissive Open Source license at http://code.google.com/p/kiwi. We thank the members of the W3C Linked Data mailing list for their valuable comments on our idea.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kurz, T., Güntner, G., Damjanovic, V. et al. Semantic enhancement for media asset management systems. Multimed Tools Appl 70, 949–975 (2014). https://doi.org/10.1007/s11042-012-1197-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1197-7