I am a Machine, Let Me Understand Web Media!

  • Magnus Knuth
  • Jörg Waitelonis
  • Harald Sack
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9671)


The majority of web assets cannot be understood by machines, because of the lack of available explicit and machine readable semantics. By enabling machines to understand the meaning of web media, fully automated discovery, processing, and linking become feasible. Semantic Web technologies offer the possibility to enhance web resources with explicit semantics via linking to ontologies encoded in RDF. We demand to make the content of every web asset explicit for machines with the least possible effort for any content provider. Web servers should deliver RDF descriptions for any web document on request. To achieve this, we propose a framework that enables web content providers to connect to content-wise descriptions of their web assets via simple HTTP content negotiation in connection with on-the-fly automated multimedia analysis services. We demonstrate the feasibility of our approach with a prototype implementation.


Machine understandability Web media Automated media analysis Semantic web technologies RDF Content negotiation 


  1. 1.
    Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: designing a well-founded multimedia ontology for the web. In: Aberer, K., et al. (eds.) ASWC 2007 and ISWC 2007. LNCS, vol. 4825, pp. 30–43. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  2. 2.
    Bailer, W., et al.: Ontology for media resources 1.0. W3C recommendation, (Feb 2012).
  3. 3.
    Berners-Lee, T., Hendler, J., Lassila, O.: The semantic web. Sci. Am. 284(5), 34–43 (2001)CrossRefGoogle Scholar
  4. 4.
    Fielding, R.T., et al.: Hypertext transfer protocol - http/1.1. RFC 2616, RFC Editor (June 1999).
  5. 5.
    Freed, N., Borenstein, D.N.S.: Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies. IETF RFC 2045 (Mar 2013).
  6. 6.
    Hausenblas, M., et al.: Interlinking multimedia. In: CEUR-WS, Proceedings of the Linked Data on the Web Workshop. Madrid, Spain, vol. 538, April 2009Google Scholar
  7. 7.
    Heath, T., Bizer, C.: Linked Data: Evolving the Web into a Global Data Space, 1st edn. Morgan & Claypool, San Rafael (2011)Google Scholar
  8. 8.
    Hellmann, S., Lehmann, J., Auer, S., Brümmer, M.: Integrating NLP using linked data. In: Alani, H., et al. (eds.) ISWC 2013, Part II. LNCS, vol. 8219, pp. 98–113. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  9. 9.
    Hentschel, C., Sack, H.: What image classifiers really see – visualizing bag-of-visual words models. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part I. LNCS, vol. 8935, pp. 95–104. Springer, Heidelberg (2015)Google Scholar
  10. 10.
    MPEG-7: Multimedia Content Description Interface (2001)Google Scholar
  11. 11.
    Exchangeable image file format for digital still cameras: Exif version 2.3 (2010).
  12. 12.
    Kanzaki, M.: Exif data description vocabulary (2003)., last update in 2007
  13. 13.
    Lafon, Y., Bos, B.: Describing and retrieving photos using RDF and HTTP. W3c note, April 2002.
  14. 14.
    Nixon, L., Troncy, R.: Survey of semantic media annotation tools for the web: towards new media applications with linked media. In: Presutti, V., Blomqvist, E., Troncy, R., Sack, H., Papadakis, I., Tordai, A. (eds.) ESWC Satellite Events 2014. LNCS, vol. 8798, pp. 100–114. Springer, Heidelberg (2014)Google Scholar
  15. 15.
    Powell, A., Nilsson, M., Naeve, A., Johnston, P.: Dublin core metadata initiative - abstract model (2005).
  16. 16.
    RDFa 1.1 primer: rich structured data markup for web documents. W3C Working group note, March 2015.
  17. 17.
    Sanderson, R., Ciccarese, P., de Sompel, H.V.: Open annotation data model. W3C community draft, Febraury 2013.
  18. 18.
    Troncy, R., et al.: Media fragment URI 1.0. W3C recommendation, September 2012.
  19. 19.
    Usbeck, R., et al.: GERBIL - general entity annotation benchmark framework. In: 24th WWW Conference (2015)Google Scholar
  20. 20.
    Vaidya, G., Kontokostas, D., Knuth, M., Lehmann, J., Hellmann, S.: DBpedia commons: structured multimedia metadata from the wikimedia commons. In: Arenas, M., et al. (eds.) ISWC 2015. LNCS, vol. 9367, pp. 281–289. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-25010-6_17 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Hasso Plattner InstituteUniversity of PotsdamPotsdamGermany

Personalised recommendations