Integrating Structure and Semantics into Audio-visual Documents

  • Raphaël Troncy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2870)


Describing audio-visual documents amounts to consider documentary aspects (the structure) as well as conceptual aspects (the content). In this paper, we propose an architecture which describes formally the content of the videos and which constrains the structure of their descriptions. This work is based on languages and technologies underlying the Semantic Web and in particular ontologies. Therefore, we propose to combine emerging Web standards, namely MPEG-7/XML Schema for the structural part and OWL/RDF for the knowledge part of the description. Finally, our work offers reasoning support on both aspects when querying a database of videos.


Description Scheme Multimedia Document Reasoning Support Knowledge Representation Language Video Document 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bachimont, B., Isaac, A., Troncy, R.: Semantic commitment for designing ontologies: A proposal. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, pp. 114–121. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  2. 2.
    Bechhofer, S., Horrocks, I., Goble, C., Stevens, R.: OilEd: a Reason-able Ontology Editor for the Semantic Web. In: Baader, F., Brewka, G., Eiter, T. (eds.) KI 2001. LNCS (LNAI), vol. 2174, pp. 396–408. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Benitez, A.B., Rising, H., Jörgensen, C.: Semantics of Multimedia in MPEG-7. In: IEEE Conference on Image Processing (ICIP 2002), Rochester, New York (2002)Google Scholar
  4. 4.
    Berners-Lee, T., Hendler, J., Lassila, O.: The Semantic Web. In Scientific American 284(5), 34–43 (2001)CrossRefGoogle Scholar
  5. 5.
    Broekstra, J., Kampman, A., van Harmelen, F.: Sesame: a Generic Architecture for Storing and Querying RDF and RDF Schema. In: Horrocks, I., Hendler, J. (eds.) ISWC 2002. LNCS, vol. 2342, pp. 54–68. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  6. 6.
    Fatemi, N., Abou Khaled, O.: COALA: Content-Oriented Audiovisual Library Access. In: Proc. of the 8th International Conference on Multimedia Modeling (MMM 2001), Amsterdam, The Netherlands, pp. 59–71 (2001)Google Scholar
  7. 7.
    Hunter, J.: Adding Multimedia to the Semantic Web – Building an MPEG-7 Ontology. In: Proc. of the First International Semantic Web Working Symposium (SWWS 2001), Stanford, California, pp. 261–283 (2001)Google Scholar
  8. 8.
    ISO. Information Technology – Multimedia Content Description Interface (MPEG- 7). Standard No. ISO/IEC 15938:2001, International Organization for Standardization (ISO) (2001) Google Scholar
  9. 9.
    Le Roux, E.: Extraction d’information dans des textes libres guide par une ontologie. PhD Thesis (2003)Google Scholar
  10. 10.
    OWL, Web Ontology Language Reference Version 1.0. W3C Working Draft, March 31 (2003),
  11. 11.
    Patel-Schneider, P.F., Siméon, J.: Building the Semantic Web on XML. In: Horrocks, I., Hendler, J. (eds.) ISWC 2002. LNCS, vol. 2342, pp. 147–161. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  12. 12.
    Pfeiffer, S., Srinivasan, U.: TV Anytime as an application scenario for MPEG-7. In: Proc. of Workshop on Standards, Interoperability and Practice of the 8th International Conference on Multimedia. ACM Multimedia, Los Angeles (2000)Google Scholar
  13. 13.
    RDF, Ressource Description Framework Primer. W3C Working Draft, January 23 (2003),
  14. 14.
    Simov, K., Jordanov, S.: BOR: a Pragmatic DAML+OIL Reasoner. Deliverable 40, On-To-Knowledge Project (2002)Google Scholar
  15. 15.
    Terzi, E., Vakali, A., Fan, J., Hacid, M.-S.: The MPEG-7 Multimedia Content Description Standard and the XML Schema Language. In: Proc. of the 7th International Conference on Distributed Multimedia Systems (DMS 2001), Taipei, Taiwan (2001)Google Scholar
  16. 16.
    XML Schema. W3C Recommendation, May 2 (2001),

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Raphaël Troncy
    • 1
    • 2
  1. 1.Institut National de l’Audiovisuel, Direction de la Recherche, Équipe DCABry-sur-Marne
  2. 2.INRIA Rhône-Alpes, Équipe EXMO 

Personalised recommendations