Multimedia Systems

, Volume 14, Issue 6, pp 327–340 | Cite as

Canonical processes of semantically annotated media production

  • Lynda Hardman
  • Željko Obrenović
  • Frank Nack
  • Brigitte Kerhervé
  • Kurt Piersol
Regular Paper


While many multimedia systems allow the association of semantic annotations with media assets, there is no agreed-upon way of sharing these among systems. As an initial step within the multimedia community, we identify a small number of fundamental processes of media production, which we term canonical processes. We specify their inputs and outputs, but deliberately do not specify their inner workings, concentrating rather on the information flow between them. We thus identify a small set of building blocks that can be supported in semantically aware media production tools. The processes are identified in conjunction with a number of different research groups within the community who supply, in the companion papers, descriptions of existing systems and a mapping to them. We give a basic formalisation of the processes and discuss how this fits with other formalisation endeavours. We present a number of frequently asked questions during the development of the model and this special issue.


Query Process Class Diagram Multimedia Community Document Structure Canonical Process 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: Designing a well-founded multimedia ontology for the Web. In The Semantic Web—ISWC/ASWC 2007, vol. 4825 of Lecture Notes in Computer Science, pages 30–43, Busan, Korea, 11–15 November 2007Google Scholar
  2. 2.
    Bailey, B.P., Konstan, J.A., Carlis, J.V.: Supporting multimedia designers: towards more effective design tools. In: Proceedings of Multimedia Modeling: Modeling Mutlimedia Information and Systems (MMM2001), pp. 267–286. Centrum voor Wiskunde en Informatica (CWI) (2001)Google Scholar
  3. 3.
    Bocconi, S., Nack, F., Hardman, L.: Using rhetorical annotations for generating video documentaries. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) (2005)Google Scholar
  4. 4.
    Davis, M.: Active capture: integrating human–computer interaction and computer vision/audition to automate media capture. In: ICME ’03, Proceedings, pp. 185–188 (2003)Google Scholar
  5. 5.
    Dorai, C., Venkatesh, S.: Bridging the semantic gap in content management systems—computational media aesthetics. In: Dorai, C., Venkatesh, S. (eds) Media computing—computational media aesthetics, pp. 1–9. Kluwer, Dordrecht (2002)Google Scholar
  6. 6.
    Gangemi, A., Guarino, N., Masolo, C., Oltramari, A.,Schneider, L.: Sweetening ontologies with DOLCE. In: EKAW ’02: Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management. Ontologies and the Semantic Web, pp. 166–181. Siguenza, Spain, 01–04 October 2002. Springer, HeidelbergGoogle Scholar
  7. 7.
    Halasz, F., Schwartz, M.: Grønbæck, K., Trigg, R. (eds) The dexter hypertext reference model. Commun ACM 37(2), 30–39 (1994)Google Scholar
  8. 8.
    Hardman, L.: Modelling and Authoring Hypermedia Documents. PhD thesis, University of Amsterdam, 1998. ISBN: 90-74795-93-5, also available at
  9. 9.
    ISO/IEC: Overview of the MPEG-7 Standard (version 6.0). ISO/IEC JTC1/SC29/WG11/N4980, Pattaya (2001)Google Scholar
  10. 10.
    Jain R. (2003). Experiential computing. Commun ACM 46(7): 48–55 CrossRefGoogle Scholar
  11. 11.
    Kerhervé, B., Ouali, A., Landon, P.: Design and production of new media artworks. In: Proceedings of the ACM Workshop on Multimedia for Human Communication—From Capture to Convey (MHC 05) (2005)Google Scholar
  12. 12.
    Kosch, H., Böszörményi, L., Döller, M., Libsie, M., Schojer, P., Kofler, A.: The life cycle of multimedia metadata. IEEE MultiMedia, (January–March) pp. 80–86 (2005)Google Scholar
  13. 13.
    Nack, F., Lindsay, A.T.: Everything you wanted to know about MPEG-7: part 1. IEEE multiMedia, pp. 65–77 (1999)Google Scholar
  14. 14.
    Nack, F., Putz, W.: Designing annotation before it’s needed. In: Proceedings of the 9th ACM International Conference on Multimedia, pp. 251–260. Ottawa, Ontario, Canada, 30 September–5 October, 2001Google Scholar
  15. 15.
    Pereira F., Vetro A. and Sikora T. (2008). Multimedia retrieval and delivery: essential metadata challenges and standards. Proc IEEE 96(4): 721–744 CrossRefGoogle Scholar
  16. 16.
    Reif, G., Morger, M., Gall, H.: Semantic clipboard—semantically enriched data exchange between desktop applications. In: SemDesk2006 Workshop at the 5th International Semantic Web Conference (ISWC2006), Athens, GA, USA, November (2006)Google Scholar
  17. 17.
    W3C.: Synchronized Multimedia Integration Language (SMIL 2.0) Specification. In: Cohen A (ed) W3C Recommendation, 7 August 2001Google Scholar
  18. 18.
    W3C.: Web Ontology Language (OWL)—overview. W3C recommendation, 10 February 2004Google Scholar

Copyright information

© Springer-Verlag 2008

Authors and Affiliations

  • Lynda Hardman
    • 1
  • Željko Obrenović
    • 1
  • Frank Nack
    • 2
  • Brigitte Kerhervé
    • 3
  • Kurt Piersol
    • 4
  1. 1.CWIAmsterdamThe Netherlands
  2. 2.University of AmsterdamAmsterdamThe Netherlands
  3. 3.Département d’InformatiqueUQAMMontrealCanada
  4. 4.Ricoh Innovations, Inc.Menlo ParkUSA

Personalised recommendations