Applied Intelligence

, Volume 24, Issue 2, pp 109–125 | Cite as

A knowledge-based framework for multimedia adaptation

  • Dietmar JannachEmail author
  • Klaus Leopold
  • Christian Timmerer
  • Hermann Hellwagner


Personalized delivery of multimedia content over the Internet opens new business perspectives for future multimedia applications and thus plays an important role in the ongoing MPEG-7 and MPEG-21 multimedia standardization efforts. Based on these standards, next-generation multimedia services will be able to automatically prepare the digital content before delivery according to the client's device capabilities, the network conditions, or even the user's content preferences. However, these services will have to deal with a variety of different end user devices, media formats, as well as with additional metadata when adapting the original media resources. In parallel, an increasing number of commercial or open-source media transformation tools will be available, capable of exploiting such descriptive metadata or dealing with new media formats; thus it is not realistic that a single tool will support all possible transformations.

In this paper, we present a novel, fully knowledge-based approach for building such multimedia adaptation services, addressing the above mentioned issues of openness, extensibility, and concordance with existing and upcoming standards. In our approach, the original media is transformed in multiple adaptation steps performed by an extensible set of external tools, where the construction of adequate adaptation sequences is solved in an Artificial Intelligence planning process. The interoperability issue is addressed by exploiting standardized Semantic Web Services technology. This technology allows us to express tool capabilities and execution semantics in a declarative and well-defined form. In this context, existing multimedia standards serve as a shared domain ontology.

The presented approach was implemented and successfully evaluated in an official ISO/IEC MPEG (Moving Picture Experts Group) Core Experiment and is currently under further evaluation by the standardization body.


Multimedia applications Knowledge-based systems Semantic web services Planning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M. Addis, M. Boniface, S. Goodall, P. Grimwood and S. KimP. Lewis, K. Martinez,and A. Stevenson, “SCULPTEUR: Towards a new paradigm for multimediamuseum information handling.” in Proceedings of the International Semantic Web Conference2003, FL, USA, Lecture Notes in Computer Science, 2870, pp. 582–596, 2003.Google Scholar
  2. 2.
    T. Berners-Lee, J. Hendler and O. Lassila, “The semantic web,” Scientific American, Vol. 284, pp. 34–43, 2001.Google Scholar
  3. 3.
    E. Bertino and E. Ferrariand M. Stolf, “MPGS: An interactive tool for thespecification and generation of multimedia presentations,” IEEE Transactions on Knowledge and Data Engineering, Vol.12, No. 1, pp. 102–125, 1994.Google Scholar
  4. 4.
    A. Blum and M. Furst“Fast planning through planning graph analysis,” Artificial Intelligence, Vol. 90, pp. 281–300, 1997.CrossRefGoogle Scholar
  5. 5.
    L. Boeszoermeny, H. Hellwagner, H. Kosch and M. Libsieand S. Podlipnig, “Metadata Driven Adaptation in the ADMITS Project.” EURASIP Signal Processing: Image Communication, Special Issue on Multimedia Adaptation, Vol. 18, pp. 749–766, 2003.Google Scholar
  6. 6.
    B. Bonet and H. Geffner“Faster heuristic search algorithms forplanning with uncertainty and full feedback,”in Int. Joint Conference on Artificial Intelligence(IJCAI-2003). Acapulco, Mexico, pp. 1233–1238, 2003.Google Scholar
  7. 7.
    J. Bormans (ed.), MPEG-21 Requirements v 1.5 ISO/IEC JTC 1/SC 29/WG11 N5873, Trondheim: Norway, 2003.Google Scholar
  8. 8.
    I. Bratko Prolog Programming for Artificial Intelligence, 3rdedn., Addison-Wesley, 2000.Google Scholar
  9. 9.
    I. Burnett, R.V. de Walle, K. Hill and J. Bormansand F. Pereira,“MPEG-21: Goals and achievements,” IEEE MultiMedia Magazine, Vol. 10, No. 6, pp. 60–70, 2003.Google Scholar
  10. 10.
    T. Bylander “The computational complexity of propositional STRIPSplanning,” Artificial Intelligence, Vol. 69, Nos. 1/2, pp. 165–204, 1994.zbMATHMathSciNetGoogle Scholar
  11. 11.
    J.M.L. Cobo and S. Losada,Ó. Corcho, V.R. Benjamins, M. Ni,ño, and J.Contreras, “SWS for Financial Overdrawn Alerting,” in International Semantic Web Conference, pp. 782–796, 2004.Google Scholar
  12. 12.
    H. Eidenberger and C. Breiteneder“VizIR,—A Framework for VisualInformation Retrieval,” Journal of Visual Languages and Computing, Vol. 14, pp. 443–469, 2003.Google Scholar
  13. 13.
    M. Fox and D. Long“PDDL2.1: An extension to PDDL for expressingtemporal planning domains,” Journal on Artificial Intelligence Research, Vol. 20, pp. 61–124, 2003.Google Scholar
  14. 14.
    J. Gecsei “Adaptation in distributed multimedia systems,”IEEE MultiMedia, Vol. 4, No. 2, pp. 58–66, 1997.CrossRefGoogle Scholar
  15. 15.
    ISO/IEC 15938-5:2003, Information Technology—Multimedia ContentDescription Interface,—Part 5: Multimedia Description Schemes, 2003.Google Scholar
  16. 16.
    ISO/IEC 21000-5:2003, Information Technology,—MultimediaFramework,—Part 5: Rights Expression Language, 2003.Google Scholar
  17. 17.
    ISO/IEC 21000-6:2003, Information Technology,—MultimediaFramework,—Part 6: Rights Data Dictionary, 2003.Google Scholar
  18. 18.
    ISO/IEC 21000-7:2004, Information Technology - MultimediaFramework,—Part 7: Digital Item Adaptation, 2004.Google Scholar
  19. 19.
    D. Jannach and K. Leopold“A multimedia adaptation framework based onsemantic web technology,” in Workshop on Multimedia and the Semantic Web, held inconjunction with 2nd European Semantic Web Conference, 2005.Google Scholar
  20. 20.
    D. Jannach and K. Leopoldand H. Hellwagner, “An extensible framework forknowledge-based multimedia adaptation,” in Proceedings of 14th Conference on Industrial and EngineeringApplications of Artificial Intelligence and Expert Systems (IEA/AIE), LectureNotes in Artificial Intelligence 2070, pp. 434–444, 2004.Google Scholar
  21. 21.
    I. Kompatsiaris and V. Mezarisand M.G. Strintzis, “Multimedia contentindexing and retrieval using an object ontology” in G. Stamou (ed.), Multimedia Content and Semantic Web,—Methods, Standards and Tools, New York, USA, 2004.Google Scholar
  22. 22.
    J.M. Martinez and R. Koenenand F. Pereira, “MPEG-7,—The GenericMultimedia Content Description Standard, Part 1.” IEEE MultiMedia, Vol. 9, No. 2, pp. 78–87, 2002.CrossRefGoogle Scholar
  23. 23.
    D.L. McGuiness F. van Harmelen (eds.), “OWL Web ontology languageoverview. Technical report,” 2004.
  24. 24.
    S. McIlraith and T. Sonand H. Zeng, “Semantic Web Services” IEEE Intelligent Systems, Special Issue on the Semantic Web,Vol. 16, pp. 46–53, 2001.Google Scholar
  25. 25.
    V. Mezaris and I. Kompatsiarisand M.G. Strintzis, “Region-based imageretrieval using an object ontology and relevance feedback,” EURASIP Journal on Applied Signal Processing, Special Issue on Object-Based and Semantic Image and Video Analysis, pp. 886–901, 2004.Google Scholar
  26. 26.
    Y. Qu X. Zhang and H. Li, “OREL: AN ontology-based rights expressionlanguage,” in Proceedings of the 2004 ACM World Wide Web Conference(WWW,'2004) Alternate Track Papers and Posters, pp. 324–425, 2004.Google Scholar
  27. 27.
    G. Rust and C. Barlas“The MPEG-21 Rights data dictionary” IEEE Transactions on Multimedia, Vol. 7, No. 2. 2005.Google Scholar
  28. 28.
    P. Schojer, L. Boeszoermenyi, H. Hellwagner and B. Penzand S. Podlipnig, “Architecture of a quality based intelligent proxy (QBIX) for MPEG-4videos,” in Proceedings of the 2003 ACM World Wide Web Conference (WWW,'2003), Budapest, Hungary, pp. 394–402, 2003.Google Scholar
  29. 29.
    M. Sheshagiri and N. Sadehand F. Gandon, “Using semantic Web Services for context-aware mobile applications,” in Proceedings of MobiSys2004 Workshop on Context Awareness. Boston, USA, pp. 782–796, 2004.Google Scholar
  30. 30.
    P. Soetens and M.D. Geyter, “Applying domain knowledge to multi-step media adaptation based on Semantic Web Services,” in Proceedings of Workshop on Image Analysis for Multi-media Interactive Systems (WIAMIS)Montreux, Switzerland, 2005.Google Scholar
  31. 31.
    O. Steiger and D.M. Sanjunand T. Ebrahimi, “MPEG-based personalized content delivery,” in Proc. of the IEEE Int. Conf. on Image Processing, ICIP 2003, Barcelona, Spain, pp. 14–16, 2003.Google Scholar
  32. 32.
    The OWL Services Coalition, “OWL-S: Semantic markup for Web Services. Technical report,”, 2004.
  33. 33.
    C., Timmerer, T. DeMartini, and C. Barlas (eds.), Information Technology—Multimedia Framework (MPEG-21),—Part 7: Digital Item Adaptation, AMENDMENT 1: DIA Conversions and Permissions, 2005.Google Scholar
  34. 34.
    A. Vetro and C. Christopoulosand T. Ebrahami (eds.), IEEE Signal Processing Magazine, Special Issue on Universal Multimedia Access, Vol. 20, 2003.Google Scholar
  35. 35.
    A. Vetro and C. Christopoulosand H. Sun, “Video transcoding architectures and techniques: An overview,” IEEE Signal Processing Magazine, Vol. 20, No. 2, pp. 18–29, 2003.Google Scholar
  36. 36.
    A. Vetro and C. Timmerer “Digital item adaptation: Overview of standardization and research activities,” IEEE Transactions on Multimedia, Vol. 7, No. 2, 2005.Google Scholar
  37. 37.
    X. Wang, T. DeMartini and B. Wraggand M. Paramasivam, “The MPEG-21 rights expression language,” IEEE Transactions on Multimedia, Vol. 7, No. 2, 2005.Google Scholar

Copyright information

© Springer Science + Business Media, Inc. 2006

Authors and Affiliations

  • Dietmar Jannach
    • 1
    Email author
  • Klaus Leopold
    • 1
  • Christian Timmerer
    • 1
  • Hermann Hellwagner
    • 1
  1. 1.Universität KlagenfurtAustria

Personalised recommendations