Multimedia Systems

, Volume 14, Issue 6, pp 415–425 | Cite as

Canonical processes for creating personalized semantically rich multimedia presentations

  • Ansgar ScherpEmail author
Regular Paper


Authoring of multimedia content can be considered as composing media assets such as images, videos, text, and audio in time, space, and interaction into a coherent multimedia presentation. Personalization of such content means that it reflects the users’ or user groups’ profile information and context information. Enriching the multimedia content with semantically rich metadata allows for a better search and retrieval of the content. To actually create personalized semantically-rich multimedia content, a manual authoring of the many different documents for all the different users’ and user groups’ needs is not feasible. Rather a (semi-)automatic authoring of the content seems reasonable. We have analyzed in detail today’s approaches and systems for authoring, personalizing, and semantically enriching multimedia presentations. Based on this analysis, we derived a general creation chain for the (semi-)automatic generation of such content. In this paper, we introduce this creation chain. We present our software engineering support for the chain, the component framework SemanticMM4U. The canonical processes supported by the creation chain and SemanticMM4U framework are described in detail. We also provide an explicit mapping of SemanticMM4U framework components to the processes and argue for the benefits of defining canonical processes for creating personalized semantically rich multimedia presentations.


Multimedia content Multimedia authoring Multimedia personalization Multimedia semantics Semantics derivation Canonical processes Media production Component framework Component technology 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adobe, Inc., USA. Flash File Format Spec. (2007).
  2. 2.
    Amazon, Inc., USA. (2007).
  3. 3.
    Bes, F., Jourdan, M., Khantache, F.: A generic architecture for automated construction of multimedia presentations. In: Multimedia Modeling. IEEE (2001)Google Scholar
  4. 4.
    Boll S., Klas W.: ZYX—a Multimedia Document Model for Reuse and Adaptation. IEEE Trans. Knowl. Data Eng. 13(3), 361–382 (2001)CrossRefGoogle Scholar
  5. 5.
    Boll, S., Klas, W., Westermann, U.: Multimedia document formats—sealed fate or setting out for new shores? In: IEEE International Conference on Multimedia Computing and Systems, pp. 604–610 (June 1999)Google Scholar
  6. 6.
    Boll, S., Sandhaus, P., Scherp, A., Westermann, U.: Semantics, content, and structure of many for the creation of personal photo albums. In: Multimedia, pp. 641–650. ACM (2007)Google Scholar
  7. 7.
    Bordegoni M., Faconti G., Feiner S., Maybury M.T., Rist T., Ruggieri S., Trahanias P., Wilson M.: A standard reference model for intelligent multimedia presentation systems. Comput. Stand. Interfaces 18(6–7), 477–496 (1997)CrossRefGoogle Scholar
  8. 8.
    Brusilovsky P., Maybury M.T.: From adaptive hypermedia to the adaptive Web. Commun. ACM 45(5), 30–33 (2002)CrossRefGoogle Scholar
  9. 9.
    Bulterman D.C.A., Hardman L.: Structured multimedia authoring. ACM TOMCCAP 1(1), 89–109 (2005)CrossRefGoogle Scholar
  10. 10.
    Christodoulakis, S., Tsinaraki, C., Breiteneder, C., et al.: CoCoMA. In: Research and Advanced Technology for Digital Libraries, p. 33 (2005)Google Scholar
  11. 11.
    DELOS NoE. DELOS Network of Excellence on Digital Libraries (2007).
  12. 12.
    Dey, A.K., Abowd, G.D.: Towards a Better Understanding of Context and Context-Awareness. Technical report, Georgia Institute, USA (1999)Google Scholar
  13. 13.
    Faconti, G.P., Rist, T. (eds.): Workshop Towards a Standard Reference Model for Intelligent Multimedia Presentation Systems (1996)Google Scholar
  14. 14.
    Falkovych K., Nack F.: Context aware guidance for multimedia authoring: harmonizing domain and discourse knowledge. Multimed. Syst. J. 3(11), 226–235 (2006)CrossRefGoogle Scholar
  15. 15.
    Falkovych, K., Nack, F., van Ossenbruggen, J., Rutledge L.: Sample: towards a framework for system-supported multimedia authoring. In: Multimedia Modelling, p. 362. IEEE (2004)Google Scholar
  16. 16.
    Fink, J., Kobsa, A., Schreck, J.: Personalized hypermedia information through adaptive and adaptable system features: user modeling, privacy and security issues. In: Intelligence in Services and Networks, pp. 459–467. Springer (1997)Google Scholar
  17. 17.
    Geurts, J., van Ossenbruggen, J., Hardman, L.: Application-specific constraints for multimedia presentation generation. In: Multimedia Modeling, pp. 247–266. IEEE (2001)Google Scholar
  18. 18.
    Hjelsvold, R., Vdaygiri, S., Léauté, Y.: Web-based personalization and management of interactive video. In: World Wide Web, pp. 129–139 (2001)Google Scholar
  19. 19.
    IBM Corporation, USA. QBIC Home Page, (2004).
  20. 20.
    Jourdan, M., Bes, F.: A new step towards multimedia documents generation. In: International Conference on Media Futures, pp. 25–28 (May 2001)Google Scholar
  21. 21.
    King, R., Popitsch, N., Westermann, U.: METIS: a flexible database foundation for unified media management. In: Multimedia, pp. 744–745. ACM (2004)Google Scholar
  22. 22.
    Kobsa, A., Koenemann, J., Pohl, W.: Personalized hypermedia presentation techniques for improving online customer relationships. In: The Knowledge Engineering Review, pp. 111–155. Cambridge University (2001)Google Scholar
  23. 23.
    Lemlouma, T., Layaïda, N.: Adapted Content Delivery for Different Contexts. In: Symposium on Applications and the Internet, pp. 190–197. IEEE (Jan 2003)Google Scholar
  24. 24.
    Lemlouma, T., Laya"  N.: Context-aware adaptation for mobile devices. In: International Conference on Mobile Data Management, pp. 106–111. IEEE (2004)Google Scholar
  25. 25.
    Oracle Corporation, USA. interMedia, (2004).
  26. 26.
    Santini S., Gupta A., Jain R.: Emergent semantics through interaction in image databases. IEEE Trans. Knowl. Data Eng. 13(3), 337–351 (2001)CrossRefGoogle Scholar
  27. 27.
    Scherp, A.: A Component Framework for Personalized Multimedia Applications. OlWIR, Oldenburg, Germany, Feb. 2007. PhD Thesis.
  28. 28.
    Scherp, A., Boll, S.: Generic support for personalized mobile multimedia tourist applications. In: Multimedia, pp. 178–179. ACM (2004)Google Scholar
  29. 29.
    Scherp, A., Boll, S.: Context-driven smart authoring of multimedia content with xSMART. In: Multimedia, pp. 802–803. ACM (2005)Google Scholar
  30. 30.
    Scherp, A., Boll, S.: MM4U—a framework for creating personalized multimedia content. In: Managing multimedia semantics, pp. 246–287. Idea group (2005)Google Scholar
  31. 31.
    Scherp, A., Boll, S.: Paving the last mile for multi-channel multimedia presentation generation. In: Multimedia Modeling, pp. 190–197. IEEE (2005)Google Scholar
  32. 32.
    Scherp, A., Boll, S., Cremer, H.: Emergent semantics in personalized multimedia content. J. Digit. Inform. Manage. 5(2) (2007)Google Scholar
  33. 33.
    Scherp, A., Jain, R.: Towards an ecosystem for semantics. In: Workshop on the many faces of multimedia semantics, pp. 3–12. ACM (2007)Google Scholar
  34. 34.
    Schilit, B., Adams, N., Want, R.: Context-aware computing applications. In: Workshop on mobil computing systems and applications, pp. 85–90. IEEE (1994)Google Scholar
  35. 35.
    Schmidt A., Beigl M., Gellersen H.-W.: There is more to context than location. Comput. Graph. 23(6), 893–901 (1999)CrossRefGoogle Scholar
  36. 36.
    van Ossenbruggen, J., Hardman, L., Geurts J., Rutledge, L.: Towards a multimedia formatting vocabulary. In: World Wide Web, pp. 384–393 (2003)Google Scholar
  37. 37.
    W3C. RDF/XML Syntax Specification, Feb. (2003).
  38. 38.
    W3C. Extensible Markup Language, Feb. (2004).
  39. 39.
    W3C. Mobile SVG Profiles, Mar. (2004).
  40. 40.
    W3C. Scalable Vector Graphics (2005).
  41. 41.
    W3C. Synchronized Multimedia Integration Language (2005).

Copyright information

© Springer-Verlag 2008

Authors and Affiliations

  1. 1.OFFIS-Institute for Information TechnologyOldenburgGermany

Personalised recommendations