Skip to main content

Context-aware design of adaptable multimodal documents


In this paper we present a model and an adaptation architecture for context-aware multimodal documents. A compound virtual document describes the different ways in which multimodal information can be structured and presented. Physical features are associated to media instances, while properties describe the context. Concrete documents are instantiated from virtual documents by selecting and synchronizing proper media instances based on the user context: the situation, the environment, the device and the available communication resources. The relations between the context features and the media properties are described by a rule based system.

This is a preview of subscription content, access via your institution.


  1. 1.

    Abowd GD, Atkeson CG, Hong J, Long S, Kooper R, Pinkerton M (1997) Cyberguide: a mobile context-aware tour guide. ACM Wirel Network 3:421–433

    Article  Google Scholar 

  2. 2.

    Bertino E, Ferrari E, Stolf M (2000, January) MPGS: an interactive tool for the specification and generation of multimedia presentations. IEEE Trans on Knowl and Data Eng 12(1):102–125

    Article  Google Scholar 

  3. 3.

    Bertolotti P, Gaggi O (2004) A notion of equivalence for multimedia document. In: Proc. Int. Workshop on Multimedia Information Systems, Washington, District of Columbia, pp. 96–104

  4. 4.

    Boll S, Klas W, Wandel J (1999) A cross-media adaptation strategy for multimedia presentations. In: ACM Multimedia, pp. 37–46

  5. 5.

    Brusilovsky P (1996) Methods and techniques of adaptive hypermedia. User Model User–Adapt Interact 6(2–3):87–129

    Article  Google Scholar 

  6. 6.

    Celentano A, Gaggi O, Sapino ML (2004) Retrieval in multimedia presentations. Multimedia Syst 10(1):72–82

    Article  Google Scholar 

  7. 7.

    Chen G, Kotz D (2000) A survey of context-aware mobile computing. Technical Report TR2000–381, Dartmouth College, Department of Computer Science

  8. 8.

    Davies N, Cheverst K, Mitchell K, Efrat A (2001) Using and determining location in a context-sensitive tour guide. IEEE Comput 34(8):35–41

    Google Scholar 

  9. 9.

    Dey AK (2001) Understanding and using context. Personal Ubiquitous Computing 5(1):4–7

    Article  Google Scholar 

  10. 10.

    Dias V, Euzenat J, Layaïda N (2003) A semantic framework for multimedia document adaptation. In: Proc. 18th Int. Joint Conf. on Artificial Intelligence, pp. 31–36

  11. 11.

    Elouazizi N, Bachvarova Y (2004) On cognitive relevance in automatic multimodal systems. In: Proc. IEEE Conf. on Multimedia Software Engineering, Miami, Florida, pp. 418–426

  12. 12.

    Fink J, Kobsa A, Nill A (1998) Adaptable and adaptive information provision for all users, including disabled and elderly people. New Rev Hypermedia Multimed 4:163–188

    Google Scholar 

  13. 13.

    Gaggi O, Celentano A (2002) Modelling synchronized hypermedia presentations. Multimedia Tools Appl 27(1):53–78

    Article  Google Scholar 

  14. 14.

    Harter A, Hopper A, Steggles P, Ward A, Webster P (1999, August) The anatomy of a context-aware application. In: Proc. 5th Annual ACM/IEEE Int'l Conf. on Mobile Computing and Networking, Seattle, Washington, pp. 59–68

  15. 15.

    Klyne G, Reynolds F, Woodrow C, Ohto H, Hjelm J, Butler MH, Tran L (2004) Composite Capability/Preference Profiles (CC/PP): Structure and Vocabularies 1.0. W3C Recommendation

  16. 16.

    Kraus M, Bry F, Kitagawa K (2003, December) XML document adaptation queries (XDAQ): an approach to adaptation reasoning using Web query languages. In: Proc. Workshop on Principles and Practice of Semantic Web Reasoning (PPSWR)

  17. 17.

    Lemlouma T, Layaïda N (2003) Adapted content delivery for different contexts. In: IEEE Symposium on Applications and the Internet (SAINT 2003), Orlando, Florida, pp. 190–199

  18. 18.

    Lemlouma T, Layaïda N (2004) Context-aware adaptation for mobile devices. In: Proc. IEEE Int. Conf. on Mobile Data Management, Berkeley, California, pp. 106–111

  19. 19.

    Petrelli D, Not E, Zancanaro M, Strapparava C, Stock O (2001) Modelling and adapting to context. Personal Ubiquitous Computing 5(1):20–24

    Article  Google Scholar 

  20. 20.

    Ranganathan A, Campbell RH (2003) An infrastructure for context-awareness based on first order logic. Personal Ubiquitous Computing 7(6):353–364

    Article  Google Scholar 

  21. 21.

    Schilit BN, Adams N, Want R (1994, December) Context-aware computing applications. In: Proc. Workshop on Mobile Computing Systems and Applications. IEEE, December

  22. 22.

    Schmidt A, Beigl M, Gellersen Hans-W (1999) There is more to context than location. Comput Graph 23

  23. 23.

    Schneider-Hufschmidt M, Kühme T, Malinowski, U (eds) (1993) Adaptive user interfaces: principles and practice. Elsevier Science, Amsterdam

    Google Scholar 

  24. 24.

    Steele R, Lubonski M, Ventsov Y, Lawrence E (2004) Accessing SMIL-based dynamically adaptable multimedia presentations from mobile devices. In: International Conference on Information Technology: Coding and Computing (ITCC'04), Volume 2, Las Vegas, Nevada, USA, pp. 410–415

  25. 25.

    Sun Microsystems. Java Architecture for XML Binding (JAXB).

  26. 26.

    Swedish Institute of Computer Science. SICStus Prolog.

  27. 27.

    Synchronized Multimedia Working Group of W3C (2001, August) Synchronized Multimedia Integration Language (SMIL) 2.0 Specification

  28. 28.

    van Ossenbruggen J, Geurts J, Cornelissen F, Rutledge L, Hardman L (2001) Towards second and third generation web-based multimedia. In: Proc. Tenth International World Wide Web Conference, Hong Kong, pp. 479–488

  29. 29.

    Villard L (2001) Authoring transformations by direct manipulation for adaptable multimedia presentations. In: Proc. 2001 ACM Symposium on Document Engineering, Atlanta, Georgia, USA, 2001. ACM, pp 125–134

  30. 30.

    Villard L, Roisin C, Layaïda N (2000, September) A XML-based multimedia document processing model for content adaptation. In: Proc. of Digital Documents and Electronic Publishing (DDEP00), vol. 2023 of LNCS, Munich, Germany. Springer, Berlin Heidelberg New York

  31. 31.

    Weiser M, Seely Brown J (1997) The coming age of calm technology. In: Beyond calculation: the next fifty years of computing. Springer, Berlin Heidelberg New York

  32. 32.

    Wirag S (1997) Modeling of adaptable multimedia documents. In: Proc. Int. Work-shop on Interactive Distributed Multimedia Systems and Telecommunication Services (IDMS'97), Darmstadt, Germany, pp 220–230

Download references

Author information



Corresponding author

Correspondence to Augusto Celentano.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Celentano, A., Gaggi, O. Context-aware design of adaptable multimodal documents. Multimed Tools Appl 29, 7–28 (2006).

Download citation


  • Hypermedia design
  • Adaptation
  • Rule system