Multimedia Tools and Applications

, Volume 76, Issue 4, pp 5511–5538 | Cite as

Interactive web-based hypermedia coordination

  • Augusto Celentano


This paper discusses the interactive coordination of hypermedia documents’ components in the world wide web environment, proposing a design space based on discrete events transmission between linked media and on an extension of the concept of spine introduced by the IEEE 1599 standard for music description. The elements of the design space draw from the early hypermedia models the basic concepts of anchor and link, framing them in the world wide web technology, and integrate the user interaction into dynamic media behavior in a coherent and seamless way. The paper describes the components and operations defined in the design space, giving a rationale for them. Several examples are discussed which represent the typical patterns of dynamic media synchronization and user interaction found in current hypermedia applications. Guidelines for the implementation in the standard HTML5/CSS/Javascript environment are also discussed.


Design space Event based synchronization HTML5 Interactive hypermedia Media coordination Spine User interaction 


  1. 1.
    Baggi DL, Haus G (2009) The new standard IEEE 1599, introduction and examples. J Multimed 4(1):3–8Google Scholar
  2. 2.
    Bailey B, Konstan JA, Cooley R, Dejong M (1998) Nsync - a toolkit for building interactive multimedia presentations. In: ACM Multimedia ’98. ACM Press, Bristol, UK, pp 257–266Google Scholar
  3. 3.
    Baratè A., Haus G, Ludovico L (2006) Music representation of score, sound, MIDI, structure and metadata all integrated in a single multilayer environment based on XML. In: Intelligent Music Information Systems. IRM PressGoogle Scholar
  4. 4.
    Baratè A, Haus G, Ludovico L (2009) IEEE 1599: a new standard for music education. In: ELPUB2009, Proceedings of the 13th International Conference on Electronic Publishing, pp 29–45Google Scholar
  5. 5.
    Barry C, Lang M (2001) A survey of multimedia and web development techniques and methodology usage. IEEE Multimed 8(2):52–60CrossRefGoogle Scholar
  6. 6.
    Bertino E, Ferrari E (1998) Temporal synchronization models for multimedia data. IEEE Trans Knowl Data Eng 10(4):612–631CrossRefGoogle Scholar
  7. 7.
    Bieber M, Isakowitz T (1995) Designing hypermedia applications. Comm ACM 38(8):26–29CrossRefGoogle Scholar
  8. 8.
    Buchanan MC, Zellweger PT (1992) Specifying temporal behavior in hypermedia documents. In: Proceedings of ACM Conference on Hypertext, pp 262–271Google Scholar
  9. 9.
    Bulterman D (2007) User-centered control within multimedia presentations. Multimed Syst 12:423–438CrossRefGoogle Scholar
  10. 10.
    Bulterman DCA, Hardman L (2005) Structured multimedia authoring. ACM Trans Multimed Comput Commun Appl 1(1):89–109CrossRefGoogle Scholar
  11. 11.
    Bulterman DCA, Hardman L, Jansen J, Mullender KS, Rutledge L (1998) GRiNS: A graphical interface for creating and playing smil documents. In: The 7th International World Wide Web Conference, Computer Networks and ISDN Systems, vol 30(1-7), Brisbane, Australia, pp 519–529Google Scholar
  12. 12.
    Campbell A, Coutson G, Garcia F, Hutchison D (1992) Orchestration services for distributed multimedia synchronization. In: Proceedings of 4th IFIP Conference on High Performance Networking, Liege, Belgium, pp 1–16Google Scholar
  13. 13.
    Celentano A (2013) A dynamic spine model for interactive hypermedia synchronization. In: Proceedings of International Conference on Distributed Multimedia Systems, DMS 2013, Brighton, UK, pp 3–8Google Scholar
  14. 14.
    Celentano A, Gaggi O (2003) Template-based generation of multimedia presentations. Int J Softw Eng Knowl Eng 13(4):419–445CrossRefGoogle Scholar
  15. 15.
    Celentano A, Gaggi O (2006) Context-aware design of adaptable multimodal documents. Multimed Tools Appl 29(1):7–28CrossRefGoogle Scholar
  16. 16.
    Gaggi O, Bossi A (2011) Analysis and verification of SMIL documents. Multimed Syst 17(6):487–506CrossRefGoogle Scholar
  17. 17.
    Gaggi O, Celentano A (2005) Modelling synchronized hypermedia presentations. Multimed Tools Appl 27:53–78CrossRefGoogle Scholar
  18. 18.
    Gaggi O, Danese L (2011) A smil player for any web browser. In: Proceedings of International Conference on Distributed Multimedia Systems, DMS 2011, Florence, Italy, pp 114–119Google Scholar
  19. 19.
    Ginige A, Lowe DB, Robertson J (1995) Hypermedia authoring. IEEE Multimed 2(4):24–35CrossRefGoogle Scholar
  20. 20.
    Goodman D (1990) Complete HyperCard 2.0 Handbook, 3rd edn. Random House Inc., NY, USAGoogle Scholar
  21. 21.
    Halasz FG (2001) Reflections on NoteCards: seven issues for the next generation of hypermedia systems. ACM J Comput Doc 25(3):71–87CrossRefGoogle Scholar
  22. 22.
    Halasz FG, Schwartz M (1994) The Dexter hypertext reference model. Comm. ACM 37(2):30–39CrossRefGoogle Scholar
  23. 23.
    Hardman L (1998) Modelling and Authoring Hypermedia Documents. Ph.D. Thesis, CWI, University of Amsterdam.
  24. 24.
    Hardman L, Bulterman DCA, Van Rossum G (1994) The Amsterdam hypermedia model: Adding time, structure and context to hypertext. Comm ACM 37 (2):50–62CrossRefGoogle Scholar
  25. 25.
    Hardman L, Van Ossenbruggen J, Mullender KS, Rutledge L, Bulterman DCA (1999) Do you have the time? composition and linking in time-based hypermedia. In: Proceedings of the Tenth ACM Conference on Hypertext and Hypermedia : Returning to Our Diverse Roots: Returning to Our Diverse Roots, HYPERTEXT ’99. ACM, NY, USA, pp 189–196Google Scholar
  26. 26.
    Hardman L, Schmitz P, Van Ossenbruggen J, Ten Kate W, Rutledge L (2000) The link vs. the event: activating and deactivating elements in time-based hypermedia. New Rev Hypermed Multimed 6:89–109CrossRefGoogle Scholar
  27. 27.
    Hirzalla N, Falchuk B, Karmouch A (1995) A temporal model for interactive multimedia scenarios. IEEE Multimed 2(3):24–31CrossRefGoogle Scholar
  28. 28.
    Huang C, Chen J, Lin C, Wang C (1998) MING I: A distributed interactive multimedia document development mechanism. Multimed Syst 6(5):316–333CrossRefGoogle Scholar
  29. 29.
    Huang C, Jang M (1999) Interactive temporal behaviours and modelling for multimedia presentations in the WWW environment. Comput J 42(2):112–128CrossRefGoogle Scholar
  30. 30.
    Huang C, Wang C (1998) Synchronization for interactive multimedia presentations. IEEE Multimed 5(4):44–62CrossRefGoogle Scholar
  31. 31.
    Hustedde SF (1996) Developing with Asymetrix Toolbook: Applied Programming Theory. Wadsworth Publication Co., CA, USAGoogle Scholar
  32. 32.
    Kappe F, Maurer H, Scherbakov N (1993) Hyper-G—a universal hypermedia system. J Educ Multimed Hypermed 2(1):39–66Google Scholar
  33. 33.
    King P, Cameron H, Bowman H, Thompson S (1998) Synchronization in multimedia documents. In: Andre J (ed) Electronic Publishing, Artistic Imaging, and Digital Typography, Lecture Notes in Computer Science, vol 1375. Springer-Verlag, pp 355–369Google Scholar
  34. 34.
    Kirsh D (1997) Interactivity and multimedia interfaces. Instr Sci 25:79–96CrossRefGoogle Scholar
  35. 35.
    Lab MM (1981) The interactive movie map. A surrogate travel systems. YouTube video,
  36. 36.
    Liao W, Li VOK (1998) Synchronization of distributed multimedia systems with user interactions. Multimed Syst 6(3):196–206CrossRefGoogle Scholar
  37. 37.
    Little TDC (1993) A framework for synchronous delivery of time-dependent multimedia data. Multimed Syst 1(2):87–94CrossRefGoogle Scholar
  38. 38.
    Little TDC, Ghafoor A, Chen CYR, Chang CS, Berra PB (1991) Multimedia synchronization. IEEE Data Eng Bullet 14(3):26–35Google Scholar
  39. 39.
    Mantovani A (2012) Back to hypermedia: A system for dynamic media structuring based on web standards. Master’s Thesis, Università Ca’ Foscari Venezia, ItalyGoogle Scholar
  40. 40.
    Mirbel I, Pernici B, Sellis T, Tserkezoglou S, Vazirgiannis M (2000) Checking the temporal integrity of interactive multimedia documents. VLDB J 9:111–130CrossRefGoogle Scholar
  41. 41.
    Nelson TH (1965) Complex information processing: A file structure for the complex, the changing and the indeterminate. In: Proceedings of the 1965 20th National Conference, ACM ’65. ACM, NY, USA, pp 84–100Google Scholar
  42. 42.
    Van Ossenbruggen J, Geurts J, Cornelissen F, Hardman L, Rutledge L (2001) Towards second and third generation web-based multimedia. In: Proceedings of the 10th International Conference on World Wide Web, WWW ’01. ACM, NY, USA, pp 479–488Google Scholar
  43. 43.
    Van Ossenbruggen J, Hardman L, Geurts J, Rutledge L (2003) Towards a multimedia formatting vocabulary. In: Proceedings of the 12th International Conference on World Wide Web, WWW ’03. ACM, NY, USA, pp 384–393Google Scholar
  44. 44.
    Prabhakaran B, Raghavan SV (1994) Synchronization models for multimedia presentation with user participation. Multimed Syst 2(2):53–62CrossRefGoogle Scholar
  45. 45.
    Van Rossum G, Jansen J, Mullender K, Bulterman D (1993) CMIFed: a presentation environment for portable hypermedia documents. In: The the First International Conference on Multimedia., Anaheim, California, pp 183–188
  46. 46.
    Sadallah M, Aubert O, Prié Y. (2014) Chm: an annotation- and component-based hypervideo model for the web. Multimed Tools Appl 70(2):869–903CrossRefGoogle Scholar
  47. 47.
    Sauer S, Engels G (2001) UML-based behavior specification of interactive multimedia applications. In: Proceedings IEEE Symposia on Human-Centric Computing Languages and Environments, pp 248–255Google Scholar
  48. 48.
    (2008) W3C: Synchronized Multimedia Integration Language (SMIL 3.0) W3C Recommendation.
  49. 49.
    (2015) W3C: Timing Object - Draft Community Group Report.
  50. 50.
    Wang Z, Peng X, Ji Z (2007) Interactive multimedia synchronization model based on Petri nets. Wuang Unive J Nat Sci 12(6):1019–1023CrossRefGoogle Scholar
  51. 51.
    Yankelovich N, Haan BJ, Meyrowitz NK, Drucker SM (1988) Intermedia: The concept and the construction of a seamless information environment. Computer 21 (1):81–96CrossRefGoogle Scholar
  52. 52.
    Zucker DF, Bulterman D (2007) Open standard and open sourced SMIL for interactivity. ACM Interact 14(6):41–46CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.DAISUniversità Ca’ Foscari VeneziaVeniceItaly

Personalised recommendations