Skip to main content
SpringerLink
Log in

Interactive web-based hypermedia coordination

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper discusses the interactive coordination of hypermedia documents’ components in the world wide web environment, proposing a design space based on discrete events transmission between linked media and on an extension of the concept of spine introduced by the IEEE 1599 standard for music description. The elements of the design space draw from the early hypermedia models the basic concepts of anchor and link, framing them in the world wide web technology, and integrate the user interaction into dynamic media behavior in a coherent and seamless way. The paper describes the components and operations defined in the design space, giving a rationale for them. Several examples are discussed which represent the typical patterns of dynamic media synchronization and user interaction found in current hypermedia applications. Guidelines for the implementation in the standard HTML5/CSS/Javascript environment are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. HTML5 defines some constructs for adding dynamic behaviors to document elements through the <canvas> tag and animated transformations. We assume that true multimedia content is the one contained in image, audio and video files.

  2. We do not distinguish between text scrolling and repositioning; it is related to text rendering issues and is not relevant for the example dynamics.

  3. https://www.w3.org/community/webtiming/

References

  1. Baggi DL, Haus G (2009) The new standard IEEE 1599, introduction and examples. J Multimed 4(1):3–8

    Google Scholar 

  2. Bailey B, Konstan JA, Cooley R, Dejong M (1998) Nsync - a toolkit for building interactive multimedia presentations. In: ACM Multimedia ’98. ACM Press, Bristol, UK, pp 257–266

  3. Baratè A., Haus G, Ludovico L (2006) Music representation of score, sound, MIDI, structure and metadata all integrated in a single multilayer environment based on XML. In: Intelligent Music Information Systems. IRM Press

  4. Baratè A, Haus G, Ludovico L (2009) IEEE 1599: a new standard for music education. In: ELPUB2009, Proceedings of the 13th International Conference on Electronic Publishing, pp 29–45

  5. Barry C, Lang M (2001) A survey of multimedia and web development techniques and methodology usage. IEEE Multimed 8(2):52–60

    Article  Google Scholar 

  6. Bertino E, Ferrari E (1998) Temporal synchronization models for multimedia data. IEEE Trans Knowl Data Eng 10(4):612–631

    Article  Google Scholar 

  7. Bieber M, Isakowitz T (1995) Designing hypermedia applications. Comm ACM 38(8):26–29

    Article  Google Scholar 

  8. Buchanan MC, Zellweger PT (1992) Specifying temporal behavior in hypermedia documents. In: Proceedings of ACM Conference on Hypertext, pp 262–271

  9. Bulterman D (2007) User-centered control within multimedia presentations. Multimed Syst 12:423–438

    Article  Google Scholar 

  10. Bulterman DCA, Hardman L (2005) Structured multimedia authoring. ACM Trans Multimed Comput Commun Appl 1(1):89–109

    Article  Google Scholar 

  11. Bulterman DCA, Hardman L, Jansen J, Mullender KS, Rutledge L (1998) GRiNS: A graphical interface for creating and playing smil documents. In: The 7th International World Wide Web Conference, Computer Networks and ISDN Systems, vol 30(1-7), Brisbane, Australia, pp 519–529

  12. Campbell A, Coutson G, Garcia F, Hutchison D (1992) Orchestration services for distributed multimedia synchronization. In: Proceedings of 4th IFIP Conference on High Performance Networking, Liege, Belgium, pp 1–16

  13. Celentano A (2013) A dynamic spine model for interactive hypermedia synchronization. In: Proceedings of International Conference on Distributed Multimedia Systems, DMS 2013, Brighton, UK, pp 3–8

  14. Celentano A, Gaggi O (2003) Template-based generation of multimedia presentations. Int J Softw Eng Knowl Eng 13(4):419–445

    Article  Google Scholar 

  15. Celentano A, Gaggi O (2006) Context-aware design of adaptable multimodal documents. Multimed Tools Appl 29(1):7–28

    Article  Google Scholar 

  16. Gaggi O, Bossi A (2011) Analysis and verification of SMIL documents. Multimed Syst 17(6):487–506

    Article  Google Scholar 

  17. Gaggi O, Celentano A (2005) Modelling synchronized hypermedia presentations. Multimed Tools Appl 27:53–78

    Article  Google Scholar 

  18. Gaggi O, Danese L (2011) A smil player for any web browser. In: Proceedings of International Conference on Distributed Multimedia Systems, DMS 2011, Florence, Italy, pp 114–119

  19. Ginige A, Lowe DB, Robertson J (1995) Hypermedia authoring. IEEE Multimed 2(4):24–35

    Article  Google Scholar 

  20. Goodman D (1990) Complete HyperCard 2.0 Handbook, 3rd edn. Random House Inc., NY, USA

    Google Scholar 

  21. Halasz FG (2001) Reflections on NoteCards: seven issues for the next generation of hypermedia systems. ACM J Comput Doc 25(3):71–87

    Article  Google Scholar 

  22. Halasz FG, Schwartz M (1994) The Dexter hypertext reference model. Comm. ACM 37(2):30–39

    Article  Google Scholar 

  23. Hardman L (1998) Modelling and Authoring Hypermedia Documents. Ph.D. Thesis, CWI, University of Amsterdam. http://www.cwi.nl/~lynda/thesis

  24. Hardman L, Bulterman DCA, Van Rossum G (1994) The Amsterdam hypermedia model: Adding time, structure and context to hypertext. Comm ACM 37 (2):50–62

    Article  Google Scholar 

  25. Hardman L, Van Ossenbruggen J, Mullender KS, Rutledge L, Bulterman DCA (1999) Do you have the time? composition and linking in time-based hypermedia. In: Proceedings of the Tenth ACM Conference on Hypertext and Hypermedia : Returning to Our Diverse Roots: Returning to Our Diverse Roots, HYPERTEXT ’99. ACM, NY, USA, pp 189–196

  26. Hardman L, Schmitz P, Van Ossenbruggen J, Ten Kate W, Rutledge L (2000) The link vs. the event: activating and deactivating elements in time-based hypermedia. New Rev Hypermed Multimed 6:89–109

    Article  Google Scholar 

  27. Hirzalla N, Falchuk B, Karmouch A (1995) A temporal model for interactive multimedia scenarios. IEEE Multimed 2(3):24–31

    Article  Google Scholar 

  28. Huang C, Chen J, Lin C, Wang C (1998) MING I: A distributed interactive multimedia document development mechanism. Multimed Syst 6(5):316–333

    Article  Google Scholar 

  29. Huang C, Jang M (1999) Interactive temporal behaviours and modelling for multimedia presentations in the WWW environment. Comput J 42(2):112–128

    Article  Google Scholar 

  30. Huang C, Wang C (1998) Synchronization for interactive multimedia presentations. IEEE Multimed 5(4):44–62

    Article  Google Scholar 

  31. Hustedde SF (1996) Developing with Asymetrix Toolbook: Applied Programming Theory. Wadsworth Publication Co., CA, USA

    Google Scholar 

  32. Kappe F, Maurer H, Scherbakov N (1993) Hyper-G—a universal hypermedia system. J Educ Multimed Hypermed 2(1):39–66

    Google Scholar 

  33. King P, Cameron H, Bowman H, Thompson S (1998) Synchronization in multimedia documents. In: Andre J (ed) Electronic Publishing, Artistic Imaging, and Digital Typography, Lecture Notes in Computer Science, vol 1375. Springer-Verlag, pp 355–369

  34. Kirsh D (1997) Interactivity and multimedia interfaces. Instr Sci 25:79–96

    Article  Google Scholar 

  35. Lab MM (1981) The interactive movie map. A surrogate travel systems. YouTube video, http://www.youtube.com/watch?v=Hf6LkqgXPMU

  36. Liao W, Li VOK (1998) Synchronization of distributed multimedia systems with user interactions. Multimed Syst 6(3):196–206

    Article  Google Scholar 

  37. Little TDC (1993) A framework for synchronous delivery of time-dependent multimedia data. Multimed Syst 1(2):87–94

    Article  Google Scholar 

  38. Little TDC, Ghafoor A, Chen CYR, Chang CS, Berra PB (1991) Multimedia synchronization. IEEE Data Eng Bullet 14(3):26–35

    Google Scholar 

  39. Mantovani A (2012) Back to hypermedia: A system for dynamic media structuring based on web standards. Master’s Thesis, Università Ca’ Foscari Venezia, Italy

    Google Scholar 

  40. Mirbel I, Pernici B, Sellis T, Tserkezoglou S, Vazirgiannis M (2000) Checking the temporal integrity of interactive multimedia documents. VLDB J 9:111–130

    Article  Google Scholar 

  41. Nelson TH (1965) Complex information processing: A file structure for the complex, the changing and the indeterminate. In: Proceedings of the 1965 20th National Conference, ACM ’65. ACM, NY, USA, pp 84–100

  42. Van Ossenbruggen J, Geurts J, Cornelissen F, Hardman L, Rutledge L (2001) Towards second and third generation web-based multimedia. In: Proceedings of the 10th International Conference on World Wide Web, WWW ’01. ACM, NY, USA, pp 479–488

  43. Van Ossenbruggen J, Hardman L, Geurts J, Rutledge L (2003) Towards a multimedia formatting vocabulary. In: Proceedings of the 12th International Conference on World Wide Web, WWW ’03. ACM, NY, USA, pp 384–393

  44. Prabhakaran B, Raghavan SV (1994) Synchronization models for multimedia presentation with user participation. Multimed Syst 2(2):53–62

    Article  Google Scholar 

  45. Van Rossum G, Jansen J, Mullender K, Bulterman D (1993) CMIFed: a presentation environment for portable hypermedia documents. In: The the First International Conference on Multimedia. http://www.cwi.nl/ftp/mmpapers/cmifed.ps.gz, Anaheim, California, pp 183–188

  46. Sadallah M, Aubert O, Prié Y. (2014) Chm: an annotation- and component-based hypervideo model for the web. Multimed Tools Appl 70(2):869–903

    Article  Google Scholar 

  47. Sauer S, Engels G (2001) UML-based behavior specification of interactive multimedia applications. In: Proceedings IEEE Symposia on Human-Centric Computing Languages and Environments, pp 248–255

  48. (2008) W3C: Synchronized Multimedia Integration Language (SMIL 3.0) W3C Recommendation. http://www.w3.org/TR/smil

  49. (2015) W3C: Timing Object - Draft Community Group Report. http://webtiming.github.io/timingobject/

  50. Wang Z, Peng X, Ji Z (2007) Interactive multimedia synchronization model based on Petri nets. Wuang Unive J Nat Sci 12(6):1019–1023

    Article  Google Scholar 

  51. Yankelovich N, Haan BJ, Meyrowitz NK, Drucker SM (1988) Intermedia: The concept and the construction of a seamless information environment. Computer 21 (1):81–96

    Article  Google Scholar 

  52. Zucker DF, Bulterman D (2007) Open standard and open sourced SMIL for interactivity. ACM Interact 14(6):41–46

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DAIS, Università Ca’ Foscari Venezia, Venice, Italy

    Augusto Celentano

Authors
  1. Augusto Celentano
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Augusto Celentano.

Additional information

A preliminary version of a part of this paper has been presented at DMS2013, Distributed Multimedia Systems, Brighton, August 2013 [13].

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Celentano, A. Interactive web-based hypermedia coordination. Multimed Tools Appl 76, 5511–5538 (2017). https://doi.org/10.1007/s11042-016-3790-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3790-7

Keywords

Search

Navigation