MediaSync pp 475-504 | Cite as

Media Synchronization on the Web

  • Ingar M. Arntzen
  • Njål T. Borch
  • François Daoust
Chapter

Abstract

The Web is a natural platform for multimedia, with universal reach, powerful backend services, and a rich selection of components for capture, interactivity, and presentation. In addition, with a strong commitment to modularity, composition, and interoperability, the Web should allow advanced media experiences to be constructed by harnessing the combined power of simpler components. Unfortunately, with timed media this may be complicated, as media components require synchronization to provide a consistent experience. This is particularly the case for distributed media experiences. In this chapter we focus on temporal interoperability on the Web, how to allow heterogeneous media components to operate consistently together, synchronized to a common timeline and subject to shared media control. A programming model based on external timing is presented, enabling modularity, interoperability, and precise timing among media components, in single-device as well as multi-device media experiences. The model has been proposed within the W3C Multi-device Timing Community Group as a new standard, and this could establish temporal interoperability as one of the foundations of the Web platform.

Keywords

Media synchronization Media orchestration Motion model Timing object Multi-device 

References

  1. 1.
  2. 2.
    Arntzen, I.M., Borch, N.T.: Composite Media, a new paradigm for online media. In: 2013 NEM Summit (Networked Electronic Media), NEM Summit ’13, pp. 105–110. Eurescom (2013). http://nem-initiative.org/wp-content/uploads/2015/06/2013-NEM-Summit_Proceedings.pdf
  3. 3.
    Arntzen, I.M., Borch, N.T.: Timingsrc: A programming model for timed Web applications, based on the Timing Object. In: Precise Timing, Synchronization and Control Enabled for Single-Device and Multi-device Web Applications (2015). http://webtiming.github.io/timingsrc/
  4. 4.
    Arntzen, I.M., Borch, N.T.: Data-independent sequencing with the timing Object: a JavaScript sequencer for single-device and Multi-device Web Media. In: Proceedings of the 7th International Conference on Multimedia Systems, MMSys’16, pp. 24:1–24:10. ACM, New York, NY, USA (2016).  https://doi.org/10.1145/2910017.2910614
  5. 5.
    Arntzen, I.M., Borch, N.T., Daoust, F., Hazael-Massieux, D.: Multi-device Linear Composition on the Web; enabling multi-device linear Media with HTMLTimingobject and shared motion. In: Media Synchronization Workshop (MediaSync) in conjunction with ACM TVX 2015. ACM (2015). https://sites.google.com/site/mediasynchronization/Paper4_Arntzen_webComposition_CR.pdf
  6. 6.
    Arntzen, I.M., Borch, N.T., Needham, C.P.: The media state vector: a unifying concept for multi-device media navigation. In: Proceedings of the 5th Workshop on Mobile Video, MoVid’13, pp. 61–66. ACM, New York, NY, USA (2013).  https://doi.org/10.1145/2457413.2457427
  7. 7.
    Arntzen, I.M., Daoust, F., Borch, N.T.: Timing Object; Draft community group report. http://webtiming.github.io/timingobject/ (2015)
  8. 8.
    Borch, N.T., Arntzen, I.M.: Distributed Synchronization of HTML5 Media. Technical report 15, Norut Northern Research Institute (2014)Google Scholar
  9. 9.
    Borch, N.T., Arntzen, I.M.: Mediasync Report 2015: Evaluating timed playback of HTML5 Media. Technical report 28, Norut Northern Research Institute (2015)Google Scholar
  10. 10.
    Document Object Model (DOM) Level-1 (1998). https://www.w3.org/TR/REC-DOM-Level-1/
  11. 11.
    Document Object Model (DOM) Level-2 (2000). https://www.w3.org/TR/DOM-Level-2/
  12. 12.
    Document Object Model (DOM) Level-2 Events (2000). https://www.w3.org/TR/DOM-Level-2-Events/
  13. 13.
    Eidson, J., Lee, K.: IEEE 1588 standard for a precision clock synchronization protocol for networked measurement and control systems. In: Sensors for Industry Conference, 2002. 2nd ISA/IEEE, pp. 98–105. IEEE (2002)Google Scholar
  14. 14.
    Google (2017). https://www.google.com
  15. 15.
    High Resolution Time (2012). https://www.w3.org/TR/hr-time-1/
  16. 16.
    High Resolution Time Level 2 (2016). https://www.w3.org/TR/hr-time-2/
  17. 17.
    HTML 3.2 Reference Specification (1997). https://www.w3.org/TR/REC-html32
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
    Media Capture and Streams (2016). https://www.w3.org/TR/mediacapture-streams/
  24. 24.
    Media Source Extensions (2016). https://www.w3.org/TR/media-source/
  25. 25.
    MediaStream Recording (2017). https://www.w3.org/TR/mediastream-recording/
  26. 26.
    Microsoft (2017). https://www.microsoft.com/
  27. 27.
    Mills, D.L.: Internet time synchronization: the network time protocol. IEEE Trans. Commun. 39(10), 1482–1493 (1991).  https://doi.org/10.1109/26.103043
  28. 28.
    Motion Corporation. http://motioncorporation.com
  29. 29.
    Mozilla (2017). https://www.mozilla.org
  30. 30.
  31. 31.
  32. 32.
    Multi-device Timing Community Group (2015). https://www.w3.org/community/webtiming/
  33. 33.
    RealPlayer (2017). http://www.real.com/
  34. 34.
    Scalable Vector Graphics (SVG) 1.1 (2011). https://www.w3.org/TR/SVG/
  35. 35.
    Synchronized Multimedia Integration Language (SMIL) 1.0 Specification (1998). https://www.w3.org/TR/1998/REC-smil-19980615/
  36. 36.
    SMIL 3.0 Synchronized Multimedia Integration Language (2008). http://www.w3.org/TR/REC-smil/
  37. 37.
  38. 38.
    Twitter (2017). https://twitter.com/
  39. 39.
    The Web Socket Protocol (2011). https://tools.ietf.org/html/rfc6455
  40. 40.
    Video synchronization by Motion Corporation (2015). https://youtu.be/lfoUstnusIE
  41. 41.
  42. 42.
  43. 43.
    Web Audio API (2015). https://www.w3.org/TR/webaudio/
  44. 44.
    Web Workers (2015). https://www.w3.org/TR/workers/
  45. 45.
  46. 46.
    WebRTC Real-time Communication Between Browsers (2017). https://www.w3.org/TR/webrtc/

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Ingar M. Arntzen
    • 1
  • Njål T. Borch
    • 1
  • François Daoust
    • 2
  1. 1.Norut Northern Research InstituteTromsøNorway
  2. 2.World Wide Web Consortium (W3C)ParisFrance

Personalised recommendations