Advertisement

MediaSync pp 3-31 | Cite as

Introduction to Media Synchronization (MediaSync)

  • Mario Montagud
  • Pablo Cesar
  • Fernando Boronat
  • Jack Jansen
Chapter

Abstract

Media synchronization is a core research area in multimedia systems. This chapter introduces the area by providing key definitions, classifications, and examples. It also discusses the relevance of different types of media synchronization to ensure satisfactory Quality of Experience (QoE) levels and highlights their necessity, by comparing the magnitudes of delay differences in real scenarios to the tolerable limits to the human perception. The chapter concludes with a brief description of the main aspects and components of media synchronization solutions, with the goal of providing a better understanding of this timely research area.

Keywords

Intra-media synchronization Inter-media synchronization Hybrid synchronization Inter-device synchronization Inter-destination media synchronization Delays Asynchrony QoE 

References

  1. 1.
    Steinmetz, R.: Human perception of jitter and media synchronization. IEEE J. Sel. Areas Commun. 14(1), 61–72 (1996)CrossRefGoogle Scholar
  2. 2.
    Chen, M.: A low-latency lip-synchronized videoconferencing system. In: SIGCHI Conference on Human Factors in Computing Systems, ACM CHI’03, pp. 464–471. New York, April 2003Google Scholar
  3. 3.
    Bartoli, I., Iacovoni, G., Ubaldi, F.: A synchronization control scheme for videoconferencing services. J. Multimedia 2(4), 1–9 (2007)CrossRefGoogle Scholar
  4. 4.
    Rodriguez, A., Talavera, G., Orero, P., Carrabina, J.: Subtitle synchronization across multiple screens and devices. Sensors 12(7), 8710–8731 (2012)CrossRefGoogle Scholar
  5. 5.
    Huang, P., Ishibashi, Y.: QoE assessment of will transmission using vision and haptics in networked virtual environment. Int. J. Commun. Netw. Syst. Sci. (IJCNS) 7(8), 265–278 (2014)Google Scholar
  6. 6.
    Ademoye, O.A., Ghinea, G.: Synchronization of olfaction-enhanced multimedia. IEEE Trans. Multimedia 11(3), 561–565 (2009)CrossRefGoogle Scholar
  7. 7.
    Murray, N., Qiao, Y., Lee, B., Muntean, G.-M.: User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP) 10(1s), 11, 24, Jan 2014Google Scholar
  8. 8.
    Huang, Z., Nahrstedt, K., Steinmetz, R.: Evolution of temporal multimedia synchronization principles: a historical viewpoint. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP) 9(1s), 34, 23, Oct 2013Google Scholar
  9. 9.
    Schulzrinne, H., Casner, S., Frederick, R., Jacobson, V.: RTP: a transport protocol for real-time applications. IETF Internet Standard, RFC 3550, July 2003Google Scholar
  10. 10.
    Concolato, C., Thomas, S., Bouqueau, R., Le Feuvre, J.: Synchronized delivery of multimedia content over uncoordinated broadcast broadband networks. In: ACM MMSys’12. Chapel Hill, North Carolina, USA, Feb 2012Google Scholar
  11. 11.
    Veenhuizen, A.: Frame accurate media synchronization of heterogeneous media sources in an HBB context. In: MediaSync Workshop 2012. Berlin (Germany), Oct 2012Google Scholar
  12. 12.
    Le Feuvre, J., Viet-Than-Trung, N., Hammidouche, W., Marchal, P., Monnier, R., Dupain, P.: A test bed for hybrid broadcast broadband services. In: MediaSync Workshop 2015. Brussels (Belgium), 3 June 2015Google Scholar
  13. 13.
    Boronat, F., Montagud, M., Marfil, D., Luzón, C.: Hybrid broadcast/broadband TV services and media synchronization. Demands, preferences and expectations of Spanish consumers. IEEE Trans. Broadcast. PP(99), 1–18, Aug 2017Google Scholar
  14. 14.
    van Brandenburg, R., Veenhuizen, A.: Immersive second-screen experiences using hybrid media synchronization. In: MediaSync Workshop 2013. Nantes (France), Oct 2013Google Scholar
  15. 15.
    Montagud, M., Boronat, F., Stokking, H., van Brandenburg, R.: Inter-destination multimedia synchronization: schemes, use cases and standardization. Multimedia Syst. 18(6), 459–482 (2012)CrossRefGoogle Scholar
  16. 16.
    Mekuria, R., Cesar, P., Bulterman, D.: Digital TV: the effect of delay when watching football. 10th European Conference on Interactive TV and Video (EuroiTV ’12). Berlin (Germany), July 2012Google Scholar
  17. 17.
    Hybrid Broadcast Broadband TV (HbbTV) 2.0.1 Specification, HbbTV Association Resource Library, July 2016. https://www.hbbtv.org/resource-library
  18. 18.
    Mekuria, R.N.: Inter-destination media synchronization for TV broadcasts. In: Master Thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Network architecture and Services. Delft University of Technology, Apr 2011Google Scholar
  19. 19.
    Jansen, J., Bulterman, D.C.A.: User-centric video delay measurements. In: 23rd ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV ’13), pp. 37–42. Oslo (Norway), Feb 2013Google Scholar
  20. 20.
    Ridoux, J., Veitch, R.: Principles of robust timing over the internet. Com. ACM 53(5), May 2010Google Scholar
  21. 21.
    Mills, D., Delaware, U., Martin, J., Burbank, J., Kasch, W.: Network time protocol version 4: protocol and algorithms specification. In: IETF Internet Standard, RFC 5905, June 2010Google Scholar
  22. 22.
    IEEE 1588-2008: IEEE standard for a precision clock synchronization protocol for networked measurement and control systems (2008)Google Scholar
  23. 23.
    ITU-T Rec. G.1050: Network model for evaluating multimedia transmission performance over internet protocol (2007)Google Scholar
  24. 24.
    ITU-T Rec. G. 114: One-way transmission time (2003)Google Scholar
  25. 25.
    Jansen, J., Cesar, P., Bulterman, D.C.A., Stevens, T., Kegel, I., Issing, J.: Enabling composition-based video-conferencing for the home. IEEE Trans. Multimedia (TMM) 13(5), 869–881 (2011)CrossRefGoogle Scholar
  26. 26.
    Geerts, D., Vaishnavi, I., Mekuria, R., Van Deventer, M.O., Cesar, P.: Are we in sync?: synchronization requirements for watching on-line video together. ACM CHI ‘11, New York, USA (2011)Google Scholar
  27. 27.
    Kooij, W., Stokking, H., van Brandenburg, R., de Boer, P.-T.: Playout delay of TV signals: measurement system design, validation and results. In: ACM TVX 2014, Newcastle (UK), June 2014Google Scholar
  28. 28.
    Van Deventer, M.O., Stokking, H., Niamut, O., Walraven, A., Klos, V.B.: Advanced interactive television service require synchronization. In: 15th International Conference on Systems, Signals and Image Processing, IWSSIP 2008. Bratislava (Slovak Republic), June 2008Google Scholar
  29. 29.
    Blesser, B.: Digitization of audio: a comprehensive examination of theory, implementation, and current practice. AES J. Audio Eng. Soc. 26(10), 739–771 (1978)Google Scholar
  30. 30.
    Steinmetz, R., Engler, C.: Human perception of media synchronization. In: Technical Report 43.9310. IBM European Networking Center, Heidelberg (1993)Google Scholar
  31. 31.
    ITU-R BT.1359: International telecommunication union radio communication sector relative timing of sound and vision for broadcastingGoogle Scholar
  32. 32.
    ATSC Implementation Subcommittee Finding: Relative Timing of Sound and Vision for Broadcast Operations, Doc. ID-191, June 2003Google Scholar
  33. 33.
    Dannenberg, R., Stern, R.: Experiments concerning the allowable skew of two audio channels operating in the stereo mode. Personal Commun. (1993)Google Scholar
  34. 34.
    Goldmann, L., Jong-Seok Lee, L., Ebrahimi, T.: Temporal synchronization in stereoscopic video: Influence on quality of experience and automatic asynchrony detection. IEEE ICIP 2010, Hong Kong, Sept 2010Google Scholar
  35. 35.
    Fujimoto, T., Ishibashi, Y., Sugawara, S.: Influences of inter-stream synchronization error on collaborative work in haptic and visual environments. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Mar 2008Google Scholar
  36. 36.
    Ghinea, G., Ademoye, O.A.: Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man Cybern. Part A: Syst. Humans 40(4), 657–663 (2010)CrossRefGoogle Scholar
  37. 37.
    Hoshino, S., Ishibashi, Y., Fukushima, N., Sugawara, S.: QoE assessment in olfactory and haptic media transmission: influence of inter-stream synchronization error. In: IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR) Workshop, May 2011Google Scholar
  38. 38.
    Yuan, Z., Bi, T., Muntean, G.-M., Ghinea, G.: Perceived synchronization of mulsemedia services. IEEE Trans. Multimedia 17(7), 957–966 (2015)CrossRefGoogle Scholar
  39. 39.
    Bang, Y., Han, J., Lee, K., Yoon, J., Joung, J., Yang, S., Rhee, J.: Wireless network synchronization for multichannel multimedia services. IEEE ICAT 2009, Sarajevo (Bosnia and Herzegovina), Feb 2009Google Scholar
  40. 40.
    Ziegler, C., Keimel, C., Ramdhany, R., Vinayagamoorthy, V.: On Time or Not on Time: A user study on delays in a synchronised companion-screen experience. In: ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’17). Hilversum (Netherlands), June 2017Google Scholar
  41. 41.
    Rainer, B., Petscharnig, S., Timmerer, C., Hellwagner, H.: Is one second enough? evaluating QoE for inter-destination multimedia synchronization using human computation and crowdsourcing. In: IEEE Seventh International Workshop in Quality of Multimedia Experience (QoMEX), pp. 1–6. Costa Navarino, Messinia, Greece, May 2015Google Scholar
  42. 42.
    Pereira, I., Silveira, L.F., Gonçalves, L.: Video synchronization with bit-rate signals and correntropy function. Sensors 17(9), 2021 (2017)CrossRefGoogle Scholar
  43. 43.
    Ishibashi, Y., Tasaka, S.: A comparative survey of synchronization algorithms for continuous media in network environments. In: 25th Annual IEEE Conference on Local Computer Networks, LCN 2000, pp. 337–348. Florida (USA), Nov 2000Google Scholar
  44. 44.
    Boronat, F., Lloret, J., García, M.: Multimedia group and inter-stream synchronization techniques: a comparative study. Inf. Syst. 34(1), 108–131 (2009)CrossRefGoogle Scholar
  45. 45.
    Montagud, M., Boronat, F., Stokking, H., Cesar, P.: Design, development and assessment of control schemes for IDMS in a standardized RTCP-based solution. Comput. Netw. 70(9), 240–259 (2014)CrossRefGoogle Scholar
  46. 46.
    Montagud, M., Boronat, F., Roig, B., Sapena, A.: How to perform AMP? cubic adjustments for improving the QoE. Comput. Commun. 103, 61–73 (2017)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Mario Montagud
    • 1
    • 2
  • Pablo Cesar
    • 2
  • Fernando Boronat
    • 1
  • Jack Jansen
    • 2
  1. 1.Departamento de ComunicacionesUniversitat Politècnica de València (UPV) – Campus de GandiaValencia, Grao de GandiaSpain
  2. 2.Centrum Wiskunde & Informatica (CWI)AmsterdamThe Netherlands

Personalised recommendations