Advertisement

Distributed Media Synchronisation for Shared Video Watching: Issues, Challenges and Examples

  • Fernando Boronat
  • Rufael Mekuria
  • Mario Montagud
  • Pablo Cesar
Chapter
Part of the Computer Communications and Networks book series (CCN)

Abstract

Current societal changes are transforming the way people retrieve, annotate and share media. While in the past users gathered together around media content, this has become an exception rather than the norm. As demonstrated by the popularity of social networking and personal communication tools, people expect the development of novel technologies that: help them connect with others (e.g. by tagging images of a friend from high school). One key challenge in this respect is to support synchronous communication between people separated in space. This chapter focuses exactly on that technologies and infrastructures for supporting social interactions between people while apart. In particular, it discusses the synchronisation aspects of distributed media consumption (TV, YouTube videos, games, photo albums). As part of the quality of experience (QoE), synchronisation is a key requirement for ensuring consistency of the media experience across locations. Starting with an overview of the research problem, the contribution of this chapter is to detail current and envisioned architectures for achieving what is commonly known as Inter-Destination Media Synchronization (IDMS), a topic drawing the attention of academy and industry alike.

Keywords

Control Message Adjustment Technique Traffic Overhead Digital Terrestrial Multimedia Broadcast Playout Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Acronyms and Abbreviations

3GP

Third Generation Partnership Project or 3GPP file format

AM

Amplitude modulation

AMP

Adaptive media playout

ATSC

Advanced Television System Committee

AVTCORE

Audio/Video Transport Core Maintenance working group

BBC

British Broadcasting Corporation

CMTS

Cable modem termination system

CRT

Cathode ray tube

DASH

Dynamic Adaptive Streaming over HTTP

DCR

Degradation category rating

DCS

Distributed control scheme

DMB

Digital Multimedia Broadcasting

DTH

(ATSC) Direct to Home (Satellite)

DSLAM

Digital subscriber line access multiplexer

DTMB

Digital Terrestrial Multimedia Broadcast

DVB

Digital Video Broadcasting

ETSI

European Telecommunications Standards Institute

FM

Frequency modulation

GPS

Global Positioning System

HD

High definition

HTML

HyperText Markup Language

HTTP

Hypertext Transfer Protocol

IDMS

Inter-Destination Media Synchronization

IETF

Internet Engineering Task Force

IPTV

Internet Protocol Television

ISDB

Integrated Services Digital Broadcasting

ISP

Internet service provider

ITU

International Telecommunication Union

M/S

Master/slave

MPD

Media Presentation Description

MDU

Media data unit

MMSH

Microsoft Media Server HTTP streaming

MOS

Mean opinion score (MOS)

MPEG

Moving Picture Experts Group

MSAS

Media Synchronization Application Server

NOS

Nederlandse Omroep Stichting

NTP

Network Time Protocol

P2P

Peer to peer

QoE

Quality of experience

QoS

Quality of service

RFC

Request for Comments

RR

(RTCP) receiver report

RTCP

Real-Time Transmission Control Protocol

RTMP

Real-Time Messaging Protocol

RTP

Real-Time Transmission Protocol

RTSP

Real-Time Streaming Protocol

SD

Standard definition

SDES

(RTCP) source description report

SMS

Synchronisation maestro scheme

SPST

Synchronization Packet Sender Type

SR

(RTCP) sender report

Sync

Synchronisation

TISPAN

Telecommunications and Internet converged Services and Protocols for Advanced Networking

TV

Television

XR

(RTCP) Extended Report

VoD

Video on Demand

VoIP

Voice over IP

WG

Working group

XML

Extensible Markup Language

Notes

Acknowledgments

UPV: This work has been financed, partially, by Universitat Politècnica de Valencia (UPV), under its R&D support programme in PAID-05-11-002-331 Project and in PAID-01-10.

CWI: The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7/2007–2013) under grant agreement no. ICT-2011-7-287723 (Reverie project). The authors would like to thank the fruitful collaboration with David Geerts (K.U. Leuven) and with Ishan Vaishnavi (CWI & Huawei).

UPV and CWI: The authors would like to thank the following people working at TNO: Hans Stokking, Ray van Brandenburg and M. Oskar van Deventer.

References

  1. 1.
    Shamma, D., Bastea-Forte, M., Joubert, N., Liu, Y.: Enhancing online personal connections through synchronized sharing of online video. CHI ’08: extended abstracts on human factors in computing systems (2008). doi: 10.1145/1358628.1358786
  2. 2.
    Coppens, T., Trappeniers, L., Godon, M.: AmigoTV, towards a Social TV experience. In: Proceedings of EuroITV, Aalborg, Denmark (2004)Google Scholar
  3. 3.
    Huang, E., et al.: Of social television comes home: a field study of communication choices and practices in TV-based text and voice chat. In: CHI ’09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2009). doi: 10.1145/1518701.1518792
  4. 4.
    Schulzrinne, H., Casner, S., Frederick, R., Jacobson, V.: RTP: a transport protocol for real-time applications, RFC-3550, July 2003Google Scholar
  5. 5.
    Brandenburg, R. Van, Stokking, H., Deventer, M.O. Van, Boronat, F., Montagud, M., Gross, K.: RTCP for inter-destination media synchronization, draft-brandenburg-avtcore-rtcp-for-idms-07.txt, IETF Audio/Video Transport Core Maintenance working draft, 11 October 2012Google Scholar
  6. 6.
    Motions Pictures Experts Group (MPEG): MPEG-2 part 2, video, standard ISO/IEC 13818-2007 (2007)Google Scholar
  7. 7.
    Motions Pictures Experts Group (MPEG): MPEG-2, part 3, audio ISO/IEC 13818-3 (1998)Google Scholar
  8. 8.
    Motions Pictures Experts Group (MPEG): MPEG-2 part 1, systems, standard ISO/IEC 13818-1 (2007)Google Scholar
  9. 9.
    Reimers, U.: DVB The Family of International Standards for Digital Video Broadcasting. Springer, Braunschweig (2006)Google Scholar
  10. 10.
    ITU-T: H.264: advanced video coding for generic audiovisual services (2003)Google Scholar
  11. 11.
    Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuit Syst. Video Technol. 13(7), 560–576 (2003). doi: 10.1109/TCSVT.2003.815165 CrossRefGoogle Scholar
  12. 12.
    Yiyan, W., Hirakawa, S., Reimers, U., Withaker, J.: Overview of digital television development. Proc. IEEE 94(1), 8–21 (2005). doi: 10.1109/JPROC.2005.861000 Google Scholar
  13. 13.
    Kumar, A.: Implementing Mobile TV. Elsevier, Burlington (2010)Google Scholar
  14. 14.
    Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., Berners-Lee, T.: RFC 2616: hypertext transfer protocol – HTTP/1.1, IETF (1999)Google Scholar
  15. 15.
    Stockhammer, T.: Dynamic adaptive streaming over HTTP- standards and design principles. In: MMSys ’11: Proceedings of the Second Annual ACM Conference on Multimedia Systems (2011). doi: 10.1145/1943552.1943572
  16. 16.
    Schulzrinne, H., Rao, A., Lanphier, R.: Real-Time Streaming Protocol (RTSP). IETF (1998)Google Scholar
  17. 17.
    ITU-T: G.1050 network model for evaluating multimedia transmission performance over internet protocol (2007)Google Scholar
  18. 18.
    Lu, Y., Fallica, B., Kuipers, F.A., Kooij, R.E., Van Mieghem, P.: Assessing the quality of experience of SopCast. Int. J. Internet Protoc. Technol. 4(1), 11–23 (2009, March)CrossRefGoogle Scholar
  19. 19.
    Cesar, P., Geerts, D.: Past, present, and future of social TV: a categorization. In: CCNC: Proceedings of the IEEE Consumer Communications and Networking Conference (2011). doi: 10.1109/CCNC.2011.5766487
  20. 20.
    Boertjes, E., et al.: ConnecTV: share the experience. In: Proceedings of EuroITV, Amsterdam, the Netherlands, pp. 139–140 (2007)Google Scholar
  21. 21.
    Weisz, D., et al.: Watching together: integrating text chat with video. In: CHI ’07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2007). doi: 10.1145/1240624.1240756
  22. 22.
    Oehlberg, L., Duchenaut, N., Thornton, J.: Social TV: designing for distributed, sociable television viewing. In: Proceedings of EuroITV, Athens, Greece (2006)Google Scholar
  23. 23.
    Geerts, D., Cesar, P., Bulterman, D.: The implications of program genres for the design of social television systems. In: UXTV’08: Proceedings of the International Conference on Designing Interactive User Experiences for TV and Video, Mountain View (CA), USA (2008)Google Scholar
  24. 24.
    ITU-T: Recommendation P.800: methods for objective and subjective assessment of transmission quality (1996)Google Scholar
  25. 25.
    Mekuria, R.: Inter-destination synchronization for TV-Broadcasts, Delft University of Technology (2011)Google Scholar
  26. 26.
    Geerts, D., Vaishnavi, I., Mekuria, R., Deventer, M.O., Cesar, P.: Are we in sync? Synchronization requirements for watching online video together. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver (BC), Canada, pp. 311–314 (2011)Google Scholar
  27. 27.
    Cortina, J.M.: What is coefficient alpha? An examination of theory and applications. J. Appl. Psychol. 78, 98–104 (1993)CrossRefGoogle Scholar
  28. 28.
    Osborne, J.W.: Effect sizes and the disattenuation of correlation and regression coefficients: lessons from educational psychology practical assessment. Res. Eval. 8(11) (2003)Google Scholar
  29. 29.
    Stokking, H., Van Deventer, M.O., Niamut, O.A., Walraven, F.A., Mekuria, R.N.: IPTV inter-destination synchronization: a network-based approach. ICIN’2010, Berlin, October 2010Google Scholar
  30. 30.
    Boronat, F., Montagud, M., Vidal, V.: Smooth control of adaptive media playout to acquire IDMS in cluster-based applications, IEEE LCN 2011, pp. 617-625. Bonn, October 2011Google Scholar
  31. 31.
    Hashimoto, T., Ishibashi, Y.: Group synchronization control over haptic media in a networked real-time game with collaborative work, Netgames’06, Singapore, October 2006Google Scholar
  32. 32.
    Montagud, M., Boronat, F.: Implementation and evaluation of an M/S scheme for inter-destination multimedia synchronization (IDMS). Netw. Protoc. Algorithm J. 3(3), 80–98 (2011, December)Google Scholar
  33. 33.
    Ishibashi, Y., Tomaru, K., Tasaka, S., Inazumi, K.: Group synchronization in networked virtual environments. In: Proceedings of the 38th IEEE International Conference on Communications, pp. 885–890, Alaska, May 2003Google Scholar
  34. 34.
    Boronat, F., Guerri, J.C., Lloret, J.: An RTP/RTCP based approach for multimedia group and inter-stream synchronization. Multimed. Tool Appl. J. 40(2), 285–319 (2008, June)CrossRefGoogle Scholar
  35. 35.
    Boronat, F., Lloret, J., García, M.: Multimedia group and inter-stream synchronization techniques: a comparative study. Inf. Syst. 34(1), 108–131 (2009, March)CrossRefGoogle Scholar
  36. 36.
    Ishibashi, Y., Tasaka, S., Ogawa, H.: Media synchronization quality of reactive control schemes. IEICE Trans. Commun. E86-B(10), 3103–3113 (2003, October)Google Scholar
  37. 37.
    Ishibashi, Y., Tsuji, A., Tasaka, S.: A group synchronization mechanism for stored media in multicast communications. In: Proceedings of the INFOCOM ’97, Washington, DC, April 1997Google Scholar
  38. 38.
    Ishibashi, Y., Tasaka, S.: A group synchronization mechanism for live media in multicast communications. In: IEEE GLOBECOM’97, Phoenix (AZ), USA, pp. 746–752, November 1997Google Scholar
  39. 39.
    Ishibashi, I., Tasaka, S.: A distributed control scheme for group synchronization in multicast communications. In: Proceedings of International Symposium Communications, pp. 317–323, Kaohsiung, November 1999Google Scholar
  40. 40.
    Ishibashi, Y., Tasaka, S.: A distributed control scheme for causality and media synchronization in networked multimedia games. In: Proceedings of the 11th International Conference on Computer Communications and Networks, pp. 144–149, Miami, October 2002Google Scholar
  41. 41.
    Ishibashi, Y., Hasegawa, T., Tasaka, S.: Group synchronization control for haptic media in networked virtual environments. In: Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 106–113, Chicago, March 2004Google Scholar
  42. 42.
    Nunome, T., Tasaka, S.: Inter-destination synchronization quality in a multicast mobile ad hoc network. In: Proceedings of IEEE 16th International Symposium on Personal, Indoor and Mobile Radio Communications, pp. 1366–1370, Berlin, September 2005Google Scholar
  43. 43.
    Kurokawa, Y., Ishibashi, Y., Asano, T.: Group synchronization control in a remote haptic drawing system. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 572–575, Beijing, July 2007Google Scholar
  44. 44.
    Hosoya, K., Ishibashi, Y., Sugawara, S., Psannis, K.E.: Group synchronization control considering difference of conversation roles. In: IEEE 13th International Symposium on Consumer Electronics, ISCE ’09, Kyoto, Japan, pp. 948–952, May 2009Google Scholar
  45. 45.
    Akyildiz, I.F., Yen, W.: Multimedia group synchronization protocols for integrated services networks. IEEE J. Sel. Area Commun. 14(1), 162–173 (1996, January)CrossRefGoogle Scholar
  46. 46.
    Diot, C., Gautier, L.: A distributed architecture for multiplayer interactive applications on the internet. IEEE Netw. 13(4), 6–15 (1999, July/August)CrossRefGoogle Scholar
  47. 47.
    Mauve, M., Vogel, J., Hilt, V., Effelsberg, W.: Local-Lag and timewarp: providing consistency for replicated continuous applications. IEEE Trans. Multimed. 6(1), 47–57 (2004, February)CrossRefGoogle Scholar
  48. 48.
    Hesselman, C., Abbadessa, D., Van Der Beek, W., et al.: Sharing enriched multimedia experiences across heterogeneous network infrastructures. IEEE Commun. Mag. 48(6), 54–65 (2010, June)CrossRefGoogle Scholar
  49. 49.
    Vaishnavi, I., Cesar, P., Bulterman, D., Friedrich, O., Gunkel, S., Geerts, D.: From IPTV to synchronous shared experiences challenges in design: distributed media synchronization. Signal Process. Image Commun. 26(7), 370–377 (2011, August)CrossRefGoogle Scholar
  50. 50.
    Cronin, E., Filstrup, B., Jamin, S., Kurc, A.R.: An efficient synchronization mechanism for mirrored game architectures. Multimed. Tool Appl. 23(1), 7–30 (2004, May)CrossRefGoogle Scholar
  51. 51.
    Palazzi, C.E., Ferretti, S., Cacciaguerra, S., Roccetti, M.: On maintaining interactivity in event delivery synchronization for mirrored game architectures. In: IEEE Global Telecommunications Conference Workshops, pp.157–165, Dallas, December 2004Google Scholar
  52. 52.
    Ott, J., Perkins, C.: Guidelines on extending the RTP control protocol (RTCP), RFC 5968, September 2010Google Scholar
  53. 53.
    Friedman, T., Caceres, R., Clark, A.: RTP control protocol extended report (XR), RFC 3611, November 2003Google Scholar
  54. 54.
    ETSI TISPAN, “IMS-based IPTV stage 3 specification”, TS 183 063 v3.4.6 (2010–12)Google Scholar
  55. 55.
    Löbner, T.: Implementing ETSI standardised RTCP-based inter-destination media synchronization. Master thesis, Hamburg, Diplomica Verlag (2011)Google Scholar

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  • Fernando Boronat
    • 1
  • Rufael Mekuria
    • 2
  • Mario Montagud
    • 1
  • Pablo Cesar
    • 2
  1. 1.Universitat Politècnica de València (UPV)Grao de GandiaSpain
  2. 2.Centrum Wiskunde & Informatica (CWI)AmsterdamThe Netherlands

Personalised recommendations