Abstract
The advent of modern mobile phones, 3G networks, and live video streaming has made it possible to broadcast live video from mobile devices. This is now giving rise to a new class of applications which enable mobile collaborative live video production, in which groups of amateurs work together to provide a rich broadcast of events. We focus on new and expected synchronization problems that arise in these more complex systems when broadcasting live events because of the delays that often occur in streaming over internet and mobile networks. The problem has been investigated by acquiring initial user feedback, as well as conducting technical delay measurements of two examples of such systems and relating them to existing literature. We identified two types of technical problems which affect the mixing of the streams, namely the difference in delay in multiple streams, a.k.a. asynchrony among streams, and the delay between the event itself and its presentation in the mixer. These problems affect the mixing in various ways depending on whether or not the director has visual access to the unmediated event. This knowledge has then been used to inform the conceptualization of identifiable ways of handling delays and synchronization. We suggest the introduction of a software feature providing context-dependent delay, in which these requirements can be balanced differently to fit specific contexts of use. We specifically address the different types of mixing which occurs when the director, or mixer, only has access to the topic through the mobile media (“out of view”), as well as mixing in a context in which the topic also is physically present (“in-view”) in front of the mixer.
Similar content being viewed by others
Abbreviations
- HD:
-
High definition
- IBS:
-
Instant broadcasting system
- MVM:
-
Mobile vision mixer
- NTP:
-
Network time protocol
References
Engstrom A, Juhlin O, Reponem E (2010) Mobile broadcasting—the whats and hows of live video as a social medium, In proceedings of mobile HCI 2010, Sept 7–10, Lisbon, Portugal
Engström A, Perry M, Juhlin O (2012) Amateur vision and recreational orientation: creating live video together. In proceedings of CSCW 2012 Seattle
Khaleel A et al (2009) A system for collaborative event casting using mobile phones. In proceeding MUM ’09 proceedings of the 8th international conference on mobile and ubiquitous multimedia
Engström A, Esbjörnsson M, Juhlin O (2008) Mobile collaborative live video mixing. Proc. Mobile HCI 2008:157–166
Wang L et al (2008) An audio wiki supporting mobile collaboration. In proceedings of SAC ’08 Proceedings of the 2008 ACM symposium on applied computing
Ito Y, Tasaka S, Fukuta Y Psychometric analysis of the effect of end-to-end delay on user level QoS in live audio–video transmission. In 2004 IEEE International Conference on Communications
Baldi M, Ofek Y (2000) End-to-End delay analysis of videoconferencing over packet-switched networks. IEEE/ACM Trans Netw 8(4):479–492
Endoh K, Yoshida K, Yakoh T (2008) Low delay live video streaming system for interactive use. The IEEE international conference on industrial informatics (INDIN2008) DDC, Daejeon, Korea, July 13–16
Sareenan CJ, Narendaran B, Agarwal P (1996) Internet stream synchronization using concord. Proceedings of IS&T/SPIE International Conference on Multimedia Computing and Networking (MMCN)
Gualdi G, Cucchiara R, Prati A (2006) Low-latency live video streaming over low-capacity networks. Proceedings of the eighth IEEE international symposium on multimedia
Weber R et al (2006) Measurement and analysis of video streaming performance in live UMTS networks. Proceedings of WPMC 2006 conference, San Diego, CA, USA, Sept 17–20, page 1 of 5
Boronat F et al (2009) Multimedia group and inter-stream synchronization techniques: a comparative study. Inf Syst 34:108–131
Blum C Practical method for the synchronization of live continuous media streams, Institut Eurécom
Rautiainen M et al (2009) Swarm synchronization for multi-recipient multimedia streaming, multimedia and expo, 2009. ICME 2009. IEEE international conference on page(s):786–789
Cremer M, Cook R (2009) Machine-assisted editing of user generated content. Proceedings of SPIE-IS&T Electronic Imaging SPIE vol 7254. Article ID 725404, p 10
Haitsma J, Kalker T (2002) A highly robust audio fingerprinting system. In Proceedings of the international symposium on music information retrieval
Kennedy L, Naaman M (2009) Less talk, more rock: automated organization of community-contributed collections of concert videos, WWW'09: Proceedings of the 18th international conference on World Wide Web, ACM, pp 311–320
Shrestha P (2009) Automatic mashup generation of multiple-camera videos, a Ph.D. dissertation, Technische Universiteit Eindhoven
Engstrom A, Juhlin O, Esbjörnsson M (2009) Instant broadcasting system: mobile collaborative live video mixing. In proceedings SIGGRAPH ASIA ’09 ACM SIGGRAPH ASIA 2009 Art Gallery and Emerging Technologies: adaptation
http://movino.org. Accessed 20 Dec 2011
Toussi R (2011) Mobile vision mixer, a system for collaborative live mobile video production, a master thesis, Royal Institute of Technology (KTH), Stockholm, Sweden
http://bambuser.com/. Accessed 9 Dec 2011
Weilenmann A (2001) Negotiating use: make sense of mobile technology. Pers Ubiquitous Comput 5:137–145
Perry M, Juhlin O et al (2009) Lean collaboration through video gestures: co-ordinating the production of live televised sport. In CHI ’09 Proceedings of the 27th international conference on Human factors in computing systems
Wang B (2008) Multimedia streaming via TCP: an analytic performance study. ACM Trans Multimed Comput Commun Appl 4(2):1–22
http://robgwilson.com/2009/04/14/jam-sync-your-damn-cameras. Accessed on 05 Nov 2011
http://www.bytefusion.com/products/ntm/ptnt/timeprotocolsaccuracy.htm/. Accessed at 10 Oct 2011
Lynnae E, Borko F, Mohammad I (1994) Evaluation of multimedia synchronization techniques. In proceedings of multimedia computing and systems (MMCS1994)
Shepherd D, Salmony M (1990) Extending OSI to support synchronization required by multimedia applications. Comput commun 13(7):399–409
Escobar et al (1994) Flow synchronization protocol. IEEE/ACM Trans Netw 2(2):111–121
Huang CM et al (2000). PARK: a paused-and-run k-stream multimedia synchronization control scheme. In Proceedings of the 20th International conference on distributed computing systems, Taipei, Taiwan
Manvi SS, Venkataram P (2006) An agent based synchronization scheme for multimedia applications. J Syst Software (JSS) 79(5):701–713
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mughal, M.A., Juhlin, O. Context-dependent software solutions to handle video synchronization and delay in collaborative live mobile video production. Pers Ubiquit Comput 18, 709–721 (2014). https://doi.org/10.1007/s00779-013-0701-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-013-0701-z