Abstract
With a new video coding standard high efficiency video coding (HEVC), the ultra high definition (UHD) TV service with robust video streaming technology is emerging in the TV industry. This paper addresses the system architecture for the UHD video streaming and proposes three main ideas: (i) picture prioritization method, (ii) error concealment mode signaling (ECMS), and (iii) Tile complexity-based parallel video processing. In the experiments using HEVC reference model conducted, the proposed picture prioritization method shows the gains in video quality from 2.2 to 7.5 dB in Y-PSNR, and the error concealment mode signaling gains from 0.2 to 2.5 dB in Y-PSNR, with corresponding subjective improvements. In addition, proposed parallel processing method for real-time decoding shows around 20% decoding speed up gain.
Similar content being viewed by others
References
Ahn H, Jeong S (2013) Power-minimizing dvfs algorithm using estimation of video frame decoding complexity. The Journal of Korean Institute of Communications and Information Sciences 38(1):46–53
Baik H, Song H (2015) A complexity-based adaptive tile partitioning algorithm for hevc decoder parallelization. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 4298–4302
Bossen F, Bross B, Suhring K, Flynn D (2012) Hevc complexity and implementation analysis. IEEE Trans Circuits Syst Video Technol 22(12):1685–1696
Chen J, Boyce J, Ye Y, Hannuksela MM (2013) Shvc test model 2 (shm 2). In: JCTVC-M1007, 13th joint collaborative team on video coding (JCT-VC) meeting, Incheon, South Korea
Guo Y, Chen Y, Wang YK, Li H, Hannuksela MM, Gabbouj M (2009) Error resilient coding and error concealment in scalable video coding. IEEE Trans Circuits Syst Video Technol 19(6):781–795
Hellge C, Schierl T, Wiegand T (2008) Receiver driven layered multicast with layer-aware forward error correction. In: ICIP 2008. 15th IEEE international conference on image processing, 2008, pp 2304–2307
Kim HS, Ryu ES, Jayant N (2010) Channel-adaptive video transmission using h.264 svc over mobile wimax network. In: 2010 digest of technical papers international conference on consumer electronics (ICCE), pp 441–442
Mansour H, Nasiopoulos P, Krishnamurthy V (2008) Joint media-channel aware unequal error protection for wireless scalable video streaming. In: Proceedings of the IEEE international conference acoustics, speech and signal processing ICASSP 2008, pp 1129–1132
Martini MG, Mazzotti M, Lamy-Bergot C, Huusko J, Amon P (2007) Content adaptive network aware joint optimization of wireless video transmission. IEEE Commun Mag 45(1):84–90
Ryu ES (2013) Prediction-based picture prioritisation method for hierarchical b-structure of high efficiency video coding. Electron Lett 49(20):1268–1270
Ryu ES, Jayant N (2011) Home gateway for three-screen tv using h.264 svc and raptor fec. IEEE Trans Consum Electron 57(4):1652–1660
Ryu ES, Kim J (2015) Error concealment mode signaling for robust mobile video transmission. AEU-Int J Electron C 69(7):1070–1073
Ryu ES, Ye Y, He Y, He Y (2012) Frame prioritization method based on prediction information. In: JCTVC-J0063 for Stockholm meeting on HEVC standard
Ryu ES, He Y, Ye Y, He Y (2013) On error concealment mode signaling. In: ISO/IEC JTC1/SC29/WG11 MPEG2013/M31189 for Geneva meeting
Ryu E, Ye Y, He Y, He Y (2014) Frame prioritization based on prediction information. In: U.S. Patent Application 13/931,362
Ryu ES, Ryu Y, Roh HJ, Kim J, Lee BG (2015) Towards robust uhd video streaming systems using scalable high efficiency video coding. In: 2015 international conference on Information and communication technology convergence (ICTC). IEEE, pp 1356–1361
Schierl T, Schwarz H, Marpe D, Wiegand T (2005) Wireless broadcasting using the scalable extension of h. 264/avc. In: IEEE international conference on multimedia and expo, pp 884–887
Sullivan GJ, Topiwala PN, Luthra A (2004) The h.264/avc advanced video coding standard: overview and introduction to the fidelity range extensions
Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (hevc) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668
Ye Y, Andrivon P (2014) The scalable extensions of hevc for ultra-high-definition video delivery. Multimedia, IEEE 21(3):58–64
Ye Y, McClellan GW, He Y, Xiu X, He Y, Dong J, Bal C, Ryu E (2014) Codec architecture for multiple layer video coding. In: U.S. Patent Application 13/937,645
Yoo S, Shim Y, Lee S, Lee SA, Kim J (2015) A case for bad big. little switching: how to scale power-performance in si-hmp. In: Proceedings of the workshop on power-aware computing and systems. ACM, pp 1–5
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2015R1C1A1A02037743).
Rights and permissions
About this article
Cite this article
Ryu, ES., Ryu, S. Robust real-time UHD video streaming system using scalable high efficiency video coding. Multimed Tools Appl 76, 25511–25527 (2017). https://doi.org/10.1007/s11042-017-4835-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4835-2