Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Robust real-time UHD video streaming system using scalable high efficiency video coding

  • 267 Accesses

  • 2 Citations

Abstract

With a new video coding standard high efficiency video coding (HEVC), the ultra high definition (UHD) TV service with robust video streaming technology is emerging in the TV industry. This paper addresses the system architecture for the UHD video streaming and proposes three main ideas: (i) picture prioritization method, (ii) error concealment mode signaling (ECMS), and (iii) Tile complexity-based parallel video processing. In the experiments using HEVC reference model conducted, the proposed picture prioritization method shows the gains in video quality from 2.2 to 7.5 dB in Y-PSNR, and the error concealment mode signaling gains from 0.2 to 2.5 dB in Y-PSNR, with corresponding subjective improvements. In addition, proposed parallel processing method for real-time decoding shows around 20% decoding speed up gain.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. 1.

    Ahn H, Jeong S (2013) Power-minimizing dvfs algorithm using estimation of video frame decoding complexity. The Journal of Korean Institute of Communications and Information Sciences 38(1):46–53

  2. 2.

    Baik H, Song H (2015) A complexity-based adaptive tile partitioning algorithm for hevc decoder parallelization. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 4298–4302

  3. 3.

    Bossen F, Bross B, Suhring K, Flynn D (2012) Hevc complexity and implementation analysis. IEEE Trans Circuits Syst Video Technol 22(12):1685–1696

  4. 4.

    Chen J, Boyce J, Ye Y, Hannuksela MM (2013) Shvc test model 2 (shm 2). In: JCTVC-M1007, 13th joint collaborative team on video coding (JCT-VC) meeting, Incheon, South Korea

  5. 5.

    Guo Y, Chen Y, Wang YK, Li H, Hannuksela MM, Gabbouj M (2009) Error resilient coding and error concealment in scalable video coding. IEEE Trans Circuits Syst Video Technol 19(6):781–795

  6. 6.

    Hellge C, Schierl T, Wiegand T (2008) Receiver driven layered multicast with layer-aware forward error correction. In: ICIP 2008. 15th IEEE international conference on image processing, 2008, pp 2304–2307

  7. 7.

    Kim HS, Ryu ES, Jayant N (2010) Channel-adaptive video transmission using h.264 svc over mobile wimax network. In: 2010 digest of technical papers international conference on consumer electronics (ICCE), pp 441–442

  8. 8.

    Mansour H, Nasiopoulos P, Krishnamurthy V (2008) Joint media-channel aware unequal error protection for wireless scalable video streaming. In: Proceedings of the IEEE international conference acoustics, speech and signal processing ICASSP 2008, pp 1129–1132

  9. 9.

    Martini MG, Mazzotti M, Lamy-Bergot C, Huusko J, Amon P (2007) Content adaptive network aware joint optimization of wireless video transmission. IEEE Commun Mag 45(1):84–90

  10. 10.

    Ryu ES (2013) Prediction-based picture prioritisation method for hierarchical b-structure of high efficiency video coding. Electron Lett 49(20):1268–1270

  11. 11.

    Ryu ES, Jayant N (2011) Home gateway for three-screen tv using h.264 svc and raptor fec. IEEE Trans Consum Electron 57(4):1652–1660

  12. 12.

    Ryu ES, Kim J (2015) Error concealment mode signaling for robust mobile video transmission. AEU-Int J Electron C 69(7):1070–1073

  13. 13.

    Ryu ES, Ye Y, He Y, He Y (2012) Frame prioritization method based on prediction information. In: JCTVC-J0063 for Stockholm meeting on HEVC standard

  14. 14.

    Ryu ES, He Y, Ye Y, He Y (2013) On error concealment mode signaling. In: ISO/IEC JTC1/SC29/WG11 MPEG2013/M31189 for Geneva meeting

  15. 15.

    Ryu E, Ye Y, He Y, He Y (2014) Frame prioritization based on prediction information. In: U.S. Patent Application 13/931,362

  16. 16.

    Ryu ES, Ryu Y, Roh HJ, Kim J, Lee BG (2015) Towards robust uhd video streaming systems using scalable high efficiency video coding. In: 2015 international conference on Information and communication technology convergence (ICTC). IEEE, pp 1356–1361

  17. 17.

    Schierl T, Schwarz H, Marpe D, Wiegand T (2005) Wireless broadcasting using the scalable extension of h. 264/avc. In: IEEE international conference on multimedia and expo, pp 884–887

  18. 18.

    Sullivan GJ, Topiwala PN, Luthra A (2004) The h.264/avc advanced video coding standard: overview and introduction to the fidelity range extensions

  19. 19.

    Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (hevc) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

  20. 20.

    Ye Y, Andrivon P (2014) The scalable extensions of hevc for ultra-high-definition video delivery. Multimedia, IEEE 21(3):58–64

  21. 21.

    Ye Y, McClellan GW, He Y, Xiu X, He Y, Dong J, Bal C, Ryu E (2014) Codec architecture for multiple layer video coding. In: U.S. Patent Application 13/937,645

  22. 22.

    Yoo S, Shim Y, Lee S, Lee SA, Kim J (2015) A case for bad big. little switching: how to scale power-performance in si-hmp. In: Proceedings of the workshop on power-aware computing and systems. ACM, pp 1–5

Download references

Author information

Correspondence to SunJung Ryu.

Additional information

This research was supported by Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2015R1C1A1A02037743).

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ryu, E., Ryu, S. Robust real-time UHD video streaming system using scalable high efficiency video coding. Multimed Tools Appl 76, 25511–25527 (2017). https://doi.org/10.1007/s11042-017-4835-2

Download citation

Keywords

  • Robust video streaming
  • Picture priority
  • Error concealment
  • Scalable high efficiency video coding