Skip to main content
Log in

Impact of packet loss on 4K UHD video for portable devices

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Ultra High Definition (UHD) video streaming to portable devices has become topical. Two standardized codecs are current, H.264/Advanced Video Coding (AVC) and the more recent High Efficiency Video Coding (HEVC). This paper compares the two codecs’ robustness to packet loss, after making allowances for relative coding gain. A significant finding from the comparison is that the H.264/AVC codec is less impacted by packet loss than HEVC, despite their differing coding efficiencies and including at low levels of packet loss. The results will be especially relevant to those designing portable devices with 4K UHD video display capability, allowing them to estimate the level of error concealment necessary. The paper also includes the results of HEVC compressed UHD video streaming over an IEEE 802.11ad wireless link operating at 60 GHz as a pointer to future performance in an error-prone channel.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Abe A, Walker SD (2016) Multi-hop 802.11ad wireless H.264 video streaming. In Proc. of the IEEE Int. Conf. on Telecomms. and Sig. Proc., p 94–99

  2. Adeyemi-Ejeye AO, Alreshoodi M, Al-Jobouri L, Fleury M (2019) Prospects for live higher resolution video streaming to mobile devices: achievable quality across wireless links. J Real-Time Image Proc 16(1):127–141

    Article  Google Scholar 

  3. Akyazi P, Ebrahimi T (2018) Comparison of compression efficiency between HEVC/H.265, VP9 and AV1 based on subjective quality assessments. In Proc. of IEEE 10th Int. Conf. on Quality of Multimedia Experience

  4. Alreshoodi M, Adeyemi-Ejeye A, Al-Jobouri L, Fleury M, Woods JC (2017) Packet loss visibility for higher resolution video on portable devices. In Proc. of the IEEE Conf. on Consumer Electron., p 237–238

  5. Argyropoulos S, Raake A, Garcia M-N, List P (2011) No-reference bit stream model for video quality assessment of H.264/AVC video based on packet loss visibility. In Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Process., p 1169–1172

  6. Bae S-H, Kim J, Kim M, Cho S e a (2013) Assessments of subjective video quality on HEVC-encoded 4K-UHD video for beyond-HDTV broadcasting services. IEEE Trans Broadcast 59(2):209–222

    Article  Google Scholar 

  7. Blender-Foundation (2011) Sintel 4k. URL http://www.sintel.org/news/sintel-4k-version-available. Accessed July

  8. Boulos F, Parrein B, Le Callet P, Hands D (2009) Perceptual effects of packet loss on H.264/AVC encoded videos. In Proc. of the 4th Int. Workshop Video Process and Quality Metrics for Consumer Electron., p 1–7

  9. Cermak G (2009) Subjective video quality as a function of bitrate, frame rate, packet loss rate and codec. In Proc. of the 1st Int. Workshop on Quality of Multimedia Experience, p 41–46

  10. Chan A, Zeng K, Mohapatra P, Lee S, Banerjee S (2010) Metrics for evaluating video streaming quality in lossy IEEE 802.11 wireless networks. In Proc. of the IEEE INFOCOM, pp. 1–9

  11. Chang Y-L, Reznik YA, Chen Z, Cosman PC (2013) Motion compensated error concealment for HEVC based on block-merging and residual energy. In Proc. of 20th Int. Packet Video Workshop, pp. 1–6

  12. Cheon M, Lee J-S (2018) Subjective and objective quality assessment of compressed 4K UHD videos for immersive experience. IEEE Trans Circuits Syst Video Technol 28(7)

    Article  Google Scholar 

  13. Cordeiro C (2009) Evaluation of medium access technologies for next generation millimeter-wave WLAN and WPAN. In Proc. of the IEEE Int. Conf. Commun. Workshops, p 1–5

  14. Emoto M, Sugawara M (2012) Critical fusion frequency for bright and wide field-of-view image display. J Disp Technol 8(7):424–429

    Article  Google Scholar 

  15. Fraunhofer HHI (2018). HEVC 4K live decoder. https://www.hhi.fraunhofer.de/en/departments/vca/technologies-and-solutions/hevc-software-and-hardware-solutions/hevc-4k-live-decoder.html. Accessed Feb 2019

  16. Halák J, Krsek M, Ubik S, Žejdl P, Nevřela F (2011) Real-time long distance transfer of uncompressed 4K video for remote collaboration. Futur Gener Comput Syst 27(7):886–892

    Article  Google Scholar 

  17. Hamidouche W, Cocherel G, Le Feuvre J, Raulet M, Déforges O (2014) 4k real time video streaming with SHVC decoder and GPAC player. In Proc. of the IEEE Int. Conf. on Multimed. and Expo Workshops

  18. He Z, Cai J, Chen C (2002) Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding. IEEE Trans Circuits Syst Video Technol 12(6):511–523

    Article  Google Scholar 

  19. International Telecommunications Union (2014) The present state of Ultrahigh Definition Television. Radiocommunication recommendation BT.2246-3

  20. Kanamuri S, Cosman P, Reibman A, Vaishampayan V (2006) Modeling packet-loss visibility in MPEG-2 video. IEEE Trans Multimedia 8(2):341–355

    Article  Google Scholar 

  21. Kanamuri S, Subramanian S, Cosman P, Reibman A (2006) Predicting, H.264 packet loss visibility using a generalized linear model. In Proc. of the IEEE Int. Conf. Image Process., p 2245–2248

  22. Khan A, Sun L, Ifeachor E (2012) QoE prediction model and its application in video quality adaptation over UMTS networks. IEEE Trans Multimedia 14(2):431–442

    Article  Google Scholar 

  23. Kim D-H, Kim Y-J, Choi K-H (2018) Motion-vector refinement for video error concealment using downhill simplex approach. ETRI J 40(2):266–274

    Article  Google Scholar 

  24. Kim Y, Choi J-S, Kim M (2018) A real-time convolutional neural network for super-resolution on FPGA with applications to 4K UHD 60 fps video services. IEEE Trans. Circ. Syst. Video Technol. (Early Access)

  25. Korhonen J, Wang Y (2005) Effect of packet size on loss rate and delay in wireless links. In Proc. of the IEEE Wireless Comms. and Network. Conf., p 241603–1608

  26. Kulapana G, Talagala DS, Arachchi HK, Fernando A (2016) Error resilience aware motion estimation and mode selection for HEVC video transmission. In Proc. of IEEE Conf. on Consumer Electronics, p 85–86

  27. Kumar R, Assunção P, Ferreira L, Navarro A (2018) Retargeting UHD 4k video for smartphones. in Proc. of IEEE 8th Int. Conf. on Consumer Electron. – Berlin

  28. Kunić S, Šego Z (2013) Beyond HDTV technology. In Proc. of the 55th Int. Symp., p 83–87

  29. Lee S, Kim H, Eum N (2016) Reduced complexity single core based HEVC video codec processor for mobile 4K-UHD applications. In Proc. of the IEEE Int. Conf. on Consumer Electron., p 94–95. Accessed July 2019

  30. Leppkes H (2014) LAV filters 0.62 [Online]. Available from https://github.com/Nevcairiel/LAVFilters/releases/tag/0.62. Accessed July

  31. Li Z, Huang Y, Liu G, Wang F, Zhang Z-L, Dai Y (2012) Cloud transcoder: bridging the format and resolution gap between Internet video and mobile devices. In Proc. of the Int. Workshop on Network and Operating System Support for Digital Audio and Video, p 33–38

  32. Liang Y, Apostolopoulos J, Girod B (2013) Analysis of packet loss for compressed video: does burst-length matter? In Proc. of the IEEE Int. Conf. Acoust. Speech, and Signal Process., p 684–687

  33. Lu C-H, Lin Y (2013) Robust error resilient H.264/AVC video coding. In Proc. of the IEEE TENCON, pp. 1–4

  34. M. Mehendale, S. Das, M. Sharma, and M. Mody et al. (2012) A true multi-standard, programmable, low-power, full HD video-codec engine for smartphone HD SoC. In Proc. of the IEEE Int. Solid State Conf., p 226–228

  35. Microsoft (2012) DirectShow. [Online] Available from http://msdn.microsoft.com/enus/library/windows/desktop/dd375454(v=vs.85).aspx

  36. Mohamed S, Rubino G (2002) A study of real-time packet video quality using random neural nets. IEEE Trans Circuits Syst Video Technol 12(12):1071–1083

    Article  Google Scholar 

  37. Moorthy A, Seshadrinathan K, Soundarajan R, Bovik A (2010) Wireless video quality assessment: a study of subjective scores and subjective algorithms. IEEE Trans Circuits Syst Video Technol 20(4):513–516

    Article  Google Scholar 

  38. Nallappan K, Gourboukha H, Nerguizian C, Skorobogatiy M (2018) Uncompressed HD and Ultra-HD video streaming using terahertz wireless communications. In Proc. of 11th Global Symp. on Millimeter Waves

  39. Nightingale J, Wang Q, Grecos C (2012) HEVStream: a framework for streaming and evaluation of high efficiency video coding (HEVC) content in loss-prone networks. IEEE Trans Consum Electron 58(2):404–412

    Article  Google Scholar 

  40. Nightingale J, Wang Q, Grecos C, Goma S (2014) The impact of network impairment on quality of experience (QoE) in H.265/HEVC video streaming. IEEE Trans Consum Electron 60(2):242–250

    Article  Google Scholar 

  41. Nitsche T, Cordeiro C, Flores AB, Knightly EW, Perahia E, Widmer JC (2014) IEEE 802.11ad: directional 60 GHz communication for multi-Gbps Wi-fi. IEEE Commun Mag 52(12):132–141

    Article  Google Scholar 

  42. Ohm J, Sullivan G, Schwarz H, Tan T, Wiegand T (2012) Comparison of the coding efficiency of video coding standards including high efficiency video coding (HEVC). IEEE Trans Circuits Syst Video Technol 22(12):1669–1684

    Article  Google Scholar 

  43. Oztas B, Pourazad MT, Nasiopoulos P, Leung VCM (2012) A study on the HEVC performance over lossy networks. In Proc. of the IEEE Int. Conf. on Elec., Circ. and Syst., p785–788

  44. Öztürk E, Zia W, Pauli V, Steinbach E (2018) Performance evaluation of ATSC 3.0 DASH over LTE eMBMS. In Proc. of the IEEE Int. Symp. on Broadcast

  45. Pal U, King HL (2018) Cost increase due to UHD video broadcasting compared to HD. SMPTE Motion Imaging J 127(10):1–8

    Article  Google Scholar 

  46. Pinson M, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322

    Article  Google Scholar 

  47. Pinson MH, Wolf S, Cermak G (2010) HDTV subjective quality of H.264 vs. MPEG-2, with and without packet loss. IEEE Trans Broadcast 56(1):86–91

    Article  Google Scholar 

  48. Pourazad MT, Doutre C, Azimi M, Nasiopoulos B (2012) HEVC: the new gold standard for video compression: how does HEVC compare with H.264/AVC? IEEE Consum Electron Mag 1(3):36–46

    Article  Google Scholar 

  49. Poynton C (2003) Digital video and HDTV: algorithms and interfaces. Morgan Kaufmann, San Francisco

    Google Scholar 

  50. Rappaport TS, Heath RW Jr, Daniels CR, Murdock NJ (2014) Millimeter wave wireless communications. Prentice Hall, Upper Saddle River

    Google Scholar 

  51. Reibman A, Poole D (2007) Predicting packet-loss visibility using scene characteristics. In proc. of the 16th Int. Packet Video Workshop: 308–317

  52. Rerăbék M, Ebrahimi T (2014) Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments. In Applications of digital image processing XXXVII, vol. 9217, no. EPFLCONF-200925. SPIE-Int Soc Optical Engineering

  53. Rerăbék M, Hanhart P, Korshunov P, Ebrahimi T (2015) Quality evaluation of HEVC and VP9 video compression in real-time applications. In proc. of IEEE 7th Int. Workshop on Quality of Multimedia Experience, p 1–6

  54. Ryu E-S, Kim J (2015) Error concealment mode signalling for robust mobile video transmission. Int J Electron Commun 69:1070–1073

    Article  Google Scholar 

  55. Salva-Garcia P, Alcaraz-Calero JM, Alaez RM, Chirivella-Perez E, Nightingale J, Wang Q (2018) 5G-UHD: design, prototyping and empirical evaluation of adaptive ultra-high-definition video streaming based on scalable H.265 in virtualised 5G networks. Comput Commun 118:171–184

    Article  Google Scholar 

  56. Schierl T, Hannuksela MM, Wang Y-K, Wenger S (2012) System layer integration of high efficiency video coding. IEEE Trans Circuits Syst Video Technol 22(12):1871–1884

    Article  Google Scholar 

  57. Seufert M, Egger S, Slanina H, Zinner T, Hoβfeld T, Tran-Gia P (2015) A survey on quality of experience of HTTP adaptive streaming. IEEE Commun Surveys Tuts 17(1):469–492

    Article  Google Scholar 

  58. Shin J, Cosman PC (2010) Classification of MPEG-2 transport stream packet loss visibility. In Proc. of the IEEE Int. Conf. Acoustics speech and signal process, p 910–913

  59. Shirai D, Yamaguchi T, Shimizu T, Murooka T, Fujii T (2006) 4K SHD real-time video streaming system with JPEG 2000 parallel codec. In Proc of the IEEE Asia Pacific Conf on Circ and Syst, p 1855–1858

  60. Shirai D, Kawano T, Fujii T, Kaneko K, Ohta N, Ono S et al (2009) Real time switching and streaming transmission of uncompressed 4K motion pictures. Futur Gener Comput Syst 25(2):192–197

    Article  Google Scholar 

  61. Stockhammer T, Zia W (2007) Error-resilient coding and decoding strategies for video communication. In: Van der Schaar M, Chou PA (eds) Multimedia over IP and wireless networks. Academic, Burlington, pp 13–58

    Chapter  Google Scholar 

  62. Sugawara M, Choi S-Y, Woods D (2014) Ultra-high-definition television (Rec. ITU-R BT.2020): a generational leap in the evolution of television. IEEE Signal Process Mag 31(3):170–174

    Article  Google Scholar 

  63. Tan TK, Weerakkody R, Mrak M, Ramzan N, Baroncini V, Ohm J-R, Sullivan GJ (2016) Video quality evaluation methodology and verification testing of HEVC compression performance. IEEE Trans Circuits Syst Video Technol 26(1):76–90

    Article  Google Scholar 

  64. Valdes-Garcia A, Reynolds S, Natarajan A et al (2011) Single element and phased-array transceiver chipsets for 60-GHz Gb/s communications. IEEE Commun Mag 49(4):120–131

    Article  Google Scholar 

  65. VQEG (2014) Final report from the video quality experts group on the validation of objective models of video quality assessment, phase ii. Available: from www.vqeg.org. Accessed July

  66. Wang J, Zhang H (2012) Capacity on 60 GHz wireless communication system over fading channels. J Netw 7(1):203–209

    Google Scholar 

  67. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  68. Wiegand T, Sullivan GJ, Bjøntegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circuits Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  69. Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54(3):1–9

    Article  Google Scholar 

  70. Wood D (2011) Beyond HDTV at ITU-R-EBU Tech.-i 10

  71. Wu N, Wen M, Su H, Ren J, Zhang C (2012) A parallel H.264 encoder with CUDA: mapping and evaluation. IEEE 18th Int Conf Parallel Distrib Syst 276–283

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Martin Fleury.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Adeyemi-Ejeye, A.O., Alreshoodi, M., Al-Jobouri, L. et al. Impact of packet loss on 4K UHD video for portable devices. Multimed Tools Appl 78, 31733–31755 (2019). https://doi.org/10.1007/s11042-019-07996-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07996-1

Keywords

Navigation