Skip to main content
SpringerLink
Log in

Content-based hybrid error concealment approach for packet video communication over the noisy channels

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video compression makes the encoded video stream more vulnerable to the channel errors so that, the quality of the received video is exposed to severe degradation when the compressed video is transmitted over the error-prone environments. Therefore, it is necessary to apply error concealment (EC) techniques in the decoder to improve the quality of the received video. In this regard, an Adaptive Content-based EC Approach (ACBECA) is proposed in this paper, which exploits both the spatial and temporal correlations within the video sequences for the EC purpose. The proposed approach adaptively utilizes two EC techniques, including new spatial-temporal error concealment (STEC) technique, and a temporal error concealment (TEC) technique, to recover the lost regions of the frame. The STEC technique proposed in this paper is established on the basis of non-Local Means concept and tries to recover each lost macroblock (MB) as the weighted average of the similar MBs in the reference frame, whereas the TEC technique recovers the motion vector of the lost MB adaptively by analyzing the behavior of the MB in the frame. The decision on temporally or spatially reconstructing the degraded frames is made dynamically according to the content of the degraded frame (i.e., structure or texture), type of the error and also block loss rate (BLR). Compared with the state-of-the-art EC techniques, the simulation results indicate the superiority of the ACBECA in terms of both the objective and subjective quality assessments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Akbari A, Trocan M, Granado B (2017) Joint-domain dictionary learning-based error concealment using common space mapping. In: 2017 22nd International Conference on Digital Signal Processing (DSP), pp 1–5. https://doi.org/10.1109/ICDSP.2017.8096049

  2. Akbari A, Trocan M, Granado B (2017) Sparse recovery-based error concealment. IEEE Trans Multimed 19(6):1339–1350. https://doi.org/10.1109/TMM.2017.2662203

    Article  Google Scholar 

  3. Aldahdooh A, Barkowsky M, Bull DR, Callet PL (2017) Inpainting-based error concealment for low-delay video communication. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 1632–1636. https://doi.org/10.1109/ICASSP.2017.7952433

  4. Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), pp 60–65 vol. 62. https://doi.org/10.1109/CVPR.2005.38

  5. Chen X, Chung YY, Bae C (2008) Dynamic multi-mode switching error concealment algorithm for H.264/AVC video applications. IEEE Trans Consum Electron 54(1):154–162. https://doi.org/10.1109/TCE.2008.4470038

    Article  Google Scholar 

  6. Cui S, Cui H, Tang K (2014) An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering. SIViP 8(8):1533–1542. https://doi.org/10.1007/s11760-012-0390-5

    Article  Google Scholar 

  7. Ebdelli M, Meur OL, Guillemot C (2015) Video Inpainting with short-term windows: application to object removal and error concealment. IEEE Trans Image Process 24(10):3034–3047. https://doi.org/10.1109/TIP.2015.2437193

    Article  MathSciNet  MATH  Google Scholar 

  8. Gadgil N, Delp EJ (2016) VPx error resilient video coding using duplicated prediction information. Electron Imaging 2016(2):1–6. https://doi.org/10.2352/ISSN.2470-1173.2016.2.VIPC-234

    Article  Google Scholar 

  9. Gang H-S, Chowdhury SI, Park C-S, Kwon G-R, Pyun J-Y (2017) Error resilient multiple reference selection for wireless video transmission. IEICE Trans Commun E100.B(4):657–665. https://doi.org/10.1587/transcom.2016EBP3221

    Article  Google Scholar 

  10. Ghanei-Yakhdan H (2013) A novel dynamic temporal error concealment technique for video sequences using a competitive neural network. Paper presented at the 1st Iranian Conf. Pattern recognition and image analysis,

  11. Ha H, Yim C (2016) Unequal Luby transform based on block weight shift (ULT-BWS) for error resilient video transmission. Wirel Pers Commun 89(4):1103–1121. https://doi.org/10.1007/s11277-016-3307-8

    Article  Google Scholar 

  12. Kazemi M, Shirmohammadi S, Sadeghi KH (2014) A review of multiple description coding techniques for error-resilient video delivery. Multimedia Systems 20(3):283–309. https://doi.org/10.1007/s00530-013-0319-z

    Article  Google Scholar 

  13. Kim D-H, Kwon Y-J, Choi K-H (2018) Motion-vector refinement for video error concealment using downhill simplex approach. ETRI J 40(2):266–274. https://doi.org/10.4218/etrij.2017-0078

    Article  Google Scholar 

  14. Lam WM, Reibman AR, Liu B (1993) Recovery of lost or erroneously received motion vectors. In: 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing, pp 417–420 vol.415. https://doi.org/10.1109/ICASSP.1993.319836

  15. Lee Y-H, Lin C-H, Chen C-C, Lin S-Y, Huang B-S (2017) The video spatial error concealment algorithm using separately-directional interpolation technique. J Signal Process Syst 88(1):13–27. https://doi.org/10.1007/s11265-016-1112-y

    Article  Google Scholar 

  16. Lie WN, Lee CM, Yeh CH, Gao ZW (2014) Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Trans Multimed 16(1):216–227. https://doi.org/10.1109/TMM.2013.2281587

    Article  Google Scholar 

  17. Lin T-L, Yang N-C, Syu R-H, Liao C-C, Tsai W-L (2013) Error concealment algorithm for HEVC coded video using block partition decisions. In: Signal Processing, Communication and Computing (ICSPCC), 2013 IEEE International Conference on, IEEE, pp 1–5

  18. Lin T-L, Chen W-C, Lai C-K (2013) Recovery of lost motion vectors using encoded residual signals. IEEE Trans Broadcast 59:705–716

    Article  Google Scholar 

  19. Lin T-L, Ding T-L, Fan C-Y, Chen W-C (2017) Error concealment algorithm based on sparse optimization. Multimed Tools Appl 76(1):397–413. https://doi.org/10.1007/s11042-015-3056-9

    Article  Google Scholar 

  20. Liu J, Zhai G, Yang X, Yang B, Chen L (2015) Spatial error concealment with an adaptive linear predictor. IEEE Trans Circ Syst Video Technol 25(3):353–366. https://doi.org/10.1109/TCSVT.2014.2359145

    Article  Google Scholar 

  21. Marvasti-Zadeh SM, Ghanei-Yakhdan H (2016) Video temporal error concealment using improved directional boundary matching algorithm. Turk J Electr Eng Comput Sci 24(6):5195–5209

    Article  Google Scholar 

  22. Ni H, Li Y (2017) Spatial error concealment algorithm based on adaptive edge threshold and directional weight. Int J Pattern Recognit Artif Intell 31(08):1754014. https://doi.org/10.1142/s0218001417540143

    Article  MathSciNet  Google Scholar 

  23. Patel D, Patel J (2014) Hybrid spatio-temporal error concealment technique for image/video transmission. Emerging Technology Trends in Electronics, Communication and Networking (ET2ECN), 2014 2nd international conference on. IEEE

  24. Qian X, Liu G, Wang H (2009) Recovering connected error region based on adaptive error concealment order determination. IEEE Trans Multimed 11(4):683–695. https://doi.org/10.1109/TMM.2009.2017609

    Article  Google Scholar 

  25. Rajani PK, Khaparde A (2016) Comparison of Frequency Selective Extrapolation and Patch Matching Algorithm for Error Concealment in Spatial Domain. In: Proceedings of the 8th International Conference on Signal Processing Systems - ICSPS 2016, Auckland, New Zealand, ACM, 3015202, pp 70–74. https://doi.org/10.1145/3015166.3015202

  26. Thaipanich T, Wu P-H, Kuo CCJ (2007) Video error concealment with outer and inner boundary matching algorithms. Optical Engineering+ Applications. International Society for Optics and Photonics

  27. Wei X, Tseng HW, Jhang JW, Su TH, Yu YC, Wen Y, Liu Z, Lin TL, Chen SL, Chiou YS, Lee HY (2017) Video error concealment method using motion vector estimation propagation. In: 2017 International Conference on Applied System Innovation (ICASI), pp 1335–1338. https://doi.org/10.1109/ICASI.2017.7988151

  28. Wells JW, Chatterjee A (2017) Error-resilient video encoding using parallel independent signature processing. IEEE Trans Circ Syst Video Technol 27(5):1077–1090. https://doi.org/10.1109/tcsvt.2016.2527303

    Article  Google Scholar 

  29. Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circ Syst Video Technol 13(7):560–576. https://doi.org/10.1109/TCSVT.2003.815165

    Article  Google Scholar 

  30. Yao W, Qin-Fan Z (1998) Error control and concealment for video communication: a review. Proc IEEE 86(5):974–997. https://doi.org/10.1109/5.664283

    Article  Google Scholar 

  31. Zabihi SM, Ghanei-Yakhdan H, Mehrshad N (2017) Adaptive temporal error concealment method based on the MB behavior estimation in the video. In: 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE), pp 193–198. https://doi.org/10.1109/iccke.2017.8167874

  32. Zhang Y, Xiang X, Zhao D, Ma S, Gao W (2012) Packet video error concealment with auto regressive model. IEEE Trans Circ Syst Video Technol 22(1):12–27. https://doi.org/10.1109/TCSVT.2011.2130450

    Article  Google Scholar 

  33. Zhang L, Peng Q, Wu X, Wang Q (2014) SSIM-based error resilient video coding over packet-switched networks. J Signal Process Syst 74(1):103–113. https://doi.org/10.1007/s11265-013-0747-1

    Article  Google Scholar 

  34. Zhou Z, Dai M, Zhao R, Li B, Zhong H, Wen Y (2017) Video error concealment scheme based on tensor model. Multimed Tools Appl 76(14):16045–16061. https://doi.org/10.1007/s11042-016-3894-0

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering Department, Yazd University, Yazd, Iran

    Seyyed Mohammad Zabihi & Hossein Ghanei-Yakhdan

  2. Electrical and Computer Engineering Department, University of Birjand, Birjand, Iran

    Nasser Mehrshad

Authors
  1. Seyyed Mohammad Zabihi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hossein Ghanei-Yakhdan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nasser Mehrshad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hossein Ghanei-Yakhdan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zabihi, S.M., Ghanei-Yakhdan, H. & Mehrshad, N. Content-based hybrid error concealment approach for packet video communication over the noisy channels. Multimed Tools Appl 80, 12335–12365 (2021). https://doi.org/10.1007/s11042-020-10290-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10290-0

Keywords

Search

Navigation