Skip to main content
SpringerLink
Log in

Pixel-level Matching Based Multi-hypothesis Error Concealment Modes for Wireless 3D H.264/MVC Communication

  • 3DR Express
  • Published:
3D Research

Abstract

3D multi-view video (MVV) is multiple video streams shot by several cameras around a single scene simultaneously. Therefore it is an urgent task to achieve high 3D MVV compression to meet future bandwidth constraints while maintaining a high reception quality. 3D MVV coded bit-streams that are transmitted over wireless network can suffer from error propagation in the space, time and view domains. Error concealment (EC) algorithms have the advantage of improving the received 3D video quality without any modifications in the transmission rate or in the encoder hardware or software. To improve the quality of reconstructed 3D MVV, we propose an efficient adaptive EC algorithm with multi-hypothesis modes to conceal the erroneous Macro-Blocks (MBs) of intra-coded and inter-coded frames by exploiting the spatial, temporal and inter-view correlations between frames and views. Our proposed algorithm adapts to 3D MVV motion features and to the error locations. The lost MBs are optimally recovered by utilizing motion and disparity matching between frames and views on pixel-by-pixel matching basis. Our simulation results show that the proposed adaptive multi-hypothesis EC algorithm can significantly improve the objective and subjective 3D MVV quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. MerkleP, Smolic A, & MullerK, Wiegand T. (2007). Efficient prediction structures for multiview video coding. IEEE Transactions on Circuits and Systems for Video Technology, 17(11), 1461–1473.

    Article  Google Scholar 

  2. Zhou, Y., Hou, C., Pan, R., Yuan, Z., & Yang, L. (2010). Distortion analysis and error concealment for multi-view video transmission. In Broadband multimedia systems and broadcasting (BMSB), IEEE international symposium, March, pp. 1–5, 24–26.

  3. Song, K., & Kim, C. (2009). Error concealment of multi-view video sequences using inter-view and intra-view correlations. Journal of Visual Communication and Image Representation, 20, 281–292.

    Article  Google Scholar 

  4. Chung, T., Song, K., & Kim, C. (2007). Error concealment techniques for multi-view video sequences. In Proceedings of the multimedia 8th Pacific Rim conference on Advances in multimedia information processing, Springer-Verlag, Hong Kong (pp. 619–627).

  5. Nasiopoulos, P., Mendozal, L., Mansour, H., & Golikeri, A. (2005). An improved error concealment algorithm for intra-frames in h.264/avc. In IEEE international symposium on circuits and systems, ISCAS (pp. 320–323).

  6. Hrusovsky, B., Mochnac, J., & Marchevsky, S. (2010). Temporal-spatial error concealment algorithm for intra-frames in H.264/AVC coded video. In Radioelektronika, 20th international conference (pp. 1–4), April 19–21.

  7. Seiler J., & Kaup, A. (2008). Adaptive joint spatio-temporal error concealment for video communication. In IEEE 10th workshop on multimedia signal processing (pp. 229–234). October 8–10.

  8. Saurav, K., Zhenyu, W., & Jill, M. (2006). An error concealment scheme for entire frame losses for H.264/AVC. In Sarnoff Symposium, IEEE (pp. 1–4). March 27–28.

  9. Xiang, X., Zhao, D., Wang, Q., Ji, X., Gao, W. (2007). A novel error concealment method for stereoscopic video coding. In ICIP IEEE international conference on image processing (Vol. 5, pp. V-101-V–104-V). October 19.

  10. Hwang, M., & Ko, S. (2008). Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Transactions on Broadcasting, 54(2), 198–207.

    Article  Google Scholar 

  11. Chung, Y., Chen, L., Chen, X., Yeh, W., & Bae, C. (2008). A novel intra-fame error concealment algorithm for H. 264 AVC. In Third international conference on convergence and hybrid information technology, ICCIT’08 (Vol. 1, pp. 881–886).

  12. El-Shafai, W., Hrusovsky, B., El-Khamy, M., & El-Sharkawy, M. (2011). Joint Space-Time-View error concealment algorithms for 3D Multi- View video. In 18th IEEE international conference on image processing (IEEE ICIP2011) (pp. 2249–2252). Brussels.

  13. http://www.iphome.hhi.de/suehring/tml/ (2015).

  14. ftp://www.merl.com/pub/avetro/mvc-testseq (2015).

  15. http://www.3dtv-research.org/3dav_CfP_FhG_HHI/ (2015).

  16. http://www.wftp3.itu.int/avarch/jvt/2009_01_Geneva/JVTAD207.zip (2015).

  17. ISO/IEC JTC1/SC29/WG11. (2006). Common test conditions for multiview video coding. JVT-U207, Hangzhou.

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952, Egypt

    Walid El-Shafai

Authors
  1. Walid El-Shafai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walid El-Shafai.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

El-Shafai, W. Pixel-level Matching Based Multi-hypothesis Error Concealment Modes for Wireless 3D H.264/MVC Communication. 3D Res 6, 31 (2015). https://doi.org/10.1007/s13319-015-0064-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13319-015-0064-5

Keywords

Search

Navigation