Abstract
The H.264 video coding standard has become popular owing to its excellent compression efficiency. However, the H.264-coded video is very vulnerable to data loss. Conventional error concealment techniques interpolate the lost data in units of rectangular blocks, which limit the performance because a visual object is not equivalent to an image block. In this paper, we propose a new error concealment technique that uses visual objects as concealment units. The H.264 error-resilience tool FMO (Flexible Macroblock Ordering) is also incorporated at the encoder side for utilizing the spatial correlation. A lost region is concealed at the decoder side in three steps, namely object segmentation, object matching, and region-based patching. Objects are formed in the reference pictures based on color similarity, and adjacent objects of small area or the same motion are grouped as a unity. Motion estimation is performed on detected objects to find the associated motion vector. A lost region is concealed by the object in the reference picture with the best boundary-matching score. The proposed method provides considerably higher PSNR (peak signal-to-noise ratio) than conventional block-based approaches, especially for traditionally difficult cases and high-quality videos.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Advanced Video Coding for Generic Audiovisual Services, ITU-T Rec. H.264, or ISO/IEC 14496–10 Information technology—Coding of audio-visual objects - Part 10: Advanced Video Coding (MPEG-4 AVC), Fifth Edition, May 2009
Fast Integer Pel and Fractional Pel Motion Estimation for JVT (JVT-F017.doc), ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, 6th Meeting, Awaji Island, Japan, Dec. 2002
Hsiao H-H, Leou J-J (2013) Background initialization and foreground segmentation for bootstrapping video sequences. EURASIP J Image Video Proc 12
ISO/IEC 14496–2 information technology—coding of audio-visual objects, Part 2: Visual, Amendment 1: visual extensions, July 2000
Li H, Zhong Y (2013) Motion characteristic differentiated error concealment. Multimedia Tools Appl 65:297–320
Richardson IE (2010) The H.264 advanced video compression standard, 2nd edn. John Wiley & Sons Ltd
Wang YK, Hannuksela MM, Varsa V, Hourunranta A, Gabbouj M (2002) The error concealment feature in the H.26 L test model. In: Proc. IEEE ICIP, 729–736
Wang L, Wang J, Goto S, Ikenaga T (2007) Variable block size error concealment scheme based on H.264/AVC non-normative decoder. International Symposium on Intelligent Signal Processing and Communication Systems, China
Wu G-L, Chen C-Y, Wu T-H, Chien S-Y (2010) Efficient spatial-temporal error concealment algorithm and hardware architecture design for H.264/AVC. IEEE Trans Circ Syst Vi Technol 20(11):1409–1422
Yan B, Gharavi H (2010) A hybrid frame concealment algorithm for H.264/AVC. IEEE Trans Image Process 19(1):98–107
Yang S-H, Tsai J-C (2010) A fast and efficient H.264 error concealment technique based on coding modes. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, Shanghai, China, March, pp. 1–4
Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circ Syst Vi Technol 10(4):659–665
Acknowledgments
This research is supported in part by the National Science Council, Taiwan, under the Grants NSC 101-2219-E-027-002 and NSC 102-2219-E-027-002.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, SH., Chang, CW. & Chan, CC. An object-based error concealment technique for H.264 coded video. Multimed Tools Appl 74, 10785–10800 (2015). https://doi.org/10.1007/s11042-014-2206-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2206-9