An object-based error concealment technique for H.264 coded video
- 192 Downloads
The H.264 video coding standard has become popular owing to its excellent compression efficiency. However, the H.264-coded video is very vulnerable to data loss. Conventional error concealment techniques interpolate the lost data in units of rectangular blocks, which limit the performance because a visual object is not equivalent to an image block. In this paper, we propose a new error concealment technique that uses visual objects as concealment units. The H.264 error-resilience tool FMO (Flexible Macroblock Ordering) is also incorporated at the encoder side for utilizing the spatial correlation. A lost region is concealed at the decoder side in three steps, namely object segmentation, object matching, and region-based patching. Objects are formed in the reference pictures based on color similarity, and adjacent objects of small area or the same motion are grouped as a unity. Motion estimation is performed on detected objects to find the associated motion vector. A lost region is concealed by the object in the reference picture with the best boundary-matching score. The proposed method provides considerably higher PSNR (peak signal-to-noise ratio) than conventional block-based approaches, especially for traditionally difficult cases and high-quality videos.
KeywordsError concealment Motion estimation Object segmentation H.264/AVC
This research is supported in part by the National Science Council, Taiwan, under the Grants NSC 101-2219-E-027-002 and NSC 102-2219-E-027-002.
- 1.Advanced Video Coding for Generic Audiovisual Services, ITU-T Rec. H.264, or ISO/IEC 14496–10 Information technology—Coding of audio-visual objects - Part 10: Advanced Video Coding (MPEG-4 AVC), Fifth Edition, May 2009Google Scholar
- 2.Fast Integer Pel and Fractional Pel Motion Estimation for JVT (JVT-F017.doc), ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, 6th Meeting, Awaji Island, Japan, Dec. 2002Google Scholar
- 3.Hsiao H-H, Leou J-J (2013) Background initialization and foreground segmentation for bootstrapping video sequences. EURASIP J Image Video Proc 12Google Scholar
- 4.ISO/IEC 14496–2 information technology—coding of audio-visual objects, Part 2: Visual, Amendment 1: visual extensions, July 2000Google Scholar
- 6.Richardson IE (2010) The H.264 advanced video compression standard, 2nd edn. John Wiley & Sons LtdGoogle Scholar
- 7.Wang YK, Hannuksela MM, Varsa V, Hourunranta A, Gabbouj M (2002) The error concealment feature in the H.26 L test model. In: Proc. IEEE ICIP, 729–736Google Scholar
- 8.Wang L, Wang J, Goto S, Ikenaga T (2007) Variable block size error concealment scheme based on H.264/AVC non-normative decoder. International Symposium on Intelligent Signal Processing and Communication Systems, ChinaGoogle Scholar
- 11.Yang S-H, Tsai J-C (2010) A fast and efficient H.264 error concealment technique based on coding modes. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, Shanghai, China, March, pp. 1–4Google Scholar