Multimedia Tools and Applications

, Volume 74, Issue 23, pp 10785–10800 | Cite as

An object-based error concealment technique for H.264 coded video

  • Shih-Hsuan YangEmail author
  • Chi-Wen Chang
  • Chih-Chieh Chan


The H.264 video coding standard has become popular owing to its excellent compression efficiency. However, the H.264-coded video is very vulnerable to data loss. Conventional error concealment techniques interpolate the lost data in units of rectangular blocks, which limit the performance because a visual object is not equivalent to an image block. In this paper, we propose a new error concealment technique that uses visual objects as concealment units. The H.264 error-resilience tool FMO (Flexible Macroblock Ordering) is also incorporated at the encoder side for utilizing the spatial correlation. A lost region is concealed at the decoder side in three steps, namely object segmentation, object matching, and region-based patching. Objects are formed in the reference pictures based on color similarity, and adjacent objects of small area or the same motion are grouped as a unity. Motion estimation is performed on detected objects to find the associated motion vector. A lost region is concealed by the object in the reference picture with the best boundary-matching score. The proposed method provides considerably higher PSNR (peak signal-to-noise ratio) than conventional block-based approaches, especially for traditionally difficult cases and high-quality videos.


Error concealment Motion estimation Object segmentation H.264/AVC 



This research is supported in part by the National Science Council, Taiwan, under the Grants NSC 101-2219-E-027-002 and NSC 102-2219-E-027-002.


  1. 1.
    Advanced Video Coding for Generic Audiovisual Services, ITU-T Rec. H.264, or ISO/IEC 14496–10 Information technology—Coding of audio-visual objects - Part 10: Advanced Video Coding (MPEG-4 AVC), Fifth Edition, May 2009Google Scholar
  2. 2.
    Fast Integer Pel and Fractional Pel Motion Estimation for JVT (JVT-F017.doc), ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, 6th Meeting, Awaji Island, Japan, Dec. 2002Google Scholar
  3. 3.
    Hsiao H-H, Leou J-J (2013) Background initialization and foreground segmentation for bootstrapping video sequences. EURASIP J Image Video Proc 12Google Scholar
  4. 4.
    ISO/IEC 14496–2 information technology—coding of audio-visual objects, Part 2: Visual, Amendment 1: visual extensions, July 2000Google Scholar
  5. 5.
    Li H, Zhong Y (2013) Motion characteristic differentiated error concealment. Multimedia Tools Appl 65:297–320CrossRefGoogle Scholar
  6. 6.
    Richardson IE (2010) The H.264 advanced video compression standard, 2nd edn. John Wiley & Sons LtdGoogle Scholar
  7. 7.
    Wang YK, Hannuksela MM, Varsa V, Hourunranta A, Gabbouj M (2002) The error concealment feature in the H.26 L test model. In: Proc. IEEE ICIP, 729–736Google Scholar
  8. 8.
    Wang L, Wang J, Goto S, Ikenaga T (2007) Variable block size error concealment scheme based on H.264/AVC non-normative decoder. International Symposium on Intelligent Signal Processing and Communication Systems, ChinaGoogle Scholar
  9. 9.
    Wu G-L, Chen C-Y, Wu T-H, Chien S-Y (2010) Efficient spatial-temporal error concealment algorithm and hardware architecture design for H.264/AVC. IEEE Trans Circ Syst Vi Technol 20(11):1409–1422CrossRefGoogle Scholar
  10. 10.
    Yan B, Gharavi H (2010) A hybrid frame concealment algorithm for H.264/AVC. IEEE Trans Image Process 19(1):98–107MathSciNetCrossRefGoogle Scholar
  11. 11.
    Yang S-H, Tsai J-C (2010) A fast and efficient H.264 error concealment technique based on coding modes. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, Shanghai, China, March, pp. 1–4Google Scholar
  12. 12.
    Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circ Syst Vi Technol 10(4):659–665CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Shih-Hsuan Yang
    • 1
    Email author
  • Chi-Wen Chang
    • 1
  • Chih-Chieh Chan
    • 1
  1. 1.Department of Computer Science and Information EngineeringNational Taipei University of TechnologyTaipeiTaiwan

Personalised recommendations