Skip to main content

Temporal Error Concealment for H.264 Using Optimum Regression Plane

  • Conference paper
  • 1647 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4903))

Abstract

Highly compressed video bitstreams transmitted over error-prone communications networks can suffer from packet erasures. In order to avoid error-catalyzed artifacts from producing visible corruption of affected video frames, the use of error concealment at the video decoder becomes essential, especially in regard to wireless video transmission which can suffer packet loss more easily due to fluctuating channel conditions. Temporal error concealment techniques are usually successful when there is continuous high correlation between the frames of the coded sequence. The proposed temporal error concealment techniques consist of a novel and unique mathematical model, the optimum regression plane, developed for the repair of damaged motion vectors, and the creation of a framework to perform the variable block size motion compensation based on predictive motion vectors in Laplacian distribution model space for H.264 decoder. Experiments performed using the proposed temporal error concealment method resulted in excellent gains of up to 3.89 dB compared to those of the Joint Model (JM) method for a wide range of benchmark sequences.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wang, Y., Zhu, Q.F.: Error control and concealment for video communication: A review. Proc. IEEE 86(5), 974–997 (1998)

    Article  Google Scholar 

  2. Peng, Q., Yang, T., Zhu, C.: Block-based temporal error concealment for video packet using motion vector extrapolation. In: IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions, vol. 1, pp. 10–14 (June 29 -July 1, 2002)

    Google Scholar 

  3. Haskell, P., Messerschmitt, D.: Resynchronization of motion compensated video affected by ATM cell loss. In: Proc. ICASSP, vol. 3, pp. 545–548 (March 1992)

    Google Scholar 

  4. Agrafiotis, D., Chiew, T.K., Ferr, P., Bull, D.R., Nix, A.R., Doufexi, A., Chung-How, J., Nicholson, D.: Seamless wireless networking for video surveillance applications. In: Proc. SPIE Image Video Commun. Process. (January 2005)

    Google Scholar 

  5. Valente, S., Dufour, C., Groliere, F., Snook, D.: An efficienct error concealment implementation for MPEG-4 video streams. IEEE Transactions on Consumer Electronics 47(3), 568–578 (2001)

    Article  Google Scholar 

  6. Yan, B., Ng, K.W.: A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels. IEEE Transactions on Consumer Electronics 49(4), 1416–1423 (2003)

    Article  Google Scholar 

  7. Zhang, J., Arnold, J.F., Frater, M.R.: A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans. Circuits Syst. Video Technol. 10(4), 659–665 (2000)

    Article  Google Scholar 

  8. Pyun, J.-Y., Lee, J.-S., Jeong, J.-W., Jeong, J.-H., Ko, S.-J.: Robust error concealment for visual communications in burst-packet-loss networks. IEEE Trans. Consum. Electron. 49(4), 1013–1019 (2003)

    Article  Google Scholar 

  9. Tsekeridou, S., Cheikh, F.A., Gabbouj, M., Pitas, I.: Vector rational interpolation schemes for erroneous motion field estimation applied to MPEG-2 error concealment. IEEE Trans. Multimedia 6(6), 876–885 (2004)

    Article  Google Scholar 

  10. Al-Mualla, M.E., Canagarajah, N., Bull, D.R.: Temporal error concealment using motion field interpolation. Electron. Lett. 35, 215–217 (1999)

    Article  Google Scholar 

  11. Al-Mualla, M.E., Canagarajah, C.N., Bull, D.R.: Error concealment using motion field interpolation. In: Int. Conf. Image Processing, vol. 28, pp. 512–516 (October 1998)

    Google Scholar 

  12. Chen, C., Chen, M., Huang, C., Sun, S.: Motion vector based error concealment algorithms. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 425–433. Springer, Heidelberg (2002)

    Google Scholar 

  13. Zheng, J., Chau, L.-P.: Error-concealment algorithm for H.26L using first-order plane estimation. IEEE Trans. Multimedia 6(6), 801–805 (2004)

    Article  Google Scholar 

  14. Zheng, J., Chau, L.-P.: Efficient motion vector recovery algorithm for H.264 based on a polynomial model. IEEE Trans. Multimedia 7(3), 507–513 (2005)

    Article  Google Scholar 

  15. Zheng, J., Chau, L.P.: A motion vector recovery algorithm for digital video using Lagrange interpolation. IEEE Trans. Broadcast. 49(4), 383–389 (2003)

    Article  Google Scholar 

  16. Lam, W.-M., Reibman, A.R.: Recovery of lost or erroneously received motion vectors. In: ICASSP. Proc. Int. Conf. Acoust., Speech Signal Process, pp. V-417-V-420 (1993)

    Google Scholar 

  17. Wang, Y.-K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M.: The error concealment feature in the H.26L test model. In: ICIP. Proc. Int. Conf. Image Processing, pp. 729–732 (2002)

    Google Scholar 

  18. Sullivan, G., Wiegand, T., Lim, K.-P.: Joint model reference encoding methods and decoding concealment methods Doc. JVT-I049 (September 2003)

    Google Scholar 

  19. Xu, Y., Zhou, Y.: H.264 video communication based refined error concealment schemes. IEEE Trans. Consum. Electron. 50(4), 1135–1141 (2004)

    Article  Google Scholar 

  20. Agrafiotis, D., Bull, D.R., Canagarajah, C.N.: Enhanced Error Concealment With Mode Selection. IEEE Trans. Circuits Syst. Video Technology 16(8), 960–973 (2006)

    Article  Google Scholar 

  21. Chen, T.: Refined boundary matching algorithm for temporal error concealment. In: Proc. Packet Video, pp. 875–887 (2002)

    Google Scholar 

  22. Zhu, Q.F., Wang, Y., Shaw, L.: Coding and cell-loss recovery in DCT-based packet video. IEEE Trans. Circuits Syst. Video Technol. 3, 248–258 (1993)

    Article  Google Scholar 

  23. Kuo, Y., Tsao, S.-C.: Error concealment based on overlapping. In: Proc. SPIE, vol. 4671, pp. 146–153 (January 2002)

    Google Scholar 

  24. Suh, J.W., Ho, Y.S.: Directional interpolation for spatial error concealment. In: Int. Conf. Consumer Electronics, pp. 26–27 (June 1997)

    Google Scholar 

  25. Tsekeridou, S., Pitas, I.: MPEG-2 error concealment based on block-matching principles. IEEE Trans. Circuits Syst. Video Technol. 10(4), 646–658 (2000)

    Article  Google Scholar 

  26. Suh, J.W., Ho, Y.S.: Error concealment techniques for digital TV. IEEE Trans. Broadcast. 48(4), 299–306 (2002)

    Article  Google Scholar 

  27. Hsu, C.T., Chen, M.J., Liao, W.-W., Lo, S.-Y.: High-performance spatial and temporal error-concealment algorithms for block-based video coding techniques. ETRI J. 27(1), 53–63 (2005)

    Google Scholar 

  28. Hong, M.C., Scwab, H., Kondi, L., Katsaggelos, A.K.: Error concealment algorithms for compressed video. Signal Process, Image Commun. 14, 473–492 (1999)

    Article  Google Scholar 

  29. Kang, L.W., Leou, J.J.: A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm. J. Vis. Commun. Image Represent. 16(3), 288–310 (2005)

    Article  Google Scholar 

  30. Lee, Y.-C., Altunbasak, Y., Mersereau, R.: Multiframe error concealment for MPEG-coded video delivery over error-prone networks. IEEE Trans. Image Process. 11(11), 1314–1331 (2002)

    Article  Google Scholar 

  31. Park, Y.O., Kim, C.-S., Lee, S.-U.: Multi-hypothesis error concealment algorithm for H.26L video. In: ICIP. Proc. Int. Conf. Image Processing, pp. 465–468 (2003)

    Google Scholar 

  32. Belfiore, S., Grangetto, M., Magli, E., Olmo, G.: Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation. IEEE Trans. Multimedia 7(2), 316–329 (2005)

    Article  Google Scholar 

  33. Baccichet, P., Bagni, D., Chimienti, A., Pezzoni, L., Rovati, F.: Frame concealment for H.264/AVC decoders. IEEE Transactions on Consumer Electronics 51(1), 227–233 (2005)

    Article  Google Scholar 

  34. Wenger, S., Horowitz, M.: Scattered Slices: A New Error Resilience Tool for H.264 (2002), Available: ftp://ftp.imtcfiles.org/jvt-experts/0202_Gen/JVT-B027.doc

  35. Wenger, S.: H.264/AVC over IP. IEEE Trans. Circuit Syst. Video Technol. 13(7), 645–656 (2003)

    Article  Google Scholar 

  36. H.264/AVC Reference Software JM, Available: http://bs.hhi.de/~suehring/tml/

  37. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Working draft number 2, revision 2 (WD-2), Joint Video Team (JVT) (2002)

    Google Scholar 

  38. Kuo, T.Y., Chan, C.H.: Fast Variable Block Size Motion Estimation for H.264 Using Likelihood and Correlation of Motion Field. IEEE Trans. Circuits Syst. Video Technology 16(10), 1185–1195 (2006)

    Article  Google Scholar 

  39. Richard, O.D., Peter, E.H., David, G.K.: Pattern Classification, pp. 46–48. Wiley-Interscience, New York (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Shin’ichi Satoh Frank Nack Minoru Etoh

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Huang, SC., Kuo, SY. (2008). Temporal Error Concealment for H.264 Using Optimum Regression Plane. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77409-9_38

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77407-5

  • Online ISBN: 978-3-540-77409-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics