Abstract
Highly compressed video bitstreams transmitted over error-prone communications networks can suffer from packet erasures. In order to avoid error-catalyzed artifacts from producing visible corruption of affected video frames, the use of error concealment at the video decoder becomes essential, especially in regard to wireless video transmission which can suffer packet loss more easily due to fluctuating channel conditions. Temporal error concealment techniques are usually successful when there is continuous high correlation between the frames of the coded sequence. The proposed temporal error concealment techniques consist of a novel and unique mathematical model, the optimum regression plane, developed for the repair of damaged motion vectors, and the creation of a framework to perform the variable block size motion compensation based on predictive motion vectors in Laplacian distribution model space for H.264 decoder. Experiments performed using the proposed temporal error concealment method resulted in excellent gains of up to 3.89 dB compared to those of the Joint Model (JM) method for a wide range of benchmark sequences.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Wang, Y., Zhu, Q.F.: Error control and concealment for video communication: A review. Proc. IEEE 86(5), 974–997 (1998)
Peng, Q., Yang, T., Zhu, C.: Block-based temporal error concealment for video packet using motion vector extrapolation. In: IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions, vol. 1, pp. 10–14 (June 29 -July 1, 2002)
Haskell, P., Messerschmitt, D.: Resynchronization of motion compensated video affected by ATM cell loss. In: Proc. ICASSP, vol. 3, pp. 545–548 (March 1992)
Agrafiotis, D., Chiew, T.K., Ferr, P., Bull, D.R., Nix, A.R., Doufexi, A., Chung-How, J., Nicholson, D.: Seamless wireless networking for video surveillance applications. In: Proc. SPIE Image Video Commun. Process. (January 2005)
Valente, S., Dufour, C., Groliere, F., Snook, D.: An efficienct error concealment implementation for MPEG-4 video streams. IEEE Transactions on Consumer Electronics 47(3), 568–578 (2001)
Yan, B., Ng, K.W.: A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels. IEEE Transactions on Consumer Electronics 49(4), 1416–1423 (2003)
Zhang, J., Arnold, J.F., Frater, M.R.: A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans. Circuits Syst. Video Technol. 10(4), 659–665 (2000)
Pyun, J.-Y., Lee, J.-S., Jeong, J.-W., Jeong, J.-H., Ko, S.-J.: Robust error concealment for visual communications in burst-packet-loss networks. IEEE Trans. Consum. Electron. 49(4), 1013–1019 (2003)
Tsekeridou, S., Cheikh, F.A., Gabbouj, M., Pitas, I.: Vector rational interpolation schemes for erroneous motion field estimation applied to MPEG-2 error concealment. IEEE Trans. Multimedia 6(6), 876–885 (2004)
Al-Mualla, M.E., Canagarajah, N., Bull, D.R.: Temporal error concealment using motion field interpolation. Electron. Lett. 35, 215–217 (1999)
Al-Mualla, M.E., Canagarajah, C.N., Bull, D.R.: Error concealment using motion field interpolation. In: Int. Conf. Image Processing, vol. 28, pp. 512–516 (October 1998)
Chen, C., Chen, M., Huang, C., Sun, S.: Motion vector based error concealment algorithms. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 425–433. Springer, Heidelberg (2002)
Zheng, J., Chau, L.-P.: Error-concealment algorithm for H.26L using first-order plane estimation. IEEE Trans. Multimedia 6(6), 801–805 (2004)
Zheng, J., Chau, L.-P.: Efficient motion vector recovery algorithm for H.264 based on a polynomial model. IEEE Trans. Multimedia 7(3), 507–513 (2005)
Zheng, J., Chau, L.P.: A motion vector recovery algorithm for digital video using Lagrange interpolation. IEEE Trans. Broadcast. 49(4), 383–389 (2003)
Lam, W.-M., Reibman, A.R.: Recovery of lost or erroneously received motion vectors. In: ICASSP. Proc. Int. Conf. Acoust., Speech Signal Process, pp. V-417-V-420 (1993)
Wang, Y.-K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M.: The error concealment feature in the H.26L test model. In: ICIP. Proc. Int. Conf. Image Processing, pp. 729–732 (2002)
Sullivan, G., Wiegand, T., Lim, K.-P.: Joint model reference encoding methods and decoding concealment methods Doc. JVT-I049 (September 2003)
Xu, Y., Zhou, Y.: H.264 video communication based refined error concealment schemes. IEEE Trans. Consum. Electron. 50(4), 1135–1141 (2004)
Agrafiotis, D., Bull, D.R., Canagarajah, C.N.: Enhanced Error Concealment With Mode Selection. IEEE Trans. Circuits Syst. Video Technology 16(8), 960–973 (2006)
Chen, T.: Refined boundary matching algorithm for temporal error concealment. In: Proc. Packet Video, pp. 875–887 (2002)
Zhu, Q.F., Wang, Y., Shaw, L.: Coding and cell-loss recovery in DCT-based packet video. IEEE Trans. Circuits Syst. Video Technol. 3, 248–258 (1993)
Kuo, Y., Tsao, S.-C.: Error concealment based on overlapping. In: Proc. SPIE, vol. 4671, pp. 146–153 (January 2002)
Suh, J.W., Ho, Y.S.: Directional interpolation for spatial error concealment. In: Int. Conf. Consumer Electronics, pp. 26–27 (June 1997)
Tsekeridou, S., Pitas, I.: MPEG-2 error concealment based on block-matching principles. IEEE Trans. Circuits Syst. Video Technol. 10(4), 646–658 (2000)
Suh, J.W., Ho, Y.S.: Error concealment techniques for digital TV. IEEE Trans. Broadcast. 48(4), 299–306 (2002)
Hsu, C.T., Chen, M.J., Liao, W.-W., Lo, S.-Y.: High-performance spatial and temporal error-concealment algorithms for block-based video coding techniques. ETRI J. 27(1), 53–63 (2005)
Hong, M.C., Scwab, H., Kondi, L., Katsaggelos, A.K.: Error concealment algorithms for compressed video. Signal Process, Image Commun. 14, 473–492 (1999)
Kang, L.W., Leou, J.J.: A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm. J. Vis. Commun. Image Represent. 16(3), 288–310 (2005)
Lee, Y.-C., Altunbasak, Y., Mersereau, R.: Multiframe error concealment for MPEG-coded video delivery over error-prone networks. IEEE Trans. Image Process. 11(11), 1314–1331 (2002)
Park, Y.O., Kim, C.-S., Lee, S.-U.: Multi-hypothesis error concealment algorithm for H.26L video. In: ICIP. Proc. Int. Conf. Image Processing, pp. 465–468 (2003)
Belfiore, S., Grangetto, M., Magli, E., Olmo, G.: Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation. IEEE Trans. Multimedia 7(2), 316–329 (2005)
Baccichet, P., Bagni, D., Chimienti, A., Pezzoni, L., Rovati, F.: Frame concealment for H.264/AVC decoders. IEEE Transactions on Consumer Electronics 51(1), 227–233 (2005)
Wenger, S., Horowitz, M.: Scattered Slices: A New Error Resilience Tool for H.264 (2002), Available: ftp://ftp.imtcfiles.org/jvt-experts/0202_Gen/JVT-B027.doc
Wenger, S.: H.264/AVC over IP. IEEE Trans. Circuit Syst. Video Technol. 13(7), 645–656 (2003)
H.264/AVC Reference Software JM, Available: http://bs.hhi.de/~suehring/tml/
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Working draft number 2, revision 2 (WD-2), Joint Video Team (JVT) (2002)
Kuo, T.Y., Chan, C.H.: Fast Variable Block Size Motion Estimation for H.264 Using Likelihood and Correlation of Motion Field. IEEE Trans. Circuits Syst. Video Technology 16(10), 1185–1195 (2006)
Richard, O.D., Peter, E.H., David, G.K.: Pattern Classification, pp. 46–48. Wiley-Interscience, New York (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huang, SC., Kuo, SY. (2008). Temporal Error Concealment for H.264 Using Optimum Regression Plane. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-77409-9_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77407-5
Online ISBN: 978-3-540-77409-9
eBook Packages: Computer ScienceComputer Science (R0)