Abstract
The lifting-based discrete wavelet transforms applied temporally along the motion trajectory is a powerful tool in scalable video compression. The longer filter is used for motion-compensated temporal filtering (MCTF) for better de-correlation. The bidirectional motion estimation (ME) used for MCTF is the major speed bottleneck. This paper propose two stages motion predictive technique to optimize the ME. In the first stage, zero motion block prediction is carried out using the content of high frequency frame, obtained after TF without motion compensation. In the second stage, the inter-frame and inter-layer prediction technique is applied to skip the coarse search of any fast ME, except for the first pair of frames in a group of pictures. The proposed algorithm is implemented in MC-EZBC. The variations observed in objective or subjective quality of the decoded video is negligible compared to the speed gained.
Similar content being viewed by others
References
Schwarz, H., Marpe, D., Wiegand, T.: Overview of scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)
Taubman, D.: Successive refinement of video: fundamental issues, past efforts and new directions. In: International Symposium on Visual Communications and Image Processing (VCIP2003), SPIE, vol. 5150, pp. 791–805
Mehrseresht, N., Taubman, D.: An efficient content-adaptive motion compensated 3-D DWT with enhanced spatial and temporal Scalability. IEEE Trans Image Process. 15(6), 1397–1412 (2006)
Andreopoulis, Y., Munteanu, A., Barbarien, J., Schaar, M. van der: In-band motion compensated temporal filtering. Signal Process. Image Commun. 19(7), 653–673 (2004)
Zgaljic, T., Sprljan, N., Izquierdo, E.: Bit-stream allocation methods for scalable video coding supporting wireless communications. Signal Process. Image Commun. 22, 298–316 (2007)
Girod, B.: The efficiency of motion-compensating prediction for hybrid coding of video sequences. IEEE J. Sel. Areas Commun. 5, 1140–1154 (1987)
Jain, J., Jain, A.: Displacement measurement and its application in inter frame image coding. IEEE Trans. Commun. 29, 1799–1808 (1981)
Li, R., Zeng, B., Liou, M.L.: A new three-step search algorithm for block motion estimation IEEE Trans. Circuits Syst. Video Technol. 4, 438–442 (1994)
Po, L.M., Ma, W.C.: A novel four step search algorithm for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 6, 313–317 (1996)
Zhu, S., Ma, K.K.: A new diamond search algorithm for fast block matching motion estimation. IEEE Trans. Image Process. 9, 287–290 (2000)
Koga, T., Linuma, K.: Motion compensated inter-frame coding for video conferencing. In: Proceedings of National Telecommunication Conference (NTC), pp. G5.3.1–G5.3.5 (1981)
Zhu, C., Lin, X., Chau, L.-P.: Hexagon-based search pattern for fast block motion estimation. IEEE Trans. Circuit Syst. Video Technol. 12, 349–355 (2002)
Secker, A., Taubman, D.: Lifting-based invertible motion adaptive transform (LIMAT) frame work for highly scalable video compression. IEEE Trans. Image Process. 12(12), 1530–1542 (2004)
Ohm, J.R.: Multimedia Communication Technology: Representation, Transmission and Identification of Multimedia Signals. Springer, Berlin (2004)
Cheung, C.-H., Po, L.-M.: A novel cross-diamond search algorithm for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 12(12), 1168–1177 (2002)
Chen, P., Woods, J.W.: Bi-directional MC-EZBC with lifting implementation. IEEE Trans. Circuits Syst. Video Technol. 14(10), 1183–1194 (2004)
Acknowledgments
Authors are thankful to Dr. John W. Woods, Professor and Director Center for Next Generation Video, Department of Electrical, Computer and Systems Engineering, of Rensselaer Polytechnic Institute, for providing MC-EZBC for academic usage.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Karunakar, A.K., Pai, M.M.M. Motion-compensated temporal filtering with optimized motion estimation. J Real-Time Image Proc 4, 329–338 (2009). https://doi.org/10.1007/s11554-009-0129-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-009-0129-x