abstract
Bit allocation with joint temporal-spatial consideration for video coding and motion-compensated frame interpolation at low bit rates is investigated. In contrast with traditional approaches where the frame-rate control and the quantization parameter selection are treated separately, they are jointly optimized in this work. In our framework, an affine warping based on triangular patch is adopted to interpolate skipped frames. Both skipped and coded frames contribute to the operational rate-distortion (R-D) function, and bit allocation is formulated as an optimization problem. A heuristic approach using iterative greedy pruning is proposed to solve this problem. It provides a suboptimal solution at a reasonable complexity. Experimental results show that, with various temporal (frame skipping) and spatial (quantizer) combinations, the proposed algorithm can achieve an average PSNR that is 0.3 ∼ 1.0 dB better than that of ITU-T H.263+/TMN8. Moreover, consistency of visual quality has significantly improved as evidenced by the reduced PSNR variance among frames.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. M. Tekalp, Digital Video Processing, Prentice hall, NJ, 1995.
A. Ortega, Optimization techniques for adaptive quantization of image and video under delay constraints, Ph.D. thesis, Dept. of Electrical Engineering, Columbia University, Jun 1994.
K. Ramchandran, A. Ortega, and M. Vetterli, “Bit allocation for dependent quantization with application to multiresolution and mpeg video coders,” in IEEE Trans. on Image Processing, Septmeber 1994, vol. 3, pp. 533–545.
H. Song, J. Kim, and J. S. Kuo, “Real-time h.263+ frame rate control for low bit rate VBR video,” in Proc. IEEE International Sympposium on Circuits and Systems, 1999, vol 4, pp. 307–310.
E. C. Reed and J. S. Lim, “Multidimensional bit rate control for communication,” in Proc. SPIE, San Diego, CA, July 2000, vol. XXIII, pp. 277–288.
T. Kuo and C.-C. Jay Kuo, “Motion-compensated interpolation for low-bit-rate video quality enhancement,” in Proc. SPIE, Application of Digital Image Processing, 1998, vol. 3460, pp. 277–288.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, S., Kim, J., Kuo, C.C.J. (2001). Bit Allocation for Video Coding with Temporal-Spatial Tradeoff. In: Shum, HY., Liao, M., Chang, SF. (eds) Advances in Multimedia Information Processing — PCM 2001. PCM 2001. Lecture Notes in Computer Science, vol 2195. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45453-5_60
Download citation
DOI: https://doi.org/10.1007/3-540-45453-5_60
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42680-6
Online ISBN: 978-3-540-45453-3
eBook Packages: Springer Book Archive