Abstract
An image warping technique based on segmented regions is introduced for the temporal prediction of videophone-type sequences. At the encoder, a set of control points are determined from the previous frame and their corresponding best matched points are determined from the current frame. The selection process of these points is achieved by segmenting the previous frame into different regions using a color segmentation technique based on a recursive histogramming approach and the control points are subsequently chosen along the region boundaries. The spatial offset of these points between the previous and current frame are represented as motion vectors. The facial area is intraframe encoded to avoid distortions of the facial features which convey critical information. At the decoder, the same segmentation and control point selection algorithm is used along with the motion vectors in order to find the region boundaries of the predicted frame. The facial area is decoded and an affine transformation is finally used to determine the remaining regions and form the predicted frame. This technique produces results that are free from blocking artifacts as in the conventional block matching method, with only a moderate increase in computational complexity.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full chapter text
Chapter PDF
References
L. Chiariglione, ‘MPEG and Multimedia Communications', IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 1, pp. 5–18, February 1997.
H.G. Musmann, M. Hotter, J. Ostermann, ‘Object-oriented analysis-synthesis coding of moving objects', Signal Processing: Image Communication, Vol. 1, No. 2, pp. 117–138, October 1989.
M. Hotter, ‘Object-oriented analysis-synthesis coding based on moving two-dimensional objects', Signal Processing: Image Communication, Vol. 2, No. 4, pp. 409–428, December 1990.
J. Nieweglowski, J. Campbell, P. Haavisto, ‘A novel video coding scheme based on temporal prediction using digital image warping', IEEE Trans. on Consumer Electronics, Vol. 39, no. 3, pp. 141–150, 1993.
G. Sullivan, ‘Motion Compensation for video compression using control grid interpolation', IEEE Int. Conf. on ASSP, pp. 2713–2716, 1991.
V. Seferidis, M. Chanbari, ‘Generalized block matching motion estimation', Visual Communications and Image Processing, SPIE Vol. 1818, pp. 110–119, 1992.
J. Nieweglowski, T. Moisala, P. Haavisto, ‘Motion compensated video sequence interpolation using digital image warping', IEEE Int. Conf. on ASSP, Vol. 5, pp. 205–208, 1994.
N. Herodotou, A.N. Venetsanopoulos, ‘Image Segmentation for Facial Image Coding of Videophone Sequences', 13th International Conference on Digital Signal Processing, Santorini, Greece, July 1997.
R. Ohlander, K. Price, D.R. Reddy ‘Picture Segmentation Using a Recursive Region Splitting Method', Computer Graphics and Image Processing Vol. 8, pp. 313–333, 1978.
A. Witkin, 'scale-space Filtering', Proceedings IJCAI-83, pp. 1019–1022, Aug 1983.
G. Wolberg ‘Digital image warping', IEEE Computer Society Press, Los Alamitos, California, 1990.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Herodotou, N., Venetsanopoulos, A.N. (1997). Temporal prediction of video sequences using an image warping technique based on color segmentation. In: Del Bimbo, A. (eds) Image Analysis and Processing. ICIAP 1997. Lecture Notes in Computer Science, vol 1310. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63507-6_237
Download citation
DOI: https://doi.org/10.1007/3-540-63507-6_237
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63507-9
Online ISBN: 978-3-540-69585-1
eBook Packages: Springer Book Archive