Temporal prediction of video sequences using an image warping technique based on color segmentation

  • N. Herodotou
  • A. N. Venetsanopoulos
Poster Session B: Active Vision, Motion, Shape, Stereo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1310)


An image warping technique based on segmented regions is introduced for the temporal prediction of videophone-type sequences. At the encoder, a set of control points are determined from the previous frame and their corresponding best matched points are determined from the current frame. The selection process of these points is achieved by segmenting the previous frame into different regions using a color segmentation technique based on a recursive histogramming approach and the control points are subsequently chosen along the region boundaries. The spatial offset of these points between the previous and current frame are represented as motion vectors. The facial area is intraframe encoded to avoid distortions of the facial features which convey critical information. At the decoder, the same segmentation and control point selection algorithm is used along with the motion vectors in order to find the region boundaries of the predicted frame. The facial area is decoded and an affine transformation is finally used to determine the remaining regions and form the predicted frame. This technique produces results that are free from blocking artifacts as in the conventional block matching method, with only a moderate increase in computational complexity.


Control Point Video Sequence Motion Vector Current Frame Side Information 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    L. Chiariglione, ‘MPEG and Multimedia Communications', IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 1, pp. 5–18, February 1997.Google Scholar
  2. 2.
    H.G. Musmann, M. Hotter, J. Ostermann, ‘Object-oriented analysis-synthesis coding of moving objects', Signal Processing: Image Communication, Vol. 1, No. 2, pp. 117–138, October 1989.Google Scholar
  3. 3.
    M. Hotter, ‘Object-oriented analysis-synthesis coding based on moving two-dimensional objects', Signal Processing: Image Communication, Vol. 2, No. 4, pp. 409–428, December 1990.Google Scholar
  4. 4.
    J. Nieweglowski, J. Campbell, P. Haavisto, ‘A novel video coding scheme based on temporal prediction using digital image warping', IEEE Trans. on Consumer Electronics, Vol. 39, no. 3, pp. 141–150, 1993.Google Scholar
  5. 5.
    G. Sullivan, ‘Motion Compensation for video compression using control grid interpolation', IEEE Int. Conf. on ASSP, pp. 2713–2716, 1991.Google Scholar
  6. 6.
    V. Seferidis, M. Chanbari, ‘Generalized block matching motion estimation', Visual Communications and Image Processing, SPIE Vol. 1818, pp. 110–119, 1992.Google Scholar
  7. 7.
    J. Nieweglowski, T. Moisala, P. Haavisto, ‘Motion compensated video sequence interpolation using digital image warping', IEEE Int. Conf. on ASSP, Vol. 5, pp. 205–208, 1994.Google Scholar
  8. 8.
    N. Herodotou, A.N. Venetsanopoulos, ‘Image Segmentation for Facial Image Coding of Videophone Sequences', 13th International Conference on Digital Signal Processing, Santorini, Greece, July 1997.Google Scholar
  9. 9.
    R. Ohlander, K. Price, D.R. Reddy ‘Picture Segmentation Using a Recursive Region Splitting Method', Computer Graphics and Image Processing Vol. 8, pp. 313–333, 1978.Google Scholar
  10. 10.
    A. Witkin, 'scale-space Filtering', Proceedings IJCAI-83, pp. 1019–1022, Aug 1983.Google Scholar
  11. 11.
    G. Wolberg ‘Digital image warping', IEEE Computer Society Press, Los Alamitos, California, 1990.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • N. Herodotou
    • 1
  • A. N. Venetsanopoulos
    • 1
  1. 1.Digital Signal & Image Processing Laboratory Department of Electrical and Computer EngineeringUniversity of TorontoTorontoCanada

Personalised recommendations