Use of object articulation and motion estimation for video production

  • Ioannis Kompatsiaris
  • Dimitrios Tzovaras
  • Michael G. Strintzis
Coded Representation
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1242)


This paper describes a procedure for stereo video production using model-based processing of both left and right channels of a stereoscopic image sequence. The proposed scheme uses an original video and the first / basic frame of a video to be produced according to the original one. A 3D model is created first for both the original and the basic images using consistent depth information. Robust classification techniques are then used to obtain an articulated description of the foreground of the scene (head, neck, shoulders). The object articulation procedure is based on a novel scheme for the segmentation of the rigid 3D motion fields of the triangle patches of the 3D model object. This procedure is applied for both the original and basic images resulting to corresponding sub-objects of the two images. The rigid 3D motion is then re-computed for each sub-object of the original image sequence and finally, the motion parameters produced for each sub-object of the original video are applied to the corresponding sub-objects of the first image of the video to be produced. The model of the produced image is moved according to the original one and the result is a new video with the same motion but different shape, size and texture than the original one. The described method is demonstrated over two stereoscopic videoconference image sequences.


Stereo video production model-based processing object articulation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [TZO97]
    D. Tzovaras, N. Grammalidis, and M. G. Strintzis, “Object-Based Coding of Stereo Image Sequences using Joint 3-D Motion/Disparity Compensation∝, IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, Apr. '97.Google Scholar
  2. [LIU93]
    J. Liu and R. Skerjanc, “Stereo and Motion Correspondence in a Sequence of Stereo Images∝, Signal Processing: Image Communication, vol. 4, pp. 305–18, Oct. '93.Google Scholar
  3. [OST89]
    J. Ostermann, “Object-Based Analysis-Synthesis Coding based on the source model of moving rigid 3D objects∝, Signal Processing: Image Communication}, vol. 6, pp. 143–161, May '89.Google Scholar
  4. [IZQ95]
    E. Izquierdo and M. Ernst, “Motion/Disparity Analysis for 3D-Video-Conference Applications∝, in Proc. Int. Workshop Stereoscopic and 3D Imaging (M. G. Strintzis. et al., editor), (Santorini, Greece), pp. 180–6, Sep.'95.Google Scholar
  5. [MUS89]
    H. G. Mussman, M. Hotter, and J. Ostermann, “Object-Oriented Analysis-Synthesis Coding of Moving Images∝, Signal Processing: Image Communication, vol. 1, pp. 117–138, Oct. '89.Google Scholar
  6. [TAM93]
    A. Tamtaoui and C. Labit, “Symmetrical Stereo Matching for 3DTV Sequence Coding∝, in Picture Coding Symposium (PCS '93), Mar. 93.Google Scholar
  7. [PAP94]
    D. V. Papadimitriou, “Stereo in Model-Based Image Coding∝, in Int'l Workshop on Coding Techniques for Very Low Bit-rate Video (VLBV 94), (Colchester), p. 3–7, Apr. '94.Google Scholar
  8. [TZO96]
    D. Tzovaras, N. Grammalidis, and M. G. Strintzis, “3-D Motion/ Disparity Segmentation for Object-Based Image Sequence Coding∝, Optical Engineering, special issue on Visual Communications and Image Processing, vol. 35, pp. 137–145, Jan. '96.Google Scholar
  9. [MPEG4]
    “MPEG-4 project description ISO/IEC JTC1/SC29/WG11 N1410∝, Chicago MPEG Meeting, Oct. '96.Google Scholar
  10. [MAR94]
    G. Martinez, “A robust algorithm for 3D motion estimation of an small surface patch of a 3D object∝, in Workshop in Image Analysis and Synthesis in Image Coding, (Berlin, D), pp. D1.1–D1.4, Oct. '94.Google Scholar
  11. [MAR95]
    G. Martinez, “Motion Estimation of Articulated 3D Objects for Object-Based Analysis-Synthesis Coding (OBASC)∝, in International Workshop on Coding Techniques for Very Low Bit-rate Video, (Shinagawa, Tokyo, Japan), pp. 8–10, Nov. '95.Google Scholar
  12. [BUS89]
    H. Busch, “Subdividing Non-rigid 3D Objects into Quasi-Rigid Parts, in IEE 3rd Int. Conf. on Im. Proc., (Warwick, UK), pp. 1–4, July 1989.Google Scholar
  13. [TZO95]
    D. Tzovaras, N. Grammalidis, and M. G. Strintzis, “Depth Map Coding for Stereo and Multiview Image Sequence Transmission∝, in Int'l Workshop on Stereoscopic and 3D Imaging (IWS3DI'95), (Santorini, Greece), pp. 75–80, Sep. '95.Google Scholar
  14. [PAN94]
    S. Panis and M. Ziegler, “Object Based Coding Using Motion and Stereo Information∝, in Proc. Picture Coding Symposium (PCS '94), (Sacramento, California), pp. 308–312, Sep. '94.Google Scholar
  15. [COX92]
    L.Ji Cox, S. Hingorani, B. M. Maggs, and S. B. Rao, “Stereo Without Regularization∝, tech. rep., NEC Research Institute, Princeton, USA, Oct. '92.Google Scholar
  16. [MAL93]
    S. Malassiotis and M. G. Strintzis, “Optimal 3D mesh object modeling for depth estimation from stereo images∝, in Proc. 4th European Workshop on 3D Television, (Rome), Oct. '93.Google Scholar
  17. [TZO96a]
    D. Tzovaras, I. Kompatsiaris, and M. G. Strintzis, “3D Object Articulation and Motion Estimation in Model-Based Stereoscopic Videoconference Image Sequence Coding∝, submitted for publication in Signal Processing: Image Communication, Nov. '96.Google Scholar
  18. [FAL95]
    L. Falkenhagen, “3D Object-based Depth Estimation From Stereoscopic Image Sequences∝, in Proc. Int'l Workshop on Stereoscopic and 3D Imaging '95, (Santorini, GR), pp.81–86, Sep. '95.Google Scholar
  19. [ADI85]
    G. Adiv, “Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects∝, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 7, pp. 384–401, Jul. '85Google Scholar
  20. [SIN92]
    S. S. Sinha and B. G. Schunck, “A Two-Stage Algorithm for Discontinuity-Preserving Surface Reconstruction, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 14, Jan. '92.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Ioannis Kompatsiaris
    • 1
  • Dimitrios Tzovaras
    • 1
  • Michael G. Strintzis
    • 1
  1. 1.Information Processing Laboratory, Electrical and Computer Engineering DepartmentAristotle University of ThessalonikiThessalonikiGreece

Personalised recommendations