Video Coding pp 79-123 | Cite as

Coding-Oriented Segmentation of Video sequences

  • Ferran Marqués
  • Montse Pardàs
  • Philippe Salembier


The importance of developing coding-oriented spatial segmentation techniques is stated. The specific problems of image sequence segmentation for coding purposes are analyzed. In order to both overcome such problems and improve the performance of segmentation-based coding schemes, a general segmentation structure is defined. This structure has five main steps: Partition projection, Image modeling, Image simplification, Marker extraction and Decision. In order to validate it, two different implementations of this structure are presented. The first utilizes a compound random field as image sequence model whereas the second relies on morphological tools.


Motion Estimation Segmentation Procedure Final Partition Gaussian Pyramid Homogeneity Criterion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    J. K. Aggarwal and W. N. Martin. Analizing dynamic scenes containing multiple moving objects. In T. S. Huang, editor, Image sequence analysis, pages 355–380. New York, 1981.Google Scholar
  2. [2]
    F. Bartolini, V. Capellini, A. Mecocci, and R. Vagheggi. A segmentation-based motion-compensated scheme for low-rate video coding. In Proceedings of the First IEEE International Conference on Image Processing, volume II, pages 457–461, Texas, U.S.A., November 1994.CrossRefGoogle Scholar
  3. [3]
    J. Benois, L. Wu, and D. Barba. Joint contour-based and motion-based image sequences segmentation for TV image coding at low bit rate. In Visual Communication and Image Processing, pages 1074–1085, Chicago, USA, September 1994.Google Scholar
  4. [4]
    M. Bertero, T. A. Poggio, and V. Torre. Ill-posed problems in early vision. Proceedings of the IEEE, 76:869–887, 1988.CrossRefGoogle Scholar
  5. [5]
    J. Besag. Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Royal Statisc. Soc, series B, 34:75–83, 1972.MathSciNetMATHGoogle Scholar
  6. [6]
    S. Beucher and F. Meyer. The morphological approach to segmentation: the watershed transformation. In E. Dougherty, editor, Mathematical morphology in image processing, chapter 12, pages 433–481. Marcel Dekker, 1993.Google Scholar
  7. [7]
    P. Bouthemy and E. François. Motion segmentation and qualitative dynamic scene analysis from an image sequence. International Journal of Computer Vision, 10(2):157–182, 1993.CrossRefGoogle Scholar
  8. [8]
    P. J. Burt and E. Adelson. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31:532–540, 1983.CrossRefGoogle Scholar
  9. [9]
    R. Chellappa and A. Jain. Markov random fields. Theory and application. Academic Press, Inc., 1993.Google Scholar
  10. [10]
    D. Cortez, P. Nunes, M. M. de Sequeira, and F. Pereira. Image segmentation towards new image representation methods. EURASIP Image Communication, 6(6):485–498, February 1995.Google Scholar
  11. [11]
    J. Crespo. Morphological connected filters and intra-region smoothing for image segmentation. PhD thesis, School of Electrical Engineering, Georgia Institute of Technology, 1993.Google Scholar
  12. [12]
    H. Derin and P. Kelly. Discrete-index Markov-type random processes. Proceedings IEEE, 77:1485–1510, 1989.CrossRefGoogle Scholar
  13. [13]
    S. Geman and D. Geman. Stochastic relaxation, Gibbs distributions, and Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(6):721–741, November 1984.MATHCrossRefGoogle Scholar
  14. [14]
    C. Gu and M. Kunt. 3D contour image sequence coding based on morphological filters and motion compensation. In International Workshop on Coding Techniques for Very Low Bit-rate Video, Colchester, U.K., April 1994.Google Scholar
  15. [15]
    C. Gu and M. Kunt. Very low bit-rate video coding using multi-criterion segmentation. In First IEEE International Conference on Image Processing, volume II, pages 418–422, Texas, U.S.A., November 1994.Google Scholar
  16. [16]
    R. M. Haralick and L.G. Shapiro. Image segmentation techniques. Computer Vision, Graphics and Image Processing, 29:100–132, January 1985.CrossRefGoogle Scholar
  17. [17]
    R. Jain and A.K. Jain. Displacement measurement and its application in interframe coding. IEEE Transactions on Communications, 29(12):1799–1808, 1981.CrossRefGoogle Scholar
  18. [18]
    F. C. Jeng and J. W. Woods. Compound GaussMarkov random fields for image estimation. IEEE Trans, on Signal Processing, 39:683–697, 1991.CrossRefGoogle Scholar
  19. [19]
    ISO/IEC JTC1/SC29/WG11. MPEG-4 Proposal Package Description (PPD). July 1995.Google Scholar
  20. [20]
    M. Kocher and M. Kunt. A contour-texture approach to picture coding. In Proc. of the 1982 IEEE Int. Conf. on Acoustics, Speech and Signal Processing, pages 436–440, Paris, France, May 1982.CrossRefGoogle Scholar
  21. [21]
    M. Kunt, A. Ikonomopoulos, and M. Kocher. Second generation image coding techniques. Proceedings of the IEEE, 73(4):549–575, April 1985.CrossRefGoogle Scholar
  22. [22]
    C. Lantuejoul and F. Maisonneuve. Geodesic methods in image analysis. Pattern Recognition, 17(2): 117–187, 1984.MathSciNetCrossRefGoogle Scholar
  23. [23]
    W. Li and M. Kunt. Morphological segmentation applied to displaced frame difference coding. EURASIP Signal Processing, 38(l):45–56, September 1994.MATHGoogle Scholar
  24. [24]
    B. Marcotegui, J. Crespo, and F. Meyer. Morphological segmentation using texture and coding cost. In IEEE Workshop on Nonlinera Signal and Image Processing, pages 246–249, Halkidiki, Greece, June 1995.Google Scholar
  25. [25]
    B. Marcotegui and F. Meyer. Morphological segmentation of image sequences. In J. Serra and P. Soille, editors, Mathematical morphology and its applications to image processing, pages 101–108. Kluwer Academic Publishers, 1994.CrossRefGoogle Scholar
  26. [26]
    F. Marqués, J. Cunillera, and A. Gasull. Unsupervised segmentation controlled oc. IEEE Int. Conf. Acoust., Speech and Signal Processing, pages 5.17–5.20, May 1993.Google Scholar
  27. [27]
    F. Marqués, A. Gasull, T. Reed, and M. Kunt. Coding-oriented segmentation based on Gibbs-Markov random fields and human visual system knowledge. In Proc. IEEE Int. Conf. Acoust., Speech and Signal Processing, pages 2749–2752, May 1991.Google Scholar
  28. [28]
    F. Marqués, V. Vera, and A. Gasull. A hierarchical image sequence model for segmentation: Application to object-based sequence coding. In Proc. SPIE Visual Communication and Signal Processing-94 Conference, pages 554–563, Oct 1994.Google Scholar
  29. [29]
    R. Mester and U. Franke. Statistical model based image segmentation using region growing, edge relaxation and classification. In T. R. Hsing, editor, Visual Communications and Image Processing ‘88, pages 616–624, Cambridge, Massachuset, November 9–11 1988.Google Scholar
  30. [30]
    F. Meyer and S. Beucher. Morphological segmentation. Journal of Visual Communication and Image Representation, l(l):21–46, September 1990.CrossRefGoogle Scholar
  31. [31]
    H.G. Musmann, M. Hotter, and J. Ostermann. Object-oriented analysis-synthesis coding of moving images. Signal Processing, Image Communications, 1(2):117–138, October 1989.CrossRefGoogle Scholar
  32. [32]
    R. Nevatia. Image segmentation. In T. Y. Young and K. S. Fu, editors, Handbook of Pattern Recognition and Image Processing, chapter 9, pages 215–231. Academic Press, New York, 1986.Google Scholar
  33. [33]
    M. Pardàs and P. Salembier. 3D morphological segmentation and motion estimation for image sequences. EURASIP Signal Processing, 38(l):31–43, September 1994.Google Scholar
  34. [34]
    M. Pardàs and P. Salembier. Joint region and motion estimation with morphological tools. In J. Serra and P. Soille, editors, Second Workshop on Mathematical Morphology and its Applications to Signal Processing, Fontainebleau, France, September 1994. Kluwer Academic Press.Google Scholar
  35. [35]
    M. Pardàs and P. Salembier. Time-recursive segmentation of image sequences. In EURASIP, editor, EUSIPCO 94, VII European Signal Processing Conference, pages 18–21, Edinburgh, U.K., September 13–16 1994.Google Scholar
  36. [36]
    T. Pavlidis. Structural Pattern Recognition, chapter 4. Springer-Verlag, New York, 1977.Google Scholar
  37. [37]
    S. Rajala, M. Civanlar, and W. Lee. Video data compression using three-dimensional segmentation based on HVS properties. In International Conference on Acoustics, Speech and Signal Processing, pages 1092–1095, New York (NY), USA, 1988.Google Scholar
  38. [38]
    P. Salembier. Morphological multiscale segmentation for image coding. EURASIP Signal Processing, 38(3):359–386, September 1994.Google Scholar
  39. [39]
    P. Salembier and M. Pardàs. Hierarchical morphological segmentation for image sequence coding. IEEE Transactions on Image Processing, 3(5):639–651, Sept. 1994.CrossRefGoogle Scholar
  40. [40]
    P. Salembier and J. Serra. Flat zones filtering, connected operators and filters by reconstruction. IEEE Transactions on Image Processing, 3(8):1153–1159, August 1995.CrossRefGoogle Scholar
  41. [41]
    P. Salembier, L. Torres, F. Meyer, and C. Gu. Region-based video coding using mathematical morphology. Proceedings of IEEE (invited paper), 83(6):843–857, June 1995.CrossRefGoogle Scholar
  42. [42]
    H. Sanson. Joint estimation and segmentation of motion video coding at very low bitrates. In Proc. COST 21 Iter European Workshop on New Techniques for Coding of Video Signals at Very Low Bitrates, pages 2.2.1–2.2.8, Dec 1993.Google Scholar
  43. [43]
    J. Serra. Image Analysis and Mathematical Morphology. Academic Press, 1982.MATHGoogle Scholar
  44. [44]
    J. Serra. Image Analysis and Mathematical Morphology, Vol II: Theoretical advances. Academic Press, 1988.Google Scholar
  45. [45]
    I. Sezan and R. L. Lagendijk. Motion Analysis and Image Sequence Processing. Kluwer Academic Publishers, Boston, 1993.CrossRefGoogle Scholar
  46. [46]
    M. Soryani and R. J. Clarke. Coding colour image sequences by segmentation of difference frames and motion-adaptive frame interpolation. In Picture Coding Symposium, page 2.7, Cambridge, MA, March 1990.Google Scholar
  47. [47]
    G. Tziritas and C. Labit. Motion Analysis for Image Sequence Coding. Elsevier Science B. V., The Netherlands, 1994.Google Scholar
  48. [48]
    L. Vincent. Grayscale area openings and closings, their efficient implementation and applications. In J. Serra and P. Salembier, editors, First Workshop on Mathematical Morphology and its Applications to Signal Processing, pages 22–27, Barcelona, Spain, May 1993. UPC.Google Scholar
  49. [49]
    P. Willemin, T. Reed, and M. Kunt. Image sequence coding by split and merge. IEEE Transactions on Communications, 39(12): 1845–1855, 1991.CrossRefGoogle Scholar
  50. [50]
    R. Wilson and M. Spann. Image segmentation and uncertainty. Research Studies Press Ltd., Letchmore, Hertfordshire, England, 1988.Google Scholar

Copyright information

© Kluwer Academic Publishers Boston 1996

Authors and Affiliations

  • Ferran Marqués
    • 1
  • Montse Pardàs
    • 1
  • Philippe Salembier
    • 1
  1. 1.Department of Signal Theory and CommunicationsUniversitat Politècnica de CatalunyaBarcelonaSpain

Personalised recommendations