A Multi-Layer MRF Model for Video Object Segmentation

  • Zoltan Kato
  • Ting-Chuen Pong
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3852)


A novel video object segmentation method is proposed which aims at combining color and motion information. The model has a multi-layer structure: Each feature has its own layer, called feature layer, where a classical Markov random field (MRF) image segmentation model is defined using only the corresponding feature. A special layer is assigned to the combined MRF model, called combined layer, which interacts with each feature layer and provides the segmentation based on the combination of different features. Unlike previous methods, our approach doesn’t assume motion boundaries being part of spatial ones. Therefore a very important property of the proposed method is the ability to detect boundaries that are visible only in the motion feature as well as those visible only in the color one. The method is validated on synthetic and real video sequences.


Markov Random Field Feature Layer Color Layer Motion Segmentation Markov Random Field Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Odobez, J.M., Bouthemy, P.: Direct model-based image motion segmentation for dynamic scene analysis. In: Proceedings of Asian Conference on Computer Vision (1995)Google Scholar
  2. 2.
    Weiss, Y., Adelson, E.H.: A unified mixture framework for motion segmentation: Incorporating spatial coherence and estimating the number of models. In: Proceedings of International Conference on Computer Vision and Pattern Recognition (1996)Google Scholar
  3. 3.
    Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, vol. II, pp. 746–751. IEEE, Los Alamitos (2001)Google Scholar
  4. 4.
    Altunbasak, Y., Eren, P.E., Tekalp, A.M.: Region-based parametric motion segmentation using color information. Computer Graphics and Image Processing: Graphical Models and Image Processing 60, 13–23 (1998)CrossRefGoogle Scholar
  5. 5.
    Kersten, D., Mamassian, P., Yuille, A.: Object perception as Bayesian inference. Annual Review of Psychology 55, 271–304 (2004)CrossRefGoogle Scholar
  6. 6.
    Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. on Pattern Analysis and Machine Intelligence 6, 721–741 (1984)zbMATHCrossRefGoogle Scholar
  7. 7.
    Besag, J.: On the statistical analysis of dirty pictures. J. Roy. Statist. Soc., ser. B (1986)Google Scholar
  8. 8.
    Proesmans, M., Gool, L.V., Pauwels, E., Oosterlinck, A.: Determination of optical flow and its discontinuities using non-linear diffusion. In: Proceedings of Eurpoean Conference on Computer Vision, vol. 2, pp. 295–304 (1994)Google Scholar
  9. 9.
    Odobez, J.M., Bouthemy, P.: Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation 6, 348–365 (1995)CrossRefGoogle Scholar
  10. 10.
    Czuni, L., Sziranyi, T.: Motion segmentation and tracking with edge relaxation and optimization using fully parallel methods in the cellular nonlinear network architecture. Real Time Imaging 7, 77–95 (2001)zbMATHCrossRefGoogle Scholar
  11. 11.
    Comaniciu, D., Meer, P.: Mean shift: A robust approach towards feature space analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence (2001)Google Scholar
  12. 12.
    Kato, Z., Pong, T.C., Song, G.Q.: Unsupervised segmentation of color textured images using a multi-layer MRF model. In: Proceedings of International Conference on Image Processing, Barcelona, Spain, vol. I, pp. 961–964. IEEE, Los Alamitos (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Zoltan Kato
    • 1
  • Ting-Chuen Pong
    • 2
  1. 1.Institute of InformaticsUniversity of SzegedSzegedHungary
  2. 2.Computer Science DepartmentHong Kong University of Science and TechnologyKowloon, Hong KongChina

Personalised recommendations