Joint Non-rigid Motion Estimation and Segmentation

  • Boris Flach
  • Radim Sara
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3322)


Usually object segmentation and motion estimation are considered (and modelled) as different tasks. For motion estimation this leads to problems arising especially at the boundary of an object moving in front of another if e.g. prior assumptions about continuity of the motion field are made. Thus we expect that a good segmentation will improve the motion estimation and vice versa. To demonstrate this we consider the simple task of joint segmentation and motion estimation of an arbitrary (non-rigid) object moving in front of a still background. We propose a statistical model which represents the moving object as a triangular (hexagonal) mesh of pairs of corresponding points and introduce an provably correct iterative scheme, which simultaneously finds the optimal segmentation and corresponding motion field.


Motion Estimation Hexagonal Lattice Optimal Segmentation Elementary Triangle Ball Image 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. In: Proc. of the 7. Intl. Conf. on Computer Vision, vol. 1, pp. 377–384 (1999)Google Scholar
  2. 2.
    Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Cremers, D., Schnörr, C.: Motion competition: Variational integration of motion segmentation and shape recognition. In: Van Gool, L. (ed.) DAGM 2002. LNCS, vol. 2449, pp. 472–480. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  4. 4.
    Flach, B., Kask, E., Schlesinger, D., Skulish, A.: Unifying registration and segmentation for multi-sensor images. In: Van Gool, L. (ed.) DAGM 2002. LNCS, vol. 2449, pp. 190–197. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6(6), 721–741 (1984)MATHCrossRefGoogle Scholar
  6. 6.
    Schlesinger, M.I., Hlavač, V.: Ten Lectures on Statistical and Structural Pattern Recognition. Computational Imaging and Vision, vol. 24. Kluwer Academic Press, Dordrecht (2002)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Boris Flach
    • 1
  • Radim Sara
    • 2
  1. 1.Dresden University of Technology 
  2. 2.Czech Technical University Prague 

Personalised recommendations