Advertisement

Perceptual Grouping from Motion Cues Using Tensor Voting in 4-D

  • Mircea Nicolescu
  • Gérard Medioni
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2352)

Abstract

We present a novel approach for motion grouping from two frames, that recovers the dense velocity field, motion boundaries and regions, based on a 4-D Tensor Voting computational framework. Given two sparse sets of point tokens, we encode the image position and potential velocity for each token into a 4-D tensor. The voting process then enforces the motion smoothness while preserving motion discontinuities, thus selecting the correct velocity for each input point, as the most salient token. By performing an additional dense voting step we infer velocities at every pixel location, motion boundaries and regions. Using a 4-D space for this Tensor Voting approach is essential, since it allows for a spatial separation of the points according to both their velocities and image coordinates. Unlike other methods that optimize a specific objective function, our approach does not involve initialization or search in a parametric space, and therefore does not suffer from local optima or poor convergence problems. We demonstrate our method with synthetic and real images, by analyzing several difficult cases — opaque and transparent motion, rigid and non-rigid motion, curves and surfaces in motion.

Keywords

Optical Flow Motion Capture Motion Boundary Perceptual Group Candidate Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. [I]
    S. Ullman, “The Interpretation of Visual Motion”, MIT Press, 1979.Google Scholar
  2. [2]
    J. Barron, D. Fleet, S. Beauchemin, “Performance of Optical Flow Techniques”, IJCV, 1994, 12:1, pp. 43–77.CrossRefGoogle Scholar
  3. [3]
    F. Heitz, P. Bouthemy, “Multimodal Estimation of Discontinuous Optical Flow Using Markov Random Fields”, PAMI, December 1993, 15:12, pp. 1217–1232.Google Scholar
  4. [4]
    S. Ghosal, “A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation”, PAMI, 1996, 18:2, pp. 181–194.MathSciNetGoogle Scholar
  5. [5]
    R. Deriche, P. Kornprobst, G. Aubert, “Optical Flow Estimation while Preserving its Discontinuities: A Variational Approach”, ACCV, 1995, pp. 290–295.Google Scholar
  6. [6]
    S. Hsu, P. Anandan, S. Peleg, “Accurate Computation of Optical Flow by Using Layered Motion Representations”, ICPR, 1994, pp. 743–746.Google Scholar
  7. [7]
    A. Jepson, M. Black, “Mixture Models for Optical Flow Computation”, CVPR, 1993, pp. 760–761.Google Scholar
  8. [8]
    M. Irani, S. Peleg, “Image Sequence Enhancement Using Multiple Motions Analysis”, CVPR, 1992, pp. 216–221.Google Scholar
  9. [9]
    J. Wang, E. Adelson, “Representing Moving Images with Layers”, IEEE Trans. On Image Processing Special Issue: Image Sequence Compression, 1994, 3:5, pp. 625–638.Google Scholar
  10. [10]
    Y. Weiss, “Smoothness in Layers: Motion Segmentation Using Nonparametric Mixture Estimation”, CVPR, 1997, pp. 520–526.Google Scholar
  11. [11]
    J. Little, H. Bulthoff, T. Poggio, “Parallel Optical Flow Using Local Voting”, ICCV, 1988, pp. 454–459.Google Scholar
  12. [12]
    G. Medioni, M.-S. Lee, C.-K. Tang, “A Computational Framework for Segmentation and Grouping”, Elsevier Science, 2000.Google Scholar
  13. [13]
    L. Gaucher, G. Medioni, “Accurate Motion Flow Estimation with Discontinuities”, ICCV, 1999, pp. 695–702.Google Scholar
  14. [14]
    G. Guy, G. Medioni, “Inference of Surfaces, 3-D Curves and Junctions from Sparse, Noisy 3-D Data”, IEEE Trans. PAMI, 1997, 19:11, pp. 1265–1277.Google Scholar
  15. [15]
    C.-K. Tang, G. Medioni, M.-S. Lee, “Epipolar Geometry Estimation by Tensor Voting in 8D”, ICCV, 1999, pp. 502–509.Google Scholar
  16. [16]
    S. Arya, D. Mount, N. Netanyahu, R Silverman, A. Wu, “An optimal algorithm for approximate nearest neighbor searching in fixed dimensions”, Journal of the ACM, 1998, 45:6, pp. 891–923.zbMATHCrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Mircea Nicolescu
    • 1
  • Gérard Medioni
    • 1
  1. 1.Integrated Media Systems CenterUniversity of Southern CaliforniaLos Angeles

Personalised recommendations