International Journal of Computer Vision

, Volume 79, Issue 1, pp 85–105

Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCA

Article

DOI: 10.1007/s11263-007-0099-z

Cite this article as:
Vidal, R., Tron, R. & Hartley, R. Int J Comput Vis (2008) 79: 85. doi:10.1007/s11263-007-0099-z

Abstract

We consider the problem of segmenting multiple rigid-body motions from point correspondences in multiple affine views. We cast this problem as a subspace clustering problem in which point trajectories associated with each motion live in a linear subspace of dimension two, three or four. Our algorithm involves projecting all point trajectories onto a 5-dimensional subspace using the SVD, the PowerFactorization method, or RANSAC, and fitting multiple linear subspaces representing different rigid-body motions to the points in ℝ5 using GPCA. Unlike previous work, our approach does not restrict the motion subspaces to be four-dimensional and independent. Instead, it deals gracefully with all the spectrum of possible affine motions: from two-dimensional and partially dependent to four-dimensional and fully independent. Our algorithm can handle the case of missing data, meaning that point tracks do not have to be visible in all images, by using the PowerFactorization method to project the data. In addition, our method can handle outlying trajectories by using RANSAC to perform the projection. We compare our approach to other methods on a database of 167 motion sequences with full motions, independent motions, degenerate motions, partially dependent motions, missing data, outliers, etc. On motion sequences with complete data our method achieves a misclassification error of less that 5% for two motions and 29% for three motions.

Keywords

Multibody factorization Multibody grouping 3-D motion segmentation Structure from motion Subspace clustering PowerFactorization and Generalized Principal Component Analysis (GPCA) Missing data 

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Center for Imaging Science, Department of Biomedical EngineeringJohns Hopkins UniversityBaltimoreUSA
  2. 2.Vision Science Technology and Applications Program, National ICT Australia, Department of Information EngineeringAustralian National UniversityCanberraAustralia

Personalised recommendations