The Visual Computer

, Volume 29, Issue 5, pp 421–431 | Cite as

Recovering shape and motion by a dynamic system for low-rank matrix approximation in L 1 norm

  • Yiguang LiuEmail author
  • Liping Cao
  • Chunling Liu
  • Yifei Pu
  • Hong Cheng
Original Article


To recover motion and shape matrices from a matrix of tracking feature points on a rigid object under orthography, we can do low-rank matrix approximation of the tracking matrix with its each column minus the row mean vector of the matrix. To obtain the row mean vector, usually 4-rank matrix approximation is used to recover the missing entries. Then, 3-rank matrix approximation is used to recover the shape and motion. Obviously, the procedure is not convenient. In this paper, we build a cost function which calculates the shape matrix, motion matrix as well as the row mean vector at the same time. The function is in L 1 norm, and is not smooth everywhere. To optimize the function, a continuous-time dynamic system is newly proposed. With time going on, the product of the shape and rotation matrices becomes closer and closer, in L 1-norm sense, to the tracking matrix with each its column minus the mean vector. A parameter is implanted into the system for improving the calculating efficiency, and the influence of the parameter on approximation accuracy and computational efficiency are theoretically studied and experimentally confirmed. The experimental results on a large number of synthetic data and a real application of structure from motion demonstrate the effectiveness and efficiency of the proposed method. The proposed system is also applicable to general low-rank matrix approximation in L 1 norm, and this is also experimentally demonstrated.


Structure from motion Low-rank matrix approximation Dynamic system L1 norm Convergence 



We thank the Editor and Reviewers for time and effort going in reviewing this paper. This work was supported by NSFC under Grants 61173182 and 61179071, and the Applied Basic Research Project (2011JY0124) and the International Cooperation and Exchange Project (2012HH0004) of Sichuan Province.


  1. 1.
    Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9, 137–154 (1992) CrossRefGoogle Scholar
  2. 2.
    Wang, G., Wu, Q.M.J.: Stratification approach for 3-D Euclidean reconstruction of nonrigid objects from uncalibrated image sequences. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 38, 90–101 (2008) CrossRefGoogle Scholar
  3. 3.
    Torresani, L., Hertzmann, A., Bregler, C.: Nonrigid structure-from-motion: estimating shape and motion with hierarchical priors. IEEE Trans. Pattern Anal. Mach. Intell. 30, 878–892 (2008) CrossRefGoogle Scholar
  4. 4.
    Peng, Y., Ganesh, A., Wright, J., Ma, Y.: RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 700–763 (2010) Google Scholar
  5. 5.
    Wright, J., Ganesh, A., Rao, S., Peng, Y., Ma, Y.: Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Bengio, Y., Schuurmans, D., Lafferty, J., Williams, C.K.I., Culotta, A. (eds.) Advances in Neural Information Processing Systems, pp. 2080–2088 (2009) Google Scholar
  6. 6.
    Liu, Y., You, Z., Cao, L.: A novel and quick SVM-based multi-class classifier. Pattern Recognit. 39, 2258–2264 (2006) zbMATHCrossRefGoogle Scholar
  7. 7.
    Liu, Y., Sam Ge, S., Li, C., You, Z.: k-NS: a classifier by the distance to the nearest subspace. IEEE Trans. Neural Netw. 22(8), 1256–1268 (2011) CrossRefGoogle Scholar
  8. 8.
    Morita, T., Kanade, T.: A sequential factorization method for recovering shape and motion from image streams. IEEE Trans. Pattern Anal. Mach. Intell. 19, 858–867 (1997) CrossRefGoogle Scholar
  9. 9.
    Hartley, R., Schaffalitzky, F.: Power factorization: 3D reconstruction with missing or uncertain data. In: Australia-Japan Advanced Workshop on Computer Vision, pp. 1–9 (2003) Google Scholar
  10. 10.
    Buchanan, A.M., Fitzgibbon, A.W.: Damped newton algorithms for matrix factorization with missing data. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 316–322 (2005) Google Scholar
  11. 11.
    Morgan, A.B.: Investigation into matrix factorization when elements are unknown. Technical report, Visual Geometry Group, Department of Engineering Science, University of Oxford (2004) Google Scholar
  12. 12.
    Ye, J.: Generalized low rank approximations of matrices. Mach. Learn. 61, 167–191 (2005) zbMATHCrossRefGoogle Scholar
  13. 13.
    Liu, J., Chen, S., Zhou, Z.-H., Tan, X.: Generalized low-rank approximations of matrices revisited. IEEE Trans. Neural Netw. 21, 621–632 (2010) CrossRefGoogle Scholar
  14. 14.
    Wiberg, T.: Computation of principal components when data are missing. In: Proc. Second Symp. Computational Statistics, Berlin, pp. 229–236 (1976) Google Scholar
  15. 15.
    Okatani, T., Deguchi, K.: On the Wiberg algorithm for matrix factorization in the presence of missing components. Int. J. Comput. Vis. 72, 329–337 (2007) CrossRefGoogle Scholar
  16. 16.
    Chen, P.: Heteroscedastic low-rank matrix approximation by the Wiberg algorithm. IEEE Trans. Signal Process. 56, 1429–1439 (2008) MathSciNetCrossRefGoogle Scholar
  17. 17.
    Chen, P.: Optimization algorithms on subspaces: revisiting missing data problem in low-rank matrix. Int. J. Comput. Vis. 80(1), 125–142 (2008) CrossRefGoogle Scholar
  18. 18.
    Lin, Z., Chen, M., Wu, L., Ma, Y.: The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices, October (2009) Google Scholar
  19. 19.
    Cai, J.-F., Candés, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20, 1956–1982 (2010) MathSciNetzbMATHCrossRefGoogle Scholar
  20. 20.
    Ke, Q., Kanade, T.: Robust L 1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: 2005 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 739–746 (2005) CrossRefGoogle Scholar
  21. 21.
    Eriksson, A., van den Hengel, A.: Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L 1 norm. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 771–778 (2010) CrossRefGoogle Scholar
  22. 22.
    Li, S.Z.: Markov Random Field Modeling in Image Analysis. Springer, Berlin (2001) zbMATHCrossRefGoogle Scholar
  23. 23.
    Zucker, S.: Differential geometry from the Frenet point of view: boundary detection, stereo, texture and color. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 359–373. Springer, Berlin (2006) Google Scholar
  24. 24.
    Liu, Y.: Automatic range image registration in the Markov chain. IEEE Trans. Pattern Anal. Mach. Intell. 32, 12–29 (2010) zbMATHCrossRefGoogle Scholar
  25. 25.
    Weickert, J., SteidI, G., Mrazek, P., Welk, M., Brox, T.: Diffusion filters and wavelets: what can they learn from each other? In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 3–17. Springer, Berlin (2006) Google Scholar
  26. 26.
    Stoykova, E., Alatan, A.A., Benzie, P., Grammalidis, N., Malassiotis, S., Ostermann, J., Piekh, S., Sainov, V., Theobalt, C., Thevar, T., Zabulis, X.: 3-D time-varying scene capture technologiesła survey. IEEE Trans. Circuits Syst. Video Technol. 17, 1568–1586 (2007) CrossRefGoogle Scholar
  27. 27.
    Liu, Y., You, Z., Cao, L.: A functional neural network computing some eigenvalues and eigenvectors of a special real matrix. Neural Netw. 18, 1293–1300 (2005) zbMATHCrossRefGoogle Scholar
  28. 28.
    Liu, Y., You, Z., Cao, L.: A concise functional neural network computing the largest modulus eigenvalues and their corresponding eigenvectors of a real skew matrix. Theor. Comput. Sci. 367, 273–285 (2006) MathSciNetzbMATHCrossRefGoogle Scholar
  29. 29.
    Orban, G.A., Janssen, P., Vogels, R.: Extracting 3D structure from disparity. Trends Neurosci. 29(8), 466–473 (2006) CrossRefGoogle Scholar
  30. 30.
    la Torre, F.D., Blackt, M.J.: Robust principal component analysis for computer vision. In: Proceedings of Eighth IEEE International Conference on Computer Vision (ICCV 2001), vol. 1, pp. 362–369 (2001) CrossRefGoogle Scholar
  31. 31.
    El-Melegy, M.T., Al-Ashwal, N.H.: A variational technique for 3D reconstruction from multiple views. In: International Conference on Computer Engineering & Systems (ICCES 07), pp. 38–43 (2007) Google Scholar
  32. 32.
    Zhong, H., Hung, Y.: Multi-stage 3D reconstruction under circular motion. Image Vis. Comput. 25, 1814–1823 (2007) CrossRefGoogle Scholar
  33. 33.
    Martinec, D., Pajdla, T.: 3D reconstruction by fitting low-rank matrices with missing data. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 198–205 (2005) Google Scholar
  34. 34.
    Keshavan, R.H., Montanari, A., Oh, S.: Matrix completion from a few entries. IEEE Trans. Inf. Theory 56, 2980–2998 (2010) MathSciNetCrossRefGoogle Scholar
  35. 35.
    Toh, K.-C., Yun, S.: An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems. Pac. J. Optim. 6, 65–640 (2010) MathSciNetGoogle Scholar
  36. 36.
    Khalil, H.K.: Nonlinear Systems, 3rd edn. Prentice Hall, New York (2002) zbMATHGoogle Scholar

Copyright information

© Springer-Verlag 2012

Authors and Affiliations

  • Yiguang Liu
    • 1
    Email author
  • Liping Cao
    • 2
  • Chunling Liu
    • 3
  • Yifei Pu
    • 1
  • Hong Cheng
    • 4
  1. 1.Vision and Image Processing Lab., College of Computer ScienceSichuan UniversityChengduChina
  2. 2.LibrarySichuan UniversityChengduChina
  3. 3.Department of OphthalmologyWest China Hospital, Sichuan UniversityChengduChina
  4. 4.Pattern Recognition and Machine Intelligence Lab.University of Electronic Science and Technology of ChinaChengduChina

Personalised recommendations