Skip to main content
SpringerLink
Log in

Application of Heterogenous Motion Models towards Structure Recovery from Motion

  • Conference paper
Computer Vision – ACCV 2012 (ACCV 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7724))

Included in the following conference series:

  • 8350 Accesses

Abstract

Non-rigid structure estimates are often performed under the assumption that linear combination of a few rigid basis shapes can describe the deformation. However, the quality of reconstruction suffers as the number of basis shapes increase. When a natural video (which may contain rigid, articulated and non-rigid objects together with camera motion) is to be processed, the complexity of motion precludes use of rigid SFM methods. We propose that this problem may be approached using the notions of heterogeneity, articulation and stationarity. In this paper, we present a scheme for structure recovery based on motion classification and automatic selection of reconstruction algorithms for each scene object. Rigid, low-rank non-rigid and articulated structures are reconstructed separately. Using sub-sequence stationarity graphs, these are stitched together to form a coherent structure. We tested our method on data from human motion capture for objective analysis and provide results on natural videos.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3d shape from image streams. In: CVPR, vol. 2, pp. 690–696 (2000)

    Google Scholar 

  2. Torresani, L., Hertzmann, A., Bregler, C.: Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors. PAMI 30, 878–892 (2008)

    Article  Google Scholar 

  3. Paladini, M., Bue, A.D., Stosic, M., Dodig, M., Xavier, J., Agapito, L.: Factorization for non-rigid and articulated structure using metric projections. In: CVPR, pp. 2898–2905 (2009)

    Google Scholar 

  4. Taylor, J., Jepson, A., Kutulakos, K.: Non-rigid structure from locally-rigid motion. In: CVPR, pp. 2761–2768 (2010)

    Google Scholar 

  5. Ozden, K., Schindler, K., Van Gool, L.: Multibody structure-from-motion in practice. PAMI 32, 1134–1141 (2010)

    Article  Google Scholar 

  6. Salzmann, M., Pilet, J., Ilic, S., Fua, P.: Surface deformation models for non-rigid 3d shape recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 1481–1487 (2007)

    Article  Google Scholar 

  7. Ross, D.A., Tarlow, D., Zemel, R.S.: Learning articulated structure and motion. Int. J. Comput. Vision 88, 214–237 (2010)

    Article  Google Scholar 

  8. Vidal, R., Ma, Y., Piazzi, J.: A new GPCA algorithm for clustering subspaces by fitting, differentiating and dividing polynomials. In: CVPR, vol. 1, pp. 510–517 (2004)

    Google Scholar 

  9. Yan, J., Pollefeys, M.: Automatic kinematic chain building from feature trajectories of articulated objects. In: CVPR, pp. 712–719 (2006)

    Google Scholar 

  10. Del Bue, A., Llad, X., Agapito, L.: Non-rigid metric shape and motion recovery from uncalibrated images using priors. In: CVPR, vol. 1, pp. 1191–1198 (2006)

    Google Scholar 

  11. Fayad, J., Russell, C., Agapito, L.: Automated articulated structure and 3d shape recovery from point correspondences. In: ICCV (2011)

    Google Scholar 

  12. Rohith, M., Kambhamettu, C.: Estimation and utilization of articulations in recovering non-rigid structure from motion using motion subspaces. In: (J-HGBU 2011), ACM Multimedia 2011 (2011)

    Google Scholar 

  13. Roy-Chowdhury, A.: A measure of deformability of shapes, with applications to human motion analysis. In: CVPR, vol. 1, pp. 398–404 (2005)

    Google Scholar 

  14. Tresadern, P., Reid, I.: Articulated structure from motion by factorization. In: CVPR, vol. 2, pp. 1110–1115 (2005)

    Google Scholar 

  15. Akhter, I., Sheikh, Y., Khan, S., Kanade, T.: Trajectory space: A dual representation for nonrigid structure from motion. PAMI 33, 1442–1456 (2011)

    Article  Google Scholar 

  16. Gotardo, P.F.U., Martinez, A.M.: Non-rigid structure from motion with complementary rank-3 spaces. In: CVPR, pp. 3065–3072 (2011)

    Google Scholar 

  17. Tresadern, P.A., Reid, I.D.: Video synchronization from human motion using rank constraints. CVIU 113, 891–906 (2009)

    Google Scholar 

  18. Shi, J., Malik, J.: Normalized cuts and image segmentation. In: CVPR (1997)

    Google Scholar 

  19. Tron, R., Vidal, R.: A benchmark for the comparison of 3d motion segmentation algorithms. In: CVPR (2007)

    Google Scholar 

  20. Oliensis, J., Hartley, R.: Iterative extensions of the Sturm/Triggs algorithm: Convergence and nonconvergence. PAMI 29, 2217–2233 (2007)

    Article  Google Scholar 

  21. Rabaud, V.: Vincent’s SFM Toolbox, http://vision.ucsd.edu/vrabaud/toolbox/

  22. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004) ISBN: 0521540518

    Google Scholar 

  23. CMU Graphics Lab Motion Capture Database, http://mocap.cs.cmu.edu//

  24. Brox, T., Malik, J.: Large displacement optical flow: Descriptor matching in variational motion estimation. PAMI 33, 500–513 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Video/Image Modeling and Synthesis (VIMS) Lab, Dept. of Computer and Information Sciences, University of Delaware, Delaware, USA

    Rohith M.V. & Chandra Kambhamettu

Authors
  1. Rohith M.V.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chandra Kambhamettu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Electrical and Computer Engineering, Seoul National University, 1 Gwanak-ro, 151-744, Gwanak-gu, Seoul, Korea

    Kyoung Mu Lee

  2. Microsoft Research Asia, No. 5, Danling st., Haidian district, 100080, Beijing, P.R. China

    Yasuyuki Matsushita

  3. School of Interactive Computing, Georgia Institute of Technology, 801 Atlantic Drive, CCB 315, 30332, Atlanta, GA, USA

    James M. Rehg

  4. Institute of Automation, National Laboratory of Pattern Recognition, Chinese Academy of Sciences, Zhong Quan Cun East Road 95, Haidian District, 100 190, Beijing, P.R. China

    Zhanyi Hu

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

M.V., R., Kambhamettu, C. (2013). Application of Heterogenous Motion Models towards Structure Recovery from Motion. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7724. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37331-2_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37331-2_47

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37330-5

  • Online ISBN: 978-3-642-37331-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation