Video Pop-up: Monocular 3D Reconstruction of Dynamic Scenes

  • Chris Russell
  • Rui Yu
  • Lourdes Agapito
Conference paper

DOI: 10.1007/978-3-319-10584-0_38

Volume 8695 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Russell C., Yu R., Agapito L. (2014) Video Pop-up: Monocular 3D Reconstruction of Dynamic Scenes. In: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8695. Springer, Cham

Abstract

Consider a video sequence captured by a single camera observing a complex dynamic scene containing an unknown mixture of multiple moving and possibly deforming objects. In this paper we propose an unsupervised approach to the challenging problem of simultaneously segmenting the scene into its constituent objects and reconstructing a 3D model of the scene. The strength of our approach comes from the ability to deal with real-world dynamic scenes and to handle seamlessly different types of motion: rigid, articulated and non-rigid. We formulate the problem as hierarchical graph-cut based segmentation where we decompose the whole scene into background and foreground objects and model the complex motion of non-rigid or articulated objects as a set of overlapping rigid parts. We evaluate the motion segmentation functionality of our approach on the Berkeley Motion Segmentation Dataset. In addition, to validate the capability of our approach to deal with real-world scenes we provide 3D reconstructions of some challenging videos from the YouTube-Objects dataset.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Chris Russell
    • 1
  • Rui Yu
    • 1
  • Lourdes Agapito
    • 1
  1. 1.University College LondonUK