A TV Prior for High-Quality Scalable Multi-View Stereo Reconstruction

  • Andreas Kuhn
  • Heiko Hirschmüller
  • Daniel Scharstein
  • Helmut Mayer
Article

DOI: 10.1007/s11263-016-0946-x

Cite this article as:
Kuhn, A., Hirschmüller, H., Scharstein, D. et al. Int J Comput Vis (2016). doi:10.1007/s11263-016-0946-x

Abstract

We present a scalable multi-view stereo method able to reconstruct accurate 3D models from hundreds of high-resolution input images. Local fusion of disparity maps obtained with semi-global matching enables the reconstruction of large scenes that do not fit into main memory. Since disparity maps may vary widely in quality and resolution, careful modeling of the 3D errors is crucial. We derive a sound stereo error model based on disparity uncertainty, which can vary spatially from tenths to several pixels. We introduce a feature based on total variation that allows pixel-wise classification of disparities into different error classes. For each class, we learn a disparity error distribution from ground-truth data using expectation maximization. We present a novel method for stochastic fusion of data with varying quality by adapting a multi-resolution volumetric fusion process that uses our error classes as a prior and models surface probabilities via an octree of voxels. Conflicts during surface extraction are resolved using visibility constraints and preference for voxels at higher resolutions. Experimental results on several challenging large-scale datasets demonstrate that our method yields improved performance both qualitatively and quantitatively.

Keywords

Multi-View Stereo 3D Modeling Scalable 3D Surface Reconstruction 

Supplementary material

11263_2016_946_MOESM_ESM.pdf (11.4 mb)
Supplementary material 1 (pdf 11706 KB)

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Bundeswehr University MunichNeubibergGermany
  2. 2.German Aerospace CentreMunichGermany
  3. 3.Roboception GmbHMunichGermany
  4. 4.Middlebury CollegeMiddleburyUSA