Original Paper

Machine Vision and Applications

, Volume 16, Issue 4, pp 246-257

First online:

Photorealistic 3D reconstruction from handheld cameras

  • Tomás RodríguezAffiliated withEptron SA. R&D Dpt. Email author 
  • , Peter SturmAffiliated withINRIA Rhône-Alpes Montbonnot
  • , Pau GargalloAffiliated withINRIA Rhône-Alpes Montbonnot
  • , Nicolas GuilbertAffiliated withCentre for Mathematical Science, Lund University
  • , Anders HeydenAffiliated withCentre for Mathematical Science, Lund University
  • , Fernando JauregizarAffiliated withE.T.S.I. Telecomunicaciones, Universidad Politécnica de Madrid
  • , J. M. MenéndezAffiliated withE.T.S.I. Telecomunicaciones, Universidad Politécnica de Madrid
  • , J. I. RondaAffiliated withE.T.S.I. Telecomunicaciones, Universidad Politécnica de Madrid

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access

Abstract

One of the major challenges in the fields of computer vision and computer graphics is the construction and representation of life-like virtual 3D scenarios within a computer. The VISIRE project attempts to reconstruct photo-realistic 3D models of large scenarios using as input multiple freehand video sequences, while rendering the technology accessible to the non-expert.

VISIRE is application oriented and hence must deal with multiple issues of practical relevance that were commonly overlooked in past experiences. The paper presents both an innovative approach for the integration of previously unrelated experiences, as well as a number of novel contributions, such as: an innovative algorithm to enforce closedness of the trajectories, a new approach to 3D mesh generation from sparse data, novel techniques dealing with partial occlusions and a method for using photo-consistency and visibility constrains to refine the 3D mesh.

Keywords

Photo-realistic 3D reconstruction Self calibration Structure from motion Image based rendering (IBR) Video analysis