Machine Vision and Applications

, Volume 16, Issue 4, pp 246–257

Photorealistic 3D reconstruction from handheld cameras

  • Tomás Rodríguez
  • Peter Sturm
  • Pau Gargallo
  • Nicolas Guilbert
  • Anders Heyden
  • Fernando Jauregizar
  • J. M. Menéndez
  • J. I. Ronda
Original Paper

DOI: 10.1007/s00138-005-0179-4

Cite this article as:
Rodríguez, T., Sturm, P., Gargallo, P. et al. Machine Vision and Applications (2005) 16: 246. doi:10.1007/s00138-005-0179-4

Abstract

One of the major challenges in the fields of computer vision and computer graphics is the construction and representation of life-like virtual 3D scenarios within a computer. The VISIRE project attempts to reconstruct photo-realistic 3D models of large scenarios using as input multiple freehand video sequences, while rendering the technology accessible to the non-expert.

VISIRE is application oriented and hence must deal with multiple issues of practical relevance that were commonly overlooked in past experiences. The paper presents both an innovative approach for the integration of previously unrelated experiences, as well as a number of novel contributions, such as: an innovative algorithm to enforce closedness of the trajectories, a new approach to 3D mesh generation from sparse data, novel techniques dealing with partial occlusions and a method for using photo-consistency and visibility constrains to refine the 3D mesh.

Keywords

Photo-realistic3D reconstructionSelf calibrationStructure from motionImage based rendering (IBR)Video analysis

Copyright information

© Springer Science + Business Media, Inc. 2005

Authors and Affiliations

  • Tomás Rodríguez
    • 1
  • Peter Sturm
    • 2
  • Pau Gargallo
    • 2
  • Nicolas Guilbert
    • 3
  • Anders Heyden
    • 3
  • Fernando Jauregizar
    • 4
  • J. M. Menéndez
    • 4
  • J. I. Ronda
    • 4
  1. 1.Eptron SA. R&D Dpt.MadridSpain
  2. 2.INRIA Rhône-Alpes MontbonnotFrance
  3. 3.Centre for Mathematical ScienceLund UniversitySweden
  4. 4.E.T.S.I. TelecomunicacionesUniversidad Politécnica de MadridSpain