Multi-View Stereoscopic Image Synthesis Algorithm for 3DTV
In this paper, we propose a multi-view stereoscopic image synthesis algorithm for 3DTV system using depth information with an RGB texture from a depth camera. The proposed algorithm synthesizes multi-view images which a virtual convergence camera model could generate. To furnish the motion parallax cue in each synthesized view, spatial and rotational transformation techniques were applied to foreground layer, and a new occlusion filling process was applied to both the foreground and background layers, as well. To add a stereoscopic depth cue to each synthesized view as a reference (left), we also generate a corresponding right view based on a virtual parallel camera model. Experimental results showed that the performance of the proposed algorithm is better than those of conventional methods.
KeywordsMulti-view synthesis Stereoscopic image Depth image based rendering (DIBR) Occlusion processing
This work was supported by the National Research Foundation of Korea Grant funded by the Korean Government (MEST) (NRF-2011-0026667) and the IT R&D program of MKE/KEIT. [KI002058, Signal Processing Elements and their SoC Developments to Realize the Integrated Service System for Interactive Digital Holograms].
- 1.Puri A, Kollarits RV, Haskell BG (1997) Basics of stereoscopic video, new compression results with MPEG-2 and a proposal for MPEG-4, signal processing. Image Commun 10:201–234Google Scholar
- 2.Fehn C (2003) A 3D-TV system based on video plus depth information. In: Conference record of the thirty-seventh Asilomar conference on signals, systems and computers 2003, vol 11, pp 1529–1533Google Scholar