Abstract
In this paper, we propose a new method for real-time disparity estimation and intermediate view synthesis from stereoscopic images. Some 3D video systems employ both the left and right depth images for virtual view synthesis; however, we estimate only one disparity map at a virtual viewpoint. In addition, we utilize hierarchical belief propagation and convergence check methods to find the global solution rapidly. In order to use the virtual viewpoint disparity map for intermediate view synthesis, we build an occlusion map that describes the occlusion information in the virtual viewpoint region of the reference image. We have also implemented the total system using GPU programming to synthesize virtual viewpoint images in real time.
Chapter PDF
Similar content being viewed by others
References
ISO/IEC JTC1/SC29/WG11 N6909: Survey of algorithms used for multi-view video coding, MVC (2005)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 1222–1239 (2000)
Kolmogorov, V., Zabih, R.: Multi-Camera Scene Reconstruction via Graph Cuts. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 82–96. Springer, Heidelberg (2002)
Sun, J., Zheng, N., Shum, H.: Stereo matching using belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 787–800 (2003)
ISO/IEC JTC1/SC29/WG11 M1537: Contribution for 3D Video Test Material of Outdoor Scene (2008)
Oh, J., Ma, S., Kuo, C.: Disparity estimation and virtual view synthesis from stereo video. In: Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), New Orleans, LA, USA, pp. 993–996 (2007)
Tappen, M., Freeman, W.: Comparison of Graph Cuts with Belief Propagation for Stereo. In: Proc. IEEE Int’l Conf. Computer Vision, vol. 1, pp. 508–515 (2003)
Felzenszwalb, P., Huttenlocher, D.: Efficient Belief Propagation for Early Vision. In: CVPR, vol. 1, pp. 261–268 (2004)
Yang, Q., Wang, L., Yang, R., Stewenius, H., Nister, D.: Stereo matching with color-weighted correlation, hierarchical belief propagation and occlusion handling. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 492–504 (2009)
Oh, K., Yea, S., Ho, Y.: Hole Filling Method using Depth Based In-painting for View Synthesis in Free Viewpoint Television and 3-D Video. In: Picture Coding Symposium, pp. 39 (1-4) (2009)
Oliveira, M., Bowen, B., McKenna, R., Chang, Y.: Fast Digital Image Inpainting. In: Proceedings of the International Conference on Visualization, Imaging and Image Processing, Marbella, Spain (2001)
NVIDIA Corporation, CUDA 3.2 Programming Guide (2010), http://www.nvidia.com/cuda_develop.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shin, IY., Ho, YS. (2011). Virtual Viewpoint Disparity Estimation and Convergence Check for Real-Time View Synthesis. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7087. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25367-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-25367-6_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25366-9
Online ISBN: 978-3-642-25367-6
eBook Packages: Computer ScienceComputer Science (R0)