Abstract
In this paper, an efficient depth image based view rendering method for high quality multi-view virtual images synthesis is proposed, which utilizes two color images with their associated depth maps. The proposed method consists of four main steps. The first step is virtual camera parameters design by using shift-sensor camera model to avoid the keystone distortion during virtual view synthesis. Secondly, the mixed color pixels around the boundary of image objects is detected and skipped in the following step, which can eliminate the “ghost” artifacts. Then the two input color images are rendered to multiple virtual view positions on the basis of depth-image-based rendering (DIBR) and merged into one image. Finally, a depth-aided inpainting algorithm is used to fill the disoccluded areas. Experiment results are shown to demonstrate the superior performance of the proposed method compared to other traditional DIBR methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fehn, C.: A 3D-TV system based on video plus depth information. Signals, Systems and Computers 2, 1529–1533 (2003)
Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004)
Vázquez, C., Tam, W.J., Speranza, F.: Stereoscopic Imaging: Filling disoccluded areas in depth image-based rendering. In: Three-Dimensional TV, Video, and Display V, SPIE, vol. 6392, p. 63920D-12 (2006)
Tam, W.J., Alain, G., Zhang, L., Martin, T., Renaud, R.: Smoothing depth maps for improved stereoscopic image quality. In: Three Dimensional TV, Video and Display III, SPIE, vol. 5599, pp. 162–172 (2004)
Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Transactions on Broadcasting 51(2), 191–199 (2005)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of ACM Conference on Computer Graphics (SIGGRAPH), pp. 417–424 (2000)
Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing 13(9), 1200–1212 (2004)
Luo, K., Li, D.-X., Feng, Y.-M., Zhang, M.: Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering. Journal of Zhejiang University - Science A 10(12), 1738–1749 (2009)
Yoon, S.-U., Ho, Y.-S.: Multiple color and depth video coding using a hierarchical representation. IEEE Transactions on Circuits and Systems for Video Technology 17(11), 1450–1460 (2007)
Shade, J., Gortler, S., He, L.-W., Szeliski, R.: Layered Depth Images. In: Proc. of ACM SIGGRAPH, pp. 231–242 (1998)
Oh, K.-J., Yea, S., Ho, Y.-S.: Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video. In: Picture Coding Symposium, pp. 1–4 (May 2009)
Woods, A.J., Docherty, T.: Image distortions in stereoscopic video systems. In: Proc. of SPIE Stereoscopic Displays and Applications, vol. 1915, pp. 36–48 (1993)
Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szelisk, R.: High-quality video view interpolation using a layered representation. ACM SIGGRAPH and ACM Transactions on Graphics, 600–608 (August 2004)
Greene, N., Kass, M., Miller, G.: Hierarchical Z-buffer visibility. In: Proceedings of the SIGGRAPH, pp. 231–240 (September 1993)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag GmbH Berlin Heidelberg
About this paper
Cite this paper
Ming, X., Jiufei, X., Lianghao, W., Dongxiao, L., Ming, Z. (2012). A Novel Method of Multi-view Virtual Image Synthesis for Auto-stereoscopic Display. In: Zhang, W. (eds) Advanced Technology in Teaching. Advances in Intelligent and Soft Computing, vol 163. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29458-7_119
Download citation
DOI: https://doi.org/10.1007/978-3-642-29458-7_119
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29457-0
Online ISBN: 978-3-642-29458-7
eBook Packages: EngineeringEngineering (R0)