An Integrated Hole-Filling Algorithm for View Synthesis

  • Wenxin Yu
  • Weichen Wang
  • Zhengyan Guo
  • Satoshi Goto
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7674)

Abstract

Multi-view video can provide users a 3-D and virtual reality perception by its multiple viewing angles. In recent years, the depth image-based rendering (DIBR) is generally used to synthesize virtual view images in free viewpoint television (FTV) and three-dimensional (3-D) video. In order to conceal the zero-region more accurately and improve the quality of virtual view synthesized frame, an integrated Hole-filling Algorithm for View Synthesis is proposed in this paper. It contains five parts: the different regions distinguishing algorithm, foreground and background boundary detection, the texture image isophotes detection, the textural and structural isophotes prediction algorithm, the in-painting algorithm with gradient priority order. Based on the texture isophotes prediction with geometrical principle and the in-painting algorithm with gradient priority order, the boundary information of the foreground is much clearer and the texture information in the zero-region can be concealed much more accurately than the previous work. The vision quality mainly depends on the distortion of the structural information. Through the experimental results, the proposed algorithm not only improves the objective quality of the virtual image, but also improves the subjective quality of the virtual image a lot, and the human vision quality is also improved obviously based on the subjective results. Especially, it ensures the boundary contours of the foreground objects and the textural and the structural information.

Keywords

DIBR Virtual view Hole-filling In-painting 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Smolic, A., Mueller, K., Merkle, P., Fehn, C., Kauff, P., Eisert, P., Wiegand, T.: 3D Video and Free Viewpoint Video – Technologies, Applications and MPEG Standards. In: Proc. of ICME 2006, pp. 2161–2164 (July 2006)Google Scholar
  2. 2.
    Tanimoto, M.: Overview of free viewpoint television. Proc. of Signal Processing: Image Communication 21, 454–461 (2006)CrossRefGoogle Scholar
  3. 3.
    Kubota, A., Smolic, A., Magnor, M., Tanimoto, M., Chen, T., Zhang, C.: Multiview Imaging and 3DTV. IEEE Signal Processing Magazine 24(6), 10–21 (2007)CrossRefGoogle Scholar
  4. 4.
    Konrad, J., Halle, M.: 3-D Displays and Signal Processing – An Answer to 3-D Ills? IEEE Signal Processing Magazine 24(6) (November 2007)Google Scholar
  5. 5.
    Kauff, P., Atzpadin, N., Fehn, C., Müller, M., Schreer, O., Smolic, A., Tanger, R.: Depth Map Creation and Image Based Rendering for Advanced 3DTV Services Providing Interoperability and Scalability. Signal Processing: Image Communication. Special Issue on 3DTV (February 2007)Google Scholar
  6. 6.
    Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing 13(9), 1200–1212 (2004)CrossRefGoogle Scholar
  7. 7.
    Müller, K., Smolic, A., Dix, K., Merkle, P., Kauf, P., Wiegand, T.: View synthesis for advanced 3-D video systems. EURASIP J. Image Video Process. 2008, Art. ID 438148 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Wenxin Yu
    • 1
  • Weichen Wang
    • 1
  • Zhengyan Guo
    • 1
  • Satoshi Goto
    • 1
  1. 1.Graduate school of Information, Production and SystemsWaseda UniversityFukuokaJapan

Personalised recommendations