Advertisement

Dynamic Light Field Compression Using Shared Fields and Region Blocks for Streaming Service

  • Yebin Liu
  • Qionghai Dai
  • Wenli Xu
  • Zhihong Liao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4179)

Abstract

The multi-view simul-switching is one of the most important features of dynamic light field (DLF) streaming. In this paper, we jointly consider light field rendering and compression and propose a novel DLF compression scheme based on the requirements of DLF streaming. In this scheme, successive temporal prediction chains are broken and a shared field is used as a reference for all the later P frames in a group of field. Meanwhile, considering the region of interest for DLF rendering, we partition all the P frames into regional blocks and code them in a manner that any region block can be independently transmitted for bandwidth economized streaming. With this coding scheme, a multi-camera DLF system is developed to verify the streaming performance of the proposed scheme. Experimental results show that our scheme saves the per-user transmission bandwidth a lot compared with other DLF compression schemes.

Keywords

Video Code Region Block Multiview Video Camera Array Partition Mode 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Levoy, M., Hanrahan, P.: Light field rendering. In: Computer Graphics (Proceedings SIGGRAPH 1996), August 1996, pp. 31–42 (1996)Google Scholar
  2. 2.
    Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. In: Computer Graphics (Proceedings SIGGRAPH 1996), vol. 42, pp. 31–42 (August 1996)Google Scholar
  3. 3.
    Goldlucke, B., Magnor, M., Wilburn, B.: Hardware-accelerated Dynamic Light Field Rendering. In: Proceedings of Vision, Modeling, and Visualization 2002, VMV 2002, Germany, November 20-22 (2002)Google Scholar
  4. 4.
    Chan, S.C., Ng, K.T., Gan, Z.F., Chan, K.L., Shum, H.Y.: The plenoptic video. IEEE Trans. on Circuits and Systems for Video Technology 15(12), 1650–1659 (2005)CrossRefGoogle Scholar
  5. 5.
    Wilburn, B., Smulski, M., Lee, K., Horowitz, M.: The light field video camera. In: Proc. SPIE Electronic Imaging: Media Processors, January 2002, vol. 4674, pp. 29–36 (2002)Google Scholar
  6. 6.
    Yang, J.C., Everett, M., Buehler, C., McMillan, L.: A Real-Time Distributed Light Field Camera. In: Thirteenth Eurographics Workshop on Rendering (2002)Google Scholar
  7. 7.
    Naemura, T., Tago, J., Harashima, H.: Realtime video-based modeling and rendering of 3d scenes. IEEE Computer Graphics and Applications 22(2), 66–73 (2002)CrossRefGoogle Scholar
  8. 8.
    MPEG Document, Survey of Algorithms used for Multi-view Video Coding (MVC). ISO/IEC JTC1/SC29/WG11, Doc. N6909 (January 2005)Google Scholar
  9. 9.
    Li, G., He, Y.: A Novel Multi-View Video Coding Scheme Based on H.264. In: PCM 2003, Singapore (December 2003)Google Scholar
  10. 10.
    Wang, R.S., Wang, Y.: Multiview video sequence analysis, compression, and virtual view-point synthesis. IEEE Transaction on Circuits and Systems for Video Technology 10, 397–410 (2000)CrossRefGoogle Scholar
  11. 11.
    Guo, X., Lu, Y., Gao, W., Huang, Q.: Viewpoint Switching in Multi-view Video Streaming. In: 2005 IEEE International Symposium on Circuits and Systems (ISCAS 2005), Kobe, Japan (May 2005)Google Scholar
  12. 12.
    Guo, X., Lu, Y., Wu, F., Gao, W., Li, S.: Free viewpoint switching in multi-view video streaming using wyner-ziv video coding. In: SPIE, Visual Communications and Image Processing 2006 (VCIP 2006) (2006)Google Scholar
  13. 13.
    Karczewicz, M., Kurceren, R.: The SP- and SI-Frames Design for H.264/AVC. IEEE Transaction on Circuits and Systems for Video Technology 13(7), 637–644 (2003)CrossRefGoogle Scholar
  14. 14.
    Magnor, M., Girod, B.: Data compression for light field rendering. IEEE Trans. on Circuits and Systems for Video Technology 10(3), 338–343 (2000)CrossRefGoogle Scholar
  15. 15.
    Magnor, M., Girod, B.: Hierarchical Coding of Light Fields with Disparity Maps. In: Proc. Int. Conf. Image Processing ICIP 1999, Kobe, Japan, pp. 334–338 (October 1999)Google Scholar
  16. 16.
    Isaksen, A., McMillan, L., Gortler, S.J.: Dynamically reparameterized light fields. In: Computer Graphics (Proc. SIGGRAPH 2000) (August 2000)Google Scholar
  17. 17.
    Buehler, C., Bosse, M., McMillan, L., Gortler, S., Cohen, M.: Unstructured lumigraph rendering. In: Computer Graphics (Proc. SIGGRAPH 2001), pp. 425–432 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yebin Liu
    • 1
  • Qionghai Dai
    • 1
  • Wenli Xu
    • 1
  • Zhihong Liao
    • 1
  1. 1.Department of AutomationTsinghua UniversityBeijingP.R. China

Personalised recommendations