Advertisement

A Distributed Stream Computing Architecture for Dynamic Light-Field Acquisition and Rendering System

  • Wenhui ZhouEmail author
  • Jiaqi Pan
  • Pengfei Li
  • Xuehui Wei
  • Zhen Liu
Chapter
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10092)

Abstract

The architectures of image acquisition and computation usually play important roles in most computer vision systems, especially in the multi-camera dynamic light-field acquisition and rendering systems for virtual reality. This paper designs a general distributed stream computing architecture to support light-field data stream acquisition and computation. Taking advantage of the distributed computing framework and in-memory high-speed processing engine, this architecture combines stream and batch processing together, which could reduce the computation burden. In order to evaluate the performance of proposed distributed stream computing architecture, we construct a dynamic light-field acquisition and rendering system, and the light-field data are obtained from a 10-meter-diameter and 7-meter-height hemispherical steel-frame dome that is equipped with 20 cameras and 2000 LED lightings. Experiments results show our system can continuously acquire and render light-field data at more than 1 frame per second with limited computational resources.

Keywords

Distributed architecture Virtual reality Light-field acquisition Rendering Stream computing  

Notes

Acknowledgment

This work is supported in part by the Key Program of Zhejiang Provincial Natural Science Foundation of China (No. LZ14F020003), National High-tech R&D Program of China (863 Program, 2015AA015901), and Zhejiang Provincial Natural Science Foundation of China (No. LQ12F02003). The authors are grateful for the anonymous reviewers who made constructive comments.

References

  1. 1.
    Levoy, M., Hanrahan, P.: Light field rendering. In: 23rd Annual Conference on Computer Graphics, pp. 31–42 (1996)Google Scholar
  2. 2.
    Adelson, E., Wang, J.: Single lens stereo with a plenoptic camera. IEEE Trans. Pattern Anal. Mach. Intell. 14, 99–106 (1992)CrossRefGoogle Scholar
  3. 3.
    McMillan, L., Bishop, G.: Plenoptic modeling: an image-based rendering system. In: 22nd Annual Conference on Computer Graphics, pp. 39–46 (1995)Google Scholar
  4. 4.
    Gortler, S., Grzeszczuk, R., Szeliski, R., Cohen, M.: The lumigraph. In: 23rd Annual Conference on Computer Graphics, pp. 43–54 (1996)Google Scholar
  5. 5.
    Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. In: ACM SIGGRAPH, pp. 600–608 (2004)Google Scholar
  6. 6.
    Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: 27th Annual Conference on Computer Graphics, pp. 145–156 (2000)Google Scholar
  7. 7.
    Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., Hawkins, T.: A lighting reproduction approach to live-action compositing. ACM Trans. Graph. 21, 547–556 (2002)CrossRefGoogle Scholar
  8. 8.
    Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. In: ACM SIGGRAPH, pp. 756–764 (2005)Google Scholar
  9. 9.
    Chabert, C., Einarsson, P., Jones, A., Lamond, B., Ma, W., Sylwan, S., Hawkins, T., Debevec, P.: Relighting human locomotion with flowed reflectance fields. In: Eurographics Symposium on Rendering, pp. 183–194 (2006)Google Scholar
  10. 10.
    Starck, J., Hilton, A.: Surface capture for performance-based animation. IEEE Comput. Graph. Appl. 27, 21–31 (2007)CrossRefGoogle Scholar
  11. 11.
    Yang, J.C., Everett, M., Buehler, C., Mcmillan, L.: A real-time distributed light field camera. In: Eurographics Workshop on Rendering, pp. 77–86 (2002)Google Scholar
  12. 12.
    Liu, Y., Dai, Q., Xu, W.: A real time interactive dynamic light field transmission system. In: IEEE International Conference on Multimedia and Expo, pp. 2173–2176 (2006)Google Scholar
  13. 13.
    Jiao, S., Wu, W., Wang, H., Zhou, M., Hong, T., Sun, X., Wu, E.: Real time light field reconstruction for sub-pixel based integral imaging display. In: SIGGRAPH Asia Technical Briefs, pp. 1–4 (2014)Google Scholar
  14. 14.
    Matusik, W., Buehler, C., Raskar, R.: Image-based visual hulls. In: 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 369–374 (2000)Google Scholar
  15. 15.
    Wu, C., Liu, Y., Dai, Q.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Visual Comput. Graph. 17, 1082–1095 (2011)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Wenhui Zhou
    • 1
    Email author
  • Jiaqi Pan
    • 1
  • Pengfei Li
    • 1
  • Xuehui Wei
    • 1
  • Zhen Liu
    • 1
  1. 1.Hangzhou Dianzi UniversityHangzhouChina

Personalised recommendations