Decoupling Rendering and Display Using Fast Depth Image Based Rendering on the GPU

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9972)

Abstract

Feasible rendering of massive scenes with hardware capabilities and scene data size concurrently growing has been an active subject of research in recent decades. While past attempts showed realtime rendering on basic consumer workstations, frame rates can still be too low for the growing demand in the professional CAD industry and sectors like entertainment for stable high frame rates. The work described in this paper focuses on fulfilling this demand in the context of CAD software. A fast custom application of the Depth Image Based Rendering (DIBR) technique is used to construct a view synthesis system generating the required rate using past frames of a classical parallel renderer. Artifacts associated with this technique are addressed in a cost-effective manner.

References

  1. 1.
    Brüderlin, B., Heyer, M., Pfützner, S.: Interviews3D: a platform for interactive handling of massive data sets. IEEE Comput. Graph. Appl. 27(6), 48–59 (2007)CrossRefGoogle Scholar
  2. 2.
    Chang, C.-F., Ger, S.-H.: Enhancing 3D graphics on mobile devices by image-based rendering. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 1105–1111. Springer, Heidelberg (2002). doi:10.1007/3-540-36228-2_137 CrossRefGoogle Scholar
  3. 3.
    Darsa, L., Costa Silva, B., Varshney, A.: Navigating static environments using image-space simplification and morphing. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics. I3D 1997, pp. 25-ff. ACM, New York (1997)Google Scholar
  4. 4.
    Decoret, X., Schaufler, G., Sillion, F., Dorsey, J.: Multi-layered impostors for accelerated rendering. In: EUROGRAPHICS 1999, vol. 18 (1999)Google Scholar
  5. 5.
    Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., Seidel, H.P.: Adaptive image-space stereo view synthesis. In: Vision, Modeling and Visualization Workshop, pp. 299–306, Siegen, Germany (2010)Google Scholar
  6. 6.
    Do, L., Zinger, S., Morvan, Y., de With, P.: Quality improving techniques in DIBR for free-viewpoint video. In: 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009, pp. 1–4, May 2009Google Scholar
  7. 7.
    Fehn, C.: A 3D-TV approach using depth-image-based rendering (DIBR). In: Proceedings of Visualization, Imaging and Image Processing, pp. 482–487 (2003)Google Scholar
  8. 8.
    Fu, C., Wong, T., Heng, P.: Triangle-based view interpolation without depth-buffering. J. Graph. Tools 3, 13–31 (1998)CrossRefGoogle Scholar
  9. 9.
    Funkhouser, T.A., Séquin, C.H.: Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. SIGGRAPH 1993, pp. 247–254. ACM, New York (1993)Google Scholar
  10. 10.
    Ghiletiuc, J., Färber, M., Brüderlin, B.: Real-time remote rendering of large 3D models on smartphones using multi-layered impostors. In: Proceedings of the 6th International Conference on Computer Vision/Computer Graphics Collaboration Techniques and Applications. MIRAGE 2013, pp. 14: 1–14: 8. ACM, New York (2013)Google Scholar
  11. 11.
    Horng, Y.R., Tseng, Y.C., Chang, T.S.: Stereoscopic images generation with directional Gaussian filter. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 2650–2653 (2010)Google Scholar
  12. 12.
    Liu, F., Huang, M.C., Liu, X.H., Wu, E.H.: Single pass depth peeling via CUDA rasterizer. In: SIGGRAPH 2009: Talks. SIGGRAPH 2009, p. 79: 1. ACM, New York (2009)Google Scholar
  13. 13.
    Mark, W.R., McMillan, L., Bishop, G.: Post-rendering 3D warping. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics. I3D 1997, pp. 7-ff. ACM, New York (1997)Google Scholar
  14. 14.
    Max, N., Ohsaki, K.: Rendering trees from precomputed z-buffer views. In: Eurographics Rendering Workshop, pp. 45–54 (1995)Google Scholar
  15. 15.
    Morvan, Y., Farin, D., de With, P.: System architecture for free-viewpoint video and 3D-TV. IEEE Trans. Consum. Electron. 54(2), 925–932 (2008)CrossRefGoogle Scholar
  16. 16.
    Ndjiki-Nya, P., Koppel, M., Doshkov, D., Lakshman, H., Merkle, P., Muller, K., Wiegand, T.: Depth image-based rendering with advanced texture synthesis for 3-D video. IEEE Trans. Multimedia 13(3), 453–465 (2011)CrossRefGoogle Scholar
  17. 17.
    Oh, K.J., Yea, S., Ho, Y.S.: Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video. In: Picture Coding Symposium, 2009. PCS 2009, pp. 1–4, May 2009Google Scholar
  18. 18.
    Popescu, V., Lastra, A., Aliaga, D., Neto, M.D.O.: Efficient warping for architectural walkthroughs using layered depth images. In: IEEE Visualization, pp. 211–215 (1998)Google Scholar
  19. 19.
    Saito, T., Takahashi, T.: Comprehensible rendering of 3-D shapes. In: Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques. SIGGRAPH 1990, pp. 197–206. ACM, New York (1990)Google Scholar
  20. 20.
    Westover, L.: Footprint evaluation for volume rendering. In: Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques. SIGGRAPH 1990, pp. 367–376. ACM, New York (1990)Google Scholar
  21. 21.
    Xi, M., Wang, L.H., Yang, Q.Q., Li, D.X., Zhang, M.: Depth-image-based rendering with spatial and temporal texture synthesis for 3DTV. EURASIP J. Image Video Process. 2013(1), 1–18 (2013)CrossRefGoogle Scholar
  22. 22.
    Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRefGoogle Scholar
  23. 23.
    Zinger, S., Do, L., de With, P.H.N.: Free-viewpoint depth image based rendering. J. Vis. Commun. Image Represent. 21(5–6), 533–541 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.TU IlmenauIlmenauGermany
  2. 2.3DInteractive GmbHIlmenauGermany

Personalised recommendations