Advertisement

Multimedia Tools and Applications

, Volume 75, Issue 8, pp 4383–4410 | Cite as

Remote rendering solutions using web technologies

  • Peter Quax
  • Jori Liesenborgs
  • Arno Barzan
  • Martijn Croonen
  • Wim Lamotte
  • Bert Vankeirsbilck
  • Bart Dhoedt
  • Tom Kimpe
  • Kurt Pattyn
  • Matthew McLin
Article

Abstract

Remote rendering is a well-known solution to the issue of running high-performance applications requiring complex visualizations on less capable hardware/software platforms or when client access to the data source for visualization is undesired or prohibitive in terms of required bandwidth. Visualizing the output of these remote rendering applications is typically achieved through native applications or, when considering a browser environment, through plug-ins. In this paper, several solutions are presented that enable deployment of these applications on standard web browsers, even those from the pre-HTML5 era. The focus in this paper is on two specific use case scenarios, taking into account that the proposed solutions are generic enough to be applied to a range of similar applications. The technologies presented cover the entire range of sub-processes contained in a complete remote rendering solution, such as the establishment of interaction feedback channels and delivery of images as part of the rendering pipeline. Depending on factors such as application requirements, developer preferences, feature availability in the web browser or raw performance figures, a custom solution can be composed from the options discussed in this paper. This is illustrated by applying them to the two aforementioned use cases, each with specific requirements and challenges, and benchmarking these example setups in terms of performance. A comparison of advantages and disadvantages is presented to guide developers in applying the technologies under real-life conditions.

Keywords

Remote rendering Web technology Scalability 

Notes

Acknowledgements

Part of this work is funded by IWT of Flanders through the R&D project CIRRUS.

References

  1. 1.
    Beznosyk A, Quax P, Coninx K, Lamotte W (2012) The influence of cooperative game design patterns for remote play on player experience. In: APCHI, pp 11–20Google Scholar
  2. 2.
    Boukerche A, Pazzi RWN (2006) Remote rendering and streaming of progressive panoramas for mobile devices. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, MULTIMEDIA ’06. ACM, New York, pp 691–694Google Scholar
  3. 3.
    Ericsson Research (2014) OpenWebRTC. [Online; accessed 5-Dec-2014]. http://www.openwebrtc.io/
  4. 4.
    Evans A, Romeo M, Bahrehmand A, Agenjo J, Blat J (2014) 3d graphics on the web: A survey. Comput Graph 41(0):43–61CrossRefGoogle Scholar
  5. 5.
    Glander T, Moreno A, Aristizabal M, Congote J, Posada J, Garcia-Alonso A, Ruiz O (2013) Reweb3d: Enabling desktop 3d applications to run in the web. In: Proceedings of the 18th International Conference on 3D Web Technology, Web3D ’13. ACM, New York, pp 147–155Google Scholar
  6. 6.
    Google (2014) WebRTC Native Code Package. [Online; accessed 5-Dec-2014]. http://www.webrtc.org/webrtc-native-code-package
  7. 7.
    Hickson I (2012) The websocket API. Candidate recommendation, W3C. http://www.w3.org/TR/2012/CR-websockets-20120920/
  8. 8.
    Jacinto H, Kéchichian R, Desvignes M, Prost R, Valette S (2012) A web interface for 3d visualization and interactive segmentation of medical images. In: Proceedings of the 17th International Conference on 3D Web Technology, Web3D ’12. ACM, New York, pp 51–58Google Scholar
  9. 9.
    Jourdain S, Ayachit U, Geveci B (2010) Paraviewweb, a web framework for 3d visualization and data processing. In: IADIS International Conference on Web Virtual Reality and Three-Dimensional Worlds, p 07Google Scholar
  10. 10.
    Kapetanakis K, Panagiotakis S, Malamos AG (2013) Html5 and websockets; challenges in network 3d collaboration. In: Proceedings of the 17th Panhellenic Conference on Informatics, PCI ’13. ACM, New York, pp 33–38Google Scholar
  11. 11.
    Manzano M, Hernandez J, Uruena M, Calle E (2012) An empirical study of cloud gaming. In: 2012 11th Annual Workshop on Network and Systems Support for Games (NetGames), pp 1–2Google Scholar
  12. 12.
    Marion C, Pouderoux J, Jomier J, Jourdain S, Hanwell M (2013) and U. Ayachit. A hybrid visualization system for molecular models. In: Proceedings of the 18th International Conference on 3D Web Technology, Web3D ’13. ACM, New York, pp 117–120Google Scholar
  13. 13.
    Narayanan A, Jennings C, Bergkvist A, Burnett D (2013) WebRTC 1.0: Real-time communication between browsers, W3C working draft, W3C. http://www.w3.org/TR/2013/WD-webrtc-20130910/
  14. 14.
    OL2 Inc (2014) Onlive. [Online; accessed 5-Dec-2014]. http://www.onlive.com
  15. 15.
    Quax P, Issaris P, Vanmontfort W, Lamotte W (2012) Evaluation of distribution of panoramic video sequences in the explorative television project. In: Network and Operating System Support for Digital Audio and Video Workshop, NOSSDAV ’12, Toronto, ON, Canada, June 7-8, 2012, pp 45–50Google Scholar
  16. 16.
    Shi S, Nahrstedt K, Campbell R (2012) A real-time remote rendering system for interactive mobile graphics. ACM Trans Multimedia Comput Commun Appl 8(3s):46:1–46:20CrossRefGoogle Scholar
  17. 17.
    Sony Inc (2014) Playstation Now. [Online; accessed 5-Dec-2014]. https://www.playstation.com/en-us/explore/psnow
  18. 18.
    Steed A, Oliveira MF (2009) Networked Graphics: Building Networked Games and Virtual Environments. Morgan Kaufmann Publishers Inc., San FranciscoGoogle Scholar
  19. 19.
    The Guardian Google’s WebM v H.264: who wins and loses in the video codec wars?. http://www.theguardian.com/technology/blog/2011/jan/17/google-webm-vp8-video-html5-h264-winners-losers
  20. 20.
    Wessels A, Purvis M, Jackson J, Rahman SS (2011) Remote data visualization through websockets. In: Proceedings of the 2011 Eighth International Conference on Information Technology: New Generations, ITNG ’11. IEEE Computer Society, Washington, pp 1050–1051Google Scholar
  21. 21.
    Yoon I (2000) Web-based Remote Rendering with Image-based Rendering Acceleration and Compression, PhD thesis. University of Southern California, Los Angeles, p AAI3041546Google Scholar
  22. 22.
    Zorrilla M, Martin A, Sanchez JR, Tamayo In, Olaizola IG (2014) Html5-based system for interoperable 3d digital home applications. Multimedia Tools Appl. 71(2):533–553CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Peter Quax
    • 1
  • Jori Liesenborgs
    • 1
  • Arno Barzan
    • 1
  • Martijn Croonen
    • 1
  • Wim Lamotte
    • 1
  • Bert Vankeirsbilck
    • 2
  • Bart Dhoedt
    • 2
  • Tom Kimpe
    • 3
  • Kurt Pattyn
    • 3
  • Matthew McLin
    • 4
  1. 1.Expertise Centre for Digital MediaiMinds / tUL / Universiteit HasseltDiepenbeekBelgium
  2. 2.Department of Information Technology, Internet Based Communication Networks and Services (IBCN)Ghent University - iMindsGentBelgium
  3. 3.Barco NVKortrijkBelgium
  4. 4.Barco IncBeavertonUSA

Personalised recommendations