A Practical Low Latency System for Cloud-Based VR Applications

  • Shuangfei Tian
  • Mingyi YangEmail author
  • Wei Zhang
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 313)


With the development of multimedia technologies, VR services have quickly gained popularity at an accelerating speed. To reduce the high cost of purchasing high-performance VR terminals for end users and to enhance the user experience, recently, the concept of cloud-based VR was proposed which brings the cloud computing technologies to VR services. On-cloud GPU clusters and multi-core servers are expected to be used for simplifying VR terminals at the users’ side. This idea, however, arises several challenges in deploying such cloud-based VR system for practical applications, among which the cloud-to-end latency is mainly concerned. In this paper, we designed a practical solution for bearing cloud-based VR applications. We aim at reducing the cloud-to-end latency to improve the experience of end users. In our system, a frame splitting technique was proposed to fulfill the goal. Specially designed algorithms including reference frame determination and rate control strategies were also included to limit the computational complexity and improve the coding efficiency while obtaining promising user experience. Experimental results showed that the proposed system can significantly reduce the cloud-to-end latency.


Cloud-based VR Cloud-to-end latency H.264 coding scheme Rate control 


  1. 1.
    Bellini, H.: The real deal with virtual and augmented reality (January 2016).
  2. 2.
    Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. VCEG-M33 (2001)Google Scholar
  3. 3.
    Boyce, J., Alshina, E., Abbas, A., Ye, Y.: JVET common test conditions and evaluation procedures for 360 video. Joint Video Explor. Team ITU-T SG 16 (2017)Google Scholar
  4. 4.
    Chan, K., Ichikawa, K., Watashiba, Y., Iida, H.: Cloud-based VR gaming: our vision on improving the accessibility of VR gaming. In: Proceedings of the International Symposium on Ubiquitous Virtual Reality, pp. 24–25 (June 2017)Google Scholar
  5. 5.
    Espelien, J.: The future of consumer VR and its impact on video viewing, 2016–2025 (January 2016). umervr-and-its-impact-on-video-viewing-2016-2025/
  6. 6.
    Freina, L., Ott, M.: A literature review on immersive virtual reality in education: state of the art and perspectives. eLearning Softw. Educ. (1), 133–141 (2015)Google Scholar
  7. 7.
    Hou, X., Lu, Y., Dey, S.: Wireless VR/AR with edge/cloud computing. In: Proceedings of the 26th International Conference on Computer Communication and Networks, pp. 1–8 (July 2017)Google Scholar
  8. 8.
    Ltd., H.T.C.: Cloud VR solution white paper (September 2018).
  9. 9.
    McMahan, R.P., Bowman, D.A., Zielinski, D.J., Brady, R.B.: Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans. Visual. Comput. Graph. 18(4), 626–633 (2012) CrossRefGoogle Scholar
  10. 10.
    Merritt, L., Vanam, R.: X264: a high performance H. 264/AVC encoder (2006).
  11. 11.
    Moglia, A., Ferrari, V., Morelli, L., Ferrari, M., Mosca, F., Cuschieri, A.: A systematic review of virtual reality simulators for robot-assisted surgery. Eur. Urol. 69(6), 1065–1080 (2016) CrossRefGoogle Scholar
  12. 12.
    Schmoll, R., Pandi, S., Braun, P.J., Fitzek, F.H.P.: Demonstration of VR/AR offloading to mobile edge cloud for low latency 5G gaming application. In: Proceedings of the 15th IEEE Annual Consumer Communications Networking Conference, pp. 1–3 (January 2018)Google Scholar
  13. 13.
    Sreedhar, K.K., Aminlou, A., Hannuksela, M.M., Gabbouj, M.: Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications. In: Proceedings of the IEEE International Symposium on Multimedia, pp. 583–586 (December 2016)Google Scholar
  14. 14.
    Wiegand, T.: Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H. 264— ISO/IEC 14496–10 AVC). JVT-G050 (2003)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2020

Authors and Affiliations

  1. 1.State Key Laboratory of ISNXidian UniversityXi’anChina

Personalised recommendations