Abstract
Panoramic videos have emerged as a widely-used media format as they provide immersive and interactive experience, but their large resolution and high frame rate pose great challenges for video compression efficiency. The challenges are relieved by tile-based viewport adaptive streaming, in which the viewport switching latency is critical to users’ quality of experience. Existing methods for reducing the switching latency are limited to single high-quality stream. In this paper, we propose a smooth viewport switching strategy, where a panoramic video is encoded into a low-quality stream and multiple high-quality streams. The low-quality stream provides basic quality for the entire video, while the high-quality streams delivery real-time high-quality rendering for the current viewport. The multiple high-quality streams have different starting times during encoding, resulting in interleaved keyframes. These interleaved keyframes serve as random access points when the viewport switches. Smooth switching is achieved through selecting the stream corresponding to the keyframe closest to the switching point. The experimental results show that our method is significantly superior to existing methods.
This work was supported in part by the National Key R &D Program of China (2021YFF0900500).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boyce, J., Alshina, E., Abbas, A., Ye, Y.: JVET-G1030: JVET common test conditions and evaluation procedures for 360\(^\circ \) video (2018)
Corbillon, X., Devlic, A., Simon, G., Chakareski, J.: Viewport-adaptive navigable 360-degree video delivery. In: IEEE International Conference on Communications, vol. abs/1609.08042 (2017)
Duanmu, F., Kurdoglu, E., Liu, Y., Wang, Y.: View direction and bandwidth adaptive 360 degree video streaming using a two-tier system. In: 2017 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–4. IEEE (2017)
de la Fuente, Y.S., Bhullar, G.S., Skupin, R., Hellge, C., Schierl, T.: Delay impact on MPEG OMAF’s tile-based viewport-dependent 360 video streaming. IEEE J. Emerg. Sel. Top. Circuits Syst. 9(1), 18–28 (2019)
Ghaznavi-Youvalari, R., Zare, A., Aminlou, A., Hannuksela, M.M., Gabbouj, M.: Shared coded picture technique for tile-based viewport-adaptive streaming of omnidirectional video. IEEE Trans. Circuits Syst. Video Technol. 29(10), 3106–3120 (2018)
Hannuksela, M.M., Wang, Y.K.: An overview of omnidirectional media format (OMAF). Proc. IEEE 109(9), 1590–1606 (2021)
Koch, C., Rak, A.T., Zink, M., Steinmetz, R., Rizk, A.: Transitions of viewport quality adaptation mechanisms in 360 degree video streaming. In: ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, pp. 14–19 (2019)
Nguyen, D.V., Tran, H.T., Pham, A.T., Thang, T.C.: An optimal tile-based approach for viewport-adaptive 360-degree video streaming. IEEE J. Emerg. Sel. Top. Circuits Syst. 9(1), 29–42 (2019)
Reese, W.: Nginx: the high-performance web server and reverse proxy. Linux J. 2008(173), 2 (2008)
Song, J., Yang, F., Zhang, W., Zou, W., Fan, Y., Di, P.: A fast FoV-switching DASH system based on tiling mechanism for practical omnidirectional video services. IEEE Trans. Multimedia 22(9), 2366–2381 (2019)
Stockhammer, T.: Dynamic adaptive streaming over HTTP-standards and design principles. In: ACM Conference on Multimedia Systems, pp. 133–144 (2011)
Wang, S., Tan, X., Li, S., Xu, X., Yang, J., Zheng, Q.: A QoE-based 360 video adaptive bitrate delivery and caching scheme for C-RAN. In: International Conference on Mobility, Sensing and Networking, pp. 49–56. IEEE (2020)
Xie, L., Xu, Z., Ban, Y., Zhang, X., Guo, Z.: 360ProbDASH: improving QoE of 360 video streaming using tile-based http adaptive streaming. In: ACM International Conference on Multimedia, pp. 315–323 (2017)
Yang, M., Liang, H., Yang, F.: Real-time adaptive switching mechanism towards viewport-adaptive omnidirectional video streaming. In: IEEE International Conference on Multimedia & Expo Workshops, pp. 1–6. IEEE (2021)
Yaqoob, A., Bi, T., Muntean, G.M.: A survey on adaptive 360 video streaming: solutions, challenges and opportunities. IEEE Commun. Surv. Tutor. 22(4), 2801–2838 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Man, H., Wang, X., Fan, X. (2024). Multi-stream-Based Low-Latency Viewport Switching Scheme for Panoramic Videos. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14435. Springer, Singapore. https://doi.org/10.1007/978-981-99-8552-4_9
Download citation
DOI: https://doi.org/10.1007/978-981-99-8552-4_9
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8551-7
Online ISBN: 978-981-99-8552-4
eBook Packages: Computer ScienceComputer Science (R0)