Skip to main content

Towards Optimal Multirate Encoding for HTTP Adaptive Streaming

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12572)

Abstract

HTTP Adaptive Streaming (HAS) enables high quality streaming of video contents. In HAS, videos are divided into short intervals called segments, and each segment is encoded at various quality/bitrates to adapt to the available channel rate. Multiple encoding of the same content imposes high cost for video content providers. To reduce the time-complexity of encoding multiple representations, state-of-the-art methods typically encode the highest quality representation first and reuse the information gathered during its encoding to accelerate the encoding of the remaining representations. As encoding the highest quality representation requires the highest time-complexity compared to the lower quality representations, it would be a bottleneck in parallel encoding scenarios and the overall time-complexity will be limited to the time-complexity of the highest quality representation. In this paper and to address this problem, we consider all representations from the highest to the lowest quality representation as a potential, single reference to accelerate the encoding of the other, dependent representations. We formulate a set of encoding modes and assess their performance in terms of BD-Rate and time-complexity, using both VMAF and PSNR as objective metrics. Experimental results show that encoding a middle quality representation as a reference, can significantly reduce the maximum encoding complexity and hence it is an efficient way of encoding multiple representations in parallel. Based on this fact, a fast multirate encoding method is proposed which utilizes depth and prediction mode of a middle quality representation to accelerate the encoding of the dependent representations.

Keywords

  • HEVC
  • Video encoding
  • Multirate encoding
  • DASH

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-67832-6_38
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-67832-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

Notes

  1. 1.

    https://cloud.google.com/compute/docs/machine-types#n1_machine_types.

References

  1. Amirpour, H., Çetinkaya, E., Timmerer, C., Ghanbari, M.: Fast multi-rate encoding for adaptive http streaming. In: 2020 Data Compression Conference (DCC), pp. 358–358 (2020)

    Google Scholar 

  2. Amirpour, H., Ghanbari, M., Pinheiro, A., Pereira, M.: Motion estimation with chessboard pattern prediction strategy. Multimed. Tools Appli. 78(15), 21785–21804 (2019)

    CrossRef  Google Scholar 

  3. Bentaleb, A., Taani, B., Begen, A.C., Timmerer, C., Zimmermann, R.: A survey on bitrate adaptation schemes for streaming media over http. IEEE Commun. Surv. Tutorials 21(1), 562–585 (2019)

    CrossRef  Google Scholar 

  4. Bossen, F., et al.: Common test conditions and software reference configurations. JCTVC-L1100 12, 7 (2013)

    Google Scholar 

  5. Bubolz, T.L.A., Conceição, R.A., Grellert, M., Agostini, L., Zatt, B., Correa, G.: Quality and energy-aware HEVC transrating based on machine learning. IEEE Trans. Circuits Syst. I Regul. Pap. 66(6), 2124–2136 (2019). https://doi.org/10.1109/TCSI.2019.2903978

    CrossRef  Google Scholar 

  6. Cisco: cisco visual networking index: forecast and methodology, 2017–2022 (White Paper) (2019)

    Google Scholar 

  7. De Praeter, J., et al.: Fast simultaneous video encoder for adaptive streaming. In: 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–6, October 2015. https://doi.org/10.1109/MMSP.2015.7340802

  8. Finstad, D.H., Stensland, H.K., Espeland, H., Halvorsen, P.: Improved multi-rate video encoding. In: 2011 IEEE International Symposium on Multimedia, pp. 293–300, December 2011. https://doi.org/10.1109/ISM.2011.53

  9. Goswami, K., et al.: Adaptive multi-resolution encoding for ABR streaming. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 1008–1012, October 2018. https://doi.org/10.1109/ICIP.2018.8451485

  10. Guo, B., Han, Y., Wen, J.: Fast block structure determination in Av1-based multiple resolutions video encoding. In: 2018 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6, July 2018. https://doi.org/10.1109/ICME.2018.8486492

  11. Kim, I., Min, J., Lee, T., Han, W., Park, J.: Block partitioning structure in the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1697–1706 (2012)

    CrossRef  Google Scholar 

  12. Schroeder, D., Ilangovan, A., Reisslein, M., Steinbach, E.: Efficient multi-rate video encoding for HEVC-based adaptive HTTP streaming. IEEE Trans. Circuits Syst. Video Technol. 28(1), 143–157 (2018). https://doi.org/10.1109/TCSVT.2016.2599028

    CrossRef  Google Scholar 

  13. Schroeder, D., Ilangovan, A., Steinbach, E.: Multi-rate encoding for HEVC-based adaptive http streaming with multiple resolutions. In: 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–6, October 2015. https://doi.org/10.1109/MMSP.2015.7340822

  14. Schroeder, D., Rehm, P., Steinbach, E.: Block structure reuse for multi-rate high efficiency video coding. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3972–3976, September 2015. https://doi.org/10.1109/ICIP.2015.7351551

  15. Sodagar, I.: The MPEG-DASH standard for multimedia streaming over the internet. IEEE Multimed. 18(4), 62–67 (2011). https://doi.org/10.1109/MMUL.2011.71

    CrossRef  Google Scholar 

  16. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    CrossRef  Google Scholar 

  17. Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the h.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13(7), 560–576 (2003)

    Google Scholar 

  18. Zaccarin, A., Boon-lock yeo: multi-rate encoding of a video sequence in the DCT domain. In: 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353), vol. 2, pp. II-II, May 2002. https://doi.org/10.1109/ISCAS.2002.1011444

  19. Çetinkaya, E., Amirpour, H., Timmerer, C., Ghanbari, M.: FaME-ML: fast multirate encoding for HTTP adaptive streaming using machine learning. In: 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP) (2020)

    Google Scholar 

Download references

Acknowledgment

This research has been supported in part by the Christian Doppler Laboratory ATHENA (https://athena.itec.aau.at/).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hadi Amirpour .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Amirpour, H., Çetinkaya, E., Timmerer, C., Ghanbari, M. (2021). Towards Optimal Multirate Encoding for HTTP Adaptive Streaming. In: , et al. MultiMedia Modeling. MMM 2021. Lecture Notes in Computer Science(), vol 12572. Springer, Cham. https://doi.org/10.1007/978-3-030-67832-6_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-67832-6_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-67831-9

  • Online ISBN: 978-3-030-67832-6

  • eBook Packages: Computer ScienceComputer Science (R0)