Advertisement

Screen Content Coding: A Survey

  • Bingyi LiEmail author
  • Jiaqi Zou
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 550)

Abstract

Screen content is partly driven by the rapid development of screen applications such as wireless display, screen sharing, cloud computing and gaming, etc. Different from camera-captured content, screen content has relatively bad continuity in spatiotemporal domain and severe movements or sudden changes may occur in continuous pictures. Owing to the special characteristics of screen content, conventional coding tools including High Efficiency Video Coding (HEVC) standard are unsuitable for screen content coding (SCC). A SCC extension to HEVC was brought out and developed to meet the demand of screen content coding. This paper provides a brief survey on the main coding tools in the HEVC-SCC extension. Screen content sequences also pose challenges on transmission due to its discontinuity. The alternate presentation of moving and stationary pictures makes the exploitation of bandwidth a technical difficulty. This paper introduces the improvements of SCC rate control in HEVC with better transmission performance and more efficient bandwidth utilization.

Keywords

Screen Content Coding (SCC) High Efficiency Video Coding (HEVC) Video coding Rate control 

Notes

Acknowledgment

This work is supported by National Natural Science Foundation of China (Project 61471066) and the open project fund (No. 201600017) of the National Key Laboratory of Electromagnetic Environment, China.

References

  1. 1.
    Advanced Video Coding for Generic Audiovisual Services, ITU-T and ISO/IEC JTC1, document ITU-T Rec. H.264 and ISO/IEC 14496-10, May 2003Google Scholar
  2. 2.
    Yu, H., McCann, K., Cohen, R., Amon, P.: Requirements for an Extension of HEVC for Coding of Screen Content, ISO/IEC JTC 1/SC 29/WG 11, document MPEG2014/N14174, San Jose, CA, USA, January 2014Google Scholar
  3. 3.
    Sullivan, G.J., Ohm, J., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)CrossRefGoogle Scholar
  4. 4.
    Boyce, J., et al.: Edition 2 Draft Text of High Efficiency Video Coding (HEVC), Including Format Range (RExt), Scalability (SHVC), and Multi-View (MV-HEVC) Extensions, document JCTVC-R1013, Sapporo, Japan, July 2014Google Scholar
  5. 5.
    Narroschke, M.: Extending H.264/AVC by an adaptive coding of the prediction error. In: Proceedings of 25th Picture Coding Symposium (PCS), O5–3. Beijing, China, April 2006Google Scholar
  6. 6.
    Lan, C., Xu, J., Sullivan, G.J., Wu, F.: Intra Transform Skipping, document JCTVC-I0408, Geneva, Switzerland, April 2012Google Scholar
  7. 7.
    Peng, X., Lan, C., Xu, J., Sullivan, G. J.: Inter Transform Skipping, document JCTVC-I0408, Stockholm, Sweden, July 2012Google Scholar
  8. 8.
    Cohen, R., Vetro, A.: AHG8: Impact of Transform Skip on New Screen Content Material, document JCTVC-L0428, Geneva, Switzerland, January 2013Google Scholar
  9. 9.
    Peng, X., Xu, J., Guo, L., Sole, J., Karczewicz, M.: Non-RCE2: Transform Skip on Large TUs, document JCTVC-N0288, Vienna, Austria, July 2013Google Scholar
  10. 10.
    An, J., Zhao, L., Huang, Y.-W., Lei, S.: Residue Scan for Intra Transform Skip Mode, document JCTVC-J0053, Stockholm, Sweden, June 2012Google Scholar
  11. 11.
    He, D., Wang, J., Martin-Cocher, G.: Rotation of Residual Block for Transform Skipping, document JCTVC-J0093, Stockholm, Sweden, June 2012Google Scholar
  12. 12.
    Peng, X., Li, B., Xu, J.: On Residual Rotation for Inter and Intra BC Modes, document JCTVC-O0186, Geneva, Switzerland, October 2013Google Scholar
  13. 13.
    Lee, S., Kim, I.-K., Kim, C.: AHG7: Residual DPCM for HEVC Lossless coding, document JCTVC-L0117, Geneva, Switzerland, January 2013Google Scholar
  14. 14.
    Joshi, R., Sole, J., Karczewicz, M.: AHG8: Residual DPCM for Visually Lossless Coding, document JCTVC-M0351, Incheon, Korea, April 2013Google Scholar
  15. 15.
    Naccari, M., Mrak, M., Gabriellini, A., Blasi, S., Izquierdo, E.: Inter-Prediction Residual DPCM, Incheon, Korea, document JCTVC-M0442, April 2013Google Scholar
  16. 16.
    Nguyen, T., Khairat, A., Marpe, D.: Non-RCE1/Non- RCE2/AHG5/AHG8: Adaptive Inter-Plane Prediction for RGB Content, document JCTVC-M0230, Incheon, Korea, April 2013Google Scholar
  17. 17.
    Joshi, R., Xu, J.: HEVC Screen Content Coding Draft Text 1, document JCTVC-R1005, Sapporo, Japan, July 2014Google Scholar
  18. 18.
    Xu, X., Li, X., Liu, S.: Intra block copy for next generation video coding. In: ICMEW (2018)Google Scholar
  19. 19.
    Guo, L., Pu, W., Zou, F., Sole, J., Karczewicz, M., Joshi, R.: Color palette for screen content coding. In: 2014 IEEE International Conference on Image Processing (ICIP), 5556–5560 October 2014Google Scholar
  20. 20.
    Onno, P., Xiu, X., Huang, Y.-W., Joshi, R.: Suggested Combined Software and Text for Run-Based Palette Mode. JCTVC-R0348, July 2014Google Scholar
  21. 21.
    Liu, Y., Fang, C., Sun, J., Huang, X.: Fast Palette Mode Decision Methods for Coding Game Videos with HEVC-SCC. IEEE Trans. Circuits Syst. Video Technol. (2018)Google Scholar
  22. 22.
    Zhang, L., et al.: SCCE5 Test 3.2.1: In-Loop Color-Space Transform. JCTVC-R0147, July 2014Google Scholar
  23. 23.
    Henrique Malvar, S., Sullivan, G.J., Srinivasan, S.: Lifting-based reversible color transformations for image compression. In: SPIE Proceedings, 7073 (2008),  https://doi.org/10.1117/12.797091
  24. 24.
    Li, B., Xu, J., Sullivan, G., Zhou, Y., Lin, B.: Adaptive Motion Vector Resolution for Screen Content. JCTVC-S0085, October 2014Google Scholar
  25. 25.
    Guo, Y., Li, B., Sun, S., Xu, J.: Rate control for screen content coding in HEVC. In: IEEE International Symposium on Circuits & Systems, September 2015Google Scholar
  26. 26.
    Wang, S., Li, J., Wang, S., Ma, S., Gao, W.: A frame level rate control algorithm for screen content coding. In: ISCAS, May 2018Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.National Engineering Laboratory for Mobile Network SecurityBeijing University of Posts and TelecommunicationsBeijingChina
  2. 2.Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of EducationBeijing University of Posts and TelecommunicationsBeijingChina
  3. 3.School of Information and Communication EngineeringBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations