Skip to main content
SpringerLink
Log in

Fast 3D-HEVC intra-prediction for depth map based on a self-organizing map and efficient features

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The ISO/IEC MPEG and ITU-T Video Coding Experts Group formed the Joint Collaborative Team on 3D Video Coding to develop the new 3D video coding standard 3D High-Efficiency Video Coding (3D-HEVC) which is based on MultiView plus Depth map data format which associates a depth map to each texture frame. The depth map intra-prediction provides the conventional HEVC intra modes and adds the depth modeling modes as new coding tools for depth map intra-predictions, which enables high coding efficiency, but also results in a very high encoding complexity and excludes the 3D-HEVC from the real-time applications. In this paper, we proposed a fast mode decision algorithm for depth map intra-coding based on efficient features. We used constructed training data and a self-organizing algorithm in the test model to skip unnecessary depth map intra modes for each prediction unit. The experimental results show that the proposed model brings a good complexity reduction with negligible loss of rate-distortion performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data Availability

All of the material is owned by the authors and/or no permissions are required

References

  1. Wang, S.: Special issue on real-time 3D imaging and processing. J. Real-Time Image Proc. 07, 1 (2012)

    Article  Google Scholar 

  2. Tech, G., Chen, Y., Müller, K., Ohm, J.R., Vetro, A., Wang, Y.K.: Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 26(1), 35 (2016)

    Article  Google Scholar 

  3. Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Rhee, F.H., Tech, G., Winken, M., Wiegand, T.: 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans. Image Process. 22(9), 3366 (2013)

    Article  ADS  MathSciNet  PubMed  Google Scholar 

  4. Sullivan, G.J., Boyce, J.M., Chen, Y., Ohm, J.R., Segall, C.A., Vetro, A.: Standardized extensions of high efficiency video coding (HEVC). IEEE J. Sel. Top. Signal Process. 7(6), 1001 (2013)

    Article  ADS  Google Scholar 

  5. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649 (2012)

    Article  Google Scholar 

  6. Kauff, P., Atzpadin, N., Fehn, C., Müller, M., Schreer, O., Smolic, A., Tanger, R.: Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Process. Image Commun. 22(2), 217 (2007)

    Article  Google Scholar 

  7. Qiuwen, Z., Kunqiang, H., Bin, J., Yong, G.: Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock. J. Real-Time Image Proc. 16, 1909–1926 (2019)

    Article  Google Scholar 

  8. Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004)

  9. Gustavo, S., César, M., Luciano, A.: Real-time scalable hardware architecture for 3D-HEVC bipartition modes. J. Real-Time Image Proc. 13, 71–83 (2017)

    Article  Google Scholar 

  10. Hamout, H., Elyousfi, A.: Low complexity intra mode decision algorithm for 3D-HEVC, pp. 1475–1479 (2017)

  11. Peng, K.K., Chiang, J.C., Lie, W.N.: Low complexity depth intra coding combining fast intra mode and fast CU size decision in 3D-HEVC. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 1126–1130 (2016). https://doi.org/10.1109/ICIP.2016.7532533

  12. Gao, P., Smolic, A.: Occlusion-aware depth map coding optimization using allowable depth map distortions. IEEE Trans. Image Process. 28(11), 5266 (2019)

    Article  ADS  MathSciNet  PubMed  Google Scholar 

  13. Silva, T., Agostini, L., da Silva Cruz, L.: Fast intra prediction algorithm based on texture analysis for 3D-HEVC encoders. J. Real-Time Image Proc. 12, 357–368 (2016)

    Article  Google Scholar 

  14. Zhang, Q., Yang, Y., Chang, H.W., Zhang, W., Gan, Y.: Fast intra mode decision for depth coding in 3D-HEVC. Multidimens. Syst. Signal Process. 28, 1203–1226 (2017)

    Article  MathSciNet  Google Scholar 

  15. Wang, B., Zeng, H., Cai, C., Ma, K.K.: Sum-of-gradient based fast intra coding in 3D-HEVC for depth map sequence (SOG-FDIC). J. Vis. Commun. Image Represent. 48, 329 (2017)

    Article  Google Scholar 

  16. Jinchao, Z., Xiaoxin, Z., Weiwei, Z., Fenqin, W., Qiuwen, Z.: An efficient depth modeling mode decision algorithm for 3D-HEVC depth map coding. Optik 127(24), 12048 (2016)

    Article  Google Scholar 

  17. Zhang, H.B., Fu, C.H., Chan, Y.L., Tsang, S.H., Siu, W.C.: Probability-based depth intra-mode skipping strategy and novel VSO metric for DMM decision in 3D-HEVC. IEEE Trans. Circuits Syst. Video Technol. 28(2), 513 (2018)

    Article  Google Scholar 

  18. Hamout, H., Elyousfi, A.: Fast depth map intra coding for 3D video compression-based tensor feature extraction and data analysis. IEEE Trans. Circuits Syst. Video Technol. 30(7), 1933 (2020)

    Google Scholar 

  19. Lin, Y.C., Lai, J.C.: Edge density early termination algorithm for HEVC coding tree block. In: 2014 International Symposium on Computer, Consumer and Control, pp. 39–42 (2014)

  20. Van Wallendael, G., Van Leuven, S., De Cock, J., Bruls, F., Van de Walle, R.: 3D video compression based on high efficiency video coding. IEEE Trans. Consum. Electron. 58(1), 137 (2012)

    Article  Google Scholar 

  21. Sole, J., Joshi, R., Nguyen, N., Ji, T., Karczewicz, M., Clare, G., Henry, F., Duenas, A.: Transform coefficient coding in HEVC. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1765 (2012)

    Article  Google Scholar 

  22. Hamout, H., Elyousfi, A.: An efficient edge detection algorithm for fast intra-coding for 3D video extension of HEVC. J. Real-Time Image Proc. 16, 2093–2105 (2019)

    Article  Google Scholar 

  23. Fu, C.H., Zhang, H.B., Su, W.M., Tsang, S.H., Chan, Y.L.: Fast wedgelet pattern decision for DMM in 3D-HEVC. In: 2015 IEEE International Conference on Digital Signal Processing (DSP), pp. 477–481 (2015)

  24. Miljković, D.: Brief review of self-organizing maps. In: 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1061–1066 (2017)

  25. Huang, Y.H., Ou, T.S., Chen, H.H.: Fast decision of block size, prediction mode, and intra block for H.264 intra prediction. IEEE Trans. Circuits Syst. Video Technol. 20(8), 1122 (2010)

    Article  Google Scholar 

  26. Elyousfi, A., Hamout, H., Hachimi, A.E.: An efficient intra block size decision for H.264/AVC encoding optimization. In: 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA), pp. 1–5 (2016)

  27. 3D-HEVC Reference Software: HTM Version 16.3. https://hevc.hhi.fraunhofer.de/trac/3dhevc/browser/3DVCSoftware/tags/HTM-16.3

  28. Uller, K.M., Vetro, A.: Common test conditions of 3DV core experiments. Joint Collaborative Team on 3D Video Coding Extension Development Document JCT3V-G1100 7th Meeting, San Jos, US (2014)

  29. Bjontegaard, G.: ITU-T SG 16 Q.6 VCEG, document VCEG-M33 (2014)

Download references

Funding

I declare that the authors have no funding source.

Author information

Authors and Affiliations

  1. Computer Systems and Vision Laboratory, Faculty of Sciences, Ibn-Zohr University, Agadir, Morocco

    Hamza Hamout & Amal Hammani

  2. Computer Science Department, ENSA Ibn-Zohr University, Agadir, Morocco

    Abderrahmane Elyousfi

Authors
  1. Hamza Hamout
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amal Hammani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abderrahmane Elyousfi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HH and AE wrote: Abstract, Introduction. AH and AE wrote: Sect. 2 and prepared their Figs. 1–4. HH and AH wrote: Sects. 3 and 4 and prepared their Fig. 5. HH, AH and AE: Sect. 5 and 6 and prepared their Fig. 6.

Corresponding author

Correspondence to Hamza Hamout.

Ethics declarations

Conflict of interest

I declare that the authors have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamout, H., Hammani, A. & Elyousfi, A. Fast 3D-HEVC intra-prediction for depth map based on a self-organizing map and efficient features. SIViP 18, 2289–2296 (2024). https://doi.org/10.1007/s11760-023-02904-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02904-5

Keywords

Search

Navigation