Skip to main content
SpringerLink
Log in

A Hierarchical modified AV1 codec for compression cartesian form of holograms in holo and object planes

  • 1207: Innovations in Multimedia Information Processing & Retrieval
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Three-dimensional (3D) image reconstruction is emerging as a leading challenge for 3D media on the Internet and virtual reality. In this regard, compression performance in 3D technology is one of the most important issues. Various codecs such as HEVC and AV1 have been suggested to improve compression performance in 3D technology. In this study, a hybrid method based on AV1 codec combined with mathematical methods is proposed for improving the quality of this codec. In the proposed method, two AV1 compression steps are used to estimate the AV1 codec error using a linear relationship and added to the basic codec output to improve the compression performance. The proposed method shows better quality in the Cartesian form (real and imaginary parts) of the hologram in Holo and Object plane when compared to new codecs that have been proposed in the field of 3D compression. In addition, the proposed method can be used as a general compression method for 2D images. Based on simulation results, the proposed method improved the quality of reconstructed hologram by up to 63% and 5 dB in terms of BDRate and BDPSNR, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. P Picart and S Montresor, “Digital holography,” in Optical Holography. Elsevier, 2020, pp 83–120

  2. GT Nemetallah, R Aylo, and LA Williams, “Analog and digital holography with matlab.” SPIE, 2015

  3. F Dufaux, Y Xing, B Pesquet-Popescu, and P Schelkens, “Compression of digital holographic data: an overview,” in Applications of Digital Image Processing XXXVIII, vol 9599. International Society for Optics and Photonics, 2015, p 95990I

  4. F Monroy, Holography: Different Fields of Application. BoD–Books on Demand, 2011

  5. T-C Poon and J-P Liu, Introduction to modern digital holography: with MATLAB. Cambridge University Press, 2014

  6. Peixeiro JP, Brites C, Ascenso J, Pereira F (2017) Holographic data coding: Benchmarking and extending hevc with adapted transforms. IEEE Trans on Multimedia 20(2):282–297

  7. C Gao, J Liu, X Li, G Xue, J Jia, and Y Wang, “Accurate compressed look up table method for cgh in 3d holographic display,” Optics express, vol 23, no 26, pp 33 194–33 204, 2015

  8. Y Xing, B Pesquet-Popescu, and F Dufaux, “Compression of computer generated hologram based on phase-shifting algorithm,” in European Workshop on Visual Information Processing (EUVIP). IEEE, 2013, pp 172–177

  9. Bernardo MV, Fernandes P, Arrifano A, Antonini M, Fonseca E, Fiadeiro PT, Pinheiro AM, Pereira M (2018) Holographic representation: Hologram plane vs. object plane. Signal Processing: Image Communication 68:193–206

    Google Scholar 

  10. Ali Z, Quang PD, Park J-H, Kim N et al (2011) Compression of digital hologram for three-dimensional object using wavelet-bandelets transform. Optics express 19(9):8019–8031

    Article  Google Scholar 

  11. K Viswanathan, P Gioia, and L Morin, “Wavelet compression of digital holograms: towards a view-dependent framework,” in Applications of Digital Image Processing XXXVI, vol 8856. International Society for Optics and Photonics, 2013, p 88561N

  12. Blinder D, Bruylants T, Ottevaere H, Munteanu A, Schelkens P (2014) Jpeg 2000-based compression of fringe patterns for digital holographic microscopy. Optical Engineering 53(12):123102

    Article  Google Scholar 

  13. Xing Y, Kaaniche M, Pesquet-Popescu B, Dufaux F (2015) Adaptive nonseparable vector lifting scheme for digital holographic data compression. Applied optics 54(1):A98–A109

    Article  Google Scholar 

  14. K Viswanathan, P Gioia, and L Morin, “A framework for view-dependent hologram representation and adaptive reconstruction,” in 2015 IEEE International Conference on Image Processing (ICIP). IEEE, 2015, pp 3334–3338

  15. D Blinder, H Ottevaere, A Munteanu, and P Schelkens, “Efficient multiscale phase unwrapping methodology with modulo wavelet transform,” Optics express, vol 24, no 20, pp 23 94–23 08, 2016

  16. D Blinder, “Efficient representation, generation and compression of digital holograms,” Ph.D. dissertation, PhD thesis, 2018

  17. T Birnbaum, D Blinder, C Schretter, and P Schelkens, “Compressing macroscopic near-field digital holograms with wave atoms,” in Digital Holography and Three-Dimensional Imaging. Optical Society of America, 2018, pp DW2F–5

  18. Blinder D, Ahar A, Bettens S, Birnbaum T, Symeonidou A, Ottevaere H, Schretter C, Schelkens P (2019) Signal processing challenges for digital holographic video display systems. Signal Processing: Image Communication 70:114–130

    Google Scholar 

  19. Bernardo MV, Fonseca E, Pinheiro AM, Fiadeiro PT, Pereira M (2021) Efficient coding of experimental holograms using speckle denoising. Signal Processing: Image Communication 96:116306

    Google Scholar 

  20. Shimobaba T, Blinder D, Makowski M, Schelkens P, Yamamoto Y, Hoshi I, Nishitsuji T, Endo Y, Kakue T, Ito T (2019) Dynamic-range compression scheme for digital hologram using a deep neural network. Optics letters 44(12):3038–3041

    Article  Google Scholar 

  21. H Ko and HY Kim, “Deep learning-based compression for phase-only hologram,” IEEE Access, 2021

  22. Muhamad RK, Birnbaum T, Gilles A, Mahmoudpour S, Oh K-J, Pereira M, Perra C, Pinheiro A, Schelkens P (2021) Jpeg pleno holography: scope and technology validation procedures. Applied Optics 60(3):641–651

    Article  Google Scholar 

  23. J-K Kim, K-J Kim, J-W Kang, K-J Oh, J-W Kim, D-W Kim, and Y-H Seo, “New compression method for full-complex holograms using the modified zerotree algorithm with the adaptive discrete wavelet transform,” Optics Express, vol 28, no 24, pp 36 27–36 45, 2020

  24. V Hajihashemi, HE Najafabadi, AA Gharahbagh, H Leung, M Yousefan, and JMR Tavares, “A novel high-efficiency holography image compression method, based on hevc, wavelet, and nearest-neighbor interpolation,” Multimedia Tools and Applications, pp 1–14, 2021

  25. L Yaroslavsky and J Astola, “Introduction to digital holography,” 2009

  26. Blinder D, Ahar A, Symeonidou A, Xing Y, Bruylants T, Schretter C, Pesquet-Popescu B, Dufaux F, Munteanu A, Schelkens P, Open access database for experimental validations of holographic compression engines, in, (2015) Seventh International Workshop on Quality of Multimedia Experience (QoMEX). IEEE 2015:1–6

  27. E Fonseca, P Fiadeiro, V Hajihashemi, M Bernardo, A Pinheiro, and M Pereira, Perceptual evaluation of speckle noise reduction techniques for phase shifting holograms, in 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 2019, pp 1–6

  28. Schelkens P, Ebrahimi T, Gilles A, Gioia P, Oh K-J, Pereira F, Perra C, Pinheiro AM (2019) Jpeg pleno: Providing representation interoperability for holographic applications and devices. ETRI journal 41(1):93–108

    Article  Google Scholar 

  29. Taubman DS, Marcellin MW (2002) Jpeg2000: Standard for interactive imaging. Proceedings of the IEEE 90(8):1336–1357

    Article  Google Scholar 

  30. Sullivan GJ, Ohm J-R, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (hevc) standard. IEEE Transactions on circuits and systems for video technology 22(12):1649–1668

    Article  Google Scholar 

  31. Chen Y, Murherjee D, Han J, Grange A, Xu Y, Liu Z, Parker S, Chen C, Su H, Joshi U, An overview of core coding tools in the av1 video codec, in, et al (2018) Picture Coding Symposium (PCS). IEEE 2018:41–45

  32. Grois D, Nguyen T, Marpe D, Coding efficiency comparison of av1, vp9, h. 265, mpeg-hevc, and h. 264, mpeg-avc encoders, in, (2016) Picture Coding Symposium (PCS). IEEE 2016:1–5

  33. Valin J (2016) Directional deringing filter. Internet Draft, Network Working Group, Internet Engineering Task Force

    Google Scholar 

  34. Mukherjee D, Bankoski J, Grange A, Han J, Koleszar J, Wilkins P, Xu Y, Bultje R, The latest open-source video codec vp9-an overview and preliminary results. in, (2013) Picture Coding Symposium (PCS). IEEE 2013:390–393

  35. D Amirkhani and A Bastanfard, “An objective method to evaluate exemplar-based inpainted images quality using jaccard index,” Multimedia Tools and Applications, pp 1–14, 2021

Download references

Author information

Authors and Affiliations

  1. Faculdade de Engenharia, Universidade do Porto, Porto, Portugal

    Vahid Hajihashemi, Abdoreza Alavi Gharahbagh, Hugo S. Oliveira & Zhen Ma

  2. Department of Computer Engineering, Karaj Branch, Islamic Azad University, Karaj, Iran

    Azam Bastanfard

  3. Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal

    Gonçalo Almeida

  4. Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal

    João Manuel R. S. Tavares

Authors
  1. Vahid Hajihashemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdoreza Alavi Gharahbagh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Azam Bastanfard
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hugo S. Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gonçalo Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhen Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. João Manuel R. S. Tavares
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vahid Hajihashemi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hajihashemi, V., Gharahbagh, A.A., Bastanfard, A. et al. A Hierarchical modified AV1 codec for compression cartesian form of holograms in holo and object planes. Multimed Tools Appl 82, 8303–8321 (2023). https://doi.org/10.1007/s11042-021-11567-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11567-8

Keywords

Search

Navigation