Abstract
In distributed video coding, the quality of side information (SI) directly affects the final compression efficiency and rate-distortion performance. In the process of generating SI, many methods require accurate pixel matching and produce intermediate frames based on calculating motion vectors. As a result, they perform poorly in scenarios such as light changes, motion blur, and so on. In this case, phase-based frame interpolation for video (PBFI) is proved to be effective. And it has the advantages of simple implementation and easy parallelization. However, this method cannot get a good result when interpolating the video sequence of large motion. This paper proposes a phase-based SI generation method, which applies PBFI to distributed video coding and improves it from two aspects. (1) Move the high frequency information to the low frequency, reduce the proportion of the high frequency components, so that more frequency components can be interpolated in phase; (2) By correcting the phase difference again, more accurate phase shift information can be obtained when facing the video sequence of large motion. Simulation results show that the proposed method can effectively improve the quality of the generated SI. Thereby the overall performance of the distributed video coding system can be improved.
Similar content being viewed by others
References
Artigas X, Ascenso J, Dalai M, Klomp S, Kubasov D, Ouaret M (2007) The DISCOVER codec: architecture, techniques and evaluation. In: Proceedings of picture coding symposium, Lisbon, Portugal, pp 1–4
Cao Y, Sun L, Han C, Guo J (2018) Improved side information generation algorithm based on naive Bayesian theory for distributed video coding. IET Image Process 12(3):354–360. https://doi.org/10.1049/iet-ipr.2017.0892
Dash B, Rup S, Mohapatra A, Mohapatra A, Majhi B, Swamy MN (2018) Decoder driven side information generation using ensemble of MLP networks for distributed video coding. Multimed Tools Appl 77(12):15221–15250. https://doi.org/10.1007/s11042-017-5103-1
Dash B, Rup S, Mohapatra A, Mohapatra A, Majhi B, Swamy MN (2018) Multi-resolution extreme learning machine-based side information estimation in distributed video coding. Multimed Tools Appl 77(20):27301–27335. https://doi.org/10.1007/s11042-018-5921-9
Didyk P, Sitthi-Amorn P, Freeman WT, Durand F, Matusik W (2013) Joint view expansion and filtering for automultiscopic 3D displays. ACM Transactions on Graphics 32(6):221:1–221:8. https://doi.org/10.1145/2508363.2508376
Dufaux F, Gao W, Tubaro S, Vetro A (2009) Distributed video coding: trends and perspectives. EURASIP J Image Video Process 2009:508167. https://doi.org/10.1155/2009/508167
Gautama T, Van Hulle MA (2002) A phase-based approach to the estimation of the optical flow field using spatial filtering. IEEE Trans Neural Netw 13(5):1127–1136. https://doi.org/10.1109/TNN.2002.1031944
Jun D (2019) Distributed video coding with adaptive two-step side information generation for smart and interactive media. Displays 59:21–27. https://doi.org/10.1016/j.displa.2019.05.002
Luong HV, Raket LL, Huang X, Forchhammer S (2012) Side information and noise learning for distributed video coding using optical flow and clustering. IEEE Trans Image Process 21(12):4782–4796. https://doi.org/10.1109/TIP.2012.2215621
Rup S, Majhi B, Padhy S (2014) An improved side information generation for distributed video coding. AEUE - International Journal of Electronics and Communications 68(3):201–209. https://doi.org/10.1016/j.aeue.2013.08.005
Shen Y, Cheng H, Luo J, Lin Y, Wu J (2017) Efficient real-time distributed video coding by parallel progressive side information regeneration. IEEE Sensors J 17(6):1872–1883. https://doi.org/10.1109/JSEN.2017.2653100
Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation.IEEE international conference on image processing, ICIP (3) 1995: 444-447. https://doi.org/10.1109/ICIP.1995.537667
Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ (1992) Shiftable multiscale transforms. IEEE Trans Inf Theory 38(2):587–607. https://doi.org/10.1109/18.119725
Simone M, Oliver W, Henning Z, Max G, Alexander S (2015) Phase-based frame interpolation for video. In: IEEE Conference on Computer Vision and Pattern Recognition CVPR, vol 2015, pp 1410–1418. https://doi.org/10.1109/CVPR.2015.7298747
Slepian D, Wolf J (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19(4):471–480. https://doi.org/10.1109/TIT.1973.1055037
Taheri YM, Ahmad MO, Swamy M (2019) Successive refinement of side information frames in distributed video coding. Multimed Tools Appl 78(15):1–26. https://doi.org/10.1007/s11042-019-7249-5
Wadhwa N, Rubinstein M, Durand F, Freeman WT (2013) Phase-based video motion processing. ACM Transactions on Graphics 32(4):80:1–80:10. https://doi.org/10.1145/2461912.2461966
Wang W, Li J, Mo H, Chen J (2021, 2021) Side information hybrid generation based on improved motion vector field. Multimed Tools Appl. https://doi.org/10.1007/s11042-021-10870-8
Wyner AD, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22(1):1–10. https://doi.org/10.1109/TIT.1976.1055508
Zhou J, Fu Y, Yang Y, Yang Y, Ho A (2019) Distributed video coding using interval overlapped arithmetic coding. Signal Process Image Commun 76:118–124. https://doi.org/10.1016/j.image.2019.03.016
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant 61861045.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chen, H., Wang, W., Li, J. et al. Phase-based side information generation in distributed video coding. Multimed Tools Appl 81, 21295–21312 (2022). https://doi.org/10.1007/s11042-022-12589-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12589-6