Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction

  • Chuanmin Jia
  • Yekang Yang
  • Xinfeng Zhang
  • Shiqi Wang
  • Shanshe Wang
  • Siwei MaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10735)


Light field (LF) attracts tremendous attention due to its capability of recording the intensity of scene objects as well as the direction of the light ray, which also dramatically increases the amount of redundant data. In this paper, we explore the structure of the light field images, and propose a pseudo-sequence based light field image compression with sub-aperture reordering and adaptive reconstruction to efficiently improve the coding performances. In the proposed method, we firstly decompose the lenslet image into sub-aperture images, and then design an optimized sub-aperture scan order to rearrange them sequentially as a pseudo-sequence. Third, we take advantage of the state-of-the-art video codec to compress the pseudo-sequence by leveraging both intra- and inter-view correlations. Considering the interpolation and transform induced by the reconstruction procedure from sub-aperture images to lenslet image, we propose an enhanced reconstruction method by applying region-based non-local adaptive filters which extracts the non-local similarities for collaborative filtering to promote the quality of reconstructed lenslet images. Extensive experimental results show that the proposed method achieves up to 15.7% coding gain in terms of BD-rate.


Light Field Image compression Sub-apertures arrangement Adaptive reconstruction 



This work was supported in part by the National High-tech R&D Program of China (863 Program, 2015AA015903) National Natural Science Foundation of China (61632001, 61571017, 61421062), and the Top-Notch Young Talents Program of China, which are gratefully acknowledged.


  1. 1.
    JPEG Pleno Final Call for Proposals on Light Field Coding.
  2. 2.
    Li, Y., Sjostrom, M., Olsson, R., Jennehag, U.: Efficient intra prediction scheme for light field image compression. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 539–543 (2014)Google Scholar
  3. 3.
    Zhong, R., Wang, S., Cornelis, B., Zheng, Y., Yuan, J., Munteanu, A.: L1-optimized linear prediction for light field image compression. In: 2016 IEEE Picture Coding Symposium, pp. 1–5 (2016)Google Scholar
  4. 4.
    Conti, C., Nunes, P., Soares, L.D.: HEVC-based light field image coding with bi-predicted self-similarity compensation. In: 2016 IEEE International Conference on Multimedia and Expo Workshops, pp. 1–4 (2016)Google Scholar
  5. 5.
    Zhang, X., Xiong, R., Ma, S., Gao, W.: Adaptive loop filter with temporal prediction. In: 2012 IEEE Picture Coding Symposium (PCS), pp. 437–440 (2012)Google Scholar
  6. 6.
    Zhang, X., Xiong, R., Lin, W., Zhang, J., Wang, S., Ma, S., Gao, W.: Low-rank based nonlocal adaptive loop filter for high efficiency video compression. IEEE Trans. Circ. Syst. Video Technol. (2016)Google Scholar
  7. 7.
    Ma, S., Zhang, X., Zhang, J., Jia, C., Wang, S., Gao, W.: Nonlocal in-loop filter: the way toward next-generation video coding? IEEE Multimed. 23(2), 16–26 (2016)CrossRefGoogle Scholar
  8. 8.
    Zhang, J., Jia, C., Ma, S., Gao, W.: Non-local structure-based filter for video coding. In: 2015 IEEE International Symposium on Multimedia, pp. 301–306 (2015)Google Scholar
  9. 9.
    Li, L., Li, Z., Li, B., Liu, D., Li, H.: Pseudo sequence based 2-D hierarchical reference structure for light-field image compression. arXiv preprint arXiv:1612.07309
  10. 10.
    Dansereau, D.G.: Light Field Toolbox for Matlab. Software Manual (2015)Google Scholar
  11. 11.
    Liu, D., Wang, L., Li, L., Xiong, Z., Wu, F., Zeng, W.: Pseudo-sequence-based light field image compression. In: 2016 IEEE International Conference on Multimedia and Expo Workshops, pp. 1–4 (2016)Google Scholar
  12. 12.
    Chen, J., Hou, J., Chau, L.P.: Light field compression with disparity guided sparse coding based on structural key views. arXiv preprint arXiv:1610.03684
  13. 13.
    Zhao, S., Chen, Z., Yang, K., Huang, H.: Light field image coding with hybrid scan order. In: 2016 IEEE Visual Communications and Image Processing, pp. 1–4 (2016)Google Scholar
  14. 14.
    Rerabek, M., Yuan, L., Authier, L.A., Ebrahimi, T.: EPFL light-field image dataset. ISO/IEC JTC 1/SC 29/WG1 (2015)Google Scholar
  15. 15.
    Tsai, C.-Y., et al.: Adaptive loop filtering for video coding. IEEE J. Selected Top. Sig. Process. 7(6), 934–945 (2013)CrossRefGoogle Scholar
  16. 16.
    Bossen, F., Flynn, D., Shring, K.: HEVC reference software manual. JCTVC-D404, Daegu, Korea (2011)Google Scholar
  17. 17.
    Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. ITU SG16 Document VCEG-M33, April 2001Google Scholar
  18. 18.
    Girod, B.: The efficiency of motion-compensating prediction for hybrid coding of video sequences. IEEE J. Sel. Areas Commun. 5(7), 1140–1154 (1987)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Chuanmin Jia
    • 1
  • Yekang Yang
    • 1
  • Xinfeng Zhang
    • 2
  • Shiqi Wang
    • 3
  • Shanshe Wang
    • 1
  • Siwei Ma
    • 1
    Email author
  1. 1.Institute of Digital MediaPeking UniversityBeijingChina
  2. 2.Rapid-Rich Object Search (ROSE) LabNanyang Technological UniversitySingaporeSingapore
  3. 3.Department of Computer ScienceCity University of Hong KongKowloon TongHong Kong

Personalised recommendations