Multimedia Tools and Applications

, Volume 60, Issue 3, pp 609–639 | Cite as

Sprite-based generation of side information for multi-view Distributed Video Coding

  • Lucian Ciobanu
  • Luís Côrte-Real


Generation of side information for multi-view Distributed Video Coding in multi-camera environments (e.g., video surveillance) poses challenges in scenarios with temporary non-overlapping among views and consequently, no resources for generating the side information at some time instants. In this paper we extend our previous work (Ciobanu and Corte-Real, Multimed Tools Appl 48(3):411–436, 2010) (for scenarios with permanent complete-overlapping among views) and propose a solution to this problem by exploiting the past visual data associated with each view, gathered over time as a panoramic image (sprite). The entire collection of temporal data from all the cameras is subsequently used for generating the side information. We tackle several topics related to these scenarios and propose solutions for the encountered issues. Optimization techniques are also discussed, e.g., temporal tags and block alternatives associated with the sprite contents for an improved generation of side information. This paper also presents a post-processing technique for additional refinement of generated side information. Practical results show an overall significant enhancement of side information by over 2 dB.


Distributed Video Coding (DVC) Wyner-Ziv (WZ) Side information generation Scale-Invariant Feature Transform (SIFT) SIFT-based multi-view registration (SMVR) Global motion estimation (GME) Sprites Multi-view registration metric (MVRM) Structural similarity (SSIM) 



The first author acknowledges the Fundação para a Ciência e a Tecnologia, Portugal, for the financial support.


  1. 1.
    Aaron A, Girod B (2004) Wyner-ziv video coding with low encoder complexity. In: Proc. international Picture Coding Symposium, PCS’04, San Francisco, CAGoogle Scholar
  2. 2.
    Aaron A, Rane S, Girod B (2004) Wyner-ziv video coding with hash-based motion-compensation at the receiver. In: Proc. IEEE intl. conference on image processing, SingaporeGoogle Scholar
  3. 3.
    Artigas X, Angeli E, Torres L (2006) Side information generation for multiview distributed video coding using a fusion approach. In: 7th Nordic Signal Processing Symposium, NORSIG’06, Reykjavik, Iceland, 7–9 June 2006Google Scholar
  4. 4.
    Ascenso J, Pereira F (2007) Adaptive hash-based side information exploitation for efficient Wyner-Ziv video coding. In: International Conference on Image Processing (ICIP)—2007, San Antonio, Texas, USAGoogle Scholar
  5. 5.
    Benedek C, Havasi L, Sziranyi T, Szlavik Z (2005) Motion-based flexible camera registration. In: IEEE conference on Advanced Video and Signal Based Surveillance, 2005, AVSS 2005, pp 439–444Google Scholar
  6. 6.
    Bergevin R, Soucy M, Gagnon H, Laurendeau D (1996) Towards a general multi-view registration technique. IEEE Trans Pattern Anal Mach Intell 18(5):540–547CrossRefGoogle Scholar
  7. 7.
    Ciobanu L, Corte-Real L (2010) Successive refinement of side information for multi-view distributed video coding. Multimed Tools Appl 48(3):411–436CrossRefGoogle Scholar
  8. 8.
    Dufaux F, Moscheni F (1996) Background mosaicking for low bit rate video coding. In: Proceedings of international conference on image processing, vol 1, pp 673–676Google Scholar
  9. 9.
    Dufaux F, Ouaret M, Ebrahimi T (2007) Recent advances in multiview distributed video coding. In: SPIE Defense and Security Symposium (DSS 2007), Orlando, Florida, USA, 9–13 Apr 2007Google Scholar
  10. 10.
    Guo X, Lu Y, Wu F, Gao W, Li S (2006) Distributed multi-view video coding. In: Proceedings of SPIE-IS&T Electronic Imaging, SPIE, vol 6077. San Jose, California, USA, 15–19 Jan 2006Google Scholar
  11. 11.
    Izquierdo E (2003) Efficient and accurate image based camera registration. IEEE Trans Multimedia 5(3):293–302CrossRefGoogle Scholar
  12. 12.
    Lee M-C, Chen W-G, Lin C, Gu C, Markoc T, Zabinsky S, Szeliski R (1997) A layered video object coding system using sprite and affine motion model. IEEE Trans Circuits Syst Video Technol 7(1):130–145CrossRefGoogle Scholar
  13. 13.
    Ouaret M, Dufaux F, Ebrahimi T (2006) Fusion-based multiview distributed video coding. In: ACM International Workshop on Video Surveillance and Sensor Networks, Santa Barbara, CA, USA, 27 Oct 2006Google Scholar
  14. 14.
    Ouaret M, Dufaux F, Ebrahimi T (2007) Multiview distributed video coding with encoder driven fusion. In: European Conference on Signal Processing (EUSIPCO), Poznan, Poland, 3–7 Sept 2007Google Scholar
  15. 15.
    Pereira FC, Ebrahimi T (2002) The MPEG-4 Book. Prentice Hall PTR, Upper Saddle River, NJ, USAGoogle Scholar
  16. 16.
    Puri R, Ramchandran K (2003) PRISM: a “reversed” multimedia coding paradigm. In: Proc. Intl. Conference on Image Processing (ICIP), Barcelona, SpainGoogle Scholar
  17. 17.
    Sikora T (2005) Trends and perspectives in image and video coding. In: Proceedings of the IEEE vol 93(1), pp 6–17Google Scholar
  18. 18.
    Slepian D, Wolf JK (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19:471–480MathSciNetzbMATHCrossRefGoogle Scholar
  19. 19.
    Smolic A, Sikora T, Ohm J-R (1999) Long-term global motion estimation and its application for sprite coding, content description, and segmentation. IEEE Trans Circuits Syst Video Technol 9(8):1227–1242CrossRefGoogle Scholar
  20. 20.
    Szlávik Z, Szirányi T, Havasi L (2007) Video camera registration using accumulated co-motion maps. ISPRS J Photogramm Remote Sens 61(5):298–306CrossRefGoogle Scholar
  21. 21.
    Wyner D, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22:1–10MathSciNetzbMATHCrossRefGoogle Scholar
  22. 22.
    Yeo C, Ramchandran K (2007) Robust distributed multi-view video compression for wireless camera networks. In: VCIP 2007, San Jose, California, USA, 28 Jan–1 Feb 2007Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.Faculdade de Engenharia da Universidade do Porto/INESC PortoPortoPortugal

Personalised recommendations