Compressive Acquisition of Dynamic Scenes

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6311)


Compressive sensing (CS) is a new approach for the acquisition and recovery of sparse signals and images that enables sampling rates significantly below the classical Nyquist rate. Despite significant progress in the theory and methods of CS, little headway has been made in compressive video acquisition and recovery. Video CS is complicated by the ephemeral nature of dynamic events, which makes direct extensions of standard CS imaging architectures and signal models infeasible. In this paper, we develop a new framework for video CS for dynamic textured scenes that models the evolution of the scene as a linear dynamical system (LDS). This reduces the video recovery problem to first estimating the model parameters of the LDS from compressive measurements, from which the image frames are then reconstructed. We exploit the low-dimensional dynamic parameters (the state sequence) and high-dimensional static parameters (the observation matrix) of the LDS to devise a novel compressive measurement strategy that measures only the dynamic part of the scene at each instant and accumulates measurements over time to estimate the static parameters. This enables us to considerably lower the compressive measurement rate considerably. We validate our approach with a range of experiments including classification experiments that highlight the effectiveness of the proposed approach.


Compressive Sense State Sequence Linear Dynamical System Video Model Dynamic Scene 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Supplementary material

978-3-642-15549-9_10_MOESM1_ESM.pdf (156 kb)
Electronic Supplementary Material (156 KB)


  1. 1.
    Baraniuk, R., Davenport, M., DeVore, R., Wakin, M.: A simple proof of the restricted isometry property for random matrices. Constructive Approximation 28(3), 253–263 (2008)zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Baraniuk, R., Cevher, V., Duarte, M., Hegde, C.: Model-Based Compressive Sensing. IEEE Transactions on Information Theory 56(4), 1982–2001 (2010)CrossRefMathSciNetGoogle Scholar
  3. 3.
    van den Berg, E., Friedlander, M.P.: Probing the pareto frontier for basis pursuit solutions. SIAM Journal on Scientific Computing 31(2), 890–912 (2008)zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Candès, E., Romberg, J., Tao, T.: Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on information theory 52(2), 489–509 (2006)CrossRefGoogle Scholar
  5. 5.
    Chan, A.B., Vasconcelos, N.: Probabilistic kernels for the classification of auto-regressive visual processes. In: IEEE Conf. on Computer Vision and Pattern Recognition. pp. 846–851 (2005)Google Scholar
  6. 6.
    Donoho, D.: Compressed sensing. IEEE Transactions on Information Theory 52(4), 1289–1306 (2006)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Doretto, G., Chiuso, A., Wu, Y., Soatto, S.: Dynamic textures. International Journal of Computer Vision 51(2), 91–109 (2003)zbMATHCrossRefGoogle Scholar
  8. 8.
    Duarte, M., Davenport, M., Takhar, D., Laska, J., Sun, T., Kelly, K., Baraniuk, R.: Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine 25(2), 83–91 (2008)CrossRefGoogle Scholar
  9. 9.
    Fowler, J.: Compressive-projection principal component analysis. IEEE Transactions on Image Processing 18(10) (October 2009)Google Scholar
  10. 10.
    Haupt, J., Nowak, R.: Signal reconstruction from noisy random projections. IEEE Transactions on Information Theory 52(9), 4036–4048 (2006)CrossRefMathSciNetGoogle Scholar
  11. 11.
    Needell, D., Tropp, J.: CoSaMP: Iterative signal recovery from incomplete and inaccurate samples. Applied and Computational Harmonic Analysis 26(3), 301–321 (2009)zbMATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Park, J., Wakin, M.: A multiscale framework for compressive sensing of video. In: Picture Coding Symposium, pp. 197–200 (May 2009)Google Scholar
  13. 13.
    Péteri, R., Fazekas, S., Huiskes, M.: DynTex: A Comprehensive Database of Dynamic Textures (to appear, 2010),
  14. 14.
    Saisan, P., Doretto, G., Wu, Y., Soatto, S.: Dynamic texture recognition. In: CVPR. vol. 2, pp. 58–63 (December 2001)Google Scholar
  15. 15.
    Turaga, P., Veeraraghavan, A., Chellappa, R.: Unsupervised view and rate invariant clustering of video sequences. CVIU 113(3), 353–371 (2009)Google Scholar
  16. 16.
    Vaswani, N.: Kalman filtered compressed sensing. In: ICIP (2008)Google Scholar
  17. 17.
    Vaswani, N., Lu, W.: Modified-CS: Modifying compressive sensing for problems with partially known support. In: Intl. Symposium on Information Theory (2009)Google Scholar
  18. 18.
    Veeraraghavan, A., Reddy, D., Raskar, R.: Coded strobing photography: Compressive sensing of high-speed periodic events. TPAMI (to appear)Google Scholar
  19. 19.
    Veeraraghavan, A., Roy-Chowdhury, A.K., Chellappa, R.: Matching shape sequences in video with applications in human movement analysis. TPAMI 27, 1896–1909 (2005)Google Scholar
  20. 20.
    Wagadarikar, A., John, R., Willett, R., Brady, D.: Single disperser design for coded aperture snapshot spectral imaging. Applied Optics 47(10), 44–51 (2008)CrossRefGoogle Scholar
  21. 21.
    Wakin, M., Laska, J., Duarte, M., Baron, D., Sarvotham, S., Takhar, D., Kelly, K., Baraniuk, R.: Compressive imaging for video representation and coding. In: Picture Coding Symposium (April 2006)Google Scholar
  22. 22.
    Willett, R., Nowak, R.: Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging. IEEE Transactions on Medical Imaging 22(3), 332–350 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  1. 1.Rice UniversityHoustonUSA
  2. 2.University of MarylandCollege ParkUSA

Personalised recommendations