Abstract
In this chapter we describe our recent work on the design and analysis of recursive algorithms for causally reconstructing a time sequence of (approximately) sparse signals from a greatly reduced number of linear projection measurements. The signals are sparse in some transform domain referred to as the sparsity basis and their sparsity patterns (support set of the sparsity basis coefficients) can change with time. By “recursive", we mean using only the previous signal’s estimate and the current measurements to get the current signal’s estimate. We also briefly summarize our exact reconstruction results for the noise-free case and our error bounds and error stability results (conditions under which a time-invariant and small bound on the reconstruction error holds at all times) for the noisy case. Connections with related work are also discussed. A key example application where the above problem occurs is dynamic magnetic resonance imaging (MRI) for real-time medical applications such as interventional radiology and MRI-guided surgery, or in functional MRI to track brain activation changes. Cross-sectional images of the brain, heart, larynx or other human organ images are piecewise smooth, and thus approximately sparse in the wavelet domain. In a time sequence, their sparsity pattern changes with time, but quite slowly. The same is also often true for the nonzero signal values. This simple fact, which was first observed in our work, is the key reason that our proposed recursive algorithms can achieve provably exact or accurate reconstruction from very few measurements.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wakin M, Laska J, Duarte M, Baron D, Sarvotham S, Takhar D, Kelly K, Baraniuk R (2006) An architecture for compressive imaging. In: IEEE Intl Conf Image Proc (ICIP)
Haupt J, Nowak R (2006) Signal reconstruction from noisy random projections. IEEE Trans Inf Theory 52(9):4036–4048
Candès EJ, Li X, Ma Y, Wright J (2009) Robust principal component analysis? J ACM 58(1): 1–37
Qiu C, Vaswani N (2011) Support predicted modified-cs for recursive robust principal components’ pursuit. In: IEEE Intl Symp Info Th (ISIT)
Qiu C, Vaswani N (2011) Recursive sparse recovery in large but correlated noise. Allerton Conf on Communication, Control, and, Computing
Carron I “Nuit blanche”, in http://nuit-blanche.blogspot.com/
“Rice compressive sensing resources”, in http://www-dsp.rice.edu/cs
Candes E, Romberg J, Tao T (2006) Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Trans Inf Theory 52(2):489–509
Donoho D (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306
Candes E, Tao T (2005) Decoding by linear programming. IEEE Trans Inf Theory 51(12):4203–4215
Gamper U, Boesiger P, Kozerke S (2008) Compressed sensing in dynamic mri. Magn Reson Med 59(2):365–373
Wakin M, Laska J, Duarte M, Baron D, Sarvotham S, Takhar D, Kelly K, Baraniuk R (2006) Compressive imaging for video representation and coding. In: Proc April, Picture Coding Symposium (PCS), Beijing, China
Jung H, Sung KH, Nayak KS, Kim EY, Ye JC (2009) k-t focuss: a general compressed sensing framework for high resolution dynamic mri. Magn Reson Med 61:103–116
Vaswani N (2008) Kalman filtered compressed sensing. In: IEEE Intl Conf Image Proc (ICIP)
Vaswani N (2010) LS-CS-residual (LS-CS): Compressive Sensing on Least Squares residual. IEEE Trans Signal Process 58(8):4108–4120
Vaswani N, Lu W (2009) Modified-cs: Modifying compressive sensing for problems with partially known support. In: IEEE Intl Symp Info Th (ISIT)
Vaswani N, Lu W (2010) Modified-cs: Modifying compressive sensing for problems with partially known support. IEEE Trans Signal Process 58(9):4595–4607
Lu W, Vaswani N (2009) Modified Compressive Sensing for Real-time Dynamic MR Imaging. In IEEE Intl Conf Image Proc (ICIP)
Lu W, Li T, Atkinson I, Vaswani N (2011) Modified-cs-residual for recursive reconstruction of highly undersampled functional mri sequences. In, IEEE Intl Conf Image Proc (ICIP)
Lu W, Vaswani N (2012) Regularized modified bpdn for noisy sparse reconstruction with partial erroneous support and signal value knowledge. IEEE Trans Signal process 60(1):182–196
Lu W, Vaswani N (2012) Exact reconstruction conditions for regularized modified basis pursuit. IEEE Trans Signal Process 60(5):2634–2640
Vaswani N (2010) Stability (over time) of Modified-CS for Recursive Causal Sparse Reconstruction. In Allerton Conf Communication, Control, and, Computing
Mallat SG, Zhang Z (1993) Matching pursuits with time-frequency dictionaries. IEEE Trans Signal Process 41(12):3397–3415
Chen S, Donoho D, Saunders M (1998) Atomic decomposition by basis pursuit. SIAM J Sci Comput 20:33–61
Wipf DP, Rao BD (2004) Sparse bayesian learning for basis selection. IEEE Trans Signal Process 52:2153–2164
Tropp JA (2006) Just relax: Convex programming methods for identifying sparse signals. IEEE Trans Inf Theory 1030–1051
Candes E (2008) The restricted isometry property and its implications for compressed sensing. Compte Rendus de l’Academie des Sciences, Paris, Serie I:589–592
Candes E, Tao T (2007) The dantzig selector: statistical estimation when p is much larger than n. Ann Stat 35(6):2313–2351
Tropp J, Gilbert A (2007) Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans Inf Theory 53(12):4655–4666
Dai W, Milenkovic O (2009) Subspace pursuit for compressive sensing signal reconstruction. IEEE Trans Inf Theory 55(5):2230–2249
Needell D, Tropp JA (May 2009) Cosamp: Iterative signal recovery from incomplete and inaccurate samples. Appl Comp Harmonic Anal 26(3):301–321
Carmi A, Gurfil P, Kanevsky D (2010) Methods for sparse signal recovery using kalman filtering with embedded pseudo-measurement norms and quasi-norms. IEEE Trans Signal Process 2405–2409
Sejdinovic D, Andrieu C, Piechocki R (2010) Bayesian sequential compressed sensing in sparse dynamical systems. In Allerton Conf Communication, Control, and, Computing
Ziniel J, Potter LC, Schniter P (2010) Tracking and smoothing of time-varying sparse signals via approximate belief propagation. Asilomar Conf Sig Sys Comp
Zhang Z, Rao BD (2011) Sparse signal recovery with temporally correlated source vectors using sparse bayesian learning. IEEE J Sel Topics Sig Proc (Special Issue on Adaptive Sparse Representation of Data and Applications in Signal and Image Processing) 5(5):912–926
Charles A, Asif MS, Romberg J, Rozell C (2011) Sparsity penalties in dynamical system estimation. In Conf Info, Sciences and Systems
Garcia-Frias J, Esnaola I (2007) Exploiting prior knowledge in the recovery of signals from noisy random projections. In Data Comp Conf
Ji S, Xue Y, Carin L (2008) Bayesian compressive sensing. IEEE Trans Signal Process 56(6):2346–2356
Schniter P, Potter L, Ziniel J (2008) Fast bayesian matching pursuit: Model uncertainty and parameter estimation for sparse linear models. In: Information Theory and Applications (ITA)
La C, Do M (2005) “Signal reconstruction using sparse tree representations”, in SPIE Wavelets XI. San Diego, California
Baraniuk R, Cevher V, Duarte M, Hegde C (2010) Model-based compressive sensing. IEEE Trans Inf Theory 56(4):1982–2001
Eldar Yonina C, Moshe Mishali (2009) Robust recovery of signals from a structured union of subspaces. IEEE Trans Inf Theory 55(11):5302–5316
Som S, Potter LC, Schniter P (2010) Compressive imaging using approximate message passing and a markov-tree prior. In Asilomar Conf Sig Sys Comp
Khajehnejad A, Xu W, Avestimehr A, Hassibi B (2009) Weighted l1 minimization for sparse recovery with prior information. In: IEEE Intl Symp Info Th (ISIT)
Khajehnejad A, Xu W, Avestimehr A, Hassibi B (2011) Weighted \(\ell _{1}\) minimization for sparse recovery with Nonuniform Sparse Models. IEEE Trans Signal Process 59(5):1985–2001
Miosso CJ, von Borries R, Argez M, Valazquez L, Quintero C, Potes C (2009) Compressive sensing reconstruction with prior information by iteratively reweighted least-squares. IEEE Trans Signal Process 57(6):2424–2431
Donoho D (2006) For most large underdetermined systems of linear equations, the minimal ell-1 norm solution is also the sparsest solution. Comm Pure App Math 59(6):797–829
Stankovic V, Stankovic L, Cheng S (2009) Compressive image sampling with side information. In: ICIP
Carrillo R, Polania LF, Barner K (2010) Iterative algorithms for compressed sensing with patially known support. In: ICASSP
Jongmin K, Ok Kyun L, Jong Chul Y (2012) Dynamic sparse support tracking with multiple measurement vectors using compressive MUSIC. In: ICASSP
Stojnic M (2010) Block-length dependent thresholds for \(\ell _2 / \ell _1\)-optimization in block-sparse compressed sensing. In: ICASSP
Jacques L (2010) A short note on compressed sensing with partially known signal support, Signal Processing 90(12):3308–3312
Lu W, Vaswani N (2010) Modified bpdn for noisy compressive sensing with partially known support. In: IEEE Intl Conf Acoustics, Speech, Sig Proc (ICASSP)
Friedlander MP, Mansour H, Saab R, Yilmaz O (2012) Recovering compressively sampled signals using partial support information. IEEE Trans Inf Theory 58(2):1122–1134
Asif MS, Romberg J (2009) Dynamic updating for sparse time varying signals In: Conf. Info, Sciences and Systems
Yin W, Osher S, Goldfarb D, Darbon J (2008) Bregman iterative algorithms for l1-minimization with applications to compressed sensing. SIAM J Imaging Sci 1(1):143–168
Malioutov DM, Sanghavi S, Willsky AS (2008) Compressed sensing with sequential observations. In: IEEE Intl Conf Acoustics, Speech, Sig Proc (ICASSP)
Angelosante D, Giannakis GB (2009) Rls-weighted lasso for adaptive estimation of sparse signals. In: IEEE Intl Conf Acoustics, Speech, Sig Proc (ICASSP)
Pierre J. Garrigues and Laurent El Ghaoui (2008) An homotopy algorithm for the lasso with online observations. In: Adv Neural Info Proc Sys (NIPS)
Candes EJ, Wakin MB, Boyd SP (2008) Enhancing sparsity by reweighted l(1) minimization. J Fourier Anal Appl 14(5–6):877–905
Chartrand R, Yin W (2008) Iteratively reweighted algorithms for compressive sensing. In: IEEE Intl Conf Acoustics, Speech, Sig Proc (ICASSP)
Wang Y, Yin W (2010) Sparse signal reconstruction via iterative support detection. SIAM J Imaging Sci 3(3):462–491
Angelosante D, Giannakis GB, Grossi E (2009) Compressed sensing of time-varying signals. Dig Sig Proc Workshop, In
Vaswani N (2009) Analyzing least squares and kalman filtered compressed sensing. In: IEEE Intl Conf Acoustics, Speech, Sig Proc (ICASSP)
Foucart S, Lai MJ (2009) Sparsest solutions of underdetermined linear systems via ell-q-minimization for 0<= q<= 1. Appl Comput Harmonic Anal 26:395–407
Jacques L (2009) A short note on compressed sensing with partially known signal support. ArXiv, preprint 0908.0660
Cevher V, Sankaranarayanan A, Duarte M, Reddy D, Baraniuk R, Chellappa R (2008) Compressive sensing for background subtraction. In: Eur Conf Comp Vis (ECCV)
Qiu C, Vaswani N (2010) Real-time robust principal components’ pursuit. Allerton Conf on Communications, Control and, Computing
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Vaswani, N., Lu, W. (2014). Recursive Reconstruction of Sparse Signal Sequences. In: Carmi, A., Mihaylova, L., Godsill, S. (eds) Compressed Sensing & Sparse Filtering. Signals and Communication Technology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38398-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-38398-4_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38397-7
Online ISBN: 978-3-642-38398-4
eBook Packages: EngineeringEngineering (R0)