Abstract
The compressed sensing (CS) theory makes sample rate relate to signal structure and content. CS samples and compresses the signal with far below Nyquist sampling frequency simultaneously. However, CS only considers the intra-signal correlations, without taking the correlations of the multi-signals into account. Distributed compressed sensing (DCS) is an extension of CS that takes advantage of both the inter- and intra-signal correlations, which is wildly used as a powerful method for the multi-signals sensing and compression in many fields. In this paper, the characteristics and related works of DCS are reviewed. The framework of DCS is introduced. As DCS’s main portions, sparse representation, measurement matrix selection, and joint reconstruction are classified and summarized. The applications of DCS are also categorized and discussed. Finally, the conclusion remarks and the further research works are provided.
Similar content being viewed by others
References
Donoho D L. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289–1306
Tsaig Y, Donoho D L. Extensions of compressed sensing. Signal processing, 2006, 86(3): 549–571
Candès E J. Compressive sampling. In: Proceedings of the international congress of mathematicians. 2006, 1433–1452
Lustig M, Donoho D, Pauly J. Rapid mr imaging with compressed sensing and randomly under-sampled 3DFT trajectories. In: Proceedings of the 14th Annual Meeting ISMRM. 2006
Lustig M, Lee J H, Donoho D L, Pauly J M. Faster imaging with randomly perturbed, under-sampled spirals and l1 reconstruction. In: Proceedings of the 13th Annual Meeting of ISMRM. 2005, 685
Lustig M, Santos J M, Lee J H, Donoho D L, Pauly J M. Application of compressed sensing for rapid MR imaging. In: Proceedings of Work. Struc. Parc. Rep. Adap. Signaux (SPARS). 2005
Trzasko J, Manduca A. Highly undersampled magnetic resonance image reconstruction via homotopic-minimization. IEEE Transactions on Medical imaging, 2009, 28(1): 106–121
Baraniuk R G. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 2008
Marcia R F, Harmany Z T, Willett R M. Compressive coded aperture imaging. In: IS&T/SPIE Electronic Imaging. 2009, 72460G–72460G
Robucci R, Chiu L K, Gray J, Romberg J, Hasler P, Anderson D. Compressive sensing on a cmos separable transform image sensor. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. 2008, 5125–5128
Yin H, Liu Z, Chai Y, Jiao X. A survey of compressed sensing. Control and Decision, 2013, 28(10): 1441–1445
Baron D, Wakin M B, Duarte M F, Sarvotham S, Baraniuk R G. Distributed compressed sensing, 2005
Slepian D, Wolf J K. Noiseless coding of correlated information sources. IEEE Transactions on Information Theory, 1973, 19(4): 471–480
Tropp J A, Gilbert A C, Strauss M J. Simultaneous sparse approxi mation via greedy pursuit. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. 2005, 721–724
Hu H, Yang Z. Spatial correlation-based distributed compressed sensing in wireless sensor networks. In: Proceedings of the 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM). 2010, 1–4
Yang H, Huang L, Xu H, Liu A. Distributed compressed sensing in wireless local area networks. International Journal of Communication Systems, 2013
Golbabaee M, Vandergheynst P. Distributed compressed sensing for sensor networks using thresholding. In: Proceedings of the SPIE Optical Engineering and Applications. 2009
Liu Y, Zhu X, Zhang L, Cho S H. Distributed compressed video sensing in camera sensor networks. International Journal of Distributed Sensor Networks, 2012, Artide 352167
Puri R, Ramchandran K. Prism: A new robust video coding architecture based on distributed compression principles. In: Proceedings of the Annual Allerton Conference on Communication Control and Computing. 2002, 586–595
Hu H F, Yang Z. An energy-efficient distributed compressed sensing architecture for wireless sensor networks based on a distributed wavelet compression algorithm. In: Proceedings of the 2011 International Conference on Wireless Communications and Signal Processing. 2011
Wang Q, Liu Z. A novel distributed compressed sensing algorithm for multichannel electrocardiography signals. In: Proceedings of 2011 4th International Conference on Biomedical Engineering and Informatics. 2011, 607–611
Prades-Nebot J, Ma Y, Huang T. Distributed video coding using compressive sampling. In: Proceedings of the 2009 Picture Coding Symposium. 2009, 1–4
Do T T, Chen Y, Nguyen D T, Nguyen N, Gan L, Tran T D. Distributed compressed video sensing. In: Proceedings of the 16th IEEE International Conference on Image Processing (ICIP). 2009, 1393–1396
Kang L W, Lu C S. Distributed compressive video sensing. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. 2009, 1169–1172
Yu D, Wang A, Zhao M. A multiple description distributed compressed video sensing for robust transmission. In: Proceedings of 2012 International Conference on Computing, Measurement, Control and Sensor Network. 2012, 13–16
Baron D, Duarte M F, Sarvotham S, Wakin M B, Baraniuk R G. An information-theoretic approach to distributed compressed sensing. In: Proceedings of the 45rd Conference on Communication, Control, and Computing. 2005
Duarte M F, Sarvotham S, Baron D, Wakin M B, Baraniuk R G. Distributed compressed sensing of jointly sparse signals. In: Proceedings of Asilomar Conf. Signals, Sys., Comput. 2005, 1537–1541
Wakin M B, Duarte M F, Sarvotham S, Baron D, Baraniuk R G. Recovery of jointly sparse signals from few random projections. In: Proceedings of Neural Information Processing Systems Foundation. 2005
Phan A H, Cichocki A, Nguyen K S. Simple and efficient algorithm for distributed compressed sensing. In: Proceedings of the 2008 IEEE Workshop on Machine Learning for Signal Processing. 2008, 61–66
Zhang W, Ma C, Wang W, Liu Y, Zhang L. Side information based orthogonal matching pursuit in distributed compressed sensing. In: Proceedings of the 2nd IEEE International Conference on Network Infrastructure and Digital Content. 2010, 80–84
Vinuelas-Peris P, Artes-Rodriguez A. Bayesian joint recovery of correlated signals in distributed compressed sensing. In: Proceedings of the 2nd International Workshop on Cognitive Information Processing (CIP). 2010, 382–387
Yu N, Qiu T, Bi F, Wang A. Image features extraction and fusion based on joint sparse representation. IEEE Journal of Selected Topics in Signal Processing, 2011, 5(5): 1074–1082
Tan Y, Xu W, He Z, Tian B, Wang D. Mimo-ofdm channel estimation based on distributed compressed sensing and kalman filter. In: Proceedings of the 2011 IEEE International Conference on Signal Processing, Communications and Computing. 2011
Nagesh P, Li B. A compressive sensing approach for expression-invariant face recognition. In: Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. 2009, 1518–1525
Cheng H, Liu Z, Yang L, Chen X. Sparse representation and learning in visual recognition: theory and applications. Signal Processing, 2013, 93(6): 1408–1425
Ma X, Quang Luong H, Philips W, Song H, Cui H. Sparse representation and position prior based face hallucination upon classified over-complete dictionaries. Signal Processing, 2012, 92(9): 2066–2074
Donoho D L, Flesia A G. Can recent innovations in harmonic analysisexplain’key findings in natural image statistics? Network: Computation in Neural Systems, 2001, 12(3): 371–393
Chew W, Song J. Fast fourier transform of sparse spatial data to sparse fourier data. In: Proceedings of IEEE Antennas and Propagation Society, AP-S International Symposium (Digest). 2000, 2324–2327
Nawab S H, Dorken E. Efficient stft approximation using a quantization and differencing method. In: Proceedings of the 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing. 1993, 587–590
Selesnick IW. Sparse signal representations using the tunable q-factor wavelet transform. In: Proceedings of SPIE Optical Engineering and Applications. 2011
Donoho D L. Wedgelets: nearly minimax estimation of edges. The Annals of Statistics, 1999, 27(3): 859–897
Meyer F G, Coifman R R. Brushlets: a tool for directional image analysis and image compression. Applied and computational harmonic analysis, 1997, 4(2): 147–187
Huo X, Donoho D. Beamlets and multiscale image analysis. Multiscale and Multiresolution Methods, 2002, 149–196
Le Pennec E, Mallat S. Image compression with geometrical wavelets. In: Proceedings of the 2000 International Conference on Image Processing. 2000, 661–664
Candes E J, Donoho D L. Ridgelets: A key to higher-dimensional intermittency. Philosophical Transactions of the Royal Society, 1999, 357(1760): 2495–2509
Donoho D L. Orthonormal ridgelets and linear singularities. SIAM Journal on Mathematical Analysis, 2000, 31(5): 1062–1099
Candes E J, Donoho D L. Curvelets: A Surprisingly Effective Non adaptive Representation for Objects With Edges. Technical report, DTIC Document. 2000
Do M N, Vetterli M. Contourlets. Studies in Computational Mathematics, 2003, 10: 83–105
Fong H, Zhang Q, Wei S. Image reconstruction based on sub-gaussian random projection. In: Proceedings of the 4th International Conference on Image and Graphics. 2007, 210–214
Candes E J, Tao T. Near-optimal signal recovery from random projections: Universal encoding strategies? IEEE Transactions on Information Theory, 2006, 52(12): 5406–5425
Bi X, Chen X D, Zhang Y, Liu B. Image compressed sensing based on wavelet transform in contourlet domain. Signal Processing, 2011, 91(5): 1085–1092
Yin H, Li S. Multimodal image fusion with joint sparsity model. Optical Engineering, 2011, 50(6): 067007–067007
Engan K, Aase S O, Husøy J H. Multi-frame compression: theory and design. Signal Processing, 2000, 80(10): 2121–2140
Aharon M, Elad M, Bruckstein A. K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 2006, 54(11): 4311–4322
Rubinstein R, Bruckstein A M, Elad M. Dictionaries for sparse representation modeling. Proceedings of the IEEE, 2010, 98(6): 1045–1057
Dong W, Li X, Zhang D, Shi G. Sparsity-based image denoising via dictionary learning and structural clustering. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2011, 457–464
Baraniuk R, Davenport M, DeVore R, Wakin M. A simple proof of the restricted isometry property for random matrices. Constructive Approximation, 2008, 28(3): 253–263
Candes E J. The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique, 2008, 346(9): 589–592
Candès E J, Romberg J, Tao T. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 2006, 52(2): 489–509
Candes E J, Romberg J K, Tao T. Stable signal recovery from incomplete and inaccurate measurements. Communications on pure and applied mathematics, 2006, 59(8): 1207–1223
Haghighatshoar S, Abbe E, Telatar E. Adaptive sensing using deterministic partial hadamard matrices. In: Proceedings of the 2012 IEEE International Symposium on Information Theory Proceedings (ISIT). 2012, 1842–1846
Yin W, Morgan S, Yang J, Zhang Y. Practical compressive sensing with toeplitz and circulant matrices. In: Proceedings of the 2010 Visual Communications and Image Processing. 2010, Article 77440K
Bajwa W U, Haupt J D, Raz G M, Wright S J, Nowak R D. Toeplitzstructured compressed sensing matrices. In: Proceedings of IEEE/SP 14th Workshop on Statistical Signal Processing. 2007, 294–298
Sebert F, Zou Y M, Ying L. Toeplitz block matrices in compressed sensing and their applications in imaging. In: Proceedings of the 2008 International Conference on Information Technology and Applications in Biomedicine. 2008, 47–50
Rauhut H. Circulant and Toeplitz Matrices in Compressed Sensing. arXiv.ovg>cs>arXiv:0902.4394. 2009
Li Z, Wu X, Peng H. Nonnegative matrix factorization on orthogonal subspace. Pattern Recognition Letters, 2010, 31(9): 905–911
Applebaum L, Howard S D, Searle S, Calderbank R. Chirp sensing codes: deterministic compressed sensing measurements for fast recovery. Applied and Computational Harmonic Analysis, 2009, 26(2): 283–290
Romberg J. Sensing by random convolution. In: Proceedings of the 2nd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing. 2007, 137–140
Wang K, Chen J Z, Zhu Y G, Niu Y T. Comparison and analysis of the performance on measurement matrix to spectrum estimation. In: Proceedings of the 2012 National Conference on Information Technology and Computer Science. 2012, 1034–1037
Haupt J, Bajwa W U, Raz G, Nowak R. Toeplitz compressed sensing matrices with applications to sparse channel estimation. IEEE Transactions on Information Theory, 2010, 56(11): 5862–5875
Wang K, Liu Y, Chen S. Measurement matrix in compressed sensing of ir-uwb signal. In: Proceedings of the 2012 International Conference on Systems and Informatics (ICSAI). 2012, 2084–2088
Sun R, Zhao H, Xu H. The application of improved hadamard measurement matrix in compressed sensing. In: Proceedings of the 2012 International Conference on Systems and Informatics. 2012, 1994–1997
Yu Y, Petropulu A P, Poor H V. Measurement matrix design for compressive sensing-based mimo radar. IEEE Transactions on Signal Processing, 2011, 59(11): 5338–5352
Mishali M, Elron A, Eldar Y C. Sub-nyquist processing with the modulated wideband converter. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 3626–3629
Mishali M, Eldar Y C, Elron A J. Xampling: Signal acquisition and processing in union of subspaces. IEEE Transactions on Signal Processing, 2011, 59(10): 4719–4734
Mishali M, Eldar Y C. Expected rip: conditioning of the modulated wideband converter. In: Proceedings of the 2009 Information Theory Workshop. 2009, 343–347
Chen Y, Mishali M, Eldar Y C, Hero A O. Modulated wideband converter with non-ideal lowpass filters. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 3630–3633
Chen Y, Xiao G. Fusion of infrared and visible images based on distributed compressive sensing. In: Proceedings of WAP Conference Series: Information Science and Technology
Luo J, Yang B, Chen Z. Color image restoration via extended joint sparse model. In: Proceedings of Communications in Computer and Information Science, Pattern Recognition. 2012, 321: 497–504
Roy O, Hormati A, Lu YM, Vetterli M. Distributed sensing of signals linked by sparse filtering. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. 2009, 2409–2412
Hormati A, Roy O, Lu Y M, Vetterli M. Distributed sampling of signals linked by sparse filtering: theory and applications. IEEE Transactions on Signal Processing, 2010, 58(3): 1095–1109
Wang X, Fang H, Zhu X, Li B, Liu Y. Sparse filter correlation model based joint reconstruction in distributed compressive video sensing. In: Proceedings of the 2nd IEEE International Conference on Network Infrastructure and Digital Content. 2010, 483–487
Wang H Q, Zhu X H, Li Y S. Parameter estimation for transmit diversity mimo radar based on distributed compressed sensing. Systems Engineering and Electronics, 2012, 34(12): 2463–2467
Kang J, Tang L, Zuo X, Li A, Li H. Distributed compressed sensingbased data fusion in sensor networks. In: Proceedings of the 1st International Conference on Pervasive Computing Signal Processing and Applications (PCSPA). 2010, 1083–1086
Li Z L, Chen H J, Yao C, Li J P. Compressed sensing reconstruction algorithm based on spectral projected gradient pursuit. Acta Automatica Sinica, 2012, 38(7): 1218–1223 (in Chinese)
Mallat S G, Zhang Z. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing, 1993, 41(12): 3397–3415
Tropp J A, Gilbert A C. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Transactions on Information Theory, 2007, 53(12): 4655–4666
Fang H, Yang H R. Greedy algorithms and compressed sensing. Acta Automatica Sinica, 2011, 37(12): 1413–1421 (in Chinese)
Gilbert A C, Strauss M J, Tropp J A, Vershynin R. Algorithmic linear dimension reduction in the l_1 norm for sparse vectors. In: Proceedings of the 44th Annual Allerton Conference Communication Contron and Computing. 2006
Schnelle S R, Laska J N, Hegde C, Duarte M F, Davenport M A, Baraniuk R G. Texas hold’em algorithms for distributed compressive sensing. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 2886–2889
Hormati A, Vetterli M. Distributed compressed sensing: Sparsity models and reconstruction algorithms using annihilating filter. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 2008, 5141–5144
Liang J, Liu Y, Zhang W, Xu Y, Gan X, Wang X. Joint compressive sensing in wideband cognitive networks. In: Proceedings of the 2010 Wireless Communications and Networking Conference (WCNC). 2010, 1–5
Davenport M A, Boufounos P T, Baraniuk R G. Compressive domain interference cancellation. Technical report, DTIC Document. 2009
Xu W, Lin J, Niu K, He Z. A joint recovery algorithm for distributed compressed sensing. Transactions on Emerging Telecommunications Technologies, 2012, 23(6): 550–559
Sundman D, Saikat C, Skoglund M. A greedy pursuit algorithm for distributed compressed sensing. In: Proceedings of the 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012, 2729–2732
Shen M, Zhang Q, Yang J. A novel receive beamforming approach of ultrasound signals based on distributed compressed sensing. In: Proceedings of Instrumentation and Measurement Technology Conference (I2MTC). 2011, 1–5
Wang X, Guo W, Lu Y, Wang W. Distributed compressed sensing for block-sparse signals. In: Proceedings of the 2011 IEEE 22nd International Symposium on Personal Indoor and Mobile Radio Communications (PIMRC). 2011, 695–699
Donoho D L. High-dimensional centrally symmetric polytopes with neighborliness proportional to dimension. Discrete & Computational Geometry, 2006, 35(4): 617–652
Do T T, Gan L, Nguyen N, Tran T D. Sparsity adaptive matching pursuit algorithm for practical compressed sensing. In: Proceedings of the 42nd Asilomar Conference Signals, Systems and Computers. 2008, 581–587
Wang Q, Liu Z. A robust and efficient algorithm for distributed compressed sensing. Computers & Electrical Engineering, 2011, 37(6): 916–926
Ndjiki-Nya P, Doshkov D, Kaprykowsky H, Zhang F, Bull D, Wiegand T. Perception-oriented video coding based on image analysis and completion: a review. Signal Processing: Image Communication, 2012, 27(6): 579–594
Yick J, Mukherjee B, Ghosal D. Wireless sensor network survey. Computer networks, 2008, 52(12): 2292–2330
Rahman S M, Ahmad M O, Swamy M. Contrast-based fusion of noisy images using discrete wavelet transform. Image Processing, IET, 2010, 4(5): 374–384
Yang A Y, Maji S, Hong K, Yan P, Sastry S S. Distributed compression and fusion of nonnegative sparse signals for multiple-view object recognition. In: Proceedings of the 12th International Conference on Information Fusion. 2009, 1867–1874
Wang W G, Yang Z, Hu H F. The method of achieving simultaneous channels estimation on distributed compressed sensing. Signal Processing (Xinhao Chuli), 2012, 28(6): 778–784 (in Chinese)
Wang D H, Niu K, He Z Q, Tian B Y. Channel estimation based on distributed compressed sensing in amplify-and-forward relay networks. The Journal of China Universities of Posts and Telecommunications, 2010, 17(5): 44–49
Corroy S, Mathar R. Distributed compressed sensing for the mimo mac with correlated sources. In: Proceedings of the 2012 IEEE International Conference on Communications (ICC). 2012, 2516–2520
Li Y, Song R. A new compressive feedback scheme based on distributed compressed sensing for time-correlated mimo channel. KSII Transactions on Internet & Information Systems, 2012, 6(2)
Prunte L. Application of distributed compressed sensing for gmti purposes. In: Proceedings of IET International Conference on Radar Systems (Radar 2012). 2012, 1–6
Wu D, Zhu W P, Swamy M. Compressive sensing-based speech enhancement in non-sparse noisy environments. IET Signal Processing, 2013, 7(5): 450–457
Author information
Authors and Affiliations
Corresponding author
Additional information
Hongpeng Yin received the BE degree in College of Communication Engineering, Chongqing University in 2003. Then he received PhD degree in control theory and control engineering, Chongqing University. His research interests include computer vision and pattern recognition.
Jinxing Li received the BE degree from Hangzhou Dianzi University in 2012. He is currently working towards the MSc degree at the College of Automation, Chongqing University. His research interests include compressed sensing and computer vision.
Yi Chai received the BE degree from National University of Defense Technology in 1982. He received the MSc and PhD degrees from Chongqing University in 1994 and 2001, respectively. He is the associate dean of the College of Automation, Chongqing University. His research interests include information processing, integration and control, and computer network and system control.
Simon X. Yang received the BE degree in engineering physics from Peking University, Beijing, China, in 1987, the MSc degree in biophysics from the Chinese Academy of Sciences, Beijing, China, in 1990, the MSc degree in electrical engineering from the University of Houston, Houston, TX in 1996, and the PhD degree in electrical and computer engineering from the University of Alberta, Edmonton, AB, Canada in 1999.
Rights and permissions
About this article
Cite this article
Yin, H., Li, J., Chai, Y. et al. A survey on distributed compressed sensing: theory and applications. Front. Comput. Sci. 8, 893–904 (2014). https://doi.org/10.1007/s11704-014-3461-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11704-014-3461-7