Abstract
While single measurement vector (SMV) models have been widely studied in signal processing, there is a surging interest in addressing the multiple measurement vectors (MMV) problem. In the MMV setting, more than one measurement vector is available and the multiple signals to be recovered share some commonalities such as a common support. Applications in which MMV is a naturally occurring phenomenon include online streaming, medical imaging, and video recovery. This work presents a stochastic iterative algorithm for the support recovery of jointly sparse corrupted MMV. We present a variant of the sparse randomized Kaczmarz algorithm for corrupted MMV and compare our proposed method with an existing Kaczmarz type algorithm for MMV problems. We also showcase the usefulness of our approach in the online (streaming) setting and provide empirical evidence that suggests the robustness of the proposed method to the number of corruptions and the distribution from which the corruptions are drawn.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
H.K. Aggarwal, A. Majumdar, Extension of sparse randomized Kaczmarz algorithm for multiple measurement vectors, in IEEE International Conference on Pattern Recognition, pp. 1014–1019 (2014)
S.R. Arridge, J.C. Schotland, Optical tomography: forward and inverse problems. Inverse Probl. 25(12), 123010 (2009)
L. Bottou, Large-scale machine learning with stochastic gradient descent, in Proceedings of COMPSTAT (Springer, Berlin, 2010), pp. 177–186
E.J. Candès, C. Fernandez-Granda, Towards a mathematical theory of super-resolution. Commun. Pure Appl. Math. 67(6), 906–956 (2014)
L. Fodor, M. Elman, Y. Ullmann, Aesthetic Applications of Intense Pulsed Light (Springer, London, 2011)
R. Gordon, R. Bender, G.T. Herman, Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and X-ray photography. J. Theor. Biol. 29, 471–481 (1970)
C. Hamaker, D.C. Solmon, The angles between the null spaces of X-rays. J. Math. Anal. Appl. 62(1), 1–23 (1978)
R. Heckel, M. Soltanolkotabi, Generalized line spectral estimation via convex optimization. IEEE Trans. Inf. Theory 64(6), 4001–4023 (2018)
G. Herman, L. Meyer, Algebraic reconstruction techniques can be made computationally efficient. IEEE Trans. Med. Imaging 12(3), 600–609 (1993)
S. Kaczmarz, Angenäherte auflösung von systemen linearer gleichungen. Bull. Int. Acad. Pol. Sci. Lett. Ser. A 35, 335–357 (1937)
F. Larusson, S. Fantini, E.L. Miller, Hyperspectral image reconstruction for diffuse optical tomography. Biomed. Opt. Express 2(4), 946–965 (2011)
J.N. Laska, M.A. Davenport, R.G. Baraniuk, Exact signal recovery from sparsely corrupted measurements through the pursuit of justice, in Asilomar Conference on Signals, Systems, and Computers (IEEE, Piscataway, 2009), pp. 1556–1560
Y. Li, Y. Chi, Off-the-grid line spectrum denoising and estimation with multiple measurement vectors. IEEE Trans. Signal Process. 64(5), 1257–1269 (2016)
S. Li, D. Yang, G. Tang, M.B. Wakin, Atomic norm minimization for modal analysis from random and compressed samples. IEEE Trans. Signal Process. 66(7), 1817–1831 (2018)
G. Lu, B. Fei, Medical hyperspectral imaging: a review. J. Biomed. Opt. 19(1), 010901 (2014)
H. Mansour, O. Yilmaz, A fast randomized Kaczmarz algorithm for sparse solutions of consistent linear systems (2013). arXiv preprint arXiv:1305.3803
T. Strohmer, R. Vershynin, Comments on the randomized Kaczmarz method. J. Fourier Anal. Appl. 15(4), 437–440 (2009)
C. Studer, P. Kuppinger, G. Pope, H. Bolcskei, Recovery of sparsely corrupted signals. IEEE Trans. Inf. Theory 58(5), 3115–3130 (2012)
G. Tang, B.N. Bhaskar, P. Shah, B. Recht, Compressed sensing off the grid. IEEE Trans. Inf. Theory 59(11), 7465–7490 (2013)
Z. Yang, L. Xie, Exact joint sparse frequency recovery via optimization methods. IEEE Trans. Signal Process. 64(19), 5145–5157 (2014)
Acknowledgements
The initial research for this effort was conducted at the Research Collaboration Workshop for Women in Data Science and Mathematics, July 17–21, held at ICERM. Funding for the workshop was provided by ICERM, AWM, and DIMACS (NSF Grant No. CCF-1144502). SL was supported by NSF CAREER Grant No. CCF− 1149225. DN was partially supported by the Alfred P. Sloan Foundation, NSF CAREER #1348721, and NSF BIGDATA #1740325. JQ was supported by NSF DMS-1818374.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 The Author(s) and the Association for Women in Mathematics
About this chapter
Cite this chapter
Durgin, N. et al. (2019). Sparse Randomized Kaczmarz for Support Recovery of Jointly Sparse Corrupted Multiple Measurement Vectors. In: Gasparovic, E., Domeniconi, C. (eds) Research in Data Science. Association for Women in Mathematics Series, vol 17. Springer, Cham. https://doi.org/10.1007/978-3-030-11566-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-11566-1_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-11565-4
Online ISBN: 978-3-030-11566-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)