Abstract
Consistent reconstruction is a method for producing an estimate \(\widetilde{x} \in {\mathbb {R}}^d\) of a signal \(x\in {\mathbb {R}}^d\) if one is given a collection of \(N\) noisy linear measurements \(q_n = \langle x, \varphi _n \rangle + \epsilon _n\), \(1 \le n \le N\), that have been corrupted by i.i.d. uniform noise \(\{\epsilon _n\}_{n=1}^N\). We prove mean-squared error bounds for consistent reconstruction when the measurement vectors \(\{\varphi _n\}_{n=1}^N\subset {\mathbb {R}}^d\) are drawn independently at random from a suitable distribution on the unit-sphere \({\mathbb {S}}^{d-1}\). Our main results prove that the mean-squared error (MSE) for consistent reconstruction is of the optimal order \({\mathbb {E}}\Vert x - \widetilde{x}\Vert ^2 \le K\delta ^2/N^2\) under general conditions on the measurement vectors. We also prove refined MSE bounds when the measurement vectors are i.i.d. uniformly distributed on the unit-sphere \({\mathbb {S}}^{d-1}\) and, in particular, show that in this case, the constant \(K\) is dominated by \(d^3\), the cube of the ambient dimension. The proofs involve an analysis of random polytopes using coverage processes on the sphere.
Similar content being viewed by others
References
P. Boufounos and R. Baraniuk, Quantization of sparse representations, Rice University ECE Department Technical Report 0701.
A. Brieden, P. Gritzmann, R. Kannan, V. Klee, L. Lovász and M. Simonivits, Deterministic and randomized polynomial-time approximation of radii, Mathematika 48 (2001), 63–105.
P. Bürgisser, F. Cucker and M. Lotz, Coverage processes on spheres and condition numbers for linear programming, The Annals of Probability 38 (2010), 570–604.
Z. Cvetković and M. Vetterli, On simple oversampled A/D conversion in \(L^2(\mathbb{R})\), IEEE Transactions on Information Theory 47 (2001), no. 1, 146–154.
Z. Cvetković, Resilience properties of redundant expansions under additive noise and quantization, IEEE Transactions on Information Theory 49 (2003), no. 3, 644–656.
T.S. Ferguson, A Course in Large Sample Theory, Chapman & Hall, London, 1996.
L. Flatto and D.J. Newman, Random coverings, Acta Mathematica 138 (1977), 241–264.
V.K. Goyal, J. Kovačević and J.A. Kelner, Quantized frame expansions with erasures, Applied and Computational Harmonic Analysis 10 (2001), no. 3, 203–233.
V.K. Goyal, M. Vetterli and N.T. Thao, Quantized overcomplete expansions in \({\mathbb{R}}^n\): analysis, synthesis, and algorithms, IEEE Transactions on Information Theory 44 (1998), no.1, 16–30.
L. Jacques, D.K. Hammond and J.M. Fadili, Dequantizing compressed sensing: when oversampling and non-Gaussian constraints combine, IEEE Transactions on Information Theory 57 (2011), no. 1, 560–571.
L. Jacques, J.N. Laska, P.T. Boufounos and R.G. Baraniuk, Robust 1-bit compressive sensing via binary stable embeddings of sparse vectors, IEEE Transactions on Information Theory 59 (2013), no. 4, 2082–2102.
S. Janson, Random coverings in several dimensions, Acta Mathematica 156 (1986), 83–118.
D. Jimenez, L. Wang and Y. Wang, White noise hypothesis for uniform quantization errors, SIAM Journal on Mathematical Analysis 38 (2007), no. 6, 2042–2056.
I. Jovanović and B. Beferull-Lozano, Oversampled A/D conversion and error-rate dependence of nonbandlimited signals with finite rate of innovation, IEEE Transactions on Signal Processing 54 (2006), no. 6, 2140–2154.
J. Masoušek, Lectures on Discrete Geometry, Springer-Verlag, New York, 2002.
Y. Plan and R. Vershynin, One-bit compressed sensing by linear programming, Communications on Pure and Applied Mathematics 66 (2013), no. 8, 1275–1297.
A.M. Powell, Mean squared error bounds for the Rangan-Goyal soft thresholding algorithm, Applied and Computational Harmonic Analysis 29 (2010), no. 3, 251–271.
S. Rangan and V.K. Goyal, Recursive consistent estimation with bounded noise, IEEE Transactions on Information Theory 47 (2001), no. 1, 457–464.
A.F. Siegel and L. Holst, Covering the circle with random arcs of random sizes, Journal of Applied Probability 19 (1982), no. 2, 373–381.
H. Solomon, Geometric Probability, Society for Industrial and Applied Mathematics, Philadelphia, 1978.
A.J. Stam, Limit theorems for uniform distributions on spheres in high-dimensional Euclidean spaces, Journal of Applied Probability 19 (1982), no. 1, 221–228.
N.T. Thao and M. Vetterli, Deterministic analysis of oversampled A/D conversion and decoding improvement based on consistent estimates, IEEE Transactions on Signal Processing 42 (1994), no. 3, 519–531.
N.T. Thao and M. Vetterli, Reduction of the MSE in \(R\)-times oversampled A/D Conversion from \({{\cal O}}(R^{-1})\) to \({{\cal O}}(R^{-2})\), IEEE Transactions on Signal Processing 42 (1994), 200–203.
N.T. Thao and M. Vetterli, Lower bound on the MSE in over sampled quantization of periodic signals using vector quantization analysis, IEEE Transactions on Information Theory 42 (1996), 469–479.
J.G. Wendel, Note on the gamma function, American Mathematical Monthly 55 (1946), no. 9, 563–564.
Acknowledgments
A.M. Powell was supported in part by NSF DMS 1211687 and NSF DMS 0811086 and also gratefully acknowledges the Academia Sinica Institute of Mathematics (Taipei, Taiwan) for its hospitality and support. The authors thank Yaniv Plan, Mark Rudelson, Roman Vershynin, and Elena Yudovina for helpful comments. The authors especially thank Elena Yudovina for a suggestion which led to an improved proof of Theorem 5.5 that is more precise than an earlier version and that is also more consistent with the proof of Theorem 6.1. The authors thank the referees for numerous helpful comments which improved the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Peter Buergisser.
Rights and permissions
About this article
Cite this article
Powell, A.M., Whitehouse, J.T. Error Bounds for Consistent Reconstruction: Random Polytopes and Coverage Processes. Found Comput Math 16, 395–423 (2016). https://doi.org/10.1007/s10208-015-9251-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10208-015-9251-2