Abstract
A quantitative comparison of Pulse Code Modulation (PCM) and Sigma–Delta (Σ Δ) quantization methods is made in the setting of finite frames. Frames allow for redundant, overcomplete signal decompositions. PCM and Σ Δ are two industry-standard quantization methods, and the setting of finite frames is appropriate for a host of modern applications. Previous results for this comparison are known for upper error bounds, where Σ Δ performs better in the setting of frames, as opposed to orthonormal bases, where PCM is optimal. We answer the following question: For which signals x is the PCM error, that is, the norm of the difference between x and its PCM approximant, less than the Σ Δ error? We prove that, typically, in the setting of frames, Σ Δ outperforms PCM, but not always.
Similar content being viewed by others
References
Aziz, P.M., Sorensen, H.V., Van Der Spiegel, J.: An overview of Sigma–Delta converters. IEEE Signal Process. Mag. 13, 61–84 (1996)
Benedetto, J.J., Frazier, M.W. (eds.): Wavelets: Mathematics and Applications. CRC Press, Boca Raton (1994)
Benedetto, J.J., Powell, A., Yılmaz, Ö.: Second order Sigma–Delta (Σ Δ) quantization of finite frame expansions. Appl. Comput. Harmon. Anal. 20, 126–148 (2006)
Benedetto, J.J., Powell, A.M., Yılmaz, Ö.: Sigma–Delta quantization and finite frames. IEEE Trans. Inf. Theory 52, 1990–2005 (2006)
Benedetto, J.J., Oktay, O., Tangboondouangjit, A.: Complex Sigma–Delta quantization algorithms for finite frames. Contemp. Math. 464, 27–51 (2008)
Beurling, A., Malliavin, P.: On the closure of characters and the zeros of entire functions. Acta Math. 118, 79–93 (1967)
Bodmann, B., Paulsen, V.: Frame paths and error bounds for Sigma–Delta quantization. Appl. Comput. Harmon. Anal. 22, 176–197 (2007)
Candy, J.C., Temes, G.C. (eds.): Oversampling Delta–Sigma Data Converters. IEEE Press, New York (1992)
Casazza, P., Han, D., Larson, D.R.: Frames for Banach spaces. Contemp. Math. 247, 149–182 (1999)
Christensen, O.: An Introduction to Frames and Riesz Bases. Birkhäuser, Boston (2003)
Cvetković, Z.: Resilience properties of redundant expansions under additive noise and quantization. IEEE Trans. Inf. Theory 49, 644–656 (2003)
Daubechies, I.: Ten Lectures on Wavelets. SIAM, Philadelphia (1992)
Daubechies, I., DeVore, R.: Reconstructing a bandlimited function from very coarsely quantized data: a family of stable Sigma–Delta modulators of arbitrary order. Ann. Math. 158, 679–710 (2003)
Daubechies, I., Yılmaz, Ö.: Robust and practical analog-to-digital conversion with exponential precision. IEEE Trans. Inf. Theory 52(8), 3533–3545 (2006)
Daubechies, I., Grossman, A., Meyer, Y.: Painless nonorthogonal expansions. J. Math. Phys. 27(5), 1271–1283 (1986)
Duffin, R.J., Schaeffer, A.C.: A class of nonharmonic Fourier series. Trans. Am. Math. Soc. 72(2), 341–366 (1952)
Gallager, R.G.: Information Theory and Reliable Communication. Wiley, New York (1968)
Gersho, A., Gray, R.M.: Vector Quantization and Signal Compression. Kluwer Academic/Springer, New York (1992)
Goyal, V.K.: Theoretical foundations of transform coding. IEEE Signal Process. Mag. 18, 9–21 (2001)
Goyal, V.K., Kovačević, J., Vetterli, M.: Multiple description transform coding: robustness to erasures using tight frame expansions. In: Proc. Int. Symp. Inform. Theory (ISIT), Cambridge, MA, August 1998, p. 408
Goyal, V.K., Vetterli, M., Thao, N.T.: Quantized overcomplete expansions in ℝn: analysis, synthesis, and algorithms. IEEE Trans. Inf. Theory 44(1), 16–31 (1998)
Goyal, V.K., Kovačević, J., Vetterli, M.: Quantized frame expansions as source-channel codes for erasure channels. In: Proc. IEEE Data Compression Conference, Snowbird, UT, March 1999, pp. 326–335
Goyal, V.K., Kovačević, J., Kelner, J.A.: Quantized frame expansions with erasures. Appl. Comput. Harmon. Anal. 10, 203–233 (2001)
Goyal, V.K., Kovačević, J., Dragotti, P.: Filter bank frame expansions with erasures. IEEE Trans. Inf. Theory 48, 1439–1450 (2002). Special Issue in honor of Aaron D. Wyner
Gray, R.M.: Quantization noise spectra. IEEE Trans. Inf. Theory 36(6), 1220–1244 (1990)
Gray, R.M.: Entropy and Information Theory. Springer, New York (1991)
Gröchenig, K.: Localization of frames, Banach frames, and the invertibility of the frame operator. J. Fourier Anal. Appl. 10, 105–132 (2004)
Güntürk, C.S.: Harmonic analysis of two problems in signal quantization and compression. Ph.D. thesis. Princeton University (2000)
Güntürk, C.S.: Approximating a bandlimited function using very coarsely quantized data: improved error estimates in Sigma–Delta modulation. J. Am. Math. Soc. 17, 229–242 (2004)
Güntürk, C.S., Lagarias, J.C., Vaishampayan, V.A.: On the robustness of single loop Sigma–Delta modulation. IEEE Trans. Inf. Theory 12, 63–79 (2001)
Güntürk, C.S., Daubechies, I., DeVore, R., Vaishampayan, V.: A/D conversion with imperfect quantizers. IEEE Trans. Inf. Theory 52, 874–885 (2006)
Holmes, R., Paulsen, V.: Optimal frames for erasures. Linear Algebra Appl. 377, 31–51 (2004)
Kovačević, J., Chebira, A.: Life beyond bases: the advent of frames (Part I). IEEE Signal Process. Mag. 24(4), 86–104 (2007). Feature article
Kovačević, J., Chebira, A.: Life beyond bases: the advent of frames (Part II). IEEE Signal Process. Mag. 24(5), 115–125 (2007). Feature article
Landau, H.J.: Necessary density conditions for sampling and interpolation of certain entire functions. Acta Math. 117, 37–52 (1967)
MacKay, D.: Information Theory, Inference and Learning Algorithms. Cambridge University Press, Cambridge (2003)
McEliece, R.J.: The Theory of Information and Coding, 2nd edn. Cambridge University Press, Cambridge (2002)
Norsworthy, S.R., Schreier, R., Temes, G.C. (eds.): Delta–Sigma Data Converters. IEEE Press, New York (1997)
Pinault, S.C., Lopresti, P.V.: On the behavior of the double-loop Sigma–Delta modulator. IEEE Trans. Circuits Syst. 40, 467–479 (1993)
Rangan, S., Goyal, V.K.: Recursive consistent estimation with bounded noise. IEEE Trans. Inf. Theory 47(1), 457–464 (2001)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 623–656 (1948)
Thao, N.T., Vetterli, M.: Deterministic analysis of oversampled A/D conversion and decoding improvement based on consistent estimates. IEEE Trans. Signal Process. 43(3), 519–531 (1994)
Thao, N.T., Vetterli, M.: Reduction in the MSE in R-times oversampled A/D conversion from o(1/r) to o(1/r 2). IEEE Trans. Signal Process. 42(1), 200–203 (1994)
Wang, Y.: Sigma–Delta quantization errors and the traveling salesman problem. Adv. Comput. Math. 28, 101–118 (2008)
Wiener, N., Paley, R.E.A.C.: Fourier Transforms in the Complex Domain, vol. 19, Am. Math. Soc. Colloq. Publ., Providence (1934)
Yılmaz, Ö.: Stability analysis for several Sigma–Delta methods of coarse quantization of bandlimited functions. Constr. Approx. 18, 599–623 (2002)
Yılmaz, Ö.: Coarse quantization of highly redundant time-frequency representations of square-integrable functions. Appl. Comput. Harmon. Anal. 14, 107–132 (2003)
Zimmermann, G.: Normalized tight frames in finite dimensions. In: Jetter, K., Haussmann, W., Reimer, M. (eds.) Recent Progress in Multivariate Approximation, pp. 249–252. Birkhäuser, Basel (2001)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Ronald A. DeVore.
Rights and permissions
About this article
Cite this article
Benedetto, J.J., Oktay, O. Pointwise Comparison of PCM and Σ Δ Quantization. Constr Approx 32, 131–158 (2010). https://doi.org/10.1007/s00365-010-9083-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00365-010-9083-x