Abstract
We obtain a minimax lower bound for the expected distortion of empirically designed vector quantizers. We show that the mean squared distortion of any empirically designed vector quantizer is at least Ω (n −1/2) away from the optimal distortion for some distribution on a bounded subset of R d, where n is the number of i.i.d. data points that are used to train the empirical quantizer.
The work of the last two authors was supported by OTKA Grant F 014174.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
K. Alexander. Probability inequalities for empirical processes and a law of the iterated logarithm. Annals of Probability, 4:1041–1067, 1984.
P. A. Chou. The distortion of vector quantizers trained on n vectors decreases to the optimum as Op(1/n). Proceedings of IEEE Int. Symp. Inform. Theory, Trondheim, Norway, 1994.
Y.S. Chow and H. Teicher. Probability Theory, Independence, Interchangeability, Martingales. Springer-Verlag, New York, 1978.
L. Devroye, L. Györfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer-Verlag, New York, 1996.
A.N. Kolmogorov and V.M. Tikhomirov. ε-entropy and ε-capacity of sets in function spaces. Translations of the American Mathematical Society, 17:277–364, 1961.
T. Linder, G. Lugosi, and K. Zeger. Rates of convergence in the source coding theorem, empirical quantizer design, and universal lossy source coding. IEEE Transactions on Information Theory, 40:1728–1740, 1994.
T. Linder, G. Lugosi, and K. Zeger. Empirical quantizer design in the presence of source noise or channel noise. IEEE Transactions on Information Theory, 1996. to appear.
C.L. Mallows. An inequality involving multinomial probabilities. Biometrika, 55:422–424, 1968.
N. Merhav and J. Ziv. On the amount of side information required for lossy data compression. submitted to IEEE Transactions on Information Theory, 1995.
D. Pollard. A central limit theorem for k-means clustering. Annals of Probability, 10:919–926, 1982.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bartlett, P., Linder, T., Lugosi, G. (1997). A minimax lower bound for empirical quantizer design. In: Ben-David, S. (eds) Computational Learning Theory. EuroCOLT 1997. Lecture Notes in Computer Science, vol 1208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62685-9_18
Download citation
DOI: https://doi.org/10.1007/3-540-62685-9_18
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62685-5
Online ISBN: 978-3-540-68431-2
eBook Packages: Springer Book Archive