Abstract
In this paper we discuss approaches to estimating probability densities from streaming data based on wavelets. It is expected that streaming datasets are large and that the rate of data acquisition is very high. Thus it is not possible to recompute the entire density so that recursive algorithms are necessary. In addition, because streaming data are typically not stationary, older data in the stream are usually less valuable. It is, therefore, necessary to discount older data. We develop in this paper a methodology that is applicable to any orthonormal bases, but, in particular, a methodology for wavelet bases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cencov, N.N.: Evaluation of an unknown density from observations. Soviet Mathematics. 3, 1559–1562 (1962)
Devore, R.A. and Lucier, B.J.: Fast wavelet techniques for near-optimal image processing. In: IEEE Military Communications Conference Record, 1129–1135 (1992)
Donoho, D.L. and Johnstone, I.M.: Ideal spatial adaptation by wavelet shrinkage. Biometika. 81(3), 425–455 1994
Kafadar, K.K. and Wegman, E.J.: Graphical displays of Internet traffic data. In COMPSTAT 2004. (Antoch, J., ed.), Berlin: Physica-Verlag, 287–302 (2004)
Mallat, S.G.: Multiresolution approximations and wavelet orthonormal bases of \( \mathbb{L}^{\text{2}} (\mathbb{R}) \). Transactions of the American Mathematical Society. 315, 69–87 (1989)
Marchette, D.J.: Computer Intrusion Detection and Network Monitoring: A Statistical Viewpoint. New York: Spring-Verlag (2001)
Vidakovic, B.: Statistics Modeling by Wavelets. New York: John Wiley and Sons (1999)
Wegman, E.J. and Davies, H.I.: Remarks on some recursive estimators of a probability density. Annals of Statistics. 7(2), 316–327 (1979)
Wegman, E.J. and Marchette, D.J.: On some techniques for streaming data: A case study of Internet packet headers. Journal of Computational and Graphical Statistics. 12(4), 893–914 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Physica-Verlag Heidelberg
About this paper
Cite this paper
Wegman, E.J., Caudle, K.A. (2006). Density estimation from streaming data using wavelets. In: Rizzi, A., Vichi, M. (eds) Compstat 2006 - Proceedings in Computational Statistics. Physica-Verlag HD. https://doi.org/10.1007/978-3-7908-1709-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-7908-1709-6_18
Publisher Name: Physica-Verlag HD
Print ISBN: 978-3-7908-1708-9
Online ISBN: 978-3-7908-1709-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)