Abstract
A new Bayesian method for non-parametric density estimation is proposed, based on a mathematical analogy to quantum statistical physics. The mathematical procedure is related to maximum entropy methods for inverse problems and image reconstruction. The information divergence enforces global smoothing toward default models, convexity, positivity, extensivity and normalization. The novel feature is the replacement of classical entropy by quantum entropy, so that local smoothing is enforced by constraints on differential operators. The linear response of the estimate is proportional to the covariance. The hyperparameters are estimated by type-II maximum likelihood (evidence). The method is demonstrated on textbook data sets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amari, S., Differential-geometrical Methods in Statistics, Springer-Verlag, Berlin, 1985.
Balian, R., From Microphysics to Macrophysics, Springer-Verlag, Berlin, 1991.
Berger, J. O., Statistical Decision Theory and Bayesian Analysis, Springer-Verlag, Berlin, 1985.
Demoment, G., “Image Reconstruction and Restoration: Overview of Common Estimation Structures and Problems”, IEEE Transactions on Acoustics, Speech and Signal Processing 37 (1989), 2024–2036.
Good, I. J., Good Thinking: The Foundations of Probability and Its Applications, University of Minnesota Press, Minneapolis, 1985.
Good, I. J., and Gaskins, R. A., “Density Estimation and Bump Hunting by the Penalized Likelihood Method Exemplified by Scattering and Meteorite Data”, Journal of the American Statistical Association 75 (1980), 42–73.
Izenman, A. J., “Recent Developments in Nonparametric Density Estimation”, Journal of the American Statistical Association 86 (1991), 205–224.
Robinson, D. R. T., “Maximum Entropy with Poisson Statistics”, Maximum Entropy and Bayesian Methods W. T. Grandy, L. H. Schick (eds.) Kluwer, Dordrecht (1991), 337–341.
Scott, D. W., Multivariate Density Estimation, John Wiley and Sons, Inc., New York, 1993.
Silver, R. N., “Quantum Statistical Inference”, Maximum Entropy and Bayesian Methods, A. Djafari, G. Demoment, (eds), Kluwer Academic Publishers, Dordrecht, 1993, 167–182.
Silver, R. N. and Martz, H. F., “Quantum Statistical Inference for Inverse Problems”, submitted to Journal of the American Statistical Association, 1993.
Silverman, B. W., Density Estimation for Statistics and Data Analysis, Chapman and Hall, London, 1986.
Skilling, J., “Bayesian Numerical Analysis”, In Physics e. Probability, W. T. Grandy, Jr., P. W. Milonni (eds), Cambridge University Press, Cambridge, 1993, p. 207–222.
Skilling, J. and Gull, S., “Classic MaxEnt”, Maximum Entropy and Bayesian Methods, J. Skilling (ed.), Kluwer, Dordrecht, 1989, 45–71.
Titterington, D. M., “Common Structure of Smoothing Techniques in Statistics”, Int. Statist. Rev. 53 (1985), 141–170.
Thompson, A. M., Brown, J. C., Kay, J. W., Titterington, D. M., “A Study of Methods of Choosing the Smoothing Parameter in Image Restoration by Regularization”, IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (1991), 326–339.
von Neumann, J., Gött. Nachr. 273, 1927.
Wallstrom, T., “Generalized Quantum Statistical Inference”, to be published, 1993.
Wehrl, A., “General Properties of Entropy”, Reviews of Modern Physics 50 (1978), 221–260.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Silver, R.N., Wallstrom, T., Martz, H.F. (1996). Density Estimation by Maximum Quantum Entropy. In: Heidbreder, G.R. (eds) Maximum Entropy and Bayesian Methods. Fundamental Theories of Physics, vol 62. Springer, Dordrecht. https://doi.org/10.1007/978-94-015-8729-7_12
Download citation
DOI: https://doi.org/10.1007/978-94-015-8729-7_12
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-4407-5
Online ISBN: 978-94-015-8729-7
eBook Packages: Springer Book Archive