Summary
A Bayesian procedure for the probability density estimation is proposed. The procedure is based on the multinomial logit transformations of the parameters of a finely segmented histogram model. The smoothness of the estimated density is guaranteed by the introduction of a prior distribution of the parameters. The estimates of the parameters are defined as the mode of the posterior distribution. The prior distribution has several adjustable parameters (hyper-parameters), whose values are chosen so that ABIC (Akaike's Bayesian Information Criterion) is minimized.
The basic procedure is developed under the assumption that the density is defined on a bounded interval. The handling of the general case where the support of the density function is not necessarily bounded is also discussed. The practical usefulness of the procedure is demonstrated by numerical examples.
Similar content being viewed by others
References
Ahrens, L. H. (1965). Observations of the Fe−Si−Mg relationship in chondrites,Geochimica et Cosmochimica Acta,29, 801–806.
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle,2nd International Symposium on Information Theory, (eds. B. N. Petrov and F. Csaki), Akademiai Kiado, Budapest, 267–281.
Akaike, H. (1977). On entropy maximization principle,Applications of Statistics, (ed. Krishnaiah, P. R.), North-Holland, Amsterdam 27–41.
Akaike, H. and Arahata, E. (1978). GALTHY, A probability density estimation,Computer Science Monographs, No. 9, The Institute of Statistical Mathematics, Tokyo.
Akaike, H. (1980). Likelihood and Bayes procedure,Bayesian Statistics, (eds. J. M. Bernardo, M. H. De Groot, D. U. Lindley and A. F. M. Smith), University Press, Valencia, Spain.
Boneva, L. I., Kendall, D. G. and Stefanov, I. (1971). Spline transformations: three new diagnostic aids for the statistical data-analyst,J. R. Statist. Soc., B,33, 1–71.
Burch, C. R. and Parsons, I. T. (1976). Squeeze significance tests,Applied Statistics,25, 287–291.
Good, I. J. and Gaskins, R. A. (1971). Nonparametric roughness penalties for probability densities,Biometrika,58, 255–277.
Good, I. J. and Gaskins, R. A. (1980). Density estimation and bump-hunting by the penalized likelihood method exemplified by scattering and meteorite data,J. Amer. Statist. Ass.,75, 42–56.
Ishiguro, M. and Sakamoto, Y. (1983). A Bayesian approach to binary response curve estimation,Ann. Inst. Statist. Math., B,35, 115–137.
Leonard, Tom (1978). Density estimation, stochastic processes, and prior information,J. R. Statist. Soc., B,40, 113–146.
Maguire, B. A., Pearson, E. S. and Wynn, A. H. A. (1952). The time intervals between industrials accidents,Biometrika,39, 168–180.
Parzen, E. (1962). On estimation of a probability density and mode,Ann. Math. Statist.,33, 1065–1076.
Rosenblatt, M. (1956). Remarks on some non-parametric estimates of a density function,Ann. Math. Statist.,27, 832–837.
Whittle, P. (1958). On the smoothing of probability density functions,J. R. Statist. Soc., B,20, 334–343.
Additional information
The Institute of Statistical Mathematics
About this article
Cite this article
Ishiguro, M., Sakamoto, Y. A bayesian approach to the probability density estimation. Ann Inst Stat Math 36, 523–538 (1984). https://doi.org/10.1007/BF02481990
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF02481990