Skip to main content
Log in

A bayesian approach to the probability density estimation

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Summary

A Bayesian procedure for the probability density estimation is proposed. The procedure is based on the multinomial logit transformations of the parameters of a finely segmented histogram model. The smoothness of the estimated density is guaranteed by the introduction of a prior distribution of the parameters. The estimates of the parameters are defined as the mode of the posterior distribution. The prior distribution has several adjustable parameters (hyper-parameters), whose values are chosen so that ABIC (Akaike's Bayesian Information Criterion) is minimized.

The basic procedure is developed under the assumption that the density is defined on a bounded interval. The handling of the general case where the support of the density function is not necessarily bounded is also discussed. The practical usefulness of the procedure is demonstrated by numerical examples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ahrens, L. H. (1965). Observations of the Fe−Si−Mg relationship in chondrites,Geochimica et Cosmochimica Acta,29, 801–806.

    Article  Google Scholar 

  2. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle,2nd International Symposium on Information Theory, (eds. B. N. Petrov and F. Csaki), Akademiai Kiado, Budapest, 267–281.

    MATH  Google Scholar 

  3. Akaike, H. (1977). On entropy maximization principle,Applications of Statistics, (ed. Krishnaiah, P. R.), North-Holland, Amsterdam 27–41.

    MATH  Google Scholar 

  4. Akaike, H. and Arahata, E. (1978). GALTHY, A probability density estimation,Computer Science Monographs, No. 9, The Institute of Statistical Mathematics, Tokyo.

    Google Scholar 

  5. Akaike, H. (1980). Likelihood and Bayes procedure,Bayesian Statistics, (eds. J. M. Bernardo, M. H. De Groot, D. U. Lindley and A. F. M. Smith), University Press, Valencia, Spain.

    MATH  Google Scholar 

  6. Boneva, L. I., Kendall, D. G. and Stefanov, I. (1971). Spline transformations: three new diagnostic aids for the statistical data-analyst,J. R. Statist. Soc., B,33, 1–71.

    MathSciNet  MATH  Google Scholar 

  7. Burch, C. R. and Parsons, I. T. (1976). Squeeze significance tests,Applied Statistics,25, 287–291.

    Article  Google Scholar 

  8. Good, I. J. and Gaskins, R. A. (1971). Nonparametric roughness penalties for probability densities,Biometrika,58, 255–277.

    Article  MathSciNet  Google Scholar 

  9. Good, I. J. and Gaskins, R. A. (1980). Density estimation and bump-hunting by the penalized likelihood method exemplified by scattering and meteorite data,J. Amer. Statist. Ass.,75, 42–56.

    Article  MathSciNet  Google Scholar 

  10. Ishiguro, M. and Sakamoto, Y. (1983). A Bayesian approach to binary response curve estimation,Ann. Inst. Statist. Math., B,35, 115–137.

    Article  Google Scholar 

  11. Leonard, Tom (1978). Density estimation, stochastic processes, and prior information,J. R. Statist. Soc., B,40, 113–146.

    MathSciNet  MATH  Google Scholar 

  12. Maguire, B. A., Pearson, E. S. and Wynn, A. H. A. (1952). The time intervals between industrials accidents,Biometrika,39, 168–180.

    Article  Google Scholar 

  13. Parzen, E. (1962). On estimation of a probability density and mode,Ann. Math. Statist.,33, 1065–1076.

    Article  MathSciNet  Google Scholar 

  14. Rosenblatt, M. (1956). Remarks on some non-parametric estimates of a density function,Ann. Math. Statist.,27, 832–837.

    Article  MathSciNet  Google Scholar 

  15. Whittle, P. (1958). On the smoothing of probability density functions,J. R. Statist. Soc., B,20, 334–343.

    MathSciNet  MATH  Google Scholar 

Download references

Authors

Additional information

The Institute of Statistical Mathematics

About this article

Cite this article

Ishiguro, M., Sakamoto, Y. A bayesian approach to the probability density estimation. Ann Inst Stat Math 36, 523–538 (1984). https://doi.org/10.1007/BF02481990

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02481990

Keywords

Navigation