Skip to main content
Log in

Some data-analytic modifications to Bayes-Stein estimation

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Summary

The usual Bayes-Stein shrinkages of maximum likelihood estimates towards a common value may be refined by taking fuller account of the locations of the individual observations. Under a Bayesian formulation, the types of shrinkages depend critically upon the nature of the common distribution assumed for the parameters at the second stage of the prior model. In the present paper this distribution is estimated empirically from the data, permitting the data to determine the nature of the shrinkages. For example, when the observations are located in two or more clearly distinct groups, the maximum likelihood estimates are roughly speaking constrained towards common values within each group. The method also detects outliers; an extreme observation will either the regarded as an outlier and not substantially adjusted towards the other observations, or it will be rejected as an outlier, in which case a more radical adjustment takes place. The method is appropriate for a wide range of sampling distributions and may also be viewed as an alternative to standard multiple comparisons, cluster analysis, and nonparametric kernel methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Clevenson, M. and Zidek, J. W. (1975). Simultaneous estimation of the means of independent Poisson laws,J. Amer. Statist Ass.,70, 698–705.

    MathSciNet  MATH  Google Scholar 

  2. Dawid, A. P. (1973). Posterior expectation for large observations,Biometrika,61, 664–667.

    Article  MathSciNet  Google Scholar 

  3. Efron, B. and Morris, C. (1973a). Stein's estimation rule and its competitors—an empirical Bayes approach,J. Amer. Statist. Ass.,68, 117–130.

    MathSciNet  MATH  Google Scholar 

  4. Efron, B. and Morris, C. (1973b). Combining possibly related estimation problems (with discussion),J. R. Statist. Soc., B,36, 379–421.

    MathSciNet  MATH  Google Scholar 

  5. Efron, B. and Morris, C. (1975). Data analysis using Stein's estimator and its generalizations.J. Amer. Statist. Ass.,70, 311–319.

    Article  Google Scholar 

  6. James, W. and Stein, C. (1961). Estimation with quadratic loss,Proc. 4th Berkeley Symposium,1, 361–379.

    MathSciNet  MATH  Google Scholar 

  7. Laird, N. M. (1978). Non-parametric maximum likelihood estimation of a mixing distribution,J. Amer. Statist. Ass.,73, 805–811.

    Article  Google Scholar 

  8. Leonard, T. (1972). Bayesian methods for binomial data,Biometrika,59, 581–589.

    Article  MathSciNet  Google Scholar 

  9. Leonard, T. (1978). Density estimation, stochastic processes, and prior information (with discussion),J. R. Statist. Soc., B,40, 113–146.

    MathSciNet  MATH  Google Scholar 

  10. Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model (with discussion),J. R. Statist. Soc., B,34, 1–41.

    MathSciNet  MATH  Google Scholar 

  11. Lindsay, B. G. (1981). Properties of the maximum likelihood estimator of a mixing distribution, inStatistical Distributions in Scientific Work (ed. C. Taillie et al.), Vol. 5, 95–109.

    Chapter  Google Scholar 

  12. Lindsay, B. G. (1982a). A geometry of mixture likelihoods: A general theory,Penn. State Univ. Tech. Report.

  13. Lindsay, B. G. (1983a). A geometry of mixture likelihoods, Part II: The exponential family,J. Amer. Statist. Ass.,4, 1200–1209.

    MATH  Google Scholar 

  14. Pearson, K. (1904). On the theory of contingency and its relation to association and normal correlation,Drapers Co. Res. Mem. Biometrics Series.

  15. Robbins, H. (1964). The empirical Bayes approach to statistical decision problems,Ann. Math. Statist.,35, 1289–1302.

    Article  MathSciNet  Google Scholar 

  16. Silverman, B. W. (1978). Choosing the window width when estimating a density,Biometrika,65, 1–12.

    Article  MathSciNet  Google Scholar 

  17. Simar, L. (1976). Maximum likelihood estimation of a compound Poisson process,Ann. Statist.,4, 1200–1209.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Leonard, T. Some data-analytic modifications to Bayes-Stein estimation. Ann Inst Stat Math 36, 11–21 (1984). https://doi.org/10.1007/BF02481949

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02481949

AMS (MOS) subject classification

Key words

Navigation