Breakthroughs in Statistics pp 257-284 | Cite as

# Introduction to Lindley and Smith (1972) Bayes Estimates for the Linear Model

## Abstract

In 1972 there were no MCMC methods readily available to the statistical community in general and to the Bayesian statisticians in particular. Realistic formulations of models for practical situations were dismissed if solutions were neither available in closed form nor amenable to numerical calculation. Thus much effort was devoted to either approximating solutions to these practically desirable models or formulating other models that were both realistic and solvable. It was also the case the Bayesian modeling did not find general acceptance unless it could be shown that such models had desirable frequentist properties. Thus, when viewed in this context, this contribution by Lindley and Smith (hereafter LS) must surely qualify for the accolade, “breakthrough.”

## Keywords

Posterior Distribution Prior Distribution Prior Information Ridge Regression MCMC Method## Preview

Unable to display preview. Download preview PDF.

## References

## References

- de Finetti, B. (1937). Foresight: Its logical laws, its subjective sources. Translated and reprinted in
*Studies in Subjective Probability*(H. Kyburg and H. Smokier, eds.), 1964, pp. 93–158. Wiley, New York.Google Scholar - Hill, B.M. (1969). Foundations for the theory of least squares.
*J. Roy. Statist. Soc. Ser. B*,**31**, 89–97.MathSciNetzbMATHGoogle Scholar - James, W. and Stein, C. (1960). Estimation with quadratic loss.
*Proc. Fourth Berkeley Sympos*., 1, 361–380. University of California Press, Berkeley.Google Scholar - Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution.
*Proc. Third Berkeley Sympos*.,**1**, 197–206. University of California Press, Berkeley.Google Scholar

## References

- Brown, L.D. (1966). On the admissibility of invariant estimators of one or more location parameters.
*Ann. Math. Statist*.,**37**, 1087–1136.MathSciNetzbMATHCrossRefGoogle Scholar - Brown, L.D. (1968). Inadmissibility of the usual estimators of scale parameters in problems with unknown location and scale parameters.
*Ann. Math*,*Statist*.,**39**, 29–48.MathSciNetzbMATHCrossRefGoogle Scholar - Cornfield, J. (1969). The Bayesian outlook and its application.
*Biometrics*,**25**, 617–657.MathSciNetCrossRefGoogle Scholar - De Finetti, B. (1964). Foresight: its logical laws, its subjective sources. In
*Studies in Subjective Probability*( n.E. Kyburg, Jr. and H.E. Smokier eds.), pp. 93–158. Wiley, New York.Google Scholar - Fisk, P.R. (1967). Models of the second kind in regression analysis.
*J. Roy. Statist. Soc. Ser. B*,**29**, 266–281.MathSciNetzbMATHGoogle Scholar - Gorman, J.W. and Tomah, R.J. (1966). Selection of variables for fitting equations to data.
*Technometrics*,**8**, 27–51.CrossRefGoogle Scholar - Hewitt, E. and Savage, L.J. (1955). Symmetric measures on Cartesian products.
*Trans. Amer. Math. Soc*.,**80**, 470–501.MathSciNetzbMATHCrossRefGoogle Scholar - Hoerl, A.E. and Kennard, R.W. (1970a). Ridge regression: Biased estimation for nonorthogonal problems.
*Technometrics*,**12**,55–67.zbMATHCrossRefGoogle Scholar - Hoerl, A.E. and Kennard, R.W. (1970b). Ridge regression: Applications to nonorthogonal problems.
*Technometrics*,**12**, 69–82.zbMATHCrossRefGoogle Scholar - Lindley, D.V. (1969). Bayesian least squares.
*Bull. Inst. Internat. Statist*.,**43**(2), 152–153.Google Scholar - Lindley, D.V. (1971a). The estimation of many parameters. In
*Foundations of Statistical Inference*( V.P. Godambe and D.A. Sprott, eds.), pp. 435 - 455. Holt, Rinehart and Winston, Toronto.Google Scholar - Neider, J.A. (1968). Regression, model-building and invariance.
*J. Roy. Statist. Soc. Ser. A*,**131**, 303–315.CrossRefGoogle Scholar - Novick, M.R., Jackson, P.H., Thayer, D.T., and Cole, N.S. (1972). Estimating multiple regressions in m-groups; a cross-validation study.
*British. J. Math. Statist. Psych*. Google Scholar - Plackett, R.L. (1960).
*Principles of Regression Analysis*. Clarendon Press, Oxford.zbMATHGoogle Scholar - Rao, C.R. (1965).
*Linear Statistical Inference and its Applications*. Wiley, New York.zbMATHGoogle Scholar - Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution.
*Proc. Third Berkeley Sympos*.,**1**, 197–206. University of California Press, Berkeley.Google Scholar