Summary
Important features of multivariate linear regression are emphasised and a selection of prior distributions discussed. Priors used by Brown and Zidek (1978) lead them to a class of ‘Empirical’ Bayes shrinkage estimates. The strength of shrinkage is examined with respect to an election forecasting example where observations obtain one after another.
Similar content being viewed by others
References
Berger, J. (1980). A robust Generalised Bayes estimator and Confidence Region for a Multivariate Normal Mean.Ann. Statist. 4, 716–61.
Brown, P.J. (1977). Centering and scaling in ridge regression.Technometrics,19, 35–6.
Brown, P.J. andPayne, C. (1975). Election night forecasting, (with discussion).J. R. Statist. Soc. A 138, 463–498.
Brown, P.J. andZidek, J.V. (1980). Adaptive Multivariate Ridge Regression.Ann. Statist. 8, 64–74.
— (1979). Multivariate Ridge Regression with Unknown Covariance Matrix.Tech. Report No. 79-11, University of British Columbia, Canada.
Dawid, A.P. (1973). Posterior expectations for large observations.Biometrika,60, 664–6.
Dempster, A.P. (1973). Alternatives to least squares in multiple regression. InMultivariate Statistical Analysis, (D. Kabe and R.P. Gupta, eds.), 25–40. Amsterdam: North-Holland.
Dempster, A.P., Schatzoff, M. andWermuth, M. (1977). A simulation study of alternatives to ordinary least squares.J. Amer. Stat. Assoc.,72, 77–106.
Dickey, J., Lindley, D.V. andPress, S.J. (1978). Estimation of the dispersion matrix of a multivariate normal distribution.Tech. report.
Efron, B. andMorris, C (1972). Empirical Bayes on vector observations: an extension of Stein’s method.Biometrika 59, 335–347.
Goldstein, M. andBrown, P.J. (1978). Prediction with shrinkage estimator.Math. Operations forsch. Statist. Ser. Statistics 9, 1, 3–7.
Good, I.J. (1965).The estimation of probabilities. Massachussets: MIT Press.
Hill, B.M. (1974). On Coherence, inadmissibility and inference about many parameters in the theory of least squares. InStudies in Bayesian Econometrics and Statistics (Fienberg, S.B. and Zellner, A. eds.) 555–84. Amsterdam: North-Holland.
Hoerl, A.E., Kennard, R.W., andBaldwin K.F. (1975). Ridge regression: some simulationsComm. Statist. 4, 105–123.
James, W. andStein, C. (1961). Estimation with quadratic loss.Proc. Fourth Berk Symp. Prob. Statist.,1, 361–379.
Lawless, J.F. andWang, P. (1976). A simulation study of Ridge and Other Regression estimators.Comm. Statist. A 5, 307–23.
Lindley, D.V. (1971). The Estimation of Many Parameters. InFoundations of Statistical inference, (V.P. Godambe and D.A. Sprott, eds.) 435–55. Toronto: Holt, Rinehart & Winston.
— (1971). The Bayesian Approach.Scand J. Statist.,5, 1–26.
Lindley, D.V. andSmith, A.F.M. (1972). Bayes estimates for the linear model (with discussion).Statist. Soc., B,34, 1–41.
Press, S.J. (1972).Applied Multivariate Analysis. Toronto: Holt, Rinehart & Winston.
Rao, C.R. (1965).Linear statistical inference and its applications. New York: John Wiley and Sons.
Rothenberg, T.J. (1963). A Bayesian Analysis of Simultaneous Equation Systems.Tech. Report. 6315. Netherlands School of Economics.
Sclove, S.L. (1971). Improved estimation of parameters in multivariate regression.Sankhya, Ser. A.,33, 61–66.
Sclove, S.L. (1973). Least squares problems with random coefficients.Tech. Rep. 72, Stanford University.
Stein, C. (1962). Confidence sets for the mean of a multivariate normal distribution.J. Roy. Statist. Soc. B. 24, 265–296.
Stein, C. (1973). Estimation of the mean of a multivariate normal distribution. InProc. Prague Symp. Asymp. Statist., 345–381.
Thisted, R.A. (1976). Ridge regression, minimax estimation and empirical Bayes methods,Tech. Rep. 28, Stanford University.
Zellner, A. (1971).An Introduction to Bayesian Inference in Econometrics. New York: Wiley.
Zellner, andVandaele, W. (1974). Bayes-Stein Estimators fork-means, regression and simultaneous equation models. InStudies in Bayesian Econometrics and Statistics. (S.E. Fienberg and Zellner, A. eds.) 627–53. Amsterdam: North Holland.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Brown, P.J. Aspects of multivariate regression. Trabajos de Estadistica Y de Investigacion Operativa 31, 249–265 (1980). https://doi.org/10.1007/BF02888354
Issue Date:
DOI: https://doi.org/10.1007/BF02888354