Skip to main content
Log in

Aspects of multivariate regression

  • Regression and Time Series
  • Invited Papers
  • Published:
Trabajos de Estadistica Y de Investigacion Operativa

Summary

Important features of multivariate linear regression are emphasised and a selection of prior distributions discussed. Priors used by Brown and Zidek (1978) lead them to a class of ‘Empirical’ Bayes shrinkage estimates. The strength of shrinkage is examined with respect to an election forecasting example where observations obtain one after another.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Berger, J. (1980). A robust Generalised Bayes estimator and Confidence Region for a Multivariate Normal Mean.Ann. Statist. 4, 716–61.

    Article  Google Scholar 

  • Brown, P.J. (1977). Centering and scaling in ridge regression.Technometrics,19, 35–6.

    Article  MATH  MathSciNet  Google Scholar 

  • Brown, P.J. andPayne, C. (1975). Election night forecasting, (with discussion).J. R. Statist. Soc. A 138, 463–498.

    Google Scholar 

  • Brown, P.J. andZidek, J.V. (1980). Adaptive Multivariate Ridge Regression.Ann. Statist. 8, 64–74.

    Article  MATH  MathSciNet  Google Scholar 

  • — (1979). Multivariate Ridge Regression with Unknown Covariance Matrix.Tech. Report No. 79-11, University of British Columbia, Canada.

    Google Scholar 

  • Dawid, A.P. (1973). Posterior expectations for large observations.Biometrika,60, 664–6.

    Article  MATH  MathSciNet  Google Scholar 

  • Dempster, A.P. (1973). Alternatives to least squares in multiple regression. InMultivariate Statistical Analysis, (D. Kabe and R.P. Gupta, eds.), 25–40. Amsterdam: North-Holland.

    Google Scholar 

  • Dempster, A.P., Schatzoff, M. andWermuth, M. (1977). A simulation study of alternatives to ordinary least squares.J. Amer. Stat. Assoc.,72, 77–106.

    Article  MATH  Google Scholar 

  • Dickey, J., Lindley, D.V. andPress, S.J. (1978). Estimation of the dispersion matrix of a multivariate normal distribution.Tech. report.

  • Efron, B. andMorris, C (1972). Empirical Bayes on vector observations: an extension of Stein’s method.Biometrika 59, 335–347.

    Article  MATH  MathSciNet  Google Scholar 

  • Goldstein, M. andBrown, P.J. (1978). Prediction with shrinkage estimator.Math. Operations forsch. Statist. Ser. Statistics 9, 1, 3–7.

    MATH  MathSciNet  Google Scholar 

  • Good, I.J. (1965).The estimation of probabilities. Massachussets: MIT Press.

    MATH  Google Scholar 

  • Hill, B.M. (1974). On Coherence, inadmissibility and inference about many parameters in the theory of least squares. InStudies in Bayesian Econometrics and Statistics (Fienberg, S.B. and Zellner, A. eds.) 555–84. Amsterdam: North-Holland.

    Google Scholar 

  • Hoerl, A.E., Kennard, R.W., andBaldwin K.F. (1975). Ridge regression: some simulationsComm. Statist. 4, 105–123.

    Article  Google Scholar 

  • James, W. andStein, C. (1961). Estimation with quadratic loss.Proc. Fourth Berk Symp. Prob. Statist.,1, 361–379.

    MathSciNet  Google Scholar 

  • Lawless, J.F. andWang, P. (1976). A simulation study of Ridge and Other Regression estimators.Comm. Statist. A 5, 307–23.

    Article  Google Scholar 

  • Lindley, D.V. (1971). The Estimation of Many Parameters. InFoundations of Statistical inference, (V.P. Godambe and D.A. Sprott, eds.) 435–55. Toronto: Holt, Rinehart & Winston.

    Google Scholar 

  • — (1971). The Bayesian Approach.Scand J. Statist.,5, 1–26.

    MathSciNet  Google Scholar 

  • Lindley, D.V. andSmith, A.F.M. (1972). Bayes estimates for the linear model (with discussion).Statist. Soc., B,34, 1–41.

    MATH  MathSciNet  Google Scholar 

  • Press, S.J. (1972).Applied Multivariate Analysis. Toronto: Holt, Rinehart & Winston.

    MATH  Google Scholar 

  • Rao, C.R. (1965).Linear statistical inference and its applications. New York: John Wiley and Sons.

    MATH  Google Scholar 

  • Rothenberg, T.J. (1963). A Bayesian Analysis of Simultaneous Equation Systems.Tech. Report. 6315. Netherlands School of Economics.

  • Sclove, S.L. (1971). Improved estimation of parameters in multivariate regression.Sankhya, Ser. A.,33, 61–66.

    MATH  MathSciNet  Google Scholar 

  • Sclove, S.L. (1973). Least squares problems with random coefficients.Tech. Rep. 72, Stanford University.

  • Stein, C. (1962). Confidence sets for the mean of a multivariate normal distribution.J. Roy. Statist. Soc. B. 24, 265–296.

    Google Scholar 

  • Stein, C. (1973). Estimation of the mean of a multivariate normal distribution. InProc. Prague Symp. Asymp. Statist., 345–381.

  • Thisted, R.A. (1976). Ridge regression, minimax estimation and empirical Bayes methods,Tech. Rep. 28, Stanford University.

  • Zellner, A. (1971).An Introduction to Bayesian Inference in Econometrics. New York: Wiley.

    MATH  Google Scholar 

  • Zellner, andVandaele, W. (1974). Bayes-Stein Estimators fork-means, regression and simultaneous equation models. InStudies in Bayesian Econometrics and Statistics. (S.E. Fienberg and Zellner, A. eds.) 627–53. Amsterdam: North Holland.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Brown, P.J. Aspects of multivariate regression. Trabajos de Estadistica Y de Investigacion Operativa 31, 249–265 (1980). https://doi.org/10.1007/BF02888354

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02888354

Keywords

Navigation