Econometrics pp 221-236 | Cite as

Generalized Least Squares

Chapter

Abstract

This chapter considers a more general variance covariance matrix for the disturbances. In other words, u ∼ (0, σ 2 I n) is relaxed so that u ∼ (0, σ 2Ω) where Ω is a positive definite matrix of dimension (n×n). First Ω is assumed known and the BLUE for β is derived. This estimator turns out to be different from \( Y_i = \alpha + \beta _2 X_{2i} + \beta _3 X_{3i } + \beta _K X_{Ki } + u_{i } i = 1, 2,...,n \) , and is denoted by \( Y_i = \alpha + \beta _2 X_{2i} + \beta _3 X_{3i } + \beta _K X_{Ki } + u_{i } i = 1, 2,...,n \) , the Generalized Least Squares estimator of β. Next, we study the properties of \( Y_i = \alpha + \beta _2 X_{2i} + \beta _3 X_{3i } + \beta _K X_{Ki } + u_{i } i = 1, 2,...,n \) under this nonspherical form of the disturbances. It turns out that the OLS estimates are still unbiased and consistent, but their standard errors as computed by standard regression packages are biased and inconsistent and lead to misleading inference. Section 9.3 studies some special forms of Ω and derive the corresponding BLUE for β. It turns out that heteroskedasticity and serial correlation studied in Chapter 5 are special cases of Ω. Section 9.4 introduces normality and derives the maximum likelihood estimator. Sections 9.5 and 9.6 study the way in which test of hypotheses and prediction get affected by this general variance-covariance assumption on the disturbances. Section 9.7 studies the properties of this BLUE for β when Ω is unknown, and is replaced by a consistent estimator. Section 9.8 studies what happens to the W, LR and LM statistics when u ∼ N(0,σ 2Ω). Section 9.9 gives another application of GLS to spatial autocorrelation

Keywords

Spatial Autocorrelation Maximum Likelihood Estimator Serial Correlation Variance Covariance Matrix Spatial Weight Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anselin, L. (2001), “Spatial Econometrics,” Chapter 14 in B.H. Baltagi (ed.) A Companion to Theoretical Econometrics (Blackwell: Massachusetts).Google Scholar
  2. Anselin, L. (1988), Spatial Econometrics: Methods and Models (Kluwer: Dordrecht).Google Scholar
  3. Anselin, L. and A.K. Bera (1998), “Spatial Dependence in Linear Regression Models with an Introduction to Spatial Econometrics,” in A. Ullah and D.E.A. Giles (eds.) Handbook of Applied Economic Statistics (Marcel Dekker: New York).Google Scholar
  4. Balestra, P. (1970), “On the Efficiency of Ordinary Least Squares in Regression Models,” Journal of the American Statistical Association, 65: 1330–1337.CrossRefGoogle Scholar
  5. Balestra, P. (1980), “A Note on the Exact Transformation Associated with First-Order Moving Average Process,” Journal of Econometrics, 14: 381–394.CrossRefGoogle Scholar
  6. Baltagi, B.H. (1989), “Applications of a Necessary and Sufficient Condition for OLS to be BLUE,” Statistics and Probability Letters, 8: 457–461.CrossRefGoogle Scholar
  7. Baltagi, B.H. (1992), “Sampling Distributions and Efficiency Comparisons of OLS and GLS in the Presence of Both Serial Correlation and Heteroskedasticity,” Econometric Theory, Problem 92.2.3, 8: 304–305.Google Scholar
  8. Baltagi, B.H. and P.X. Wu (1997), “Estimation of Time Series Regressions with Autoregressive Disturbances and Missing Observations,” Econometric Theory, Problem 97.5.1, 13: 889.Google Scholar
  9. Baltagi, B.H. (1998), “Prediction in the Equicorrelated Regression Model,” Econometric Theory, Problem 98.3.3, 14: 382.CrossRefGoogle Scholar
  10. Breusch, T.S. (1979), “Conflict Among Criteria for Testing Hypotheses: Extensions and Comments,” Econometrica, 47: 203–207.CrossRefGoogle Scholar
  11. Breusch, T.S. and A.R. Pagan (1979), “A Simple Test for Heteroskedasticity and Random Coefficient Variation,” Econometrica, 47: 1287–1294.CrossRefGoogle Scholar
  12. Buse, A. (1982), “The Likelihood Ratio, Wald, and Lagrange Multiplier Tests: An Expository Note,” The American Statistician, 36: 153–157.CrossRefGoogle Scholar
  13. Dufour, J.M. (1986), “Bias of s2 in Linear Regressions with Dependent Errors,” The American Statistician, 40: 284–285.CrossRefGoogle Scholar
  14. Fuller, W.A. and G.E. Battese (1974), “Estimation of Linear Models with Crossed-Error Structure,” Journal of Econometrics, 2: 67–78.CrossRefGoogle Scholar
  15. Goldberger, A.S. (1962), “Best Linear Unbiased Prediction in the Generalized Linear Regression Model,” Journal of the American Statistical Association, 57: 369–375.CrossRefGoogle Scholar
  16. Harvey, A.C. (1976), “Estimating Regression Models With Multiplicative Heteroskedasticity,” Econometrica, 44: 461–466.CrossRefGoogle Scholar
  17. Im, E.I. and M.S. Snow (1993), “Sampling Distributions and Efficiency Comparisons of OLS and GLS in the Presence of Both Serial Correlation and Heteroskedasticity,” Econometric Theory, Solution 92.2.3, 9: 322–323.Google Scholar
  18. Kadiyala, K.R. (1968), “A Transformation Used to Circumvent the Problem of Autocorrelation,” Econometrica, 36: 93–96.CrossRefGoogle Scholar
  19. Koenker, R. and G. Bassett, Jr. (1982), “Robust Tests for Heteroskedasticity Based on Regression Quantiles,” Econometrica, 50: 43–61.CrossRefGoogle Scholar
  20. Krämer, W. and S. Berghoff (1991), “Consistency of s2 in the Linear Regression Model with Correlated Errors,” Empirical Economics, 16: 375–377.CrossRefGoogle Scholar
  21. Kruskal, W. (1968), “When are Gauss-Markov and Least Squares Estimators Identical? A Coordinate-Free Approach,” The Annals of Mathematical Statistics, 39: 70–75.Google Scholar
  22. Lempers, F.B. and T. Kloek (1973), “On a Simple Transformation for Second-Order Autocorrelated Disturbances in Regression Analysis,” Statistica Neerlandica, 27: 69–75.CrossRefGoogle Scholar
  23. Magnus, J. (1978), “Maximum Likelihood Estimation of the GLS Model with Unknown Parameters in the Disturbance Covariance Matrix,” Journal of Econometrics, 7: 281–312.CrossRefGoogle Scholar
  24. Milliken, G.A. and M. Albohali (1984), “On Necessary and Sufficient Conditions for Ordinary Least Squares Estimators to be Best Linear Unbiased Estimators,” The American Statistician, 38: 298–299.CrossRefGoogle Scholar
  25. Neudecker, H. (1977), “Bounds for the Bias of the Least Sqaures Estimator of σ 2 in Case of a First-Order Autoregressive Process (positive autocorrelation),” Econometrica, 45: 1257–1262.CrossRefGoogle Scholar
  26. Neudecker, H. (1978), “Bounds for the Bias of the LS Estimator in the Case of a First-Order (positive) Autoregressive Process Where the Regression Contains a Constant Term,” Econometrica, 46: 1223–1226.CrossRefGoogle Scholar
  27. Newey, W. and K. West (1987), “A Simple Positive Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix,” Econometrica, 55: 703–708.CrossRefGoogle Scholar
  28. Oksanen, E.H. (1991), “A Simple Approach to Teaching Generalized Least Squares Theory,” The American Statistician, 45: 229–233.CrossRefGoogle Scholar
  29. Ord, J.K. (1975), “Estimation Methods for Models of Spatial Interaction,” Journal of the American Statistical Association, 70: 120–126.CrossRefGoogle Scholar
  30. Phillips, P.C.B. and M.R. Wickens (1978), Exercises in Econometrics, Vol. 1 (Philip Allan/Ballinger: Oxford).Google Scholar
  31. Puntanen S. and G.P.H. Styan (1989), “The Equality of the Ordinary Least Squares Estimator and the Best Linear Unbiased Estimator,” (with discussion), The American Statistician, 43: 153–161.CrossRefGoogle Scholar
  32. Sathe, S.T. and H.D. Vinod (1974), “Bounds on the Variance of Regression Coefficients Due to Heteroskedastic or Autoregressive Errors,” Econometrica, 42: 333–340.CrossRefGoogle Scholar
  33. Schmidt, P. (1976), Econometrics (Marcell-Decker: New York).Google Scholar
  34. Termayne, A.R. (1985), “Prediction Error Variances Under Heteroskedasticity,” Econometric Theory, Problem 85.2.3, 1: 293–294.Google Scholar
  35. Theil, H. (1971), Principles of Econometrics (Wiley: New York).Google Scholar
  36. Thomas, J.J and K.F. Wallis (1971), “Seasonal Variation in Regression Analysis,” Journal of the Royal Statistical Society, Series A, 134: 67–72.Google Scholar
  37. White, H. (1980), “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity,” Econometrica, 48: 817–838.CrossRefGoogle Scholar
  38. Zyskind, G. (1967), “On Canonical Forms, Non-Negative Covariance Matrices and Best and Simple Least Squares Linear Estimators in Linear Models,” The Annals of Mathematical Statistics, 38: 1092–1109.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Personalised recommendations