Abstract
The linear regression model is commonly used by practitioners to model the relationship between the variable of interest and a set of explanatory variables. The assumption that all error variances are the same, known as homoskedasticity, is oftentimes violated when cross sectional data are used. Consistent standard errors for the ordinary least squares estimators of the regression parameters can be computed following the approach proposed by White (Econometrica 48:817–838, 1980). Such standard errors, however, are considerably biased in samples of typical sizes. An improved covariance matrix estimator was proposed by Qian and Wang (J Stat Comput Simul 70:161–174, 2001). In this paper, we improve upon the Qian–Wang estimator by defining a sequence of bias-adjusted estimators with increasing accuracy. The numerical results show that the Qian–Wang estimator is typically much less biased than the estimator proposed by Halbert White and that our correction to the former can be quite effective in small samples. Finally, we show that the Qian–Wang estimator can be generalized into a broad class of heteroskedasticity-consistent covariance matrix estimators, and our results can be easily extended to such a class of estimators.
Similar content being viewed by others
References
Cagan P. (1974). Common stock values and inflation: the historical record of many countries. National Bureau of Economic Research, Boston
Chesher A. and Jewitt I. (1987). The bias of a heteroskedasticity consistent covariance matrix estimator. Econometrica 55: 1217–1222
Cribari-Neto F. (2004). Asymptotic inference under heteroskedasticity of unknown form. Computational Statistics and Data Analysis 45: 215–233
Cribari-Neto F. and Zarkos S.G. (1999). Bootstrap methods for heteroskedastic regression models: evidence on estimation and testing. Econometric Reviews 18: 211–228
Cribari-Neto F. and Zarkos S.G. (2001). Heteroskedasticity-consistent covariance matrix estimation: White’s estimator and the bootstrap. Journal of Statistical Computation and Simulation 68: 391–411
Cribari-Neto F., Ferrari S.L.P. and Cordeiro G.M. (2000). Improved heteroskedasticity-consistent covariance matrix estimators. Biometrika 87: 907–918
Davidson R. and MacKinnon J.G. (1993). Estimation and inference in econometrics. Oxford University Press, New York
Ferrari S.L.P. and Cribari-Neto F. (1998). On bootstrap and analytical bias corrections. Economics Letters 58: 7–15
Flachaire E. (2005). Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap. Computational Statistics and Data Analysis 49: 361–376
Greene W.H. (1997). Econometric analysis, 3rd edn. Prentice-Hall, Upper Saddle River
Hinkley D.V. (1977). Jackknifing in unbalanced situations. Technometrics 19: 285–292
Horn S.D., Horn R.A. and Duncan D.B. (1975). Estimating heteroskedastic variances in linear models. Journal of the American Statistical Association 70: 380–385
Long J.S. and Ervin L.H. (2000). Using heteroskedasticity-consistent standard errors in the linear regression model. American Statistician 54: 217–224
MacKinnon J.G. and Smith A.A. (1998). Approximate bias corrections in econometrics. Journal of Econometrics 85: 205–230
MacKinnon J.G. and White H. (1985). Some heteroskedasticity-consistent covariance matrix estimators with improved finite-sample properties. Journal of Econometrics 29: 305–325
Qian L. and Wang S. (2001). Bias-corrected heteroscedasticity robust covariance matrix (sandwich) estimators. Journal of Statististical Computation and Simulation 70: 161–174
Rao C.R. (1973). Linear statistical inference and its applications, 2nd edn. Wiley, New York
White H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48: 817–838
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Cribari-Neto, F., Lima, M.d.G.A. Sequences of bias-adjusted covariance matrix estimators under heteroskedasticity of unknown form. Ann Inst Stat Math 62, 1053–1082 (2010). https://doi.org/10.1007/s10463-008-0201-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-008-0201-5