Abstract
There is a good deal of literature that investigates the properties of various operational variants of Theil's (1971, Principles of Econometrics, Wiley, New York) minimum mean squared error estimator. It is interesting that virtually all of the existing analysis to date is based on the premise that the model's disturbances are i.i.d., an assumption which is not satisfied in many practical situations. In this paper, we consider a model with non-spherical errors and derive the asymptotic distribution, bias and mean squared error of a general class of feasible minimum mean squared error estimators. A Monte-Carlo experiment is conducted to examine the performance of this class of estimators in finite samples.
Similar content being viewed by others
References
Baranchik, A. J. (1970). A family of minimax estimators of the mean of a multivariate normal distribution, Ann. Math. Statist., 41, 642–645.
Chaturvedi, A. and Shukla G. (1990). Stein-rule estimation in linear model with non-scalar error covariance matrix, Sankhyā Ser. B, 52, 293–304.
Draper, N. R. and Van Nostrand, R. C. (1979). Ridge regression and James Stein estimation: review and comments, Technometrics, 21, 451–466.
Dwivedi, T. D. and Srivastava, V. K. (1978). On the minimum mean squared error estimator in a regression model, Comm. Statist. Theory Methods, 7, 487–494.
Farebrother, R. W. (1975). The minimum mean square error linear estimator and ridge regression, Technometrics, 17, 127–128.
Liski, E. P., Toutenburg, H. and Trenkler, G. (1993). Minimum mean square error estimation in linear regression, J. Statist. Plann. Inference, 37, 203–214.
Mayer, L. S. and Willke, T. A. (1973). On biased estimation in linear models, Technometrics, 15, 497–508.
Ohtani, K. (1996a). Exact small sample properties of an operational variant of the minimum mean squared error estimator, Comm. Statist. Theory Methods, 25, 1223–1231.
Ohtani, K. (1996b). On an adjustment of degrees of freedom in the minimum mean squared error estimator, Comm. Statist. Theory Methods, 25, 3049–3058.
Ohtani, K. (1997). Minimum mean squared error estimation of each individual coefficient in a linear regression model, J. Statist. Plann. Inference, 62, 301–316.
Ohtani, K. (1999). MSE performance of a heterogeneous pre-test estimator, Statist. Probab. Lett., 41, 65–71.
Prais, S. J. and Winsten, C. B. (1954). Trend estimators and serial correlation, Cowles Commission Discussion, Paper No. 383, University of Chicago.
Rao, C. R. and Toutenburg, H. (1995). Linear Models: Least Squares and Alternatives, Springer, New York.
Rothenberg, T. J. (1984). Approximate normality of generalized least squares estimates, Econometrica, 52, 811–825.
Stahlecker, P. and Trenkler, G. (1985). On heterogeneous versions of the best linear and the ridge estimator, Proceedings of the First International Tampere Seminar on Linear Statistical Models and Their Applications (eds. T. Pukkila and S. Puntanen), University of Tampere, Finland.
Theil, H. (1971). Principles of Econometrics, Wiley, New York.
Toutenburg, H., Trenkler, G. and Liski, E. (1992). Optimal estimation methods under weakened linear restrictions in regression, Comput. Statist. Data Anal., 14, 527–536.
Tracy, D. S. and Srivastava, A. K. (1994). Comparison of operational variants of best homogeneous and heterogeneous estimators in linear regression, Comm. Statist. Theory Methods, 23, 2313–2322.
Vinod, H. D. (1976). Simulation and extension of a minimum mean squared error estimator in comparison with Stein's, Technometrics, 18, 491–496.
Vinod, H. D. (1978). A survey of ridge regression and related techniques for improvements over ordinary least squares, Review of Economics and Statistics, 60, 121–131.
Author information
Authors and Affiliations
About this article
Cite this article
Wan, A.T.K., Chaturvedi, A. Operational Variants of the Minimum Mean Squared Error Estimator in Linear Regression Models with Non-Spherical Disturbances. Annals of the Institute of Statistical Mathematics 52, 332–342 (2000). https://doi.org/10.1023/A:1004169923370
Issue Date:
DOI: https://doi.org/10.1023/A:1004169923370