Skip to main content
Log in

Operational Variants of the Minimum Mean Squared Error Estimator in Linear Regression Models with Non-Spherical Disturbances

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

There is a good deal of literature that investigates the properties of various operational variants of Theil's (1971, Principles of Econometrics, Wiley, New York) minimum mean squared error estimator. It is interesting that virtually all of the existing analysis to date is based on the premise that the model's disturbances are i.i.d., an assumption which is not satisfied in many practical situations. In this paper, we consider a model with non-spherical errors and derive the asymptotic distribution, bias and mean squared error of a general class of feasible minimum mean squared error estimators. A Monte-Carlo experiment is conducted to examine the performance of this class of estimators in finite samples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Baranchik, A. J. (1970). A family of minimax estimators of the mean of a multivariate normal distribution, Ann. Math. Statist., 41, 642–645.

    Google Scholar 

  • Chaturvedi, A. and Shukla G. (1990). Stein-rule estimation in linear model with non-scalar error covariance matrix, Sankhyā Ser. B, 52, 293–304.

    Google Scholar 

  • Draper, N. R. and Van Nostrand, R. C. (1979). Ridge regression and James Stein estimation: review and comments, Technometrics, 21, 451–466.

    Google Scholar 

  • Dwivedi, T. D. and Srivastava, V. K. (1978). On the minimum mean squared error estimator in a regression model, Comm. Statist. Theory Methods, 7, 487–494.

    Google Scholar 

  • Farebrother, R. W. (1975). The minimum mean square error linear estimator and ridge regression, Technometrics, 17, 127–128.

    Google Scholar 

  • Liski, E. P., Toutenburg, H. and Trenkler, G. (1993). Minimum mean square error estimation in linear regression, J. Statist. Plann. Inference, 37, 203–214.

    Google Scholar 

  • Mayer, L. S. and Willke, T. A. (1973). On biased estimation in linear models, Technometrics, 15, 497–508.

    Google Scholar 

  • Ohtani, K. (1996a). Exact small sample properties of an operational variant of the minimum mean squared error estimator, Comm. Statist. Theory Methods, 25, 1223–1231.

    Google Scholar 

  • Ohtani, K. (1996b). On an adjustment of degrees of freedom in the minimum mean squared error estimator, Comm. Statist. Theory Methods, 25, 3049–3058.

    Google Scholar 

  • Ohtani, K. (1997). Minimum mean squared error estimation of each individual coefficient in a linear regression model, J. Statist. Plann. Inference, 62, 301–316.

    Google Scholar 

  • Ohtani, K. (1999). MSE performance of a heterogeneous pre-test estimator, Statist. Probab. Lett., 41, 65–71.

    Google Scholar 

  • Prais, S. J. and Winsten, C. B. (1954). Trend estimators and serial correlation, Cowles Commission Discussion, Paper No. 383, University of Chicago.

  • Rao, C. R. and Toutenburg, H. (1995). Linear Models: Least Squares and Alternatives, Springer, New York.

    Google Scholar 

  • Rothenberg, T. J. (1984). Approximate normality of generalized least squares estimates, Econometrica, 52, 811–825.

    Google Scholar 

  • Stahlecker, P. and Trenkler, G. (1985). On heterogeneous versions of the best linear and the ridge estimator, Proceedings of the First International Tampere Seminar on Linear Statistical Models and Their Applications (eds. T. Pukkila and S. Puntanen), University of Tampere, Finland.

    Google Scholar 

  • Theil, H. (1971). Principles of Econometrics, Wiley, New York.

    Google Scholar 

  • Toutenburg, H., Trenkler, G. and Liski, E. (1992). Optimal estimation methods under weakened linear restrictions in regression, Comput. Statist. Data Anal., 14, 527–536.

    Google Scholar 

  • Tracy, D. S. and Srivastava, A. K. (1994). Comparison of operational variants of best homogeneous and heterogeneous estimators in linear regression, Comm. Statist. Theory Methods, 23, 2313–2322.

    Google Scholar 

  • Vinod, H. D. (1976). Simulation and extension of a minimum mean squared error estimator in comparison with Stein's, Technometrics, 18, 491–496.

    Google Scholar 

  • Vinod, H. D. (1978). A survey of ridge regression and related techniques for improvements over ordinary least squares, Review of Economics and Statistics, 60, 121–131.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Wan, A.T.K., Chaturvedi, A. Operational Variants of the Minimum Mean Squared Error Estimator in Linear Regression Models with Non-Spherical Disturbances. Annals of the Institute of Statistical Mathematics 52, 332–342 (2000). https://doi.org/10.1023/A:1004169923370

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1004169923370

Navigation