Skip to main content
Log in

An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression

  • Published:
Test Aims and scope Submit manuscript

Abstract

In this paper, we consider the feasible minimum mean squared error (FMMSE) estimator and the adjusted FMMSE (AFMMSE) estimator which are obtained by shrinking the ordinary least squares (OLS) estimator towards the restricted least squares estimator. We derive the formulas of MSE for the restricted FMMSE and AFMMSE estimators. By numerical evaluations, the MSE performances of the restricted FMMSE and AFMMSE estimators are compared with that of the restricted positive-part Stein-rule estimator.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adkins, L.C. and R.C. Hill (1990). The RLS positive-part Stein estimator.American Journal of Agriculatural Economics,72, 727–730.

    Article  Google Scholar 

  • Baranchik, A.J. (1970). A family of minimax estimators of the mean of a multi-variate normal distribution.Annals of Mathematical Statistics,41, 642–645.

    MathSciNet  Google Scholar 

  • Cellier, D. and D. Fourdrinier (1995). Shrinkage estimators under spherical symmetry for the general linear model.Journal of Multivariate Analysis,52, 338–351.

    Article  MathSciNet  MATH  Google Scholar 

  • Dube, M. and V. Singh (1995). Predictive efficiency of improved estimators in restricted regression models.Test,4, 323–331.

    MathSciNet  MATH  Google Scholar 

  • Dwivedi, T.D. and V.K. Srivastava (1978). On the minimum mean squared error estimator in a regression model.Communications in Statitics-Theory and Methods,7, 487–494.

    MathSciNet  Google Scholar 

  • Farebrother, R.W. (1975). The minimum mean square error linear estimator and ridge regression.Technometrics,17, 127–128.

    Article  MathSciNet  MATH  Google Scholar 

  • Hill, R.C. and T.B. Fomby (1992). The effects of extrapolation on minimax Stein-Rule prediction. InReadings in Econometric Theory and Practice (Griffith, W. Lütkerpohl, H. and Bock, M.E., Eds.). North-Holland, Amsterdam.

    Google Scholar 

  • Hill, R.C., R.F. Ziemer and F.C. White (1981). Mitigating the effects of multi-collinearity using exact and stochastic restrictions: The case of an aggregate agricultural production function in Thailand: Comment.American Journal of Agricultural Economics,63, 298–300.

    Article  Google Scholar 

  • James, W. and C. Stein (1961). Estimation with quadratic loss.Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability 1. University of California Press, Berkeley, 361–379.

    Google Scholar 

  • Judge, G.G. and M.E. Bock (1978).The Statistical Implications of Pre-Test and Stein-Rule estimators in Econometrics. North-Holland, Amsterdam.

    MATH  Google Scholar 

  • Ti, T.F. and D.S. Bhoj, (1988). A modified James-Stein estimator with application to multiple regression analysis.Scandinavian Journal of Statistics,15, 33–37.

    Google Scholar 

  • Liski, E.P., H. Toutenburg and G. Trenkler (1993). Minimum mean square error estimation in linear regression,Journal of Statistical Planning and Inference.37, 203–214.

    Article  MathSciNet  MATH  Google Scholar 

  • Mittelhammer, R.C. (1984). Restricted least squares, pre-test, OLS and Stein-rule estimators: Risk comparisons under model misspecification.Journal of Econometrics,25, 151–164.

    Article  MathSciNet  Google Scholar 

  • Mittelhammer, R.C. and D.L. Young (1981). Mitigating the effects of multi-collinearity using exact and stochastic restrictions: The case of an aggregate agricultural production function in Thailand: Reply.American Journal of Agricultural Economics,63, 301–304.

    Article  Google Scholar 

  • Ohtani, K. (1993). A comparison of the Stein-rule and positive-part Stein-rule estimators in a misspecified linear regression model.Econometric Therapy,9, 668–679.

    Article  MathSciNet  Google Scholar 

  • Ohtani, K. (1996a). Exact small sample properties of an operational variant of the minimum mean squared error estimator.Communications in Statistics—Theory and Methods,25, 1223–1231.

    MathSciNet  MATH  Google Scholar 

  • Ohtani, K. (1996b). On an adjustment of degrees of freedom in the minimum mean squared error estimator.Communications in Statistics—Theory and Methods,25, 3049–3058.

    MathSciNet  MATH  Google Scholar 

  • Ralescu, S., A.C. Brandwein and W.E. Strawderman (1992). Stein estimation for non-normal spherically symmetric location families in three dimensions.Journal of Multivariate Analysis,42, 35–50.

    Article  MathSciNet  MATH  Google Scholar 

  • Srivastava, V.K. and A.K. Srivastava (1994). A feasible minimum risk estimator interpretation to Stein-rule estimators in linear regression model.Statistics and Probability Letters. 19, 317–319.

    Article  MathSciNet  MATH  Google Scholar 

  • Stahlecker, P. and G. Trenkler (1985). On heterogeneous versions of the best linear and ridge estimators.Proceedings of the First Tampere Seminar on Linear Models, 301–322.

  • Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution,Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, Berkeley, 197–206.

    Google Scholar 

  • Theil, H. (1971).Principles of Econometrics. John Wiley, New York.

    MATH  Google Scholar 

  • Tracy, D.S. and A.K. Srivastava (1994). Comparison of operational variants of best homogeneous and heterogeneous estimators in linear regression.Communications in Statistics—Theory and Methods 23, 2313–2322.

    MathSciNet  MATH  Google Scholar 

  • Vinod, H.D. (1976). Simulation and extension of a minimum mean squared error estimator in comparison with Stein's.Technometrics,18, 491–496.

    Article  MathSciNet  MATH  Google Scholar 

  • Yamauti, Z. (Chairman of Editing Committee) (1972).Statistical Tables and Formulas with Computer Applications, Japanese Standards Association.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ohtani, K. An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression. Test 7, 361–376 (1998). https://doi.org/10.1007/BF02565118

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02565118

Key words

AMS subject classification

Navigation