Abstract
In this paper, we consider the feasible minimum mean squared error (FMMSE) estimator and the adjusted FMMSE (AFMMSE) estimator which are obtained by shrinking the ordinary least squares (OLS) estimator towards the restricted least squares estimator. We derive the formulas of MSE for the restricted FMMSE and AFMMSE estimators. By numerical evaluations, the MSE performances of the restricted FMMSE and AFMMSE estimators are compared with that of the restricted positive-part Stein-rule estimator.
Similar content being viewed by others
References
Adkins, L.C. and R.C. Hill (1990). The RLS positive-part Stein estimator.American Journal of Agriculatural Economics,72, 727–730.
Baranchik, A.J. (1970). A family of minimax estimators of the mean of a multi-variate normal distribution.Annals of Mathematical Statistics,41, 642–645.
Cellier, D. and D. Fourdrinier (1995). Shrinkage estimators under spherical symmetry for the general linear model.Journal of Multivariate Analysis,52, 338–351.
Dube, M. and V. Singh (1995). Predictive efficiency of improved estimators in restricted regression models.Test,4, 323–331.
Dwivedi, T.D. and V.K. Srivastava (1978). On the minimum mean squared error estimator in a regression model.Communications in Statitics-Theory and Methods,7, 487–494.
Farebrother, R.W. (1975). The minimum mean square error linear estimator and ridge regression.Technometrics,17, 127–128.
Hill, R.C. and T.B. Fomby (1992). The effects of extrapolation on minimax Stein-Rule prediction. InReadings in Econometric Theory and Practice (Griffith, W. Lütkerpohl, H. and Bock, M.E., Eds.). North-Holland, Amsterdam.
Hill, R.C., R.F. Ziemer and F.C. White (1981). Mitigating the effects of multi-collinearity using exact and stochastic restrictions: The case of an aggregate agricultural production function in Thailand: Comment.American Journal of Agricultural Economics,63, 298–300.
James, W. and C. Stein (1961). Estimation with quadratic loss.Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability 1. University of California Press, Berkeley, 361–379.
Judge, G.G. and M.E. Bock (1978).The Statistical Implications of Pre-Test and Stein-Rule estimators in Econometrics. North-Holland, Amsterdam.
Ti, T.F. and D.S. Bhoj, (1988). A modified James-Stein estimator with application to multiple regression analysis.Scandinavian Journal of Statistics,15, 33–37.
Liski, E.P., H. Toutenburg and G. Trenkler (1993). Minimum mean square error estimation in linear regression,Journal of Statistical Planning and Inference.37, 203–214.
Mittelhammer, R.C. (1984). Restricted least squares, pre-test, OLS and Stein-rule estimators: Risk comparisons under model misspecification.Journal of Econometrics,25, 151–164.
Mittelhammer, R.C. and D.L. Young (1981). Mitigating the effects of multi-collinearity using exact and stochastic restrictions: The case of an aggregate agricultural production function in Thailand: Reply.American Journal of Agricultural Economics,63, 301–304.
Ohtani, K. (1993). A comparison of the Stein-rule and positive-part Stein-rule estimators in a misspecified linear regression model.Econometric Therapy,9, 668–679.
Ohtani, K. (1996a). Exact small sample properties of an operational variant of the minimum mean squared error estimator.Communications in Statistics—Theory and Methods,25, 1223–1231.
Ohtani, K. (1996b). On an adjustment of degrees of freedom in the minimum mean squared error estimator.Communications in Statistics—Theory and Methods,25, 3049–3058.
Ralescu, S., A.C. Brandwein and W.E. Strawderman (1992). Stein estimation for non-normal spherically symmetric location families in three dimensions.Journal of Multivariate Analysis,42, 35–50.
Srivastava, V.K. and A.K. Srivastava (1994). A feasible minimum risk estimator interpretation to Stein-rule estimators in linear regression model.Statistics and Probability Letters. 19, 317–319.
Stahlecker, P. and G. Trenkler (1985). On heterogeneous versions of the best linear and ridge estimators.Proceedings of the First Tampere Seminar on Linear Models, 301–322.
Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution,Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, Berkeley, 197–206.
Theil, H. (1971).Principles of Econometrics. John Wiley, New York.
Tracy, D.S. and A.K. Srivastava (1994). Comparison of operational variants of best homogeneous and heterogeneous estimators in linear regression.Communications in Statistics—Theory and Methods 23, 2313–2322.
Vinod, H.D. (1976). Simulation and extension of a minimum mean squared error estimator in comparison with Stein's.Technometrics,18, 491–496.
Yamauti, Z. (Chairman of Editing Committee) (1972).Statistical Tables and Formulas with Computer Applications, Japanese Standards Association.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Ohtani, K. An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression. Test 7, 361–376 (1998). https://doi.org/10.1007/BF02565118
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02565118
Key words
- Linear restrictions
- mean squared error
- minimum mean squared error estimators
- restricted estimator
- Stein-rule estimators