Abstract
The paper provides a theoretical result about the performance of any two members of a class of ridge-type estimators of the regression parameter using the criterion of Pitman Measure of Nearness. Based on the result it is possible to establish conditions under which a member of the ridge-type class of estimators is better than the standard least squares estimator in the Pitman-Nearness sense.
Similar content being viewed by others
References
Bertuzzi, A. and Gandolfi, A. (1991): Ridge regression versus OLS by Pitman’s closeness under quadratic and Fisher’s loss. Communications in Statistics — Theory and Methods 20, 3581–3590.
Conerly, M.D. and Hardin, M.J. (1990): A comparison of biased regression estimators using a Pitman Nearness criterion. Journal of Statistical Computation and Simulations 34, 75–95.
Hocking, R.R., Speed, F.M. and Lynn, M.J. (1976): A class of biased estimators in linear regression. Technometrics 18, 425–437.
Hoerl, A.E. and Kennard, R.W. (1970a): Ridge regression: Biased estimation for non-orthogonal problems. Technometrics 12, 55–67.
Hoerl, A.E. and Kennard, R.W. (1970b): Ridge regression: Applications to non-orthogonal problems. Technometrics 12, 69–82.
Keating, J.P., Mason, R.L. and Sen, P.K. (1993): Pitman Measure of Closeness: A Comparison of Statistical Estimators. Society for Industrial and Applied Mathematics (SIAM), (monograph).
Marquardt, D.W. (1970): Generalized inverses, ridge regression, biased linear estimation and non-linear estimation. Technometrics 12, 591–612.
Mason, R.L. and Blaylock, N.W. (1991): Ridge regression estimator comparisons using Pitman’s Measure of Closeness. Communications in Statistics-Theory and Methods 20, 3629–3641.
Mason, R.L., Keating, J.P., Sen, P.K and Blaylock, N.W. (1990): Comparison of linear estimators using Pitman’s Measure of Closeness. Journal of American Statistical Association 85, 579–581.
Mayer, L.S. and Willke, T.A. (1973): On biased estimation in linear models. Technometrics 15, 497–508.
Pitman, E.J.G. (1937): The closest estimates of statistical parameters. Proceedings of the Cambridge Philosophical Society 33, 212–222.
Obenchain, R.L. (1975): Ridge analysis following a preliminary test of shrunken hypothesis. Technometrics 17, 431–445.
Obenchain, R.L. (1978): Good and optimal ridge estimators. Annals of Statistics 6, 1111–1121.
Rao, C.R. (1981): Some comments on the minimum mean square error as a criterion of estimation. In: Statistics and Related Topics. Eds. M. Csorgo, D.A. Dawson, J.N.K. Rao, A.A. M. E. Saleh. Amsterdam: North-Holland, 123–143.
Trenkler, D. (1986): Verallgemeinerte Ridge Regression. In: Mathematical Systems in Economics 104. Anton Hain Verlag, Frankfurt/Main.
Trenkler, G. (1981): Biased estimators in linear regression model. In: Mathematical Systems in Economics 58. Oelgeschlager, Gunn/Hain, Cambridge, Massachussets.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Wencheko, E. Comparison of regression estimators using Pitman measures of nearness. Statistical Papers 42, 375–386 (2001). https://doi.org/10.1007/s003620100064
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/s003620100064