Abstract
In the presence of multicollinearity, the r − k class estimator is proposed as an alternative to the ordinary least squares (OLS) estimator which is a general estimator including the ordinary ridge regression (ORR), the principal components regression (PCR) and the OLS estimators. Comparison of competing estimators of a parameter in the sense of mean square error (MSE) criterion is of central interest. An alternative criterion to the MSE criterion is the Pitman’s (1937) closeness (PC) criterion. In this paper, we compare the r − k class estimator to the OLS estimator in terms of PC criterion so that we can get the comparison of the ORR estimator to the OLS estimator under the PC criterion which was done by Mason et al. (1990) and also the comparison of the PCR estimator to the OLS estimator by means of the PC criterion which was done by Lin and Wei (2002).
Similar content being viewed by others
References
Baye MR, Parker DF (1984) Combining ridge and principal component regression: a money demand illustration. Commun Stat Theory Method 13:197–205
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–67
Keating JP, Mason RL (1985) Practical relevance of an alternative criterion in estimation. Am Stat 39:203–205
Lin M, Wei L (2002) The small sample properties of the principal components estimator for regression coefficients. Commun Statist Theory Method 31(2):271–283
Mason RL, Keating JP, Sen PK, Blaylock NW (1990) Comparison of linear estimators using Pitman’s measure of closeness. J Am Stat Assoc 85:579–581
Nomura M, Ohkubo T (1985) A note on combining ridge and principal component regression. Commun Stat Theory Method 14:2489–2493
Pitman EJG (1937) The closest estimates of statistical parameters. Proc Cambridge Philos Soc 33:212–222
Rao CR (1981) Some comments on the minimum mean square error as a criterion of estimation. Statistics and related topics, North Holland, Amsterdam, pp 123–143
Rao CR, Keating JP, Mason RL (1986) The Pitman nearness criterion and determination. Commun Stat Theory Method 15:3173–3191
Sarkar N (1996) Mean square error matrix comparison of some estimators in linear regressions with multicollinearity. Stat Prob Lett 30:133–138
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article is available at http://dx.doi.org/10.1007/s00362-010-0362-1.
Rights and permissions
About this article
Cite this article
Özkale, M.R., Kaçıranlar, S. Comparisons of the r − k class estimator to the ordinary least squares estimator under the Pitman’s closeness criterion. Statistical Papers 49, 503–512 (2008). https://doi.org/10.1007/s00362-006-0029-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-006-0029-0