Abstract
In this paper we introduce a new biased estimator for the vector of parameters in a linear regression model and discuss its properties. We show that our new biased estimator is superior, in the mean square error(mse) sense, to the ordinary least squares (OLS) estimator, the ordinary ridge regression (ORR) estimator and the Liu estimator. We also compare the performance of our new biased estimator with two other special Liu-type estimators proposed in Liu (2003). We illustrate our findings with a numerical example based on the widely analysed dataset on Portland cement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akdeniz F (2001) The examination and analysis of residuals for some biased estimators in linear regression. Commun Stat Theory Methods 30:1171–1183
Akdeniz F, Kaçıranlar S (1995) On the almost unbiased generalized Liu estimator and unbiased estimation of the bias and MSE. Commun Stat: Theory Methods 24:1789–1797
Akdeniz F, Kaçıranlar S (2001) More on the new biased estimator in linear regression. Sânkhya, Series B. Indian J Stat 63:321–325
Daniel C, Wood FS (1980) Fitting equations to data: computer analysis of multifactor data. 2nd edn. In: With the assistance of John W. Gorman. Wiley, New York
Farebrother RW (1976) Further results on the mean square error of ridge regression. J R Stat Soc B (28):248–250
Groβ J, Markiewicz A (2004) Characterization of admissible linear estimators in the linear model. Linear Algebra Appl 388:239–248
Hald A (1952) Statistical theory with engineering applications. Wiley, New York
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–67
Kaçıranlar S, Sakallıoğlu S (2001) Combining the Liu estimator and the principal component regression estimator. Commun Stat Theory Methods 30:2699–2706
Kaçıranlar S, Sakallıoğlu S, Akdeniz F, Styan GPH, Werner HJ (1999) A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland cement. Sânkhya, Series B. Indian J Stat 61:443–459
Liu K (1993) A new class of biased estimate in linear regression. Commun Stat Theory Methods 22:393–402
Liu K (2003) Using Liu-type estimator to combat collinearity. Commun Stat Theory Methods 32:1009–1020
Nomura M (1988) On the almost unbiased ridge regression estimator. Commun Stat Simul and Comput 17:729–743
Sakallıoğlu S, Kaçıranlar S, Akdeniz F (2001) Mean square error comparisons of some biased regression estimators. Commun Stat Theory Methods 30:347–361
Stein C (1956) Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 1:197–206
Theobald CM (1974) Generalizations of mean square error applied to ridge regression. J R Stat So B 36:103–106
Trenkler G (1980) Generalized mean square error comparisons of biased regression estimators. Commun Stat Theory Methods A9 (12):1247–1259
Trenkler G, Toutenburg H (1990) Mean squared error matrix comparisons between biased estimators an overview of recent results. Stat Pap 31:165–179
Woods H, Stenior HH, Starke HR (1932) Effect of composition of Portland cement on heat evolved during hardening. Industrial and Eng Chem 24:1207–1214
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sakallıoğlu, S., Kaçıranlar, S. A new biased estimator based on ridge estimation. Stat Papers 49, 669–689 (2008). https://doi.org/10.1007/s00362-006-0037-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-006-0037-0