Abstract
In this paper, we derive the exact formulae for moments of the ridge regression estimator proposed by Huang (Econ Lett 62:261–264, 1999), when there exist omitted variables. We show the conditions under which the ridge regression estimator has smaller mean squared error (MSE) than the ordinary least squares estimator. Based on the exact formulae for moments, we compare the bias and MSE performances of both estimators by numerical evaluations.
Similar content being viewed by others
References
Chawla JS (1988) A note on general ridge estimator. Commun Stat Theory Methods 17: 739–744
Chawla JS (1990) A note on ridge regression. Stat Probab Lett 9: 343–345
Dwivedi TD, Srivastava VK, Hall RL (1980) Finite sample properties of ridge estimators. Technometrics 2: 205–212
Farebrother RW (1976) Further results on the mean square error of ridge regression. J R Stat Soc B38: 248–250
Farebrother RW (1978) A class of shrinkage estimators. J R Stat Soc B40: 47–49
Gibbons DG (1981) A simulation study of some ridge estimators. J Am Stat Assoc 76: 131–139
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12: 55–67
Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulations. Commun Stat Theory Methods 4: 105–123
Huang J-C (1999) Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach. Econ Lett 62: 261–264
Kozumi H, Ohtani K (1994) The general expressions for the moments of lawless and Wang’s ordinary ridge regression estimator. Commun Stat Theory Methods 23: 2755–2774
Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat Theory Methods A5: 307–323
Lee BMS, Trivedi PK (1982) Error misspecification and properties of the simple ridge estimator. Commun Stat: Theory Methods 11: 1615–1624
Lin K, Kmenta J (1982) Ridge regression under alternative loss criteria. Rev Econ Stat 64: 488–494
Lowerre JM (1974) On the mean square error of parameter estimates for some biased estimators. Technometrics 16: 461–464
Ohtani K (1985) Small sample properties of the generalized ridge regression predictor under specification error. Econ Stud Q 36: 53–60
Oman SD (1981) A confidence bound approach to choosing the biasing parameter in ridge regression. J Am Stat Assoc 76: 452–461
Theobald CM (1974) Generalizations of mean square error applied to ridge regression. J R Stat Soc B36: 103–106
Ullah A, Vinod HD, Kadiyala RK (1981) A family of improved shrinkage factors for the ordinary ridge estimator. In: Proceedings of the Econometric Society European Meeting 1979, North-Holland Publishing Company, New York, pp 259–277
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article can be found at http://dx.doi.org/10.1007/s00362-011-0413-2
Rights and permissions
About this article
Cite this article
Uemukai, R. Small sample properties of a ridge regression estimator when there exist omitted variables. Stat Papers 52, 953–969 (2011). https://doi.org/10.1007/s00362-009-0303-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-009-0303-z