Skip to main content
Log in

Small sample properties of a ridge regression estimator when there exist omitted variables

  • Published:
Statistical Papers Aims and scope Submit manuscript

An Erratum to this article was published on 12 November 2011

Abstract

In this paper, we derive the exact formulae for moments of the ridge regression estimator proposed by Huang (Econ Lett 62:261–264, 1999), when there exist omitted variables. We show the conditions under which the ridge regression estimator has smaller mean squared error (MSE) than the ordinary least squares estimator. Based on the exact formulae for moments, we compare the bias and MSE performances of both estimators by numerical evaluations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Chawla JS (1988) A note on general ridge estimator. Commun Stat Theory Methods 17: 739–744

    Article  MathSciNet  MATH  Google Scholar 

  • Chawla JS (1990) A note on ridge regression. Stat Probab Lett 9: 343–345

    Article  MathSciNet  MATH  Google Scholar 

  • Dwivedi TD, Srivastava VK, Hall RL (1980) Finite sample properties of ridge estimators. Technometrics 2: 205–212

    Article  Google Scholar 

  • Farebrother RW (1976) Further results on the mean square error of ridge regression. J R Stat Soc B38: 248–250

    MathSciNet  Google Scholar 

  • Farebrother RW (1978) A class of shrinkage estimators. J R Stat Soc B40: 47–49

    MathSciNet  Google Scholar 

  • Gibbons DG (1981) A simulation study of some ridge estimators. J Am Stat Assoc 76: 131–139

    Article  MATH  Google Scholar 

  • Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12: 55–67

    Article  MATH  Google Scholar 

  • Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulations. Commun Stat Theory Methods 4: 105–123

    Article  Google Scholar 

  • Huang J-C (1999) Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach. Econ Lett 62: 261–264

    Article  MATH  Google Scholar 

  • Kozumi H, Ohtani K (1994) The general expressions for the moments of lawless and Wang’s ordinary ridge regression estimator. Commun Stat Theory Methods 23: 2755–2774

    Article  MathSciNet  MATH  Google Scholar 

  • Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat Theory Methods A5: 307–323

    Article  Google Scholar 

  • Lee BMS, Trivedi PK (1982) Error misspecification and properties of the simple ridge estimator. Commun Stat: Theory Methods 11: 1615–1624

    Article  MATH  Google Scholar 

  • Lin K, Kmenta J (1982) Ridge regression under alternative loss criteria. Rev Econ Stat 64: 488–494

    Article  Google Scholar 

  • Lowerre JM (1974) On the mean square error of parameter estimates for some biased estimators. Technometrics 16: 461–464

    Article  MathSciNet  MATH  Google Scholar 

  • Ohtani K (1985) Small sample properties of the generalized ridge regression predictor under specification error. Econ Stud Q 36: 53–60

    Google Scholar 

  • Oman SD (1981) A confidence bound approach to choosing the biasing parameter in ridge regression. J Am Stat Assoc 76: 452–461

    Article  MathSciNet  MATH  Google Scholar 

  • Theobald CM (1974) Generalizations of mean square error applied to ridge regression. J R Stat Soc B36: 103–106

    MathSciNet  Google Scholar 

  • Ullah A, Vinod HD, Kadiyala RK (1981) A family of improved shrinkage factors for the ordinary ridge estimator. In: Proceedings of the Econometric Society European Meeting 1979, North-Holland Publishing Company, New York, pp 259–277

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ryo Uemukai.

Additional information

An erratum to this article can be found at http://dx.doi.org/10.1007/s00362-011-0413-2

Rights and permissions

Reprints and permissions

About this article

Cite this article

Uemukai, R. Small sample properties of a ridge regression estimator when there exist omitted variables. Stat Papers 52, 953–969 (2011). https://doi.org/10.1007/s00362-009-0303-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-009-0303-z

Keywords

Navigation