Abstract
Ridge Regression techniques have been found useful to reduce mean square errors of parameter estimates when multicollinearity is present. But the usefulness of the method rest not only upon its ability to produce good parameter estimates, with smaller mean squared error than Ordinary Least Squares, but also on having reasonable inferential procedures. The aim of this paper is to develop asymptotic confidence intervals for the model parameters based on Ridge Regression estimates and the Edgeworth expansion. Some simulation experiments are carried out to compare these confidence intervals with those obtained from the application of Ordinary Least Squares. Also, an example will be provided based on the well known data set of Hald.
Similar content being viewed by others
References
Crivelli A, Firinguetti L, Montaño R, (1996) Confidence intervals in ridge regression by bootstrapping the dependent variable: a simulation study. Commun Stat Simul Comp 24: 631–652
Elston D, Proe M (1995) Smoothing regression coefficients in an overspecified regression model with interrelated explanatory variables. Appl Stat 44: 395–406
Feig D, Witting T (1988) Ridge estimated confidence intervals: a Monte Carlo evaluation. J Stat Simul Comp 29: 127–142
Frank I, Friedman J (1993) A statistical view of some chemometrics regression tools. Technometrics 35: 365–371
Hald A (1952) Statistical theory with engineering applications. Wiley, New York
Hill G, Davis A (1968) Generalized asymptotic expansions of Cornish–Fisher type. Ann Math Stat 39: 1264–1273
Hoerl A, Kennard R (2000) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 42: 105–123
Jang D, Yoon M (1997) Graphical methods for evaluating ridge regression estimator in mixture experiments. Commun Stat Simul Comp 26: 1049–1061
Johnson S, Reimer S, Rothrock T (1973) Principal components and the problem of multicollinearity. Metroeconomica 25: 306–317
Lawless J, Wang P (1976) A simulation study of ridge regression and other regression estimators. Commun Stat A 5: 1615–1624
Mason R, Gunst R, Webster J (1975) Regression analysis and problems of multicollinearity. Commun Stat 4: 277–292
Sargan J (1975) Gram–Charlier approximation applied to t-ratios of k-class estimators. Econometrica 43: 327–346
Vinod H (1995) Double bootstrap for shrinkage estimators. J Econ 68: 287–302
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by FONDECYT-Chile, Grant #1010009 and DICYT, Grant # 49931BA.
Rights and permissions
About this article
Cite this article
Firinguetti, L., Bobadilla, G. Asymptotic confidence intervals in ridge regression based on the Edgeworth expansion. Stat Papers 52, 287–307 (2011). https://doi.org/10.1007/s00362-009-0229-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-009-0229-5