Abstract
This chapter deals with the problem of multicollinearity, also commonly termed collinearity and ill-conditioning. The problem arises when there exist near-linear dependencies among the vectors of explanatory variables, so that if the Gaussian elimination of Section 3.2 were used to solve the least squares equations then at least one pivot would be near-zero. The effect of multicollinearity is to inflate the variance of the least squares estimator and possibly any predictions made, and also to restrict the generality and applicability of the estimated model. Therefore, when multicollinearities occur they should be investigated thoroughly and, if they prove harmful, an effort should be made to deal with them appropriately (see below).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dempster, P., Schatsoff, M. and Wermuth, D. (1977) A simulation study of alternatives to ordinary least squares. J. Amer. Statist. Assoc., 72, 77–91.
Draper, N. R. and Smith, H. (1966) Applied Regression Analysis. Wiley, New York.
Farrar, D. E. and Glauber, R. R. (1967) Multicollinearity in regression analysis: the problem revisited. Rev. Econ. Statist., 49, 92–107.
Fomby, T. B., Hill R. C. and Johnson, S. R. (1978) An optimal property of principal components in the context of restricted least squares. J. Amer. Statist. Assoc., 73, 191–193.
Garnham, N. F. J. (1979) Some aspects of the use of principal components in multiple regression. Dissertation for M.Sc. in Statistics at University of Kent at Canterbury.
Greenberg, E. (1975) Minimum variance properties of principal components regression. J. Amer. Statist. Assoc., 70, 194–197.
Gunst, R. F. and Mason, R. L. (1977a) Advantages of examining multi-collinearities in regression analysis. Biometrics, 33, 249–260.
Gunst, R. F. and Mason, R. L. (1977b) Biased estimation in regression: an evaluation using mean square error. J. Amer. Statist. Assoc., 72, 616–628.
Gunst, R. F. Webster, J. T. and Mason, R. L. (1976) A comparison of least squares and latent root regression estimators. Technometrics, 18, 75–83.
Hawkins, D. M. (1973) On the investigation of alternative regressions by principal component analysis. Appl. Statist., 22, 275–286.
Hawkins, D. M. (1975) Relations between ridge regression and eigenanalysis of the augmented correlation matrix. Technometrics, 17, 477–480.
Hill, R. C., Fomby, T. B. and Johnson, S. R. (1977) Component selection norms for principal components regression. Commun. Statist., A, 6, 309–317.
Hocking, R. R. (1976) The analysis and selection of variables in linear regression. Biometrics, 32, 1–49.
Hoerl, A. E. and Kennard, R. W. (1970a) Ridge regression: biased estimation for non-orthogonal problems. Technometrics, 12, 55–67.
Hoerl, A. E. and Kennard, R. W. (1970b) Ridge regression: application to non-orthogonal problems. Technometrics, 12, 591–612.
Johnson, S. R., Reimer, S. C. and Rothrock, T. P. (1973) Principal components and the problem of multicollinearity. Metroeconomica, 25, 306–317.
Jolliffe, I. T. (1972) Discarding variables in a principal component analysis. I: Artificial data. Appl. Statist., 21, 160–173.
Jolliffe, I. T. (1973) Discarding variables in a principal component analysis, II: Real data. Appl. Statist., 22, 21–31.
Kumar, T. K. (1975) Multicollinearity in regression analysis. Rev. Econ. Statist., 57, 365–366.
Lawson, C. L. and Hanson, R. J. (1974) Solving Least Squares Problems. Prentice-Hall, Englewood Cliffs, NJ.
Lott, W. F. (1973) The optimal set of principal component restrictions on a least squares regression. Commun. Statist. A, 2, 449–464.
Marquardt, D. W. and Snee, R. D. (1975) Ridge regression in practice. Amer. Statist., 29, 3–19.
Mason, R. L., Gunst, R. F. and Webster, J. T. (1975) Regression analysis and problems of multicollinearity. Commun. Statist. A, 4 (3), 277–292.
Massy, W. F. (1965) Principal components regression in exploratory statistical research. J. Amer. Statist. Assoc., 60, 234–256.
Silvey, S. D. (1969) Multicollinearity and imprecise estimation. J. Roy. Statist. Soc. B, 31, 539–552.
Stewart, G. W. (1973) Introduction to Matrix Computations. Academic Press, New York.
Webster, J. T., Gunst, R. F. and Mason, R. L. (1974) Latent root regression analysis. Technometrics, 16, 513–522.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1986 G. Barrie Wetherill
About this chapter
Cite this chapter
Barrie Wetherill, G., Duncombe, P., Kenward, M., Köllerström, J., Paul, S.R., Vowden, B.J. (1986). Multicollinearity. In: Regression Analysis with Applications. Monographs on Statistics and Applied Probability. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-4105-2_4
Download citation
DOI: https://doi.org/10.1007/978-94-009-4105-2_4
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-8322-5
Online ISBN: 978-94-009-4105-2
eBook Packages: Springer Book Archive