, Volume 49, Issue 1, pp 79–94 | Cite as

Linear relations amongk sets of variables

  • John P. Van de Geer


A family of solutions for linear relations amongk sets of variables is proposed. It is shown how these solutions apply fork=2, and how they can be generalized from there tok≥3.

The family of solutions depends on three independent choices: (i) to what extent a solution may be influenced by differences in variances of components within each set; (ii) to what extent the sets may be differentially weighted with respect to their contribution to the solution—including orthogonality constraints; (iii) whether or not individual sets of variables may be replaced by an orthogonal and unit normalized basis.

Solutions are compared with respect to their optimality properties. For each solution the appropriate stationary equations are given. For one example it is shown how the determinantal equation of the stationary equations can be interpreted.

Key words

canonical correlation linear relations between sets multiple regression redundancy analysis ridge regression 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Reference notes

  1. Dauxois, J., and Pousse, A. (1976).Les analyses factorielles en calcul des probabilités et en statistique: essai d'étude synthétique. Toulouse; Ph.D. Thesis, Université de Toulouse.Google Scholar
  2. Ten Berge, J. M. F. (1977).Optimizing factorial invariance. Groningen; Ph.D. Thesis, University of Groningen.Google Scholar


  1. DeSarbo, W. S. Canonical/redundancy factorial analysis. (1981).Psychometrika, 46, 307–329.Google Scholar
  2. Guttman, L. (1953). Image theory and the structure of quantitative variables.Psychometrika, 18, 277–296.Google Scholar
  3. Hoerl, A. E., and Kennard, R. W. (1970). Ridge regression. Biased estimation for nonorthogonal problems.Technometrics, 12, 55–67.Google Scholar
  4. Hoerl, A. E., and Kennard, R. W. (1970). Ridge regression: applications to nonorthogonal problems.Technometrics, 12, 67–82.Google Scholar
  5. Horst, P. (1961). Relations amongm sets of measures.Psychometrika, 26, 129–149.Google Scholar
  6. Horst, P. (1965).Factorial analysis of data matrices. New York, Holt, Rinehart and Winston.Google Scholar
  7. Johansson, J. K. (1981). An extension of Wollenberg's redundancy analysis.Psychometrika, 46, 93–104.Google Scholar
  8. Kettenring, J. R. (1971). Canonical analysis of several sets of variables.Biometrika, 58, 433–451.Google Scholar
  9. Kristof, W. (1971). Orthogonal inter-battery factor analysis.Psychometrika, 32, 199–227.Google Scholar
  10. Tucker, L. R. (1958). An inter-battery method of factor analysis.Psychometrika, 23, 111–136.Google Scholar
  11. Van de Geer, J. P. (1971).Introduction to multivariate analysis for the social sciences. San Francisco: Freeman and Company.Google Scholar
  12. Van den Wollenberg, A. L. (1977). Redundancy analysis: an alternative for canonical correlation analysis.Psychometrika, 42, 297–220.Google Scholar

Copyright information

© The Psychometric Society 1984

Authors and Affiliations

  • John P. Van de Geer
    • 1
  1. 1.Department of Data TheoryUniversity of LeidenLeidenThe Netherlands

Personalised recommendations