Abstract
An important feature of distance-based principal components analysis, is that the variables can be optimally transformed. For monotone spline transformation, a nonnegative least-squares problem with a length constraint has to be solved in each iteration. As an alternative algorithm to Lawson and Hanson (1974), we propose the Alternating Length-Constrained Non-Negative Least-Squares (ALC-NNLS) algorithm, which minimizes the nonnegative least-squares loss function over the parameters under a length constraint, by alternatingly minimizing over one parameter while keeping the others fixed. Several properties of the new algorithm are discussed. A Monte Carlo study is presented which shows that for most cases in distance-based principal components analysis, ALC-NNLS performs as good as the method of Lawson and Hanson or sometimes even better in terms of the quality of the solution.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Borg, I., & Groenen, P.J.F. (1997).Modern multidimensional scaling: Theory and applications. New York: Springer.
Breiman, L., & Friedman, J.H. (1985). Estimating optimal transformations for multiple regression and correlation.Journal of the American Statistical Association, 80, 580–619.
Bro, R., & De Jong, S. (1997). A fast non-negativity-constrained least squares algorithm.Journal of Chemometrics, 11, 393–401.
De Boor, C. (1978).A practical guide to splines. New York: Springer.
de Leeuw, J. (1977).Normalized cone regression. Leiden, The Netherlands: Department of Data Theory.
de Leeuw, J., & Heiser, W.J. (1977). Convergence of correction-matrix algorithms for multidimensional scaling. In J.C. Lingoes, E.E. Roskam, & I. Borg (Eds.),Geometric representations of relational data (pp. 735–752). Ann Arbor, MI: Mathesis Press.
Dinkelbach, W. (1967). On nonlinear fractional programming.Managment Science, 13, 492–498.
Gifi, A. (1990).Nonlinear multivariate analysis. Chichester: Wiley.
Gower, J.C., & Hand, D.J. (1996).Biplots. London: Chapman and Hall.
Groenen, P.J.F., Commandeur, J.J.F., & Meulman, J.J. (1997). PIONEER: A program for distance-based multivariate analysis. In W. Bandilla & F. Faulbaum (Eds.),Softstat'97: Advances in statistical software (pp. 83–90). Stuttgart: Lucius & Lucius.
Heiser, W.J. (1985).Multidimensional scaling by optimizing goodness-of-fit to a smooth hypothesis (Tech. Rep. RR-85-07). Leiden, The Netherlands: Leiden University, Department of Data Theory.
Jones, L.K., & Seaton, L. (Eds.). (1994).Math77: Reference manual. Sterling, VA: Language Systems Coorporation.
Kiers, H. A.L. (1995). Maximization of sums of quotients of quadratic forms and some generalizations.Psychometrika, 60, 221–245.
Kruskal, J.B. (1964a). Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis.Psychometrika, 29, 1–27.
Kruskal, J.B. (1964b). Nonmetric multidimensional scaling: A numerical method,Psychometrika, 29, 115–129.
Kruskal, J.B., & Carroll, J.D. (1969). Geometrical models and badness-of-fit functions. In P.R. Krishnaiah (Ed.),Multivariate analysis (Vol. 2, pp. 639–671). New York: Academic Press.
Krzanowski, W.J., & Marriott, F.H.C. (1994).Multivariate analysis. Part 1: Distributions, ordination and inference. London: Wiley.
Lawson, C.L., & Hanson, R.J. (1974).Solving least squares problems. Englewood Cliffs, NJ: Prentice Hall.
Meulman, J.J. (1986).A distance approach to nonlinear multivariate analysis. Leiden, The Netherlands: DSWO Press.
Meulman, J.J. (1992). The integration of multidimensional scaling and multivariate analysis with optimal transformations.Psychometrika, 57, 539–565.
Meyer, R. (1997). Nonlinear eigenvector algorithms for local optimization in multivariate data analysis.Linear Algebra and its Applications, 264, 225–246.
Ramsay, J.O. (1988). Monotone regression splines in action.Statistical Science, 3, 425–461.
Rockafellar, R.T. (1970).Convex analysis. Princeton, NJ: Princeton University Press.
Verboon, P. (1994).A robust approach to nonlinear multivariate analysis. Leiden, The Netherlands: DSWO Press.
Watson, G.A. (1985). On a class of algorithms for total approximation.Journal of Approximation Theory, 45, 219–231.
Young, F.W., de Leeuw, J., & Takane, Y. (1976). Regression with qualitative and quantitative variables: An alternating least squares approach.Psychometrika, 41, 505–529.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by The Netherlands Organization for Scientific Research (NWO) by grant nr. 030-56403 for the “PIONEER” project “Subject Oriented Multivariate Analysis” to the third author. We would like to thank the anonymous referees for their valuable remarks that have improved the quality of this paper.
Rights and permissions
About this article
Cite this article
Groenen, P.J.F., van Os, BJ. & Meulman, J.J. Optimal scaling by alternating length-constrained nonnegative least squares, with application to distance-based analysis. Psychometrika 65, 511–524 (2000). https://doi.org/10.1007/BF02296341
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02296341