Skip to main content

On the Interface between Cluster Analysis, Principal Component Analysis, and Multidimensional Scaling

  • Chapter
Multivariate Statistical Modeling and Data Analysis

Part of the book series: Theory and Decision Library ((TDLB,volume 8))

Abstract

This paper shows how methods of cluster analysis, principal component analysis, and multidimensional scaling may be combined in order to obtain an optimal fit between a classification underlying some set of objects 1,…,n and its visual representation in a low-dimensional euclidean space ℝs. We propose several clustering criteria and corresponding k-means-like algorithms which are based either on a probabilistic model or on geometrical considerations leading to matrix approximation problems. In particular, a MDS-clustering strategy is presented for-displaying not only the n objects using their pairwise dissimilarities, but also the detected clusters and their average distances.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Bezdek, J.C., Ch. Coray, R. Gunderson, J. Watson: Detection and characterization of cluster substructure. I. Linear structure: Fuzzy c-lines. II, Fuzzy c-varietes and convex combinations thereof. SIAM J. Appl. Math. 40 (1981) 339–357

    Article  MathSciNet  MATH  Google Scholar 

  • Bezdek, J.C., Ch. Coray, R. Gunderson, J. Watson: Detection and characterization of cluster substructure. I. Linear structure: Fuzzy c-lines. II, Fuzzy c-varietes and convex combinations thereof. SIAM J. Appl. Math. 40 (1981) 358–372.

    Article  MathSciNet  MATH  Google Scholar 

  • Bock, H.H.: Automatische, Klassifikation. Theoretische und praktische Methoden zur, Gruppierung und Strukturierung von Daten (Cluster-Analyse). Vandenhoeck & Ruprecht, Göttingen 1974, 480 pp.

    MATH  Google Scholar 

  • Bock, H.H.: Clusteranalyse mit unscharfen Partitionen. In: Bock, H.H. (ed.): Klassifikation und Erkenntnis III: Numerische Klassifikation. Studien zur Klassifikation SK-6. INDEKS-Verlag, Frankfurt 1979, 137–163.

    Google Scholar 

  • Bock, H.H.: Multidimensional scaling in the framework of cluster analysis. In: Degens, P.O., H.-J. Hermes, O. Opitz (eds.): Classification and its environment. (Proc. 10. Annual Meeting of the Gesellschaft für Klassifikation) Studien zur Klassifikation SK-17. INDEKS-Verlag, Frankfurt 1986.

    Google Scholar 

  • Diday, E. et al.: Optimisation en classification automatique I, II. Institut National de Recherche en Informatique et en Automatique (INRIA), Le Chesnay/France 1979.

    Google Scholar 

  • Friedman, H.P., J. Rubin: On some invariant criteria for grouping data. J. Amer. Statist. Assoc. 62 (1967) 1159–1178.

    Article  MathSciNet  Google Scholar 

  • Huber, P.J.: Projection pursuit. Annals of Statistics 13 (1985) 435–475.

    Article  MathSciNet  MATH  Google Scholar 

  • Keller, J.B.: Factorization of matrices by least squares. Biometrika 49 (1962) 239–242.

    MathSciNet  MATH  Google Scholar 

  • Mathar, R.: The best Euclidean fit to a given distance matrix in prescribed dimensions. Linear Algebra and Its Applications 67 (1985) 1–6.

    Article  MathSciNet  MATH  Google Scholar 

  • Okamoto, M., M. Kanazawa: Minimisation of eigenvalues of a matrix and optimality of principal components. Ann. Math. Statist. 39 (1968) 859–863.

    Article  MathSciNet  MATH  Google Scholar 

  • Pearson, K.: On lines and planes of closest fit to systems of points in space. Phil. Mag. (6th series) 2 (1901) 559–572.

    Google Scholar 

  • Rao, C.R.: The use and interpretation of_principal component analysis in applied research. Sankkya A 26 (1964) 329–358.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1987 D. Reidel Publishing Company, Dordrecht, Holland

About this chapter

Cite this chapter

Bock, H.H. (1987). On the Interface between Cluster Analysis, Principal Component Analysis, and Multidimensional Scaling. In: Bozdogan, H., Gupta, A.K. (eds) Multivariate Statistical Modeling and Data Analysis. Theory and Decision Library, vol 8. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3977-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-3977-6_2

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-8264-8

  • Online ISBN: 978-94-009-3977-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics