Introduction
Large or massive data sets are increasingly common and often include measurements on many variables. It is frequently possible to reduce the number of variables considerably while still retaining much of the information in the original data set. Principal component analysis (PCA) is probably the best known and most widely used dimension-reducing technique for doing this. Suppose we have n measurements on a vector x of p random variables, and we wish to reduce the dimension from p to q, where q is typically much smaller than p. PCA does this by finding linear combinations, a 1 ′ x, a 2 ′ x, …, a q ′ x, called principal components, that successively have maximum variance for the data, subject to being uncorrelated with previous { a} k ′ { x}s. Solving this maximization problem, we find that the vectors a 1, a 2, …, a q are the eigenvectors of the covariance matrix, S, of the data, corresponding to the q largest eigenvalues (see Eigenvalue, Eigenvector and Eigenspace). The...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References and Further Reading
Hotelling H (1933) Analysis of a complex of statistical variables into principal components. J Educ Psychol 24:417–441, 498–520
Jackson JE (1991) A user’s guide to principal components. Wiley, New York
Jolliffe IT (2002) Principal component analysis, 2nd edn. Springer, New York
Pearson K (1901) On lines and planes of closest fit to systems of points in space. Philos Mag 2:559–572
Yule W, Berger M, Butler S, Newham V, Tizard J (1969) The WPPSI: an empirical evaluation with a British sample. Brit J Educ Psychol 39:1–13
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this entry
Cite this entry
Jolliffe, I. (2011). Principal Component Analysis. In: Lovric, M. (eds) International Encyclopedia of Statistical Science. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04898-2_455
Download citation
DOI: https://doi.org/10.1007/978-3-642-04898-2_455
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04897-5
Online ISBN: 978-3-642-04898-2
eBook Packages: Mathematics and StatisticsReference Module Computer Science and Engineering