Skip to main content

Principal Component and Factor Analysis

  • Chapter
  • First Online:
  • 139k Accesses

Part of the book series: Springer Texts in Business and Economics ((STBE))

Abstract

We first provide comprehensive and advanced access to principal component analysis, factor analysis, and reliability analysis. Based on a discussion of the different types of factor analytic procedures (exploratory factor analysis, confirmatory factor analysis, and structural equation modeling), we introduce the steps involved in a principal component analysis and a reliability analysis, offering guidelines for executing them in SPSS. Specifically, we cover the requirements for running an analysis, modern options for extracting the factors and deciding on their number, as well as for interpreting and judging the quality of the results. Based on a step-by-step description of SPSS’s menu options, we present an in-depth discussion of each element of the SPSS output. Interpretation of output can be difficult, which we make much easier by means of various illustrations and applications, using a detailed case study to quickly make sense of the results. We conclude with suggestions for further readings on the use, application, and interpretation of factor analytic procedures.

Electronic supplementary material

The online version of this chapter (https://doi.org/10.1007/978-3-662-56707-4_8) contains additional material that is available to authorized users. You can also download the “Springer Nature More Media App” from the iOS or Android App Store to stream the videos and scan the image containing the “Play button”.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Other methods for carrying out factor analyses include, for example, unweighted least squares, generalized least squares, or maximum likelihood but these are statistically complex.

  2. 2.

    Related discussions have been raised in structural equation modeling, where researchers have heatedly discussed the strengths and limitations of factor-based and component-based approaches (e.g. Sarstedt et al. 2016a; Hair et al. 2017b).

  3. 3.

    Note that Fig. 8.3 describes a special case, as the five variables are scaled down into a two-dimensional space. In this set-up, it would be possible for the two factors to explain all five items. However, in real-life, the five items span a five-dimensional vector space.

  4. 4.

    Note that this changes when oblique rotation is used. We will discuss factor rotation later in this chapter.

  5. 5.

    Note that this is only the case in PCA. When using factor analysis, the standard deviations are different from one (DiStefano et al. 2009).

  6. 6.

    Note that we omitted the error terms for clarity.

References

  • Brown, J. D. (2009). Choosing the right type of rotation in PCA and EFA. JALT Testing & Evaluation SIG Newsletter, 13(3), 20–25.

    Google Scholar 

  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.

    Article  Google Scholar 

  • Cliff, N. (1987). Analyzing multivariate data. New York, NJ: Harcourt Brace Jovanovich.

    Google Scholar 

  • Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.

    Article  Google Scholar 

  • Diamantopoulos, A., & Siguaw, J. A. (2000). Introducing LISREL: A guide for the uninitiated. London: Sage.

    Book  Google Scholar 

  • Dinno, A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44(3), 362–388.

    Article  Google Scholar 

  • DiStefano, C., Zhu, M., & Mîndriă, D. (2009). Understanding and using factor scores: Considerations fort he applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11.

    Google Scholar 

  • Festge, F., & Schwaiger, M. (2007). The drivers of customer satisfaction with industrial goods: An international study. Advances in International Marketing, 18, 179–207.

    Google Scholar 

  • Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Graffelman, J. (2013). Linear-angle correlation plots: New graphs for revealing correlation structure. Journal of Computational and Graphical Statistics, 22(1), 92–106.

    Article  Google Scholar 

  • Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.

    Article  Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis. A global perspective (8th ed.). Boston. MA: Cengage.

    Google Scholar 

  • Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–151.

    Article  Google Scholar 

  • Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017a). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., & Thiele, K. O. (2017b). Mirror, mirror on the wall. A comparative evaluation of composite-based structural equation modeling methods. Journal of the Academy of Marketing Science, 45(5), 616–632.

    Article  Google Scholar 

  • Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Hamilton, L. C. (2013), Statistics with Stata: Version 12: Cengage Learning.

    Google Scholar 

  • Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205.

    Article  Google Scholar 

  • Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416.

    Article  Google Scholar 

  • Hershberger, S. L. (2005). Factor scores. In: B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 636–644). New York, NJ: John Wiley.

    Google Scholar 

  • Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.

    Article  Google Scholar 

  • Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36(4), 409–426.

    Article  Google Scholar 

  • Kaiser, H. F. (1958). The varimax criterion for factor analytic rotation in factor analysis. Educational and Psychological Measurement, 23(3), 770–773.

    Google Scholar 

  • Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36.

    Article  Google Scholar 

  • Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Thousand Oaks, CA: Sage.

    Book  Google Scholar 

  • Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989). A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile Eigenvalues. Multivariate Behavioral Research, 24(1), 59–69.

    Article  Google Scholar 

  • MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99.

    Article  Google Scholar 

  • Matsunga, M. (2010). How to factor-analyze your data right: Do’s and don’ts and how to’s. International Journal of Psychological Research, 3(1), 97–110.

    Article  Google Scholar 

  • Mulaik, S. A. (2009). Foundations of factor analysis (2nd ed.). London: Chapman & Hall.

    Google Scholar 

  • O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402.

    Article  Google Scholar 

  • Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13–43.

    Article  Google Scholar 

  • Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646.

    Article  Google Scholar 

  • Sarstedt, M., Schwaiger, M., & Ringle, C. M. (2009). Do we fully understand the critical success factors of customer satisfaction with industrial goods? Extending Festge and Schwaiger’s model to account for unobserved heterogeneity. Journal of Business Market Management, 3(3), 185–206.

    Article  Google Scholar 

  • Sarstedt, M., Ringle, C. M., Raithel, S., & Gudergan, S. (2014). In pursuit of understanding what drives fan satisfaction. Journal of Leisure Research, 46(4), 419–447.

    Article  Google Scholar 

  • Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with PLS and CBSEM: Where the bias lies!. Journal of Business Research, 69(10), 3998–4010.

    Article  Google Scholar 

  • Steiger, J. H. (1979). Factor indeterminacy in the 1930's and the 1970's some interesting parallels. Psychometrika, 44(2), 157–167.

    Article  Google Scholar 

  • Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). Hillsdale: Erlbaum.

    Google Scholar 

  • Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25(1), 1–28.

    Article  Google Scholar 

  • Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters?. Multivariate Behavioral Research, 28(3), 263–311.

    Article  Google Scholar 

  • Wold, H. O. A. (1982). Soft modeling: The basic design and some extensions. In: K. G. Jöreskog & H. O. A. Wold (Eds.), Systems under indirect observations: Part II (pp. 1–54). Amsterdam: North-Holland.

    Google Scholar 

  • Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442.

    Article  Google Scholar 

Further Reading

  • Nunnally, J. C., & Bernstein, I. H. (1993). Psychometric theory (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Stewart, D. W. (1981). The application and misapplication of factor analysis in marketing research. Journal of Marketing Research, 18(1), 51–62.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer-Verlag GmbH Germany, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sarstedt, M., Mooi, E. (2019). Principal Component and Factor Analysis. In: A Concise Guide to Market Research. Springer Texts in Business and Economics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-56707-4_8

Download citation

Publish with us

Policies and ethics