Abstract
Exploratory factor analysis (EFA) is a widely used but poorly understood statistical procedure. This paper described EFA and its methodological variations. Then, key methodological variations were used to evaluate EFA usage over a 10-year period in five leading developmental disabilities journals. Sixty-six studies were located and evaluated on multiple procedural variations. Only 35% (n = 23) of studies used EFA; principal components analysis was the model used most often (n = 40, 61%). Orthogonal rotation was used most often (n = 39, 59%). A large portion of studies ran analyses with a subject: item ratio larger than 5:1 (n = 49, 74%). Most researchers employed multiple criteria for retaining factors (n = 45, 68%). Overall, results indicated that published recommendations and guidelines for the use of EFA are largely ignored.
Similar content being viewed by others
References
References marked with an asterisk indicate studies included in the review
*Argus, G. R., Terry, P. C., Bramston, P., & Dinsdale, S. L. (2004). Measurement of mood disorder in adolescents with intellectual disability. Research in Developmental Disabilities, 25, 493–507.
*Balboni, G., Battagliese, G., & Pedrabissi, L. (2000). The psychopathology inventory for mentally retarded adults: Factor structure and comparisons between subjects with or without dual diagnosis. Research in Developmental Disabilities, 21, 311–321.
*Barthélémy, C., Roux, S., Adrien, J. L., Hameury, L., Guérin, P., Garreau, B., et al. (1997). Validation of the revised behavior summarized evaluation scale. Journal of Autism and Developmental Disorders, 27, 139–153.
*Baxter, C., Cummins, R. A., & Yiolitis, L. (2000). Parental stress attributed to family members with and without disability: A longitudinal study. Journal of Intellectual & Developmental Disability, 25, 105–118.
Borgatta, E. F., Kercher, K., & Stull, D. E. (1986). A cautionary note on the use of principal components analysis. Sociological Methods and Research, 15, 160–168.
*Borthwick-Duffy, S. A., Lane, K. L., & Widaman, K. F. (1997). Measuring problem behaviors in children with mental retardation: Dimensions and predictors. Research in Developmental Disabilities, 18, 415–433.
*Brinkley, J., Nations, L., Abramson, R. K., Hall, A., Wright, H. H., Gabriels, R., et al. (2007). Factor analysis of the Aberrant Behavior Checklist in individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 37, 1949–1959.
*Brown, E. C., Aman, M. G., & Havercamp, S. M. (2002). Factor analysis and norms for parent ratings on the Aberrant Behavior Checklist-Community for young people in special education. Research in Developmental Disabilities, 23, 45–60.
Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111–150.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21, 230–258.
Browne, M. W., Cudeck, R., Tateneni, K. & Mels G. (2004). CEFA: Comprehensive Exploratory Factor Analysis, Version 2.00 [Computer software and manual]. Retrieved from http://quantrm2.psy.ohio-state.edu/browne/.
*Caballo, C., Crespo, M., Jenaro, C., Verdugo, M. A., & Martinez, J. L. (2005). Factor structure of the Schalock and Keith Quality of Life Questionnaire (QOL-Q): Validation on Mexican and Spanish samples. Journal of Intellectual Disability Research, 49, 773–776.
Catell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245–276.
Cliff, N. (1988). The eigenvalues-greater-than-one-rule and the reliability of components. Psychological Bulletin, 103, 276–279.
*Cohen, I. L., Schmidt-Lackner, S., Romanczyk, R., & Sudhalter, V. (2003). The PDD behavior inventory: A rating scale for assessing response to intervention in children with pervasive developmental disorder. Journal of Autism and Developmental Disorders, 33, 31–45.
Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis. Hillsdale, NJ: Lawrence Erlbaum Associates, Publishers.
*Cuskelly, M., & Gilmore, L. (2007). Attitudes to Sexuality Questionnaire (individuals with an intellectual disability): Scale development and community norms. Journal of Intellectual and Developmental Disability, 32, 214–221.
de *Bildt, A., Kraijer, D., Sytema, S., & Minderaa, R. (2005). The psychometric properties of the Vineland Adaptive Behavior Scales in children and adolescents with mental retardation. Journal of Autism and Developmental Disorders, 35, 53–62.
*Dekker, M. C., Nunn, R. J., Einfeld, S. E., Tonge, B. J., & Koot, H. M. (2002). Assessing emotional and behavioral problems in children with intellectual disability: Revisiting the factor structure of the Developmental Behaviour Checklist. Journal of Autism and Developmental Disorders, 32, 601–610.
*Duarte, C. S., Bordin, I. A. S., de Oliveira, A., & Bird, H. (2003). The CBCL and the identification of children with autism and related conditions in Brazil: Pilot findings. Journal of Autism and Developmental Disorders, 33, 703–707.
*Duker, P. C. (1999). The Verbal Behavior Assessment Scale (VerBAS): Construct validity, reliability, and internal consistency. Research in Developmental Disabilities, 20, 347–353.
*Duker, P. C., & Sigafoos, J. (1998). The Motivation Assessment Scale: Reliability and construct validity across three topographies of behavior. Research in Developmental Disabilities, 19, 131–141.
*Elias, C., Vermeer, A., & Hart, H’. t. (2005). Measurement of perceived competence in Dutch children with mild intellectual disabilities. Journal of Intellectual Disability Research, 49, 288–295.
*Esbensen, A. J., Rojahn, J., Aman, M. G., & Ruedrich, S. (2003). Reliability and validity of an assessment instrument for anxiety, depression, and mood among individuals with mental retardation. Journal of Autism and Developmental Disorders, 33, 617–629.
*Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272–299.
*Feurer, I. D., Dimitropoulos, A., Stone, W. L., Roof, E., Butler, M. G., & Thompson, T. (1998). The latent variable structure of the Compulsive Behaviour Checklist in people with Prader-Willi syndrome. Journal of Intellectual Disability Research, 42, 472–480.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286–299.
*Fogarty, G. J., Bramston, P., & Cummins, R. A. (1997). Validation of the Lifestress Inventory for people with a mild intellectual disability. Research in Developmental Disabilities, 18, 435–456.
Ford, J. K., MacCallum, R. C., & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39, 291–314.
*Frazier, T. W., Youngstrom, E. A., Kubu, C. S., Sinclair, L., & Rezai, A. (2008). Exploratory and confirmatory factor analysis of the autism diagnostic interview-revised. Journal of Autism and Developmental Disorders, 38, 474–480.
*Glidden, L. M., & Jobe, B. M. (2007). Measuring parental daily rewards and worries in transition to adulthood. American Journal on Mental Retardation, 112, 275–288.
Gorsuch, R. L. (1974). Factor analysis. Philadelphia, PA: W. B. Saunders Company.
*Groden, J., Diller, A., Bausman, M., Velicer, W., Norman, G., & Cautela, J. (2001). The development of a stress survey schedule for persons with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 31, 207–217.
Guadagnoli, E., & Velicer, W. F. (1988). Relations of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.
*Guralnick, M. J., Neville, B., Connor, R. T., & Hammond, M. A. (2003). Family factors associated with the peer social competence of young children with mild delays. American Journal on Mental Retardation, 108, 272–287.
*Gustafsson, C., & Sonnander, K. (2002). Psychometric evaluation of a Swedish version of the Reiss Screen for maladaptive behavior. Journal of Intellectual Disability Research, 46, 218–229.
*Gustafsson, C., & Sonnander, K. (2005). A psychometric evaluation of a Swedish version of the psychopathology inventory for mentally retarded adults (PIMRA). Research in Developmental Disabilities, 26, 183–201.
*Hampton, N. Z., & Xiao, F. (2008). Psychometric properties of the mental retardation attitude inventory-revised in Chinese college students. Journal of Intellectual Disability Research, 52, 299–308.
*Harries, J., Guscia, R., Kirby, N., Nettelbeck, T., & Taplin, J. (2005). Support needs and adaptive behaviors. American Journal on Mental Retardation, 110, 393–404.
*Hartman, C. A., Luteijn, E., Serra, M., & Minderaa, R. (2006). Refinement of the Children’s Social Behavior Questionnaire (CSBQ): An instrument that describe the diverse problems seen in milder forms of PDD. Journal of Autism and Developmental Disorders, 36, 325–342.
*Hastings, R. P., Brown, T., Mount, R. H., & Magnus Cormack, K. F. (2001). Exploration of psychometric properties of the Developmental Behavior Checklist. Journal of Autism and Developmental Disorders, 31, 423–431.
*Hastings, R. P., Horne, S., & Mitchell, G. (2004). Burnout in direct care staff in intellectual disability services: A factor analytic study of the Maslach Burnout Inventory. Journal of Intellectual Disability Research, 48, 268–273.
*Hastings, R. P., Sjöström, K. E., & Stevenage, S. V. (1998). Swedish and English adolescents’ attitudes toward the community presence of people with disabilities. Journal of Intellectual Disability Research, 42, 246–253.
*Hatton, C., Rivers, M., Mason, H., Mason, L., Kiernan, C., Emerson, E., et al. (1999). Staff stressors and staff outcomes in services for adults with intellectual disabilities: The Staff Stressor Questionnaire. Research in Developmental Disabilities, 20, 269–285.
*Hill, J., Powlitch, S., & Furniss, F. (2008). Convergent validity of the Aberrant Behavior Checklist and Behavior Problems Inventory with people with complex needs. Research in Developmental Disabilities, 29, 45–60.
Hubbard, R., & Allen, S. J. (1987). A cautionary note on the use of principal components analysis: Supportive empirical evidence. Sociological Methods and Research, 16, 301–308.
Humphreys, L. G., & Montanelli, R. G., Jr. (1975). An investigation of the parallel analysis criterion for determining the number of common factors. Multivariate Behavioral Research, 10, 193–205.
*Iacono, T., Bloomberg, K., & West, D. (2005). A preliminary investigation into the internal consistency and construct validity of the triple C: Checklist of communicative competencies. Journal of Intellectual & Developmental Disability, 30, 139–145.
*Kellett, S., Beail, N., & Newman, D. W. (2005). Measuring interpersonal problems in people with mental retardation. American Journal on Mental Retardation, 110, 136–144.
*Kennedy, C. H., & Niederbuhl, J. (2001). Establishing criteria for sexual consent capacity. American Journal on Mental Retardation, 106, 503–510.
*Lam, K. S. L., & Aman, M. G. (2007). The Repetitive Behavior Scale-Revised: Independent validation in individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders, 37, 855–866.
*Lecavalier, L. (2005). An evaluation of the Gilliam Autism Rating Scale. Journal of Autism and Developmental Disorders, 35, 795–805.
*Lecavalier, L., Aman, M. G., Hammer, D., Stoica, W., & Mathews, G. L. (2004). Factor analysis of the Nisonger Child Behavior Rating Form in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 34, 709–721.
*Lecavalier, L., Aman, M. G., Scahill, L., McDougle, C. J., McCracken, J. T., Vitiello, B., et al. (2006). Validity of the autism diagnostic interview—revised. American Journal on Mental Retardation, 111, 199–215.
*Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.
*Luteijn, E., Luteijn, F., Jackson, S., Volkmar, F., & Minderaa, R. (2000). The Childre’s Social Behavior Questionnaire for milder variants of PDD problems: Evaluation of the psychometric characteristics. Journal of Autism and Developmental Disorders, 30, 317–330.
MacCallum, R. C., Widaman, K. F., Preacher, K. J., & Hong, S. (2001). Sample size in factor analysis: The role of model error. Multivariate Behavioral Research, 36, 611–637.
*Magyar, C. I., & Pandolfi, V. (2007). Factor structure evaluation of the Childhood Autism Rating Scale. Journal of Autism and Developmental Disorders, 37, 1787–1794.
Marsh, H. W., & Hau, K.-T. (1999). Confirmatory factor analysis: Strategies for small sample size. In R. H. Hoyle (Ed.), Statistical strategies for small sample research. Thousand Oaks, CA: Sage Publications.
*Martorell, A., Pereda, A., Salvador-Carulla, L., Ochoa, S., & Ayuso-Mateos, J. L. (2007). Validation of the Subjective and Objective Family Burden Interview (SOFBI/ECFOS) in primary caregivers to adults with intellectual disabilities living in the community. Journal of Intellectual Disability Research, 51, 892–901.
*Matson, J. L., & Kuhn, D. E. (2001). Identifying feeding problems in mentally retarded persons: Development and reliability of the screening tool of feeding problems (STEP). Research in Developmental Disabilities, 21, 165–172.
*Matson, J. L., Kuhn, D. E., Dixon, D. R., Mayville, S. B., Laud, R. B., Cooper, C. L., et al. (2003). The development and factor structure of the Functional Assessment for Multiple CausaliTy (FACT). Research in Developmental Disabilities, 24, 485–495.
*McCallion, P., McCarron, M., & Force, L. T. (2005). A measure of subjective burden for dementia care: The Caregiving Difficulty Scale—Intellectual Disability. Journal of Intellectual Disability Research, 49, 365–371.
McCloy, C. H., Metheny, A., & Knott, V. (1938). A comparison of the Thurstone method of multiple factors with the Hotelling method of principal components. Psychometrika, 3, 61–67.
*Miranda-Linné, F. M., & Melin, L. (2002). A factor analytic stud of the Autism Behavior Checklist. Journal of Autism and Developmental Disorders, 32, 181–188.
*Mitchell, G., & Hastings, R. P. (2001). Coping, burnout, and emotion in staff working in community services for people with challenging behaviors. American Journal on Mental Retardation, 106, 448–459.
Montanelli, R. G., Jr., & Humphreys, L. G. (1976). Latent roots of random data correlation matrices with squared multiple correlations on the diagonal: A Monte Carlo study. Psychometrika, 41, 341–348.
*Moss, S., Prosser, H., Costello, H., Simpson, N., Patel, P., Rowe, S., et al. (1998). Reliability and validity of the PAD-ADD Checklist for detecting psychiatric disorders in adults with intellectual disability. Journal of Intellectual Disability Research, 42, 173–183.
Mulaik, S. A. (1990). Blurring the distinctions between component analysis and common factor analysis. Multivariate Behavioral Research, 25, 53–59.
*Nicholson, J., Konstantinidi, E., & Furniss, F. (2006). On some psychometric properties of the questions about behavioral function (QABF) scale. Research in Developmental Disabilities, 27, 337–352.
*Noens, I., van Berckelaer-Ones, I., Verpoorten, R., & van Duijn, G. (2006). The ComFor: An instrument for the indication of augmentative communication in people with autism and intellectual disability. Journal of Intellectual Disability Research, 50, 621–632.
*Nota, L., Soresi, S., & Perry, J. (2006). Quality of life in adults with an intellectual disability: The evaluation of quality of life instrument. Journal of Intellectual Disability Research, 50, 371–385.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers., 32, 396–402.
*Paclawskyj, T. R., Matson, J. L., Rush, K. S., Smalls, Y., & Vollmer, T. R. (2000). Questions about behavioral function (QABF): A behavioral checklist for functional assessment of aberrant behavior. Research in Developmental Disabilities, 21, 223–229.
*Park, J., Hoffman, L., Marquis, J., Turnbull, A. P., Poston, D., Mannan, H., et al. (2003). Toward assessing family outcomes of service delivery: Validation of a family quality of life survey. Journal of Intellectual Disability Research, 47, 367–384.
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Thousand Oaks, CA: Sage Publications, Inc.
*Rojahn, J., Matson, J. L., Lott, D., Esbensen, A. J., & Smalls, Y. (2001). The behavior problems inventory: An instrument for the assessment of self-injury, stereotyped behavior, and aggression/destruction in individuals with developmental disabilities. Journal of Autism and Developmental Disorders, 31, 577–588.
*Rojahn, J., Matson, J. L., Naglieri, J. A., & Mayville, E. (2004). Relationships between psychiatric conditions and behavior problems among adults with mental retardation. American Journal on Mental Retardation, 109, 21–33.
*Rojahn, J., Tasse, M. J., & Sturmey, P. (1997). The Stereotyped Behavior Scale for adolescents and adults with mental retardation. American Journal of Mental Retardation, 102, 137–146.
*Rose, J. (1999). Stress and residential staff who work with people who have an intellectual disability: A factor analytic study. Journal of Intellectual Disability Research, 43, 268–278.
*Schalock, R. L., Verdugo, M. A., Jenaro, C., Wang, M., Wehmeyer, M., Jiancheng, X., et al. (2005). Cross-cultural study of quality of life indicators. American Journal on Mental Retardation, 110, 298–311.
Snook, S. C., & Gorsuch, R. L. (1989). Component analysis versus common factor analysis: A Monte Carlo study. Psychological Bulletin, 106, 148–154.
Steiger, J. H. (1990). Some additional thoughts on components, factors, and factor indeterminacy. Multivariate Behavioral Research, 25, 41–45.
*Stella, J., Mundy, P., & Tuchman, R. (1999). Social and nonsocial factors in the Childhood Autism Rating Scale. Journal of Autism and Developmental Disorders, 29, 307–317.
Streiner, D. L. (1994). Figuring out factors: The use and misuse of factor analysis. The Canadian Journal of Psychiatry, 39, 135–140.
*Sturmey, P., Matson, J. L., & Lott, J. D. (2003). The internal consistency and factor structure of the Choice Assessment Scale. Research in Developmental Disabilities, 24, 317–322.
*Teunisse, J., Cools, A. R., van Spaendonck, K. P. M., Aerts, F. H. T. M., & Berger, H. J. C. (2001). Cognitive styles in high-functioning adolescents with autistic disorder. Journal of Autism and Developmental Disorders, 31, 55–66.
*Trute, H., & Hiebert-Murphy, D. (2005). Predicting family adjustment and parenting stress in childhood disability services using brief assessment tools. Journal of Intellectual & Developmental Disability, 30, 217–225.
*Urv, T. K., Zigman, W. B., & Silverman, W. (2003). Maladaptive behaviors related to adaptive decline in aging adults with mental retardation. American Journal on Mental Retardation, 108, 327–339.
Velicer, W. F., & Fava, J. L. (1998). Effects of variable and subject sampling on factor pattern recovery. Psychological methods, 3, 231–251.
Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25, 1–28.
*Wallander, J. L., & Marullo, D. S. (1997). Handicap-related problems in mothers of children with physical impairments. Research in Developmental Disabilities, 18, 151–165.
Widaman, K. F. (1990). Bias in pattern loadings represented by common factor analysis and component analysis. Multivariate Behavioral Research, 25, 89–95.
Widaman, K. F. (2007). Common factors versus components: principals and principles, errors and misconceptions. In R. Cudeck & R. C. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 177–204). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12, 58–79.
*Zigler, E., Bennett-Gates, D., Hodapp, R., & Henrich, C. C. (2002). Assessing personality traits of individuals with mental retardation. American Journal on Mental Retardation, 107, 181–193.
Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retains. Psychological Bulletin, 99, 432–442.
Acknowledgments
The authors wish to thank Michael C. Edwards, Ph.D., for his insightful comments during the development and preparation of this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Norris, M., Lecavalier, L. Evaluating the Use of Exploratory Factor Analysis in Developmental Disability Psychological Research. J Autism Dev Disord 40, 8–20 (2010). https://doi.org/10.1007/s10803-009-0816-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-009-0816-2