Psychometric Evaluation of the Short Sensory Profile in Youth with Autism Spectrum Disorder
The Short Sensory Profile (SSP) is one of the most commonly used measures of sensory features in children with autism spectrum disorder (ASD), but psychometric studies in this population are limited. Using confirmatory factor analysis, we evaluated the structural validity of the SSP subscales in ASD children. Confirmatory factor models exhibited poor fit, and a follow-up exploratory factor analysis suggested a 9-factor structure that only replicated three of the seven original subscales. Secondary analyses suggest that while reliable, the SSP total score is substantially biased by individual differences on dimensions other than the general factor. Overall, our findings discourage the use of the SSP total score and most subscale scores in children with ASD. Implications for future research are discussed.
KeywordsAutism spectrum disorder Sensory Short Sensory Profile Factor analysis Psychometric Validity
Data and/or research tools used in the preparation of this manuscript were obtained from the NIH-supported National Database for Autism Research (NDAR). NDAR is a collaborative informatics system created by the National Institutes of Health to provide a national resource to support and accelerate research in autism. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or of the Submitters submitting original data to NDAR. The authors would like to thank Dr. Grace Baranek for her input regarding our recommendations for the use of the Sensory Experiences Questionnaire.
ZJW conceived of the study, performed and interpreted all statistical analyses, and drafted the manuscript; CC participated in the design and coordination of the study, gathered data from both samples, and helped to draft the manuscript; MDF, KOG, and TGW all contributed to the interpretation of the data and helped to draft the manuscript. All authors read and approved the final manuscript.
This study was funded by the National Institutes of Health under the following award numbers: T32 GM007347, R01 MH102272, K01 MH 90232, R21 MH 109225, R21 MH10132, UL1 TR000445 from NCATS/NIH, and U54 HD083211.
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflicts of interest with respect to their authorship or the publication of this article.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®) (Fifth Edition). American Psychiatric Pub. https://doi.org/10.1176/appi.books.9780890425596.
- Ashburner, J., Ziviani, J., & Rodger, S. (2008). Sensory processing and classroom emotional, behavioral, and educational outcomes in children with autism spectrum disorder. The American Journal of Occupational Therapy, 62(5), 564–573. https://doi.org/10.1186/s13229-015-0060-x.CrossRefPubMedGoogle Scholar
- Asparouhov, T., & Muthén, B. (2010). Simple second order chi-square correction: Technical appendix related to new features in Mplus version 6. Los Angeles: Muthén & Muthén.Google Scholar
- Ausderau, K., Sideris, J., Furlong, M., Little, L. M., Bulluck, J., & Baranek, G. T. (2014b). National survey of sensory features in children with ASD: Factor structure of the sensory experience questionnaire (3.0). Journal of Autism and Developmental Disorders, 44(4), 915–925. https://doi.org/10.1007/s10803-013-1945-1.CrossRefPubMedPubMedCentralGoogle Scholar
- Ausderau, K. K., Furlong, M., Sideris, J., Bulluck, J., Little, L. M., Watson, L. R., & Baranek, G. T. (2014a). Sensory subtypes in children with autism spectrum disorder: Latent profile transition analysis using a national survey of sensory features. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 55(8), 935–944. https://doi.org/10.1111/jcpp.12219.CrossRefPubMedPubMedCentralGoogle Scholar
- Ben-Sasson, A., Cermak, S. A., Orsmond, G. I., Tager-Flusberg, H., Kadlec, M. B., & Carter, A. S. (2008). Sensory clusters of toddlers with autism spectrum disorders: Differences in affective symptoms. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 49(8), 817–825. https://doi.org/10.1111/j.1469-7610.2008.01899.x.CrossRefPubMedGoogle Scholar
- Ben-Sasson, A., Hen, L., Fluss, R., Cermak, S. A., Engel-Yeger, B., & Gal, E. (2009). A meta-analysis of sensory modulation symptoms in individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(1), 1–11. https://doi.org/10.1007/s10803-008-0593-3.CrossRefPubMedGoogle Scholar
- Black, K. R., Stevenson, R. A., Segers, M., Ncube, B. L., Sun, S. Z., Philipp-Muller, A., et al. (2017). Linking anxiety and insistence on sameness in autistic children: The role of sensory hypersensitivity. Journal of Autism and Developmental Disorders, 47(8), 2459–2470. https://doi.org/10.1007/s10803-017-3161-x.CrossRefPubMedGoogle Scholar
- Brunner, M., Nagy, G., & Wilhelm, O. (2012). A tutorial on hierarchically structured constructs. Journal of Personality, 80(4), 795–795. https://doi.org/10.1111/j.1467-6494.2012.00749_1.x.CrossRefGoogle Scholar
- Burns, C. O., Dixon, D. R., Novack, M., & Granpeesheh, D. (2017). A systematic review of assessments for sensory processing abnormalities in autism spectrum disorder. Review Journal of Autism and Developmental Disorders, 4(3), 209–224. https://doi.org/10.1007/s40489-017-0109-1.CrossRefGoogle Scholar
- Cermak, S. A., Curtin, C., & Bandini, L. (2014). Sensory sensitivity and food selectivity in children with autism spectrum disorders. In V. R. Patel, V. R. Preedy & C. R. Martin (Eds.), Comprehensive guide to autism (pp. 2061–2076). New York: Springer. https://doi.org/10.1007/978-1-4614-4788-7_126.CrossRefGoogle Scholar
- Charman, T., Loth, E., Tillmann, J., Crawley, D., Wooldridge, C., Goyard, D., & Buitelaar, J. K. (2017). The EU-AIMS longitudinal european autism project (LEAP): Clinical characterisation. Molecular Autism, 8(1), 27. https://doi.org/10.1186/s13229-017-0145-9.CrossRefPubMedPubMedCentralGoogle Scholar
- Chen, Y.-H., Rodgers, J., & McConachie, H. (2009). Restricted and repetitive behaviours, sensory processing and cognitive style in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(4), 635–642. https://doi.org/10.1007/s10803-008-0663-6.CrossRefPubMedGoogle Scholar
- Chistol, L. T., Bandini, L. G., Must, A., Phillips, S., Cermak, S. A., & Curtin, C. (2018). Sensory sensitivity and food selectivity in children with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 48(2), 583–591. https://doi.org/10.1007/s10803-017-3340-9.CrossRefPubMedPubMedCentralGoogle Scholar
- Corbett, B. A., Muscatello, R. A., & Blain, S. D. (2016). Impact of sensory sensitivity on physiological stress response and novel peer interaction in children with and without autism spectrum disorder. Frontiers in Neuroscience, 10, 1–9. https://doi.org/10.3389/fnins.2016.00278.CrossRefGoogle Scholar
- Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research and Evaluation, 10(7), 1–9.Google Scholar
- Dunn, W. (1999). Sensory profile: User’s manual. San Antonio: Psychological Corporation.Google Scholar
- Dunn, W. (2014). Sensory profile 2: User’s manual. San Antonio: Psychological Corporation.Google Scholar
- Ee, S. I., Loh, S. Y., Chinna, K., & Marret, M. J. (2016). Cross-cultural adaptation and psychometric properties of the Malay version of the Short Sensory Profile. Physical and Occupational Therapy in Pediatrics, 36(2), 117–130. https://doi.org/10.3109/01942638.2015.1040574.CrossRefPubMedGoogle Scholar
- Egelhoff, K., & Lane, A. E. (2013). Brief report: Preliminary reliability, construct validity and standardization of the Auditory Behavior Questionnaire (ABQ) for children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(4), 978–984. https://doi.org/10.1007/s10803-012-1626-5.CrossRefPubMedGoogle Scholar
- Engel-Yeger, B., Hardal-Nasser, R., & Gal, E. (2016). The relationship between sensory processing disorders and eating problems among children with intellectual developmental deficits. British Journal of Occupational Therapy, 79(1), 17–25. https://doi.org/10.1177/0308022615586418.CrossRefGoogle Scholar
- Frazier, T. W., Ratliff, K. R., Gruber, C., Zhang, Y., Law, P. A., & Constantino, J. N. (2014). Confirmatory factor analytic structure and measurement invariance of quantitative autistic traits measured by the social responsiveness scale-2. Autism, 18(1), 31–44. https://doi.org/10.1177/1362361313500382.CrossRefPubMedGoogle Scholar
- Glod, M., Riby, D. M., Honey, E., & Rodgers, J. (2015). Psychological correlates of sensory processing patterns in individuals with autism spectrum disorder: A systematic review. Review Journal of Autism and Developmental Disorders, 2(2), 199–221. https://doi.org/10.1007/s40489-015-0047-8.CrossRefGoogle Scholar
- Green, D., Chandler, S., Charman, T., Simonoff, E., & Baird, G. (2016). Brief report: DSM-5 sensory behaviours in children with and without an autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(11), 3597–3606. https://doi.org/10.1007/s10803-016-2881-7.CrossRefPubMedGoogle Scholar
- Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11 Suppl 3), S78–94. https://doi.org/10.1097/01.mlr.0000245454.12228.8f.CrossRefPubMedPubMedCentralGoogle Scholar
- Hazen, E. P., Stornelli, J. L., O’Rourke, J. A., Koesterer, K., & McDougle, C. J. (2014). Sensory symptoms in autism spectrum disorders. Harvard Review of Psychiatry, 22(2), 112–124. https://doi.org/10.1097/01.HRP.0000445143.08773.58.CrossRefPubMedGoogle Scholar
- Hegarty II, J. P., Gu, M., Spielman, D. M., Cleveland, S. C., Hallmayer, J. F., Lazzeroni, L. C. et al (2018). A proton MR spectroscopy study of the thalamus in twins with autism spectrum disorder. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 81, 153–160. https://doi.org/10.1016/j.pnpbp.2017.09.016.CrossRefGoogle Scholar
- Hermida, R. (2015). The problem of allowing correlated errors in structural equation modeling: Concerns and considerations. Computational Methods in Social Sciences, 3(1), 5–17.Google Scholar
- Johnson, C. R., Turner, K., Stewart, P. A., Schmidt, B., Shui, A., Macklin, E., & Hyman, S. L. (2014). Relationships between feeding problems, behavioral characteristics and nutritional quality in children with ASD. Journal of Autism and Developmental Disorders, 44(9), 2175–2184. https://doi.org/10.1007/s10803-014-2095-9.CrossRefPubMedGoogle Scholar
- Kuschner, E. S., Eisenberg, I. W., Orionzi, B., Simmons, W. K., Kenworthy, L., Martin, A., & Wallace, G. L. (2015). A preliminary study of self-reported food selectivity in adolescents and young adults with autism spectrum disorder. Research in Autism Spectrum Disorders, 15, 53–59. https://doi.org/10.1016/j.rasd.2015.04.005.CrossRefPubMedGoogle Scholar
- Lajonchere, C., Jones, N., Coury, D. L., & Perrin, J. M. (2012). Leadership in health care, research, and quality improvement for children and adolescents with autism spectrum disorders: Autism treatment network and autism intervention research network on physical health. Pediatrics, 130(Supplement 2), S62–S68. https://doi.org/10.1542/peds.2012-0900C.CrossRefPubMedGoogle Scholar
- Lane, A. E., Geraghty, M. E., Young, G. S., & Rostorfer, J. L. (2014a). Problem eating behaviors in autism spectrum disorder are associated with suboptimal daily nutrient intake and taste/smell sensitivity. ICAN: Infant, Child, & Adolescent Nutrition, 6(3), 172–180. https://doi.org/10.1177/1941406414523981.CrossRefGoogle Scholar
- Levitin, D. J., Cole, K., Lincoln, A., & Bellugi, U. (2005). Aversion, awareness, and attraction: Investigating claims of hyperacusis in the Williams syndrome phenotype. Journal of Child Psychology and Psychiatry, 46(5), 514–523. https://doi.org/10.1111/j.1469-7610.2004.00376.x.CrossRefPubMedGoogle Scholar
- Little, L. M., Dean, E., Tomchek, S., & Dunn, W. (2018). Sensory processing patterns in autism, attention deficit hyperactivity disorder, and typical development. Physical and Occupational Therapy in Pediatrics, 38(3), 243–254. https://doi.org/10.1080/01942638.2017.1390809.CrossRefPubMedGoogle Scholar
- Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., & Rutter, M. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223.CrossRefGoogle Scholar
- Luisier, A.-C., Petitpierre, G., Ferdenzi, C., Clerc Bérod, A., Giboreau, A., Rouby, C., & Bensafi, M. (2015). Odor perception in children with autism spectrum disorder and its relationship to food neophobia. Frontiers in Psychology, 6, 1830. https://doi.org/10.3389/fpsyg.2015.01830.CrossRefPubMedPubMedCentralGoogle Scholar
- Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320–341. https://doi.org/10.1207/s15328007sem1103_2.CrossRefGoogle Scholar
- Mazurek, M. O., Keefer, A., Shui, A., & Vasa, R. A. (2014). One-year course and predictors of abdominal pain in children with autism spectrum disorders: The role of anxiety and sensory over-responsivity. Research in Autism Spectrum Disorders, 8(11), 1508–1515. https://doi.org/10.1016/j.rasd.2014.07.018.CrossRefGoogle Scholar
- Mazurek, M. O., Vasa, R. A., Kalb, L. G., Kanne, S. M., Rosenberg, D., Keefer, A., & Lowery, L. A. (2013). Anxiety, sensory over-responsivity, and gastrointestinal problems in children with autism spectrum disorders. Journal of Abnormal Child Psychology, 41(1), 165–176. https://doi.org/10.1007/s10802-012-9668-x.CrossRefPubMedGoogle Scholar
- McDonald, R. P. (1999). Test theory: A unified treatment. New York: Psychology Press.Google Scholar
- McIntosh, D. N., Miller, L. J., & Shyu, V. (1999). Development and validation of the Short Sensory Profile. In W. Dunn (Ed.), Sensory Profile: User's manual (pp. 59–73). San Antonio, TX: Psychological Corporation.Google Scholar
- Murray, A. L., Booth, T., McKenzie, K., Kuenssberg, R., & O’Donnell, M. (2014). Are autistic traits measured equivalently in individuals with and without an autism spectrum disorder? An invariance analysis of the Autism Spectrum Quotient Short Form. Journal of Autism and Developmental Disorders, 44(1), 55–64. https://doi.org/10.1007/s10803-013-1851-6.CrossRefPubMedGoogle Scholar
- Neil, L., Olsson, N. C., & Pellicano, E. (2016). The relationship between intolerance of uncertainty, sensory sensitivities, and anxiety in autistic and typically developing children. Journal of Autism and Developmental Disorders, 46(6), 1962–1973. https://doi.org/10.1007/s10803-016-2721-9.CrossRefPubMedPubMedCentralGoogle Scholar
- Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. New York: MacGraw-Hill.Google Scholar
- O’Donnell, S., Deitz, J., Kartin, D., Nalty, T., & Dawson, G. (2012). Sensory processing, problem behavior, adaptive behavior, and cognition in preschool children with autism spectrum disorders. The American Journal of Occupational Therapy, 66(5), 586–594. https://doi.org/10.5014/ajot.2012.004168.CrossRefPubMedGoogle Scholar
- Orekhova, E. V., Tsetlin, M. M., Butorina, A. V., Novikova, S. I., Gratchev, V. V., Sokolov, P. A., et al. (2012). Auditory cortex responses to clicks and sensory modulation difficulties in children with autism spectrum disorders (ASD). PLoS ONE, 7(6), e39906. https://doi.org/10.1371/journal.pone.0039906.CrossRefPubMedPubMedCentralGoogle Scholar
- R Core Team (2017). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. https://www.R-project.org/.
- Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., … & PROMIS Cooperative Group (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5), S22–S31. https://doi.org/10.1097/01.mlr.0000250483.85507.04.CrossRefPubMedGoogle Scholar
- Revelle, W. (2017). psych: Procedures for Personality and Psychological Research. Evanston: Northwestern University.Google Scholar
- Samson, A. C., Phillips, J. M., Parker, K. J., Shah, S., Gross, J. J., & Hardan, A. Y. (2014). Emotion dysregulation and the core features of autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(7), 1766–1772. https://doi.org/10.1007/s10803-013-2022-5.CrossRefPubMedGoogle Scholar
- Schauder, K. B., & Bennetto, L. (2016). Toward an interdisciplinary understanding of sensory dysfunction in autism spectrum disorder: An integration of the neural and symptom literatures. Frontiers in Neuroscience, 10(51), 268. https://doi.org/10.3389/fnins.2016.00268.CrossRefPubMedPubMedCentralGoogle Scholar
- Schoen, S. A., Miller, L. J., Brett-Green, B. A., & Nielsen, D. M. (2009). Physiological and behavioral differences in sensory processing: A comparison of children with autism spectrum disorder and sensory modulation disorder. Frontiers in Integrative Neuroscience, 3, 1–11. https://doi.org/10.3389/neuro.07.029.2009.CrossRefGoogle Scholar
- Schoen, S. A., Miller, L. J., & Sullivan, J. (2017). The development and psychometric properties of the Sensory Processing Scale Inventory: A report measure of sensory modulation. Journal of Intellectual & Developmental Disability, 42(1), 12–21. https://doi.org/10.3109/13668250.2016.1195490.CrossRefGoogle Scholar
- Siper, P. M., Kolevzon, A., Wang, A. T., Buxbaum, J. D., & Tavassoli, T. (2017). A clinician-administered observation and corresponding caregiver interview capturing DSM-5 sensory reactivity symptoms in children with ASD. Autism Research, 10(6), 1133–1140. https://doi.org/10.1002/aur.1750.CrossRefPubMedGoogle Scholar
- Tavassoli, T., Bellesheim, K., Siper, P. M., Wang, A. T., Halpern, D., Gorenstein, M., et al. (2016). Measuring sensory reactivity in autism spectrum disorder: Application and simplification of a clinician-administered sensory observation scale. Journal of Autism and Developmental Disorders, 46(1), 287–293. https://doi.org/10.1007/s10803-015-2578-3.CrossRefPubMedGoogle Scholar
- Tavassoli, T., Miller, L. J., Schoen, S. A., Jo Brout, J., Sullivan, J., & Baron-Cohen, S. (2018). Sensory reactivity, empathizing and systemizing in autism spectrum conditions and sensory processing disorder. Developmental Cognitive Neuroscience, 29, 72–77. https://doi.org/10.1016/j.dcn.2017.05.005.CrossRefPubMedGoogle Scholar
- Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment (pp. 41–71). Boston: Springer. https://doi.org/10.1007/978-1-4615-4397-8_3.CrossRefGoogle Scholar
- Wiggins, L. D., Robins, D. L., Bakeman, R., & Adamson, L. B. (2009). Brief report: Sensory abnormalities as distinguishing symptoms of autism spectrum disorders in young children. Journal of Autism and Developmental Disorders, 39(7), 1087–1091. https://doi.org/10.1007/s10803-009-0711-x.CrossRefPubMedGoogle Scholar
- Wigham, S., Rodgers, J., South, M., McConachie, H., & Freeston, M. (2015). The interplay between sensory processing abnormalities, intolerance of uncertainty, anxiety and restricted and repetitive behaviours in autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(4), 943–952. https://doi.org/10.1007/s10803-014-2248-x.CrossRefPubMedGoogle Scholar
- Wodka, E. L., Puts, N. A. J., Mahone, E. M., Edden, R. A. E., Tommerdahl, M., & Mostofsky, S. H. (2016). The role of attention in somatosensory processing: A multi-trait, multi-method analysis. Journal of Autism and Developmental Disorders, 46(10), 3232–3241. https://doi.org/10.1007/s10803-016-2866-6.CrossRefPubMedPubMedCentralGoogle Scholar
- Yates, A. (1987). Multivariate exploratory data analysis: A perspective on exploratory factor analysis. Albany: State University of New York Press.Google Scholar
- Yerys, B. E., Nissley-Tsiopinis, J., de Marchena, A., Watkins, M. W., Antezana, L., Power, T. J., & Schultz, R. T. (2017). Evaluation of the ADHD rating scale in youth with Autism. Journal of Autism and Developmental Disorders, 47(1), 90–100. https://doi.org/10.1007/s10803-016-2933-z.CrossRefPubMedPubMedCentralGoogle Scholar
- Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. (Unpublished doctoral dissertation). University of California, Los Angeles.Google Scholar