Abstract
This study assesses the psychometric properties of three self-report measures of autistic-like tendencies in the general adult population: autistic spectrum quotient (AQ), adult repetitive behaviours questionnaire-2 (RBQ-2A), and systemizing quotient (SQ). Three rounds of development and testing using different U.S. and global samples led to three instruments that are psychometrically sound, parsimonious, and generalizable across populations. The resulting AQ-9, consisting of two factors: social communication and attention to detail, now mirrors the current dual diagnostic criteria in the DSM-5. The RBQ-2A-R has now been refined through CFA for the first time. The new SQ-7 scale also has updated content. All three refined scales demonstrate satisfactory psychometric validity and parsimony and now provide evidence of their appropriateness for empirical research.
Similar content being viewed by others
Notes
There exists another adult, self-report scale, the Autism Spectrum Disorder in Adults Screening Questionnaire (ASDASQ; Nylander and Gillberg 2001). It was not included in this study because it “used a Scandinavian definition” of autism, rather than DSM or ICD-10, which “limits the evidence for its value” (Carpenter 2012, p. 123) and relationship to prior literature on autism-like symptoms.
The reverse may also be true as research on the “Double Empathy Problem” of autism has shown that neurotypical individuals may also struggle to read the emotions of autistic participants (e.g., Milton 2012). Thus, the issue of limited insight is arguably a mutual one.
We thank an anonymous reviewer for suggesting this point.
References
Allison, C., Auyeung, B., & Baron-Cohen, S. (2012). Toward brief “Red Flags” for autism screening: The short autism spectrum quotient and the short quantitative checklist for autism in toddlers in 1,000 cases and 3,000 controls. Journal of the American Academy of Child and Adolescent Psychiatry, 51(2), 202–212. https://doi.org/10.1016/j.jaac.2011.11.003.
American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Arlington: American Psychiatric Publishing.
Austin, E. J. (2005). Personality correlates of the broader autism phenotype as assessed by the autism spectrum quotient (AQ). Personality and Individual Differences, 38, 451–460. https://doi.org/10.1016/j.paid.2004.04.022.
Baron-Cohen, S. (2002). The extreme male brain theory of autism. Trends in Cognitive Sciences, 6(6), 248–254.
Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., & Wheelwright, S. (2003). The systemizing quotient: An investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358, 361–374. https://doi.org/10.1098/rstb.2002.1206.
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, malesand females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31(1), 5–17.
Barrett, S. L., Uljarević, M., Baker, E. K., Richdale, A. L., Jones, C. R. G., & Leekam, S. R. (2015). The adult repetitive behaviours questionnaire-2 (RBQ-2A): A self-report measure of restricted and repetitive behaviours. Journal of Autism and Developmental Disorders, 45(11), 3680–3692. https://doi.org/10.1007/s10803-015-2514-6.
Berger, N. I., Manston, L., & Ingersoll, B. (2016). Establishing a scale for assessing the social validity of skill building interventions for young children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(10), 3258–3269.
Bishop, S. L., & Seltzer, M. M. (2012). Self-reported autism symptoms in adults with autism spectrum disorders. Journal of Autism and Developmental Disorder, 42, 2354–2363. https://doi.org/10.1007/s10803-012-1483-2.
Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
Carpenter, P. (2012). “Diagnosis and assessment in autism spectrum disorders”. Advances in Mental Health and Intellectual Disabilities, 6(3), 121–129. https://doi.org/10.1108/20441281211227184.
Cheung, G. W. (2008). Testing equivalence in the structure, means, and variances of higher-order constructs with structural equation modeling. Organizational Research Methods, 11(3), 593–613.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5.
Chua, R. Y. J. (2013). The costs of ambient cultural disharmony: Indirect intercultural conflicts in social environment undermine creativity. Academy of Management Journal, 56(6), 1545–1577.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957.
Cuccaro, M. L., Shao, Y., Grubber, J., Slifer, M., Wolpert, C. M., Donnelly, S. L., et al. (2003). Factor analysis of restricted and repetitive behaviors in autism using the autism diagnostic interview-R. Child Psychiatry and Human Development, 34(1), 3–17. https://doi.org/10.1023/A:1025321707947.
Deutskens, E., de Ruyter, K., Wetzels, M., & Oosterveld, P. (2004). Response rate and response quality of internet-based surveys: An experimental study. Marketing Letters, 15(1), 21–36. https://doi.org/10.1023/B:MARK.0000021968.86465.00.
Dillman, D. A. (2000). Mail and internet surveys: The tailored design method. New York: Wiley.
Frazier, T. W., & Youngstrom, E. A. (2007). Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring? Intelligence, 35, 169–182.
Gosling, S. D., & Mason, W. (2015). Internet research in psychology. Annual Review of Psychology, 66, 877–902.
Guadagnoli, E., & Velicer, W. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (1998). Multivariate data analysis (Vol. 5, 3, pp. 207–219). Upper Saddle River: Prentice Hall.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Hui, C., Lee, C., & Rousseau, D. M. (2004). Psychological contract and organizational citizenship behavior in China: Investigating generalizability and instrumentality. Journal of Applied Psychology, 89(2), 311.
Hurst, R., Mitchell, J., Kimbrel, N., Kwapil, T., & Nelson-Gray, R. (2007). Examination of the reliability and factor structure of the autism spectrum quotient (AQ) in a non-clinical sample. Personality and Individual Differences, 43(7), 1938–1949. https://doi.org/10.1016/j.paid.2007.06.012.
Jackson, S. L. J., Hart, L., Brown, J. T., & Volkmar, F. R. (2018). Brief Report: Self-Reported Academic, Social, and Mental Health Experiences of Post-Secondary Students with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 48(3), 643–650. https://doi.org/10.1007/s10803-017-3315-x.
John, O. P., & Srivastava, S. (1999). The big five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd edn., pp. 102–138). New York: Guilford.
Kline, R. B. (2010). Principles and practice of structural equation modeling. New York: The Guildford Press.
Kloosterman, P., Keefer, K., Kelley, E., Summerfeldt, L., & Parker, J. (2011). Evaluation of the factor structure of the autism-spectrum quotient. Personality and Individual Differences, 50(2), 310–314.
Kukull, W. A., & Ganguli, M. (2012). Generalizability: The trees, the forest, and the low-hanging fruit. Neurology, 78(23), 1886–1891.
Lewis, M. H., & Bodfish, J. W. (1998). Repetitive behavior disorders in autism. Mental Retardation Research Reviews, 4, 80–89.
Ling, J., Burton, T. C., Salt, J. L., & Muncer, S. J. (2009). Psychometric analysis of the systemizing quotient (SQ) scale. British Journal of Psychology, 100, 539–552. https://doi.org/10.1348/000712608X368261.
Lodi-Smith, J., Rodgers, J. D., Cunningham, S. A., Lopata, C., & Thomeer, M. L. (2018). Meta-analysis of Big Five personality traits in autism spectrum disorder. Autism, https://doi.org/10.1177/1362361318766571.
Longo, Y., Coyne, I., & Joseph, S. (2018). Development of the short version of the scales of general well-being: The 14-item SGWB. Personality and Individual Differences, 124, 31–34.
MacCallum, R., Roznowski, M., & Necowitz, L. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111(3), 490–504.
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011). Construct measurement and validation procedures in MIS and behavioral research: Integrating new and existing techniques. MIS Quarterly, 35(2), 293–334.
Manning, J. T., Baron-Cohen, S., Wheelwright, S., & Fink, B. (2010). Is digit ratio (2D:4D) related to systemizing and empathizing? Evidence from direct finger measurements reported in the BBC internet survey. Personality and Individual Differences, 48, 767–771. https://doi.org/10.1016/j.paid.2010.01.030.
Marques, M. D., Elphinstone, B., Critchley, C. R., & Eigenberger, M. E. (2017). A brief scale for measuring anti-intellectualism. Personality and Individual Differences, 114, 167–174. https://doi.org/10.1016/j.paid.2017.04.001.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.
Milton, D. E. M. (2012). On the ontological status of autism: the ‘double empathy problem’. Disability & Society, 27(6), 883–887. https://doi.org/10.1080/09687599.2012.710008.
Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015). The generalizability of survey experiments. Journal of Experimental Political Science, 2(2), 109–138.
Nunnally, J. C. (1978). Assessment of reliability. In J. C. Nunnally (Ed.), Psychometric theory (2nd edn., pp. 245–246). New York: McGraw-Hill.
Nylander, L., & Gillberg, C. (2001). Screening for autism spectrum disorders in adult psychiatric out-patients: A preliminary report. Acta Psychiatrica Scandinavica, 103, 428–434.
Odom, S. L., Cox, A., Sideris, J., Hume, K. A., Hedges, S., Kucharczyk, S. et al. (2018). Assessing quality of program environments for children and youth with autism: Autism Program Environment Rating Scale (APERS). Journal of Autism And Developmental Disorders, 48(3), 913–924.
Rodgers, J. D., Lodi-Smith, J., Hill, P. L., Spain, S. M., Lopata, C., & Thomeer, M. L. (2018). Brief report: Personality mediates the relationship between autism quotient and well-being: A conceptual replication using self-report. Journal of Autism & Developmental Disorders, 48, 307–315. https://doi.org/10.1007/s10803-017-3290-2.
Schriber, R. A., Robins, R. W., & Solomon, M. (2014). Personality and self-insight in individuals with autism spectrum disorder. Journal of Personality and Social Psychology, 106(1), 112–130.
Schwartzman, B. C., Wood, J. J., & Kapp, S. K. (2016). Journal of Autism & Developmental Disorders, 46, 253–272. https://doi.org/10.1007/s10803-015-2571-x.
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using mechanical turk to study clinical populations. Clinical Psychological Science, 1(2), 213–220.
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014). Data collection in the digital age: Innovative alternatives to student samples. MIS Quarterly, 38(2), 355–378.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th edn.). Boston: Allyn and Bacon.
van Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLoS ONE 8(9): https://doi.org/10.1371/annotation/af78b324-7b44-4f89-b932-e851fe04a8e5.
Veale, J. F., & Williams, M. N. (2015). The psychometric properties of a brief version of the systemizing quotient. European Journal of Psychological Assessment, 33(3), 173–180. https://doi.org/10.1027/1015-5759/a000283.
Velicer, W. F., & Fava, J. L. (1998). Effects of variable and subject sampling on factor pattern recovery. Psychological Methods, 3, 231–251.
Wakabayashi, A., Baron-Cohen, S., & Wheelwright, S. (2006). Are autistic traits an independent personality dimension? A study of the autism-spectrum quotient (AQ) and the NEO-PI-R. Personality and Individual Differences, 41, 873–883. https://doi.org/10.1016/j.paid.2006.04.003.
Author information
Authors and Affiliations
Contributions
All authors contributed to the design, analysis, and writing of the paper.
Corresponding author
Ethics declarations
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the research.
Conflict of interest
None.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Dr. Ronnie Jia is an Associate Professor at Illinois State University, Normal, Illinois, USA.
Dr. Zachary R. Steelman is an Assistant Professor at University of Arkansas, Fayetteville, Arkansas, USA.
Dr. Heather H. Jia is an Associate Professor at Illinois State University, Normal, Illinois, USA.
Appendix: Final Scales
Appendix: Final Scales
All items are measured on Likert-like scales of 1–7 from “Strongly Disagree” to “Strongly Agree.”
All item numbers are from the original measurement instruments.
-
AQ-9 (Adapted from Baron-Cohen et al. 2001).
-
Attention to detail
-
6.
I usually notice car number plates or similar strings of information
-
12.
I tend to notice details that others do not
-
19.
I am fascinated by numbers
-
23.
I notice patterns in things all the time
-
6.
-
Social Communication.
-
15R.
I find myself drawn more strongly to people than to things.
-
17R.
I enjoy social chit-chat.
-
22.
I find it hard to make new friends.
-
44R.
I enjoy social occasions.
-
47R.
I enjoy meeting new people.
-
15R.
-
-
RBQ-2A-R (Adapted from Barrett et al. 2015).
-
Repetitive motor behavior
-
2.
Do you repetitively fiddle with items?
-
4.
Do you rock backwards and forwards, or side to side, either when sitting or when standing?
-
5.
Do you pace or move around repetitively?
-
6.
Do you make repetitive hand and/or finger movements?
-
2.
-
Insistence on sameness
-
3.
Do you insist on things at home remaining the same?
-
4.
Do you get upset about minor changes to objects?
-
5.
Do you insist that aspects of daily routine must remain the same?
-
6.
Do you insist on doing things in a certain way or re-doing things until they are ‘‘just right’’?
-
8.
Do you insist on eating the same foods, or a very small range of foods, at every meal?
-
3.
-
-
SQ-7 (Adapted from Baron-Cohen et al. 2003).
-
Technicity
-
5.
If I were buying a car I would want to obtain specific information about its engine capacity.
-
20.
If I were buying a computer I would want to know exact details about its hard drive capacity and processor speed.
-
33.
If I were buying a stereo, I would want to know about its precise technical features.
-
43.
If I were buying a camera I would look carefully at the quality of the lens.
-
5.
-
Structure
-
13.
I am fascinated by how machines work.
-
37.
When I look at a building I am curious about the precise way it was constructed.
-
49.
I can easily visualize how the motorways in my region link up.
-
13.
-
Rights and permissions
About this article
Cite this article
Jia, R., Steelman, Z.R. & Jia, H.H. Psychometric Assessments of Three Self-Report Autism Scales (AQ, RBQ-2A, and SQ) for General Adult Populations. J Autism Dev Disord 49, 1949–1965 (2019). https://doi.org/10.1007/s10803-019-03880-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-019-03880-x