Skip to main content

Psychometric Assessments of Three Self-Report Autism Scales (AQ, RBQ-2A, and SQ) for General Adult Populations

Abstract

This study assesses the psychometric properties of three self-report measures of autistic-like tendencies in the general adult population: autistic spectrum quotient (AQ), adult repetitive behaviours questionnaire-2 (RBQ-2A), and systemizing quotient (SQ). Three rounds of development and testing using different U.S. and global samples led to three instruments that are psychometrically sound, parsimonious, and generalizable across populations. The resulting AQ-9, consisting of two factors: social communication and attention to detail, now mirrors the current dual diagnostic criteria in the DSM-5. The RBQ-2A-R has now been refined through CFA for the first time. The new SQ-7 scale also has updated content. All three refined scales demonstrate satisfactory psychometric validity and parsimony and now provide evidence of their appropriateness for empirical research.

This is a preview of subscription content, access via your institution.

Notes

  1. 1.

    There exists another adult, self-report scale, the Autism Spectrum Disorder in Adults Screening Questionnaire (ASDASQ; Nylander and Gillberg 2001). It was not included in this study because it “used a Scandinavian definition” of autism, rather than DSM or ICD-10, which “limits the evidence for its value” (Carpenter 2012, p. 123) and relationship to prior literature on autism-like symptoms.

  2. 2.

    The reverse may also be true as research on the “Double Empathy Problem” of autism has shown that neurotypical individuals may also struggle to read the emotions of autistic participants (e.g., Milton 2012). Thus, the issue of limited insight is arguably a mutual one.

  3. 3.

    We thank an anonymous reviewer for suggesting this point.

References

  1. Allison, C., Auyeung, B., & Baron-Cohen, S. (2012). Toward brief “Red Flags” for autism screening: The short autism spectrum quotient and the short quantitative checklist for autism in toddlers in 1,000 cases and 3,000 controls. Journal of the American Academy of Child and Adolescent Psychiatry, 51(2), 202–212. https://doi.org/10.1016/j.jaac.2011.11.003.

    Article  PubMed  Google Scholar 

  2. American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Arlington: American Psychiatric Publishing.

  3. Austin, E. J. (2005). Personality correlates of the broader autism phenotype as assessed by the autism spectrum quotient (AQ). Personality and Individual Differences, 38, 451–460. https://doi.org/10.1016/j.paid.2004.04.022.

    Article  Google Scholar 

  4. Baron-Cohen, S. (2002). The extreme male brain theory of autism. Trends in Cognitive Sciences, 6(6), 248–254.

    Article  Google Scholar 

  5. Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., & Wheelwright, S. (2003). The systemizing quotient: An investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358, 361–374. https://doi.org/10.1098/rstb.2002.1206.

    Article  PubMed  Google Scholar 

  6. Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, malesand females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31(1), 5–17.

    Article  Google Scholar 

  7. Barrett, S. L., Uljarević, M., Baker, E. K., Richdale, A. L., Jones, C. R. G., & Leekam, S. R. (2015). The adult repetitive behaviours questionnaire-2 (RBQ-2A): A self-report measure of restricted and repetitive behaviours. Journal of Autism and Developmental Disorders, 45(11), 3680–3692. https://doi.org/10.1007/s10803-015-2514-6.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Berger, N. I., Manston, L., & Ingersoll, B. (2016). Establishing a scale for assessing the social validity of skill building interventions for young children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(10), 3258–3269.

    Article  Google Scholar 

  9. Bishop, S. L., & Seltzer, M. M. (2012). Self-reported autism symptoms in adults with autism spectrum disorders. Journal of Autism and Developmental Disorder, 42, 2354–2363. https://doi.org/10.1007/s10803-012-1483-2.

    Article  Google Scholar 

  10. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

    Book  Google Scholar 

  11. Carpenter, P. (2012). “Diagnosis and assessment in autism spectrum disorders”. Advances in Mental Health and Intellectual Disabilities, 6(3), 121–129. https://doi.org/10.1108/20441281211227184.

    Article  Google Scholar 

  12. Cheung, G. W. (2008). Testing equivalence in the structure, means, and variances of higher-order constructs with structural equation modeling. Organizational Research Methods, 11(3), 593–613.

    Article  Google Scholar 

  13. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5.

    Article  Google Scholar 

  14. Chua, R. Y. J. (2013). The costs of ambient cultural disharmony: Indirect intercultural conflicts in social environment undermine creativity. Academy of Management Journal, 56(6), 1545–1577.

    Article  Google Scholar 

  15. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957.

    Article  Google Scholar 

  16. Cuccaro, M. L., Shao, Y., Grubber, J., Slifer, M., Wolpert, C. M., Donnelly, S. L., et al. (2003). Factor analysis of restricted and repetitive behaviors in autism using the autism diagnostic interview-R. Child Psychiatry and Human Development, 34(1), 3–17. https://doi.org/10.1023/A:1025321707947.

    Article  PubMed  Google Scholar 

  17. Deutskens, E., de Ruyter, K., Wetzels, M., & Oosterveld, P. (2004). Response rate and response quality of internet-based surveys: An experimental study. Marketing Letters, 15(1), 21–36. https://doi.org/10.1023/B:MARK.0000021968.86465.00.

    Article  Google Scholar 

  18. Dillman, D. A. (2000). Mail and internet surveys: The tailored design method. New York: Wiley.

    Google Scholar 

  19. Frazier, T. W., & Youngstrom, E. A. (2007). Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring? Intelligence, 35, 169–182.

    Article  Google Scholar 

  20. Gosling, S. D., & Mason, W. (2015). Internet research in psychology. Annual Review of Psychology, 66, 877–902.

    Article  Google Scholar 

  21. Guadagnoli, E., & Velicer, W. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.

    Article  Google Scholar 

  22. Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (1998). Multivariate data analysis (Vol. 5, 3, pp. 207–219). Upper Saddle River: Prentice Hall.

    Google Scholar 

  23. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  24. Hui, C., Lee, C., & Rousseau, D. M. (2004). Psychological contract and organizational citizenship behavior in China: Investigating generalizability and instrumentality. Journal of Applied Psychology, 89(2), 311.

    Article  Google Scholar 

  25. Hurst, R., Mitchell, J., Kimbrel, N., Kwapil, T., & Nelson-Gray, R. (2007). Examination of the reliability and factor structure of the autism spectrum quotient (AQ) in a non-clinical sample. Personality and Individual Differences, 43(7), 1938–1949. https://doi.org/10.1016/j.paid.2007.06.012.

    Article  Google Scholar 

  26. Jackson, S. L. J., Hart, L., Brown, J. T., & Volkmar, F. R. (2018). Brief Report: Self-Reported Academic, Social, and Mental Health Experiences of Post-Secondary Students with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 48(3), 643–650. https://doi.org/10.1007/s10803-017-3315-x.

  27. John, O. P., & Srivastava, S. (1999). The big five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd edn., pp. 102–138). New York: Guilford.

    Google Scholar 

  28. Kline, R. B. (2010). Principles and practice of structural equation modeling. New York: The Guildford Press.

    Google Scholar 

  29. Kloosterman, P., Keefer, K., Kelley, E., Summerfeldt, L., & Parker, J. (2011). Evaluation of the factor structure of the autism-spectrum quotient. Personality and Individual Differences, 50(2), 310–314.

    Article  Google Scholar 

  30. Kukull, W. A., & Ganguli, M. (2012). Generalizability: The trees, the forest, and the low-hanging fruit. Neurology, 78(23), 1886–1891.

    Article  Google Scholar 

  31. Lewis, M. H., & Bodfish, J. W. (1998). Repetitive behavior disorders in autism. Mental Retardation Research Reviews, 4, 80–89.

    Google Scholar 

  32. Ling, J., Burton, T. C., Salt, J. L., & Muncer, S. J. (2009). Psychometric analysis of the systemizing quotient (SQ) scale. British Journal of Psychology, 100, 539–552. https://doi.org/10.1348/000712608X368261.

    Article  PubMed  Google Scholar 

  33. Lodi-Smith, J., Rodgers, J. D., Cunningham, S. A., Lopata, C., & Thomeer, M. L. (2018). Meta-analysis of Big Five personality traits in autism spectrum disorder. Autism, https://doi.org/10.1177/1362361318766571.

    Article  PubMed  Google Scholar 

  34. Longo, Y., Coyne, I., & Joseph, S. (2018). Development of the short version of the scales of general well-being: The 14-item SGWB. Personality and Individual Differences, 124, 31–34.

    Article  Google Scholar 

  35. MacCallum, R., Roznowski, M., & Necowitz, L. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111(3), 490–504.

    Article  Google Scholar 

  36. MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011). Construct measurement and validation procedures in MIS and behavioral research: Integrating new and existing techniques. MIS Quarterly, 35(2), 293–334.

    Article  Google Scholar 

  37. Manning, J. T., Baron-Cohen, S., Wheelwright, S., & Fink, B. (2010). Is digit ratio (2D:4D) related to systemizing and empathizing? Evidence from direct finger measurements reported in the BBC internet survey. Personality and Individual Differences, 48, 767–771. https://doi.org/10.1016/j.paid.2010.01.030.

    Article  Google Scholar 

  38. Marques, M. D., Elphinstone, B., Critchley, C. R., & Eigenberger, M. E. (2017). A brief scale for measuring anti-intellectualism. Personality and Individual Differences, 114, 167–174. https://doi.org/10.1016/j.paid.2017.04.001.

    Article  Google Scholar 

  39. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.

    Article  Google Scholar 

  40. Milton, D. E. M. (2012). On the ontological status of autism: the ‘double empathy problem’. Disability & Society, 27(6), 883–887. https://doi.org/10.1080/09687599.2012.710008.

    Article  Google Scholar 

  41. Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015). The generalizability of survey experiments. Journal of Experimental Political Science, 2(2), 109–138.

    Article  Google Scholar 

  42. Nunnally, J. C. (1978). Assessment of reliability. In J. C. Nunnally (Ed.), Psychometric theory (2nd edn., pp. 245–246). New York: McGraw-Hill.

    Google Scholar 

  43. Nylander, L., & Gillberg, C. (2001). Screening for autism spectrum disorders in adult psychiatric out-patients: A preliminary report. Acta Psychiatrica Scandinavica, 103, 428–434.

    Article  Google Scholar 

  44. Odom, S. L., Cox, A., Sideris, J., Hume, K. A., Hedges, S., Kucharczyk, S. et al. (2018). Assessing quality of program environments for children and youth with autism: Autism Program Environment Rating Scale (APERS). Journal of Autism And Developmental Disorders, 48(3), 913–924.

    Article  Google Scholar 

  45. Rodgers, J. D., Lodi-Smith, J., Hill, P. L., Spain, S. M., Lopata, C., & Thomeer, M. L. (2018). Brief report: Personality mediates the relationship between autism quotient and well-being: A conceptual replication using self-report. Journal of Autism & Developmental Disorders, 48, 307–315. https://doi.org/10.1007/s10803-017-3290-2.

    Article  Google Scholar 

  46. Schriber, R. A., Robins, R. W., & Solomon, M. (2014). Personality and self-insight in individuals with autism spectrum disorder. Journal of Personality and Social Psychology, 106(1), 112–130.

    Article  Google Scholar 

  47. Schwartzman, B. C., Wood, J. J., & Kapp, S. K. (2016). Journal of Autism & Developmental Disorders, 46, 253–272. https://doi.org/10.1007/s10803-015-2571-x.

    Article  Google Scholar 

  48. Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using mechanical turk to study clinical populations. Clinical Psychological Science, 1(2), 213–220.

    Article  Google Scholar 

  49. Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014). Data collection in the digital age: Innovative alternatives to student samples. MIS Quarterly, 38(2), 355–378.

    Article  Google Scholar 

  50. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th edn.). Boston: Allyn and Bacon.

    Google Scholar 

  51. van Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLoS ONE 8(9): https://doi.org/10.1371/annotation/af78b324-7b44-4f89-b932-e851fe04a8e5.

  52. Veale, J. F., & Williams, M. N. (2015). The psychometric properties of a brief version of the systemizing quotient. European Journal of Psychological Assessment, 33(3), 173–180. https://doi.org/10.1027/1015-5759/a000283.

    Article  Google Scholar 

  53. Velicer, W. F., & Fava, J. L. (1998). Effects of variable and subject sampling on factor pattern recovery. Psychological Methods, 3, 231–251.

    Article  Google Scholar 

  54. Wakabayashi, A., Baron-Cohen, S., & Wheelwright, S. (2006). Are autistic traits an independent personality dimension? A study of the autism-spectrum quotient (AQ) and the NEO-PI-R. Personality and Individual Differences, 41, 873–883. https://doi.org/10.1016/j.paid.2006.04.003.

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Contributions

All authors contributed to the design, analysis, and writing of the paper.

Corresponding author

Correspondence to Ronnie Jia.

Ethics declarations

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the research.

Conflict of interest

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Dr. Ronnie Jia is an Associate Professor at Illinois State University, Normal, Illinois, USA.

Dr. Zachary R. Steelman is an Assistant Professor at University of Arkansas, Fayetteville, Arkansas, USA.

Dr. Heather H. Jia is an Associate Professor at Illinois State University, Normal, Illinois, USA.

Appendix: Final Scales

Appendix: Final Scales

All items are measured on Likert-like scales of 1–7 from “Strongly Disagree” to “Strongly Agree.”

All item numbers are from the original measurement instruments.

  • AQ-9 (Adapted from Baron-Cohen et al. 2001).

    • Attention to detail

      1. 6.

        I usually notice car number plates or similar strings of information

      2. 12.

        I tend to notice details that others do not

      3. 19.

        I am fascinated by numbers

      4. 23.

        I notice patterns in things all the time

    • Social Communication.

      1. 15R.

        I find myself drawn more strongly to people than to things.

      2. 17R.

        I enjoy social chit-chat.

      3. 22.

        I find it hard to make new friends.

      4. 44R.

        I enjoy social occasions.

      5. 47R.

        I enjoy meeting new people.

  • RBQ-2A-R (Adapted from Barrett et al. 2015).

    • Repetitive motor behavior

      1. 2.

        Do you repetitively fiddle with items?

      2. 4.

        Do you rock backwards and forwards, or side to side, either when sitting or when standing?

      3. 5.

        Do you pace or move around repetitively?

      4. 6.

        Do you make repetitive hand and/or finger movements?

    • Insistence on sameness

      1. 3.

        Do you insist on things at home remaining the same?

      2. 4.

        Do you get upset about minor changes to objects?

      3. 5.

        Do you insist that aspects of daily routine must remain the same?

      4. 6.

        Do you insist on doing things in a certain way or re-doing things until they are ‘‘just right’’?

      5. 8.

        Do you insist on eating the same foods, or a very small range of foods, at every meal?

  • SQ-7 (Adapted from Baron-Cohen et al. 2003).

    • Technicity

      1. 5.

        If I were buying a car I would want to obtain specific information about its engine capacity.

      2. 20.

        If I were buying a computer I would want to know exact details about its hard drive capacity and processor speed.

      3. 33.

        If I were buying a stereo, I would want to know about its precise technical features.

      4. 43.

        If I were buying a camera I would look carefully at the quality of the lens.

    • Structure

      1. 13.

        I am fascinated by how machines work.

      2. 37.

        When I look at a building I am curious about the precise way it was constructed.

      3. 49.

        I can easily visualize how the motorways in my region link up.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jia, R., Steelman, Z.R. & Jia, H.H. Psychometric Assessments of Three Self-Report Autism Scales (AQ, RBQ-2A, and SQ) for General Adult Populations. J Autism Dev Disord 49, 1949–1965 (2019). https://doi.org/10.1007/s10803-019-03880-x

Download citation

Keywords

  • Autism
  • AQ
  • RBQ-2A
  • SQ
  • Mechanical Turk
  • Factorial validity