Matching Strategies in Cognitive Research with Individuals with High-Functioning Autism: Current Practices, Instrument Biases, and Recommendations

Abstract

A meta-analysis was performed on the 133 cognitive and behavioral papers in autism using comparison groups in the 1999–2002 period. High-functioning (average IQ: 84.7), adolescents (average, 14.4 years) are largely dominant. IQ is the most frequent matching variable in use (51.2%). The instruments that are most frequently used to determine IQ or general level are Wechsler scales (46.9%), British Picture Vocabulary Scale (BPVS; 22.3%), and Raven Progressive Matrices (RPM; 16.9%). In order to determine if these instruments were equivalent when applied to individuals with pervasive developmental disorders (PDDs), Wechsler IQ, EVIP (a French Canadian translation of the BPVS), and RPM were given to a group of 14 individuals with autism and 12 with Asperger syndrome. Comparison of Wechsler and RPM IQs values, expressed as percentiles, to percentile values of EVIP score revealed that EVIP (and to a lesser extent RPM) considerably overestimates the level of all PDD participants as compared to Wechsler Verbal IQ (VIQ), Performance IQ (PIQ), or Full-Scale IQ (FSIQ), whereas these instruments are reported to be strongly correlated in typically developing individuals. This study reveals that identification of objects from a verbal label—the BPVS–PPVT–EVIP task—is a peak of ability in high functioning individuals with PDDs. This peak of ability, even superior to that of block design, has a detrimental effect on matching based on this instrument. A recommendation to replace BPVS/PPVT/EVIP or RPM by Wechsler scale as a basis of IQ/level matching is provided. Accordingly, the former instruments are a potential source of type-1 (for cognitive deficits) or type-2 (for cognitive hyperfunctioning) errors.

This is a preview of subscription content, access via your institution.

Reference

  1. Burack, J. A., Iarocci, G., Bowler, D., & Mottron, L. (2002). Benefits and pitfalls in the merging of disciplines: The example of developmental psychopathology and the study of persons with autism. Development and Psychopathology, 14, 225-237.

    Google Scholar 

  2. Burke, H. R. (1985). Raven's Progressive Matrices: More on norms, reliability and validity. Journal of Clinical Psychology, 41, 231-235.

    Google Scholar 

  3. Datafinder 3.5. Digimed Systems, Montréal, Canada 〈info@digimedsystems.com〉.

  4. Dunn, L. M., & Dunn, E. S. (1981). Peabody Picture Vocabulary Test-Revised. Circle Pines, MN: American Guidance Services.

    Google Scholar 

  5. Dunn, L. M., Dunn, L. M., Whetton, C., & Pintilie, D. (1982). British Picture Vocabulary Scale. Windsor: NFER-NELSON.

    Google Scholar 

  6. Dunn, L. M., Thériault-Whalen, C. M., & Dunn, L. M. (1993). Échelle de vocabulaire en image Peabody. Toronto, Ontario: Psycan.

    Google Scholar 

  7. Hermelin, B., & O'Connor, N. (1970). Psychological experiments with autistic children. Oxford: Pergamon Press.

    Google Scholar 

  8. Jensen, A. R., Saccuzzo, D. P., & Larsen, G. E. (1988). Equating the standard and advanced forms of the Raven Progressive Matrices. Educational and Psychological Measurement, 48, 1091-1095.

    Google Scholar 

  9. Mangiaracina, J., & Simon, M. J. (1986). Comparison of the PPVT-R and WAIS-R in state hospital psychiatric patients. Journal of Clinical Psychology, 42, 817-820.

    Google Scholar 

  10. Miller, J. N., & Ozonoff, S. (2000). The external validity of Asperger disorder: Lack of evidence from the domain of neuropsychology. Journal of Abnormal Psychology, 109, 227-238.

    Google Scholar 

  11. Minshew, N. J., Sweeney, J., & Luna, B. (2002). Autism as a selective disorder of complex information processing and underdevelopment of neocortical systems. Molecular Psychiatry, 7, S14-15.

    Google Scholar 

  12. Mottron, L., Burack, J. A., Stauder, J. E., & Robaey, P. (1999). Perceptual processing among high-functioning persons with autism. Journal of Child Psychology and Psychiatry, 40, 203-211.

    Google Scholar 

  13. Mottron, L., & Burack, J. (2001). Enhanced perceptual functioning in the development of autism. In J. A. Burack, T. Charman, N. Yirmiya, & P. R. Zelazo (Eds.), The development of autism: Perspectives from theory and research (pp. 131-148). Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  14. O'Leary, U. M., Rusch, K. M., & Guastello, S. J. (1991). Estimating age-stratified WAIS-R IQs from scores on the Raven's Standard Progressive Matrices. Journal of Clinical Psychology, 47, 277-284.

    Google Scholar 

  15. Ozonoff, S., Pennington, B. F., & Rogers, S. J. (1991). Executive function deficits in high-functioning autistic individuals: Relationship to theory of mind. Journal of Child Psychology and Psychiatry, 32, 1081-1105.

    Google Scholar 

  16. Price, D. R., Herbert, D. A., Walsh, M. L., & Law, J. G. (1990). Study of WAIS-R, Quick Test and PPVT IQs for neuropsychiatric patients. Perceptual and Motor Skills, 70, 1320-1322.

    Google Scholar 

  17. Raven, J. C. (1938, 1996). Progressive Matrices: A perceptual test of intelligence. Individual form. Oxford: Oxford Psychologists Press Ltd.

    Google Scholar 

  18. Raven, J. C. (1947, 1995). Colored Progressive Matrices Sets I and II. Oxford: Oxford Psychologists Press Ltd.

    Google Scholar 

  19. Snitz, B. E., Bieliauskas, L. A., Crossland, A., Basso, M. R., & Roper, B. (2000). PPVT-R as an estimate of premorbid intelligence in older adults. The Clinical Neuropsychologist, 14, 181-186.

    Google Scholar 

  20. Wechsler, D. (1974). Wechsler Intelligence Scale for Children-Revised. New York: The Psychological Corporation.

    Google Scholar 

  21. Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised. New York: The Psychological Corporation.

    Google Scholar 

  22. Yirmiya, N., Erel, O., Shaked, M., & Solomonica-Levi, D. (1998). Meta-analyses comparing theory of mind abilities of individuals with autism, individuals with mental retardation, and normally developing individuals. Psychological Bulletin, 124, 283-307.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Mottron, L. Matching Strategies in Cognitive Research with Individuals with High-Functioning Autism: Current Practices, Instrument Biases, and Recommendations. J Autism Dev Disord 34, 19–27 (2004). https://doi.org/10.1023/B:JADD.0000018070.88380.83

Download citation

  • British Picture Vocabulary Scale
  • high-functioning autism
  • IQ
  • matching strategy
  • methodology
  • peaks of ability
  • Raven Progressive Matrices
  • Wechsler Intelligence Scale