Abstract
Designing effective treatments for improving early social behaviors in autism has been identified as a critical research need. One barrier to drawing conclusions about optimal treatments for children with autism is the use of highly varied dependent measures in the treatment literature. Contributing to this is the absence of “gold standard” assessment batteries. This is particularly true for assessing changes in social interaction impairments in very young children with autism. This paper addresses this issue by reviewing variables important in the development and evaluation of assessment measures, discussing previous studies’ choices of socially-related dependent measures, and the strengths, limitations, and research questions pertaining to them. It concludes with recommendations for measurement selection and future directions for research.
Similar content being viewed by others
References
Achenbach, T. M. (2005). Advancing assessment of children and adolescents: Commentary on evidence-based assessment of child and adolescent disorders. Journal of Clinical Child and Adolescent Psychology, 34, 451–547.
Akshoomoff, N., Stahmer, A. C., Corsello, C., & Mahrer, N. E. (2010). What happens next? Follow-up from the children’s toddler school program. Journal of Positive Behavior Interventions, 12, 245–253.
Aldred, C., Green, J., & Adams, C. (2004). A new social communication intervention for children with autism: Pilot randomized controlled treatment study suggesting effectiveness. Journal of Child Psychology and Psychiatry, 45, 1420–1430.
Aman, M. G., Novotny, S., Samango-Sprouse, C., Lecavalier, L., Leonard, E., Gadow, K. D., et al. (2004). Outcome measures for clinical drug trials in autism. CNS Spectrums, 9, 36–47.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (DSM-IV-TR). Washington DC: American Psychiatric Association.
American Psychiatric Association. (2010). Proposed revision: Autistic disorder. Retrieved February 24, 2010 from http://www.dsm5.org/ProposedRevisions/Pages/proposedrevision.aspx?rid=94.
Bellini, S., & Hopf, A. (2007). The development of the autism social skills profile: A preliminary analysis of psychometric properties. Focus on Autism and Other Developmental Disabilities, 22, 80–87.
Bibby, P., Eikeseth, S., Martin, N. T., Mudford, O. C., & Reeves, D. (2001). Progress and outcomes for children with autism receiving parent-managed intensive interventions. Research in Developmental Disabilities, 22, 425–447.
Bodfish, J. W. (2004). Treating the core features of autism: Are we there yet? Mental Retardation and Developmental Disabilities Research Reviews, 10, 318–326.
Carter, A. S., Volkmar, F. R., Sparrow, S. S., Wang, J., Lord, C., Dawson, G., et al. (1998). The Vineland Adaptive Behavior Scales: Supplementary norms for individuals with autism. Journal of Autism and Developmental Disorders, 28, 287–302.
Charman, T., Howlin, P., Aldred, C., Baird, G., Degli Espinosa, F., Diggle, T., et al. (2003). Research into early intervention for children with autism and related disorders: Methodological and design issues. Autism, 7, 217–225.
Charman, T., Howlin, P., Berry, B., & Prince, E. (2004). Measuring developmental progress of children with autism spectrum disorder on school entry using parent report. Autism, 8, 89–100.
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.
Constantino, J. N. (2002). The Social Responsiveness Scale. Los Angeles: Western Psychological Services.
Constantino, J. N., Abbacchi, A. M., Lavesser, P. D., Reed, H., Givens, L., Chiang, L., et al. (2009). Developmental course of autistic social impairment in males. Development and Psychopathology, 21, 127–138.
Constantino, J. N., Davis, S. A., Todd, R. D., Schindler, M. K., Gross, M. M., Brophy, S. L., et al. (2003). Validation of a brief quantitative measure of autistic traits: Comparison of the Social Responsiveness Scale with the autism diagnostic interview-revised. Journal of Autism and Developmental Disorders, 33, 427–433.
Constantino, J. N., Gruber, C. P., Davis, S., Hayes, S., Passanante, N., & Prsybeck, T. (2004). The factor structure of autistic traits. Journal of Child Psychology and Psychiatry, 45, 719–726.
Constantino, J. N., LaVesser, P. D., Zhang, Y., Abbacchi, A. M., Gray, T., & Todd, R. D. (2007). Rapid quantitative assessment of autistic social impairment by classroom teachers. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1668–1676.
Constantino, J. N., Przybeck, T., Frisen, D., & Todd, R. D. (2000). Reciprocal social behavior in children with and without pervasive developmental disorders. Journal of Developmental and Behavioral Pediatrics, 21, 2–11.
Constantino, J. N., & Todd, R. D. (2005). Intergenterational transmission of subthreshold autistic traits in the general population. Biological Psychiatry, 57, 655–660.
Corsello, C. (2005). Early intervention in autism. Infants & Young Children, 18, 74–85.
Cox, A., Klein, K., Charman, T., Baird, G., Baron-Cohen, S., Sweetenham, J., et al. (1999). Autism spectrum disorders at 20 and 42 months of age: Stability of clinical and ADI-R diagnosis. Journal of Child Psychology and Psychiatry, 40, 719–732.
Dawson, G. (2008). Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorders. Development and Psychopathology, 20, 775–803.
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., et al. (2009). Randomized, controlled trial of an intervention for toddlers with autism: The early start Denver model. Pediatrics, 125, e17–e23.
Department of Health and Human Services. (1999). Mental health: A report of the surgeon general. Rockville, MD: Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institute of Mental Health.
Doll, B., & Elliott, S. N. (1994). Representativeness of observed preschool social behaviors: How many data are enough? Journal of Early Intervention, 18, 227–238.
Frazier, T. W., Youngstroms, E. A., Kubu, C. S., Sinclair, L., & Rezai, A. (2008). Exploratory and confirmatory factor analysis of the autism diagnostic interview-revised. Journal of Autism and Developmental Disorders, 38, 474–480.
Georgiades, S., Szatmari, P., Zwaigenbaum, L., Duku, E., Bryson, S., Roberts, W., et al. (2007). Structure of the autism symptom phenotype: A proposed multidimensional model. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 188–196.
Gotham, K., Pickles, A., & Lord, C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 693–705.
Gotham, K., Risi, S., Dawson, G., Tager-Flusberg, S., McMahon, W., Rodier, P., et al. (2008). A replication of the autism diagnostic observation schedule (ADOS) revised algorithms. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 642–651.
Gotham, K., Risi, S., Pickles, A., & Lord, C. (2007). The autism diagnostic observation schedule: Revised algorithms for improved diagnostic reliability. Journal of Autism and Developmental Disorders, 37, 613–627.
Gresham, F. M., Sugai, G., & Horner, R. H. (2001). Interpreting outcomes of social skills training for students with high-incidence disabilities. Exceptional Children, 67, 331–344.
Gutstein, S. E., Burgess, A. F., & Montfort, K. (2007). Evaluation of the relationship development intervention program. Autism, 11, 397–411.
Horner, R. H., Carr, E. G., James, H., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–180.
Hunsley, J., & Mash, E. J. (2008). Developing criteria for evidence-based assessment: An introduction to assessments that work. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 3–14). Oxford: Oxford University Press.
Interagency Autism Coordinating Committee. (2006). Evaluating progress on the IACC autism research matrix. Retrieved December 1, 2008 from http://www.nimh.nih.gov/research-funding/scientific-meetings/recurring-meetings/iacc/reports/evaluating-progress-on-the-iacc-autism-research-matrix.pdf.
Jahr, E., Eikeseth, S., Eldevik, S., & Aase, H. (2007). Frequency and latency of social interaction in an inclusive kindergarten setting: A comparison between typical children and children with autism. Autism, 11, 349–363.
Kasari, C. (2002). Assessing change in early intervention programs for children with autism. Journal of Autism and Developmental Disorders, 32, 447–461.
Kasari, C., Freeman, S., & Paparella, T. (2006). Joint attention and symbolic play in young children with autism: A randomized controlled intervention study. Journal of Child Psychology and Psychiatry, 47, 611–620.
Kasari, C., Freeman, S., Paparella, T., Wong, C., Kwon, S., & Gulsrud, A. (2005). Early intervention on core deficits in autism. Clinical Neuropsychiatry, 2, 380–388.
Kazdin, A. E. (2005). Evidence-based assessment for children and adolescents: Issues in measurement developmental and clinical application. Journal of Clinical Child and Adolescent Psychology, 34, 548–558.
Kazdin, A. E. (2006). Arbitrary metrics: Implications for identifying evidence-based treatments. American Psychologist, 61, 42–49.
Koegel, R. L., Dyer, K., & Bell, L. K. (1987). The influence of child-preferred activities on autistic children’s social behavior. Journal of Applied Behavior Analysis, 20, 243–252.
Koegel, L. K., Koegel, R. L., Frea, W. D., & Fredeen, R. M. (2001). Identifying early intervention targets for children with autism in inclusive school settings. Behavior Modification, 25, 745–761.
Landa, R. J. (2005). Assessment of social communication skills in preschoolers. Mental Retardation and Developmental Disabilities Research Reviews, 11, 247–252.
Lecavalier, L., Aman, M. G., Scahill, L., McDougle, C. J., McCracken, J. T., Vitiello, B., et al. (2006). Validity of the autism diagnostic interview-revised. American Journal on Mental Retardation, 111, 199–215.
Lord, C. (1995). Follow-up of two-year-olds referred for possible autism. Journal of Child Psychology and Psychiatry, 36, 1365–1382.
Lord, C. (2009). ADOS FAQS. Retrieved January 7, 2009 from http://portal.wpspublish.com/portal/page?_pageid=53,84992&_dad=portal&_schema=PORTAL.
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.
Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (1999). Autism diagnostic observation schedule. Los Angeles, CA: Western Psychological Services.
Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24, 659–685.
Lord, C., Wagner, A., Rogers, S., Szatmari, P., Aman, M., Charman, T., et al. (2005). Challenges in evaluating psychosocial interventions for autistic spectrum disorders. Journal of Autism and Developmental Disorders, 35, 695–708.
Mash, E. J., & Hunsley, J. (2008). Commentary: Evidence-based assessment—Strength in numbers. Journal of Pediatric Psychology, 33, 981–982.
Matson, J. L. (2007). Determining treatment outcome in early intervention programs for autism spectrum disorders: A critical analysis of measurement issues in learning based interventions. Research in Developmental Disabilities, 28, 207–217.
Matson, J. L., Matson, M. L., & Rivet, T. T. (2007). Social-skills treatments for children with autism spectrum disorders. Behavior Modification, 31, 682–707.
Matson, J. L., & Wilkins, J. (2007). A critical review of assessment targets and methods for social skills excesses and deficits for children with autism spectrum disorders. Research in Autism Spectrum Disorders, 1, 28–37.
Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis for single-case time series: Effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341–351.
McConachie, H. (2002). Appropriate research design in evaluating interventions for children with disabilities. Child: Care, Health and Development, 28, 195–197.
McConachie, H., Randle, V., Hammal, D., & Le Couteur, A. (2005). A controlled trial of a training course for parents of children with suspected autism spectrum disorder. The Journal of Pediatrics, 147, 334–340.
McConnell, S. R. (2002). Interventions that facilitate social interaction for young children with autism: Review of available research and recommendations for education intervention and future research. Journal of Autism and Developmental Disorders, 32, 351–372.
McEvoy, M. A., & Odom, S. L. (1987). Social interaction training for preschool children with behavioral disorders. Behavioral Disorders, 12, 242–251.
McGee, G. G., Feldman, R. S., & Morrier, M. J. (1997). Benchmarks of social treatment for children with autism. Journal of Autism and Developmental Disorders, 27, 353–364.
McGovern, C. W., & Sigman, M. (2005). Continuity and change from early childhood to adolescence in autism. Journal of Child Psychology and Psychiatry, 46, 401–408.
Merrell, K. W. (2001). Assessment of children’s social skills: Recent developments, best practices, and new directions. Exceptionality, 9, 3–18.
Mundy, P., Delgado, C., Block, J., Venezia, M., Hogan, A., & Siebert, J. (2003). A manual for the abridged Early Social Communication Scales (ESCS). Coral Gables, FL: University of Miami.
Mundy, P., Kasari, C., Sigman, M., & Ruskin, E. (1995). Nonverbal communication and language development in children with Down syndrome and children with normal development. Journal of Speech and Hearing Research, 38, 1–11.
Mundy, P., Sigman, M., & Kasari, C. (1994). Joint attention, developmental level, and symptom presentation in young children with autism. Development and Psychopathology, 6, 389–401.
Mundy, P., Sigman, M., Kasari, C., & Yirmiya, N. (1988). Nonverbal communication skills in Down syndrome children. Child Development, 59, 235–249.
National Research Council. (2001). Educating children with autism. Washington, DC: National Academy Press.
Ozonoff, S., Goodlin, B. L., & Solomon, M. (2005). Evidence-based assessment of autism spectrum disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 523–540.
Pierce-Jordan, S., & Lifter, K. (2005). Interaction of social and play behaviors in preschoolers with and without pervasive developmental disorder. Topics in Early Childhood Special Education, 25, 34–47.
Pine, E., Luby, J., Abbacchi, A., & Constantino, J. N. (2006). Quantitative assessment of autistic symptomotology in preschoolers. Autism, 10, 344–352.
Remington, B., Hastings, R. P., Kovshoff, H., degli Espinosa, F., Jahr, E., Brown, T., et al. (2007). Early intensive behavioral intervention: Outcomes for children with autism and their parents after two years. American Journal on Mental Retardation, 112, 418–438.
Rogers, S. J. (2000). Interventions that facilitate socialization in children with autism. Journal of Autism and Developmental Disorders, 30, 399–409.
Rogers, S. J., Hayden, D., Hepburn, S., Charlifue-Smith, R., Hall, T., & Hayes, A. (2006). Teaching young nonverbal children with autism useful speech: A pilot study of the Denver model and PROMPT interventions. Journal of Autism and Developmental Disorders, 36, 1007–1024.
Rogers, S. J., & Vismara, L. A. (2008). Evidence-based comprehensive treatments for early autism. Journal of Clinical Child and Adolescent Psychology, 37, 8–38.
Sallows, G. O., & Graupner, T. D. (2005). Intensive behavioral treatment for children autism: Four-year outcome and predictors. American Journal on Mental Retardation, 2005, 417–438.
Salt, J., Shemilt, J., Sellars, V., Boyd, S., Coulson, T., & McCool, S. (2002). The Scottish Centre for Autism preschool treatment programme. Autism, 6, 33–46.
Schreibman, L. (2000). Intensive behavioral/psychoeducational treatment for autism: Research needs and future directions. Journal of Autism and Developmental Disorders, 30, 373–378.
Schwartz, I. S., & Baer, D. M. (1991). Social validity assessments: Is current practice state of the art? Journal of Applied Behavior Analysis, 24, 189–204.
Sigman, M., & Capps, L. (1997). Children with autism: A developmental perspective. Cambridge, MA: Harvard University Press.
Siller, M., & Sigman, M. (2008). Modeling longitudinal change in the language abilities of children with autism: Parent and child characteristics as predictors of change. Developmental Psychology, 44, 1691–1704.
Smith, T., Groen, A. D., & Wynn, J. W. (2000). Randomized trial of intensive early intervention for children with pervasive developmental disorder. American Journal of Mental Retardation, 105, 269–285.
Snow, A. V., Lecavalier, L., & Houts, C. (2009). The structure of the autism diagnostic interview-revised: Diagnostic and phenotypic implications. Journal of Child Psychology and Psychiatry, 50, 734–742.
Sparrow, S. S., Balla, D., & Cicchetti, D. V. (1984). Vineland Adaptive Behavior Scales. Circle Pines, MN: American Guidance Service.
Sparrow, S. S., Cicchetti, D. V., & Balla, D. (2005). Vineland Adaptive Behavior Scales (2nd ed.). Circle Pines, MN: American Guidance Service.
Stone, W. L., Coonrod, E. E., Pozdol, S. L., & Turner, L. M. (2003). The parent interview for autism-clinical version (PIA-CV): A measure of behavioral change for young children with autism. Autism, 7, 9–30.
Stone, W. L., Ousley, O. Y., Hepburn, S. L., Hogan, K. L., & Brown, C. S. (1999). Patterns of adaptive behavior in very young children with autism. American Journal on Mental Retardation, 104, 187–199.
Szatmari, P., Merette, C., Bryson, S. E., Thivierge, J., Roy, M., Cayer, M., et al. (2002). Quantifying dimensions in autism: A factor-analytic study. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 467–474.
Tadevosyan-Leyfer, O., Dowd, M., Mankoski, R., Binklosky, B., Putnam, S., McGrath, L., et al. (2003). A principal components analysis of the autism diagnostic interview-revised. Journal of the Academy of Child and Adolescent Psychiatry, 42, 864–872.
VanMeter, L., Fein, D., Morris, R., Waterhouse, L., & Allen, D. (1997). Delay versus deviance in autistic social behavior. Journal of Autism and Developmental Disorders, 27, 557–569.
Vermeersch, D. A., Lambert, M. J., & Burlingame, G. M. (2000). Outcome questionnaire: Item sensitivity to change. Journal of Personality Assessment, 74, 242–261.
Volkmar, F. R., Sparrow, S. S., Goudreau, D., Cicchetti, D. V., Paul, R., & Cohen, D. J. (1987). Social deficits in autism: An operational approach using the Vineland Adaptive Behavior Scales. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 156–161.
Warreyn, P., Roeyers, H., & De Groote, I. (2005). Early social communicative behaviours of preschoolers with autism spectrum disorder during interaction with their mothers. Autism, 9(4), 342–361.
White, S. W., Keonig, K., & Scahill, L. (2007). Social skills development in children with autism spectrum disorders: A review of the intervention research. Journal of Autism and Developmental Disorders, 37, 1858–1868.
Williams, S. K., Scahill, L., Vitiello, B., Aman, M. G., Arnold, L. E., McDougle, C. J., et al. (2006). Risperidone and adaptive behavior in children with autism. Journal of the American Academy of Child and Adolescent Psychiatry, 54, 431–439.
Wolery, M., & Garfinkle, A. N. (2002). Measures in intervention research with young children who have autism. Journal of Autism and Developmental Disorders, 32, 463–478.
Wolery, M., & Harris, S. R. (1982). Interpreting results of single-subject research designs. Physical Therapy, 62, 445–452.
Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203–214.
Yoder, P., & Stone, W. L. (2006). Randomized comparison of two communication interventions for preschoolers with autism spectrum disorders. Journal of Consulting and Clinical Psychology, 74(3), 426–435.
Acknowledgments
The author is grateful to Drs. Mark Appelbaum, Laura Schreibman, and Aubyn Stahmer for input on an earlier draft of this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Preparation of this paper was facilitated by U.S.P.H.S. Research Grant MH#39434 from the National Institute of Mental Health.
Rights and permissions
About this article
Cite this article
Cunningham, A.B. Measuring Change in Social Interaction Skills of Young Children with Autism. J Autism Dev Disord 42, 593–605 (2012). https://doi.org/10.1007/s10803-011-1280-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-011-1280-3