Journal of Autism and Developmental Disorders

, Volume 33, Issue 6, pp 653–672 | Cite as

Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism

  • Alexis Bosseler
  • Dominic W. Massaro


Using our theoretical framework of multimodal processing, we developed and evaluated a computer-animated tutor, Baldi, to teach vocabulary and grammar for children with autism. Baldi was implemented in a Language Wizard/Player, which allows easy creation and presentation of a language lesson involving the association of pictures and spoken words. The lesson plan includes both the identification of pictures and the production of spoken words. In Experiment 1, eight children were given initial assessment tests, tutorials, and reassessment tests 30 days following mastery of the vocabulary items. All of the students learned a significant number of new words and grammar. A second within-subject design with six children followed a multiple baseline design and documented that the program was responsible for the learning and generalization of new words. The research indicates that children with autism are capable of learning new language within an automated program centered around a computer-animated agent, multimedia, and active participation and can transfer and use the language in a natural, untrained environment.

Vocabulary learning animated tutor multimedia language learning animated speech tutoring children with autism computer 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. American Psychiatric Association (1994). Diagnostic and Statistical Manual of Mental Disorders (4th ed.). Washington, DC: Author.Google Scholar
  2. Baer, D. M., Wolf, M. M., Risley, T. R. (1968). Some current dimenstions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.Google Scholar
  3. Barker, L. J. (2003). Computer-assisted vocabulary acquisition: The CSLU vocabulary tutor in oral-deaf education. Journal of Deaf Studies and Deaf Education, 8, 187-198.PubMedGoogle Scholar
  4. Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe and A. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185-205). Cambridge, MA: MIT Press.Google Scholar
  5. Calvert, S. L. (1999). Children's journeys through the information age. Boston: McGraw Hill.Google Scholar
  6. Carr, E. G. (1980). Generalization of treatment effects following educational intervention with autistic children and youth. In B. Wilcox & A. Thompson (Eds.), Critical issues in educating autistic children and youth (pp. 118-134). Washington, DC: Department of Education, Office of Special Education.Google Scholar
  7. Carr, E. G. (1982). Sign language. In R. L. Koegel, A. Rincover, & A. L. Egel (Eds.), Educating and understanding autistic children. San Diego, CA: College Hill.Google Scholar
  8. Carr, E. G., & Dores, P. A. (1981). Patterns of language acquisition following simultaneous communication with autistic children. Analysis & Intervention in Developmental Disabilities, 1(3-sup-4), 347-361.Google Scholar
  9. Carr, E. G., & Kologinsky, E. (1983). Acquisition of sign language by autistic children II: spontaneity and generalization effects. Journal of Applied Behavior Analysis, 16, 297-314.PubMedGoogle Scholar
  10. Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. Modern Language Journal 80, 183-198.Google Scholar
  11. Cohen, M. M., Beskow, J., & Massaro, D. W. (1998). Recent developments in facial animation: An inside view. In Proceedings of Auditory Visual Speech Perception '98. (pp. 201–206). Terrigal-Sydney Australia, December, 1998.Google Scholar
  12. Cohen, M. M., Walker, R. L., & Massaro, D. W. (1996). Perception of synthetic visual speech. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines (pp. 153-168). New York: Springer.Google Scholar
  13. Courchesne, E., Townsend, J., Ashoomoff, N. A., Yeung-Courchesne, R., Press, G., Murakami, J., Lincoln, A., James, H., Saitoh, O., Haas, R., & Schreibman, L. (1994). A new finding in autism: Impairment in shifting attention. In S. H. Broman & J. Grafman (Eds.), Atypical cognitive deficits in developmental disorders: Implications for brain function (pp. 101-137). Hillsdale NJ: Lawrence Erlbaum.Google Scholar
  14. Dubois, M., & Vial, I. (2000). Multimedia design: The effects of relating multimodal information. Journal of Computer Assisted Learning, 16, 157-165.Google Scholar
  15. Gupta, P., & MacWhinney, B. (1997). Vocabulary acquisition and verbal short-term memory: computation and neural bases. Brain and Language, 59, 267-333.PubMedGoogle Scholar
  16. Handleman, J. S. (1979). Generalization by autistic-type children of verbal responses across settings. Journal of Applied Behavior Analysis, 12, 273-282.PubMedGoogle Scholar
  17. Heimann, M., Nelson, K., Tjus, T., & Gilberg, C. (1995). Increasing reading and communication skills in children with autism through an interactive multimedia computer program. Journal of Autism and Developmental Disorders, 25, 459-480.PubMedGoogle Scholar
  18. Horner, R. D., & Baer, D. M. (1978). Multiple-probe technique: A variation of the multiple baseline. Journal of Applied Behavior Analysis, 11, 189-196.Google Scholar
  19. Jahr, E. (2001). Teaching children with autism to answer novel whquestions by utilizing a multiple exemplar strategy. Research in Developmental Disabilities, 22, 407-423.PubMedGoogle Scholar
  20. Koegel, L. K. (2000). Interventions of facilitate communication in autism. Journal of Autism and Developmental Disorders, 2, 383-391.Google Scholar
  21. Koegel, L., Koegel, L. K., Surratt, A. (1992). Language intervention and disruptive behavior in preschool children with autism. Journal of Autism and Developmental Disorders, 22, 141-153.PubMedGoogle Scholar
  22. Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism Diagnostic Interview—Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism & Developmental Disorders, 24, 659-685.Google Scholar
  23. Lovaas, O. I., Koegel, R., Simmons, J. Q., & Long, J. S. (1973). Some generalization and follow-up measures on autistic children in behavior therapy. Journal of Applied Behavior Analysis, 6, 131-166.Google Scholar
  24. Lovaas, O. I., Schreibman, L., Koegel, R., & Rehm, R. (1971). Selective responding by autistic children to multiple sensory input. Journal of Abnormal Psychology, 77, 211-222.PubMedGoogle Scholar
  25. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.Google Scholar
  26. Massaro, D. W. (1999). From theory to practice: Rewards and challenges. In Proceedings of the International Conference of Phonetic Sciences, San Francisco, CA, August.Google Scholar
  27. Massaro, D. W. (2000). From “Speech is Special” to Talking Heads in Language Learning. In Proceedings of Integrating speech technology in the (Language) Learning and Assistive Interface, (InSTIL 2000) August 29-30.Google Scholar
  28. Moore, M., & Calvert, S. (2000). Brief report: Vocabulary acquisition for children with autism: Teacher or computer instruction. Journal of Autism and Developmental Disorders, 30, 359-362.PubMedGoogle Scholar
  29. Prizant, B. M. (1983). Language acquisition and communicative behavior in autism: Toward an understanding of the “whole” of it. Journal of Speech & Hearing Disorders, 48, 296-307.Google Scholar
  30. Rincover, A., & Koegel, R. L. (1975). Setting generality and stimulus control in autistic children. Journal of Applied Behavior Analysis, 8, 235-246.PubMedGoogle Scholar
  31. Schopler, E., Mesibov, G. B., & Hearsey, K. (1995). Structured teaching in the TEACCH system. In E. Schopler & G. B. Mesibov (Eds.), Learning and cognition in autism. Current issues in autism. (pp. 243-268). New York: Plenum Press.Google Scholar
  32. Schopler, E., Reichler, R., Bashford, A., Lansing, M., & Marcus, L. 1990. The Psychoeducational Profile Revised (PEP-R). Austin, TX: Pro-ed.Google Scholar
  33. Sparrow, S. S., Balla, D. A., & Cicchetti, D. V. (1984). Vineland Adaptive Behavior Scales. Circle Pines, MN: American Guidance Service.Google Scholar
  34. Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21, 360-406.Google Scholar
  35. Stokes, T. F., Baer, D. M., & Jackson, R. L. (1974). Programming the generalization of a greeting response in four retarded children. Journal of Applied Behavior Analysis, 7, 599-610.PubMedGoogle Scholar
  36. Tager-Flusberg, H. (1999). A psychological approach to understanding the social and language impairments in autism. International Review of Psychiatry, 11, 355-334.Google Scholar
  37. Tager-Flusberg, H. (2000). Language development in children with autism. In L. Menn & N. Bernstein Ratner (Ed.), Methods For Studying Language Production (pp. 313-332). Mahwah, NJ: Lawrence Erlbaum.Google Scholar
  38. Van Lancker, D., Cornelius, C., Needleman, R. (1991). Comprehension of verbal terms for emotions in normal, autistic, and schizophrenic children. Developmental Neuropsychology, 7, 1-18.Google Scholar
  39. Vermeer, A. (2001). Breadth and depth of vocabulary in relation to L1/L2 acquisition and frequency of input. Applied Psycholinguistics, 22, 217-234.Google Scholar
  40. Wechsler, D. (1989). Wechsler Preschool and Primary Scale of Intelligence–Revised. San Antonio, TX: Psychological Corporation.Google Scholar
  41. Wood, J. (2001). Can software support children's vocabulary development? Language Learning & Technology, 5, 166-201.Google Scholar
  42. Yamamoto, J., & Miya, T. (1999). Acquisition and transfer of sentence construction in autistic students: Analysis of computer-based teaching. Research in Developmental Disabilities, 20, 355-377.PubMedGoogle Scholar

Copyright information

© Plenum Publishing Corporation 2003

Authors and Affiliations

  • Alexis Bosseler
    • 1
  • Dominic W. Massaro
    • 1
  1. 1.Department of PsychologyUniversity of CaliforniaSanta Cruz

Personalised recommendations