Embodied Agents in Language Learning for Children with Language Challenges
Given the value of face-to-face interaction in communication and learning, our persistent goal has been to develop, evaluate, and apply animated agents to produce realistic and accurate speech. We have implemented these agents as computer-assisted speech and language tutors for hard of hearing and autistic children, and other children with language challenges. Our language-training program utilizes conversational agents, who guide students through a variety of exercises designed to teach vocabulary and grammar, to improve speech articulation, and to develop linguistic and phonological awareness. We report a new experiment showing its effectiveness for school children learning English as a new language. Some of the advantages of this pedagogy and technology include the popularity and effectiveness of computers and embodied conversational agents, the perpetual availability of the program, and individualized instruction. Animated tutors offer a promising approach to language learning, human-machine interaction, and education.
KeywordsHearing Loss Phonological Awareness Language Learn Autistic Child Specific Language Impairment
Unable to display preview. Download preview PDF.
- 1.Massaro, D.W.: Perceiving Talking Faces: From Speech Perception to a Behavioral Principle. MIT Press, Cambridge (1998)Google Scholar
- 2.Granström, B., House, D., Beskow, J.: Speech and gestures for talking faces inconversational dialogue systems. In: Granstrom, B., House, D., Karlsson, I. (eds.) Multilmodality in language and speech systems, pp. 209–241. Kluwer Academic Publishers, The Netherlands (2002)Google Scholar
- 3.Massaro, D.W., Ouni, S., Cohen, M.M., Clark, R.: A Multilingual Embodied Conversational Agent. In: Sprague, R.H. (ed.) Proceedings of 38th Annual Hawaii International Conference on System Sciences (HICCS 2005) (CD-ROM), 10 pages. IEEE Computer Society Press, Los Alimitos (2005)Google Scholar
- 4.Massaro, D.W.: Symbiotic Value of an Embodied Agent in Language Learning. In: Sprague Jr., R.H. (ed.) Proceedings of 37th Annual Hawaii International Conference on System Sciences (HICCS 2004) (CD-ROM, 10 pages), IEEE Computer Society Press, Los Alimitos (2004) Best paper in Emerging TechnologiesGoogle Scholar
- 5.Beck, I.L., McKeown, M.G., Kucan, L.: Bringing words to life: Robust Vocabulary Instruction. The Guilford Press, New York (2002)Google Scholar
- 6.Massaro, D.W., Light, J.: Improving the vocabulary of children with hearing loss. Volta Review 104(3), 141–174 (2004)Google Scholar
- 9.Massaro, D.W., Light: Read my tongue movements: bimodal learn-ing to perceive and produce non-native speech /r/ and /l/. In: Eurospeech 2003-Switzerland (In-terspeech). 8th European Conference on Speech Communication and Technology, Geneva, Switzerland (September 2003)Google Scholar