Can Social Interaction Skills Be Taught by a Social Agent? The Role of a Robotic Mediator in Autism Therapy

  • Iain Werry
  • Kerstin Dautenhahn
  • Bernard Ogden
  • William Harwin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2117)


Increasingly socially intelligent agents (software or robotic) are used in education, rehabilitation and therapy. This paper discusses the role of interactive, mobile robots as social mediators in the particular domain of autism therapy. This research is part of the project AURORA that studies how mobile robots can be used to teach children with autism basic interaction skills that are important in social interactions among humans. Results from a particular series of trials involving pairs of two children and a mobile robot are described. The results show that the scenario with pairs of children and a robot creates a very interesting social context which gives rise to a variety of different social and non-social interaction patterns, demonstrating the specific problems but also abilities of children with autism in social interactions. Future work will include a closer analysis of interactional structure in human-human and robot-human interaction. We outline a particular framework that we are investigating.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aibo, URL: Last referenced 23rd March 2001.
  2. 2.
    Arkin, R. (1998) Behavior-based robotics. MIT Press, Cambridge, Mass.Google Scholar
  3. 3.
    AURORA, URL: Last referenced 23rd March 2001.
  4. 4.
    Billard, A. (2000) Play, dreams and imitation in Robota. Proc. Socially Intelligent Agents-the Human in the Loop, AAAI Fall Symposium, Technical Report FS-00-04, AAAI Press, pp. 9–12.Google Scholar
  5. 5.
    Blocher, K.H. (1999) Affective Social Quest (ASQ) Teaching emotion recognition with interactive media and wireless expressive toys, MSc Thesis, MIT, USA.Google Scholar
  6. 6.
    Bobick, A. F., Intille, S. S., Davis, J. W., Baird, F., Pinhanez, S., Campbell, L. W., Ivanov, Y. A., Schütte, A., & Wilson, A. (1999) The KidsRoom: A perceptually-based interactive and immersive story environment. Presence: Teleoperators and Virtual Environments 8(4), pp. 369–393.CrossRefGoogle Scholar
  7. 7.
    Breazeal, C. & Scassellati, B. (1999) How to build robots that make friends and influence people. Proc. 1ROS99, Kyonjiu, Korea.Google Scholar
  8. 8.
    Bumby, K. & Dautenhahn, K. (1999) Investigating Children’s Attitudes Towards Robots: A Case Study, Proc. CT99, The Third International Cognitive Technology Conference, August, San Francisco.Google Scholar
  9. 9.
    Button, G. (1990) Going up a Blind Alley: Conflating Conversation Analysis and Computational Modelling. In Luff, Gilbert and Fröhlich (eds) Computers and Conversation, Academic Press Limited, London, UK.Google Scholar
  10. 10.
    Cappella, J.N. (1997) Behavioral and Judged Coordination in Adult Informal Social Interactions: Vocal and Kinesic Indicators. Journal of Personality and Social Psychology 72(1), pp. 119–131.CrossRefGoogle Scholar
  11. 11.
    Charitos, D., Karadanos, G., Sereti, E., Triantafillou, S., Koukouvinou, S. & Martakos D. (2000) Employing virtual reality for aiding the organisation of autistic children behaviour in everyday tasks, Proc. 3 rd Intl. Conf. Disability, Virtual Reality & Assoc. Tech, Alghero, Italy 2000, pp. 147–152.Google Scholar
  12. 12.
    Chen, A. H. A. & Bernard-Opitz, V. (1993) Comparison of personal and computer-assisted instruction for children with autism. Mental Retardation 31(6): 368–376.Google Scholar
  13. 13.
    Colby, K. M. & Smith, D.C. (1971) Computers in the Treatment of Nonspeaking Autistic Children. Current Psychiatric Therapies, 11, pp. 1–17.Google Scholar
  14. 14.
    Colby, K. M. (1973) The Rationale for Computer-Based Treatment of Language Difficulties in Nonspeaking Autistic Children. Journal of Autism and Childhood Schizophrenia, 3(3), pp. 254–260.CrossRefGoogle Scholar
  15. 15.
    Cooper, M., Keating, D., Harwin, W. & Dautenhahn, K (1999) Robots in the Classroom-Tools for Accessible Education. Proc. AAATE Conference 1999, The 5th European Conference for the Advancement of Assistive Technology, C. Bühler and H. Knops (Eds.), November, Düsseldorf/Germany, IOS Press, pp. 448–452.Google Scholar
  16. 16.
    Dautenhahn, K. (1997) I could be you-the phenomenological dimension of social understanding. Cybernetics and Systems Journal, 28(5), 417–453.CrossRefGoogle Scholar
  17. 17.
    Dautenhahn, K. (1998) The Art of Designing Socially Intelligent Agents-Science, Fiction, and the Human in the Loop. Special Issue “Socially Intelligent Agents”, Applied Artificial Intelligence Journal, Vol 12, 7–8, October–December, pp. 573–617, 1998.Google Scholar
  18. 18.
    Dautenhahn, K. (1999) Robots as Social Actors: AURORA and the Case of Autism Proc. CT99, The Third International Cognitive Technology Conference, August, San Francisco.Google Scholar
  19. 19.
    Dautenhahn, K. (1999b) odiment and Interaction in Socially Intelligent Life-Like Agents. In: C. L. Nehaniv (Ed.): Computation for Metaphors, Analogy and Agent, Springer Lecture Notes in Artificial Intelligence, Volume 1562, Springer, pp. 102–142.Google Scholar
  20. 20.
    Dautenhahn, K. & Werry, I. (2000). Issues of Robot-Human Interaction Dynamics in the Rehabilitation of Children with Autism. Proc: From Animals To Animais, The Sixth International Conference on the Simulation of Adaptive Behavior (SAB2000), 11–15 September 2000, Paris, France.Google Scholar
  21. 21.
    Dautenhahn, K. & Werry, I. (2001) The AURORA Project: Using Mobile Robots in Autism Therapy. Learning Technology online newsletter, publication of IEEE Computer Society Learning Technology Task Force (LTTF), Volume 3 Issue 1, January 2001, ISSN 1438-0625.Google Scholar
  22. 22.
    Druin A. & Hendler J., Eds, (2000) Robots for Kids: Exploring New Technologies for Learning. Morgan Kaufmann Publishers.Google Scholar
  23. 23.
    Jordan, R. (1999) Autistic Spectrum Disorders-An Introductory Handbook for Practitioners. David Fulton Publishers, London.Google Scholar
  24. 24.
    Kendon, A. (1980) Features of the Structural Analysis of Human Communicational Behaviour. In: von Raffler-Engel (ed) Aspects of Nonverbal Communication, Swets and Zeitlinger, Lisse, Netherlands, pp. 29–43.Google Scholar
  25. 25.
    Kendon, A. (1990) A Description of Some Human Greetings. In Kendon, Conducting Interaction: Patterns of Behavior in Focused Encounters, Cambridge University Press, Cambridge, UK.Google Scholar
  26. 26.
    Machado, I. & Paiva, A. (2000) The child behind the character. Proc. Socially Intelligent Agents-The Human in the Loop, AAAI Press, Technical report FS-00-04, pp. 102–106.Google Scholar
  27. 27.
    Magnusson, M.S. (1996) Hidden Real-Time Patterns in Intra-and Inter-Individual Behavior: Description and Detection. European Journal of Psychological Assessment 12(2), pp. 112–123.CrossRefGoogle Scholar
  28. 28.
    Marsella, S. Johnson, W.L., & LaBore, C. (2000) Interactive Pedagogical Drama. Proc. of the Fourth International Conference on Autonomous Agents, June 3–7, Barcelona, Spain, ACM Press, pp. 301–308.CrossRefGoogle Scholar
  29. 29.
    Michaud, F., Clavet, A., Lachiver, G., & Lucas, M. (2000) Designing toy robots to help autistic children-An open design project for Electrical and Computer Engineering education. Proc. American Society for Engineering Education, June 2000.Google Scholar
  30. 30.
    Moore, D. (1998) Computers and people with autism. Communication, Summer 1998, pp. 20–21.Google Scholar
  31. 31.
    Murray, D. (1997) Autism and information technology: therapy with computers. In: S. Powell and R. Jordan: Autism and Learning: a guide to good practice. London: David Fulton, pp. 100–117.Google Scholar
  32. 32.
    Nadel, J., Guerini, C., Peze, A. & Rivet, C. (1999) The evolving nature of imitation as a format of communication, In: J. Nadel and G. Butterworth (Eds.) Imitation in Infancy, Cambridge University Press, pp. 209–234.Google Scholar
  33. 33.
    Ogden, & Dautenhahn, K. (2000) Robotic Etiquette: Structured Interaction in Humans and Robots. Proc. SIRS2000, Symposium on Intelligent Robotic Systems, Reading, UK, pp 353–361Google Scholar
  34. 34.
    Ogden, B. & Dautenhahn, K. (2001) Embedding Robotic Agents in the Social Environment. Proc. TIMR 2001, Towards Intelligent Mobile Robots: The 3rd British Conference on Autonomous Mobile Robotics and Autonomous Systems, Manchester, 5th April 2001.Google Scholar
  35. 35.
    Ogden, B. & Dautenhahn, K. (2001) Interactive Vision from the Top Down: Interactional Structure Applied to the Identification and Interpretation of Visual Interactive Behaviour. To be presented at Gesture Workshop 2001, The 4th International Workshop on Gesture and Sign Language Based Human-Computer Interaction, 18th–20th April 2001, City University, London, UK.Google Scholar
  36. 36.
    Panyan, M.V. (1984) Computer technology for autistic students. Journal of Autism and Developmental Disorders 14(4): 375–382.CrossRefGoogle Scholar
  37. 37.
    Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas Basic Books, New York.Google Scholar
  38. 38.
    Parsons, S., Beardon, L., Neale, H. R., Reynard, G., Eastgate, R., Wilson, J. R., Cobb, S.V. g., Benford, S. D., Mitchell, P. & Hopkins, E. (2000) Development of social skills amongst adults with Asperger’s Syndrome using virtual environments: the ‘AS Interactive’ project. Proc. 3 rd Interl Conf. Disability, Virtual Reality & Assoc. Tech, Alghero, Italy 2000, pp. 163–170.Google Scholar
  39. 39.
    Plaisant, Druin, A., Lathan, C., Dakhane, K., Edwards, K., Vice, J.M., Montemayor, J. (2000) A Storytelling Robot for Pediatrie Rehabilitation. Proc. ASSETS’ 00, Washington, Nov. 2000, ACM, New York.Google Scholar
  40. 40.
    Powell, S. (1996) The use of computers in teaching people with autism. In: Autism on the Agenda: Papers from a National Autistic Society Conference. London: NAS, 1996.Google Scholar
  41. 41.
    Psathas, G. (1995) Conversation Analysis: The Study of Talk-In-Interaction. Sage Publications Inc, Thousand Oaks, California, USA.Google Scholar
  42. 42.
    Russo, D. & Koegel, R.L. & Lovaas, O. I. (1978) A Comparison of Human and Automated Instruction of Autistic Children. Journal of Abnormal Child Psychology, June, 6(2), pp. 189–201.Google Scholar
  43. 43.
    Schank, R.C. & Abelson, R. (1977) Scripts, Plans, Goals and Understanding Laurence Erlbaum Associates Inc, Hillsdale, NJ.MATHGoogle Scholar
  44. 44.
    Schulte, J., Rosenberg, C. & Thrun, S. (1999) Spontaneous Short-term Interaction with Mobile Robots. Proc. ICRA’ 99, 1999 IEEE Int. Conference on Robotics and Automation, May 10–15, 1999, Marriott Hotel, Renaissance Center, Detroit, Michigan, USA.Google Scholar
  45. 45.
    Strickland, D. (1996) A virtual reality application with autistic children, Presence: Teleoperators and Virtual Environments 5(3), pp. 319–329.Google Scholar
  46. 46.
    Weir, S. & Emanuel, R. (1976) Using Logo to catalyse communication in an autistic child. DAI Research Report No. 15, University of Edinburgh.Google Scholar
  47. 47.
    Werry, I. & Dautenhahn, K. (1999) Applying robot technology to the rehabilitation of autistic children. In Proc. SIRS99, 7 th International Symposium on Intelligent Robotic Systems’ 99, pp. 265–272.Google Scholar
  48. 48.
    Werry, I., Dautenhahn, K. & Harwin, W. (2001) Evaluating the response of children with autism to a robot. To appear in Proc. RESNA 2001, Rehabilitation Engineering and Assistive Technology Society of North America, Friday, June 22–Tuesday, June 26, 2001, Reno, Nevada, USA.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Iain Werry
    • 2
  • Kerstin Dautenhahn
    • 1
  • Bernard Ogden
    • 1
  • William Harwin
    • 2
  1. 1.Department of Computer ScienceAdaptive Systems Research Group, University of HertfordshireHatfieldUK
  2. 2.Department of CyberneticsUniversity of ReadingReadingUK

Personalised recommendations