Abstract
We present an interdisciplinary methodology for designing interactive multi-modal technology for young children with autism spectrum disorders (ASDs). In line with many other researchers in the field, we believe that the key to developing technology in this context is to embrace perspectives from diverse disciplines to arrive at a methodology that delivers satisfactory outcomes for all stakeholders. The ECHOES project provided us with the opportunity to develop a technology-enhanced learning (TEL) environment that facilitates acquisition and exploration of social skills by typically developing (TD) children and children with autism spectrum disorders (ASDs). ECHOES’ methodology and the learning environment rely crucially on multi-disciplinary expertise including developmental psychology, visual arts, human–computer interaction, artificial intelligence, education, and several other cognate disciplines. In this article, we reflect on the methods needed to develop a TEL environment for young users with ASDs by identifying key features, benefits, and challenges of this approach.
Similar content being viewed by others
Notes
The numbers of participants represent the total number of ASDs children and young adults, both with and without ASDs who took part in the respective workshops and studies.
References
Alcorn AM (2010) Exploring joint attention responses in Autism Spectrum children: interacting with a virtual agent in the ECHOES TEL environment. Unpublished M.Sc. thesis, University of Edinburgh, Edinburgh, United Kingdom
Alcorn A, Pain H, Rajendran T, Smith T, Lemon O, Porayska-Pomsta K, Foster ME, Avramides K, Frauenberger C, Bernardini S (2011) Using virtual characters to scaffold social communication in children with autism. Submitted to the international conference on artificial intelligence in education (submitted)
Avramides K, Bernardini S, Porayska-Pomsta K, Foster ME, Lemon O (2011) Socially competent pedagogical agents for children, submitted to international conference on artificial intelligence in education (submitted)
Baron-Cohen S, Leslie AM, Frith U (1985) Does the autistic-child have a theory of mind. Cognition 21(1):37–46
Behne T, Carpenter M, Tomasello M (2005) One-year-olds comprehend the communicative intentions behind gestures in a hiding game. Dev Sci 8(6):492–499
Billard A, Robins B, Nadel J, Dautenhahn K (2007) Building Robota, a mini-humanoid robot for the rehabilitation of children with autism. Assis Technol 19(1):37–49
Bjerknes G, Bratteteig T (1995) User participation and democracy: a discussion of Scandinavian research on systems development. Scand J Inf Syst 7(1):73–98
Brown J, Murray D (2001) Strategies for enhancing play skills for children with autism spectrum disorders. Educ Training Ment Retard Dev Disabil 36:312–317
Bundy A (1986) What kind of field is artificial intelligence? DAI Research Paper No. 305. Department of Artificial Intelligence, University of Edinburgh, Edinburgh
Charman T (2003) Why is joint attention a pivotal skill in autism? Philos Trans Biol Sci 358:315324
Chen J, Lemon O (2009) Facial feature detection and tracking in a new multimodal technology-enhanced learning environment for social communication. In: Proceedings of the IEEE international conference on signal and image processing applications (ICSIPA)
Cicchetti D (1984) The emergence of developmental psychopathology. Child Dev 55(1):1–7
Cohen L, Manion L (1980) Research methods in education. Routledge, New York
Conlon T, Pain H (1996) Persistent collaboration: a methodology for applied artificial intelligence and education. Int J Artif Intell Educ 7(3/4):219–252
De Menthon DF, Davis LS (1992) Model based object pose in 25 lines of code. In: Proceedings of 2nd European conference on computer vision, Santa Margherita Ligure, pp 335–343
Dias J, Paiva A (2005) Feeling and reasoning: a computational model for emotional characters. Progress Artif Intell Lecture Notes Comput Sci 3808/2005:127–140
Druin A (2002) The role of children in the design of new technology. Behav Inform Technol 21(1):1–25
Duquette A, Michaud F, Mercier H (2008) Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism. Autonomous Robots 24(2):147–157
Faja S, Aylward E, Bernier R, Dawson G (2008) Becoming a face expert: a computerized face-training program for high-functioning individuals with autism spectrum disorders. Dev Neuropsychol 33(1):1–24
Frauenberger C, Good J, Keay-Bright WE (2010) Phenomenology, a framework for participatory design. In: Proceedings of the 11th participatory design conference
Fullan M (1991) The new meaning of educational change. Cassell, London
Golan O, Baron-Cohen S (2006) Systemizing empathy: teaching adults with asperger syndrome or highfunctioning autism to recognize complex emotions using interactive multimedia. Dev Psychopathol 18(2):591–617
Good J, Robertson J (2006) CARSS: a framework for learner-centred design with children. Int J Artif Intell Ed 16(4):381–413
Green J, Charman T, McConachie H, Aldred C, Slonims V, Howlin P et al (2010) Parent-mediated communication-focused treatment in children with autism (PACT): a randomized controlled trial. Lancet 375(9732):2152–2160
Grynszpan O, Martin J-C, Nadel J (2008) Multimedia interfaces for users with high functioning autism: an empirical investigation. Int J Human Comput Stud 66(8):628–639
Insel T (2009) Translating scientific opportunity into public health impact: a strategic plan for research on mental illness. Arch Gen Psychiatry 66(2):128–133
Jones C, McIver L, Gibson L, Gregor P (2003) Experiences obtained from designing with children. In: IDC '03: Proceedings of the 2003 conference on Interaction design and children, ACM, New York, pp 69–74
Kabat-Zinn J (2003) Mindfulness-based interventions in context: past, present, and future. Clin Psychol Sci Prac 10(2):144–156
El Kaliouby R, Teeters A, Picard RW (2006) An exploratory social-emotional prosthetic for autism spectrum disorders, international workshop on wearable and implantable body sensor networks, April 3–5, 2006, MIT Media Lab, Cambridge, p 3
Keay-Bright WE (2007) The reactive colours project: demonstrating participatory and collaborative design methods for the creation of software for autistic children. Design Princi Prac Int J 1:7–16
Landauer T (1995) The trouble with computers: usefulness, usability, and productivity. MIT Press, Cambridge
Lanyi CS, Tilinger A (2004) Multimedia and virtual reality in the rehabilitation of autistic children. Comput Helping People Special Needs Proc 3118:22–28
Merryman J, Tartaro A, Arie M, Cassell J (2008) Designing virtual peers for assessment and intervention for children with autism. Workshop on designing for children with special needs at the conference on interaction design and children. ACM Press, Evanston
Mitchell P, Parsons S, Leonard A (2007) Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J Autism Dev Disord 37(3):589–600
Muller MJ (2003) The human-computer interaction handbook, chapter: participatory design: the third space in HCI. Lawrence Erlbaum Associates, London, pp 1051–1068
Parsons S, Guldberg KK, MacLeod A, Jones GE, Prunty A, Balfe T (2009) International review of the literature of evidence of best practice provision in the education of persons with Autistic Spectrum Disorders. National Council for Special Education, Ireland
Picard RW (2009) Future affective technology for autism and emotion communication. Philosophi Trans R Soci B Biol Sci 364(1535):3575–3584
Poh MZ, McDuff DJ, Picard RW (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics Express 18(10):10762–10774
Prizant BMW, Amy M, Rubin, Emily, Laurent AC, Rydell PJ (2005) The SCERTS Model: a comprehensive educational approach for children with autism spectrum disorders, Brookes Publishing Company
Rajendran G, Mitchell P (2000) Computer mediated interaction in Asperger’s syndrome: the bubble dialogue program. Comput Educ 35(3):189–207
Rao PA, Beidel DC, Murray MJ (2008) Social skills interventions for children with Asperger’s syndrome or high-functioning autism: a review and recommendations. J Autism Dev Disord 38(2):353–361
Safyan L, Lagattuta KH (2008) Grownups are not afraid of scary stuff, but kids are: young children’s and adults’ reasoning about children’s, infants’, and adults’ fears. Child Dev 79(4):821–835
Schön DA (1983) The Reflective Practioner: how professionals think in action. Temple Smith, London
Stenhouse L (1975) An introduction to curriculum research and development. Heinmann, London
Swettenham J (1996) Can children with autism be taught to understand false belief using computers? J Child Psychol Psychiatry 37(2):157–165
Tartaro A, Cassell J (2006) Authorable virtual peers for autism spectrum disorders. Paper presented at the combined workshop on language-enabled educational technology and development and evaluation of robust spoken dialogue systems at the 17th European conference on artificial intelligence (ECAI06), Riva del Garda, Italy
Tentori M, Hayes G (2010) Designing for interaction immediacy to enhance social skills of children with autism. In: Proceedings of the 12th ACM international conference on ubiquitous computing 2010, Copenhagen
Tomasello M (1995) Joint attention as social cognition. In: Moore C, Dunham PJ (eds) Joint attention: its origin and role in development. Cambridge University Press, Cambridge, pp 103–130
Vasilakakis V (2009) The use of eye-tracking technology in order to investigate emotion recognition in individuals with autism, Unpublished M.Sc. Thesis, University of Edinburgh, School of Informatics
Whalen C, Schreibman L (2003) Joint attention training for children with autism using behavior modification procedures. J Child Psychol Psychiatry 44(3):456–468
Weatherhead L (2010) Investigating children’s perception of causality and animacy: to what extent is this affected by object preference? Unpublished UG Thesis, University of Edinburgh, School of Informatics
Acknowledgments
The research reported in this manuscript is funded by the Economic and Social Research Council, UK and Engineering and Physical Sciences Research Council, UK under the Teaching and Learning Research Program—Technology-Enhanced Learning, grant number: RES-139-25-0395. We would like to thank staff, pupils and parents at the following schools: Kaimes School, Edinburgh; The Hollies School, Cardiff; Allfarthing Primary School, London; Chantry Community Primary School, Sussex; Gattons Infants School, Burgess Hill; and Fintry Language Unit, Dundee, Blackness Primary, Dundee.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article is available at http://dx.doi.org/10.1007/s00779-015-0834-3.
Rights and permissions
About this article
Cite this article
Porayska-Pomsta, K., Frauenberger, C., Pain, H. et al. Developing technology for autism: an interdisciplinary approach. Pers Ubiquit Comput 16, 117–127 (2012). https://doi.org/10.1007/s00779-011-0384-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-011-0384-2