Audiovisual Design of Learning Systems for Children with ASD

  • Rafael Toscano
  • Valdecir BeckerEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10907)


The increasing use of information and communication technologies for children with Autism Spectrum Disorder (ASD) establishes a complex media, interaction and learning scenario not currently supported by models of communication, computation, and pedagogy. Moving forward on this theme, this work proposes a model of interactions for problem description, planning, and production of systems for teaching skills and abilities to children with ASD. The proposed model arises from theoretical integration between Audiovisual Design framework with Taxonomy Instructional Objectives. In addition to theoretical input, a systematic review of the state of the art reveals a shared nature of media, among individuals with ASD, family members, clinical and educational professionals. Four stages of interaction were identified. In this way, this research contributes to teaching strategies that integrate levels of interaction from cognitive, affective and psychomotor domains, that impact the generation of contents and adaptive systems for the needs of children with ASD.


Autism Learning Taxonomy Goals Audiovisual Design 


  1. 1.
    Rotta, N.T., Ohlweiler, L., dos Santos Riesgo, R.: Transtornos da Aprendizagem: Abordagem neurobiológica e multidisciplinar. Artmed, Porto Alegre, Brasil (2016)Google Scholar
  2. 2.
    Mintz, M.: Evolution in the understanding of Autism Spectrum Disorder: historical perspective. Indian J. Pediatr. 84, 44–52 (2017). Scholar
  3. 3.
    Wong, C., Odom, S.L., Hume, K.A., Cox, A.W., Fettig, A., Kucharczyk, S., Brock, M.E., Plavnick, J.B., Fleury, V.P., Schultz, T.R.: Evidence-based practices for children, youth, and young adults with Autism Spectrum Disorder: a comprehensive review. J. Autism Dev. Disord. 45, 1951–1966 (2015). Scholar
  4. 4.
    Zhen, B., Blackwell, A.F., Coulouris, G.: Using augmented reality to elicit pretend play for children with autism. IEEE Trans. Vis. Comput. Graph. 21, 598–610 (2015). Scholar
  5. 5.
    Macpherson, K., Charlop, M.H., Miltenberger, C.A.: Using portable video modeling technology to increase the compliment behaviors of children with autism during athletic group play. J. Autism Dev. Disord. 45, 3836–3845 (2015). Scholar
  6. 6.
    Özen, A.: Effectiveness of siblings-delivered iPad game activities in teaching social interaction skills to children with Autism Spectrum Disorders. Kuram ve Uygulamada Egit. Bilim. 15, 1287–1303 (2015). Scholar
  7. 7.
    Bartolome, N.A., Zapirain, B.G.: Cognitive rehabilitation system for children with Autism Spectrum Disorder using serious games: a pilot study. Biomed. Mater. Eng. 26, S811–S824 (2015). Scholar
  8. 8.
    Jouen, A.-L., Narzisi, A., Xavier, J., Tilmont, E., Bodeau, N., Bono, V., Ketem-Premel, N., Anzalone, S., Maharatna, K., Chetouani, M., Muratori, F., Cohen, D.: GOLIAH (Gaming Open Library for Intervention in Autism at Home): a 6-month single blind matched controlled exploratory study. Child Adolesc. Psychiatry Ment. Health 11, 17 (2017). Scholar
  9. 9.
    Eder, M.S., Diaz, J.M.L., Madela, J.R.S., Mag-usara, M.U., Sabellano, D.D.M.: Fill me app: an interactive mobile game application for children with autism. Int. J. Interact. Mob. Technol. 10, 59 (2016). Scholar
  10. 10.
    Lee, S.Y., Lo, Y., Lo, Y.: Teaching functional play skills to a young child with Autism Spectrum Disorder through video self-modeling. J. Autism Dev. Disord. (2017).
  11. 11.
    Malmberg, D.B., Charlop, M.H., Gershfeld, S.J.: A two experiment treatment comparison study: teaching social skills to children with Autism Spectrum Disorder. J. Dev. Phys. Disabil. 27, 375–392 (2015). Scholar
  12. 12.
    Malinverni, L., Mora-Guiard, J., Padillo, V., Valero, L., Hervás, A., Pares, N.: An inclusive design approach for developing video games for children with Autism Spectrum Disorder. Comput. Hum. Behav. 71, 535–549 (2017). Scholar
  13. 13.
    Spriggs, A.D., Gast, D.L., Knight, V.F.: Video modeling and observational learning to teach gaming access to students with ASD. J. Autism Dev. Disord. 46, 2845–2858 (2016). Scholar
  14. 14.
    Fridenson-Hayo, S., Berggren, S., Lassalle, A., Tal, S., Pigat, D., Meir-Goren, N., O’Reilly, H., Ben-Zur, S., Bölte, S., Baron-Cohen, S., Golan, O.: “Emotiplay”: a serious game for learning about emotions in children with autism: results of a cross-cultural evaluation. Eur. Child Adolesc. Psychiatry 1–14 (2017).
  15. 15.
    Miltenberger, C.A., Charlop, M.H.: The comparative effectiveness of portable video modeling vs. traditional video modeling interventions with children with Autism Spectrum Disorders. J. Dev. Phys. Disabil. 27, 341–358 (2015).
  16. 16.
    Jung, S., Sainato, D.M.: Teaching games to young children with autism spectrum disorder using special interests and video modelling. J. Intellect. Dev. Disabil. 40, 198–212 (2015). Scholar
  17. 17.
    Ryan, C., Furley, P., Mulhall, K.: Judgments of nonverbal behaviour by children with high-functioning Autism Spectrum Disorder: can they detect signs of winning and losing from brief video clips? J. Autism Dev. Disord. 46, 2916–2923 (2016). Scholar
  18. 18.
    Durango, I., Carrascosa, A., Gallud, J.A., Penichet, V.M.R.: Interactive fruit panel (IFP): a tangible serious game for children with special needs to learn an alternative communication system. Univers. Access Inf. Soc. 17, 51–65 (2017). Scholar
  19. 19.
    Rice, L.M., Wall, C.A., Fogel, A., Shic, F.: Computer-assisted face processing instruction improves emotion recognition, mentalizing, and social skills in students with ASD. J. Autism Dev. Disord. 45, 2176–2186 (2015). Scholar
  20. 20.
    Craig, A.B., Brown, E.R., Upright, J., DeRosier, M.E.: Enhancing children’s social emotional functioning through virtual game-based delivery of social skills training. J. Child Fam. Stud. 25, 959–968 (2016). Scholar
  21. 21.
    Edwards, J., Jeffre, S., Jeffre, S., Rinehart, N.J., Barnett, L.M.: Does playing a sports active video game improve object control skills of children with autism spectrum disorder? J. Sport Heal. Sci. 1 (2016).
  22. 22.
    Fiilatro, A., Piconez, S.C.B.: Design instrucional contextualizado (2004)Google Scholar
  23. 23.
    Benton, L., Vasalou, A., Khaled, R., Johnson, H., Gooch, D.: Diversity for design: a framework for involving neurodiverse children in the technology design process. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI 2014, pp. 3747–3756. ACM Press, Toronto (2014)Google Scholar
  24. 24.
    Hiléia, Á., Melo, S., Barreto, R.: ProAut: Um Processo para Apoio de Projetos de Interface de Produtos de Software para Crianças Autistas. Cad. Informática 9, 27–41 (2016)Google Scholar
  25. 25.
    da Silva Melo, Á.H., Fernandes, C.A.A.B., da Silva Jardim, M.S., da Silva Barreto, R.: Modelo 3C de Colaboração aplicado ao uso de um repositório para o desenvolvimento de interfaces para autistas. In: 14o SBSC - Simpósio Brasileiro de Sistemas Colaborativos Modelo, pp. 1471–1485. XXXVII Congresso da Sociedade Brasileira de Computação (2017)Google Scholar
  26. 26.
    Becker, V., Gambaro, D., Ramos, T.S.: Audiovisual design and the convergence between HCI and audience studies. In: Kurosu, M. (ed.) HCI 2017. LNCS, vol. 10271, pp. 3–22. Springer, Cham (2017). Scholar
  27. 27.
    Becker, V., Gambaro, D., Ramos, T.S., Toscano, R.M.: The development of media affordances in the audiovisual design. In: de Abreu, J.F., Guerrero, M.J.A., Almeida, P., Silva, T. (eds.) Proceedings of the 6th Iberoamerican Conference on Applications and Usability of Interactive TV - jAUTI 2017, pp. 91–103. UA Editora, Aveiro (2017)Google Scholar
  28. 28.
    Bloom, S.B.: Taxonomy of Educational Objectives. David Mckay, New York (1956)Google Scholar
  29. 29.
    Krathwohl, D.R.: A revision of Bloom’s taxonomy: an overview. Theory Pract. 41, 212–218 (2002). Scholar
  30. 30.
    Harrow, A.: A Taxonomy of Psychomotor Domain – A Guide for Developing Behavioural Objectives. David Mckay, New York (1972)Google Scholar
  31. 31.
    Dave, R.H.: Developing and Writing Behavioural Objectives. Educational Innovators Press, Tucson (1970)Google Scholar
  32. 32.
    Simpson, E.J.: The Classification of Educational Objectives in the Psychomotor Domain. Gryphon House, Washington, DC (1972)Google Scholar
  33. 33.
    Ferraz, A.P.D.C.M., Belhot, R.V.: Taxonomia de Bloom: revisão teórica e apresentação das adequações do instrumento para definição de objetivos instrucionais. Gestão & Produção 17, 421–431 (2010). Scholar
  34. 34.
    Vygotsky, L.S.: Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Harvard (1978)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Informatics CenterFederal University of ParaibaJoão PessoaBrazil

Personalised recommendations