Using Artificial Intelligence for Augmentative Alternative Communication for Children with Disabilities

  • Rodica NeamtuEmail author
  • André Camara
  • Carlos Pereira
  • Rafael Ferreira
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11746)


According to the World Health Organization, an estimated one billion people live with a disability. Millions of them are non-verbal, and also experience motor-skill challenges. The limitations on activity and restrictions on participation due to such disabilities often lead to discrimination and social exclusion. A UNICEF study analyzing data from 15 countries found that almost 50% of children with disabilities are out of school, and 85% of them did not receive any formal education. Affording enhanced and accelerated communication for disabled people, who continue to form the world’s largest minority to experience social discrimination, is central to making the world a more inclusive place. Our LIVOX application incorporates artificial intelligence algorithms to reduce the so-called “reciprocity gap” that acts as a communication barrier between disabled people and their interlocutors, thus enabling people with disabilities, especially children, to participate in daily social and educational activities. Integrating them into the existing social structures is central to making the world a more inclusive place.


Augmentative alternative communication Children interfaces Artificial intelligence Interaction with large and small displays 

Supplementary material

Supplementary material 1 (mp4 8824 KB)


  1. 1.
    Baldassarri, S., Rubio, J.M., Azpiroz, M.G., Cerezo, E.: Araboard: a multiplatform alternative and augmentative communication tool. Procedia Comput. Sci. 27, 197–206 (2014)CrossRefGoogle Scholar
  2. 2.
    Beukelman, D., Mirenda, P.: Augmentative and alternative communication (2005)Google Scholar
  3. 3.
    Beukelman, D.R., Ball, L.J., Fager, S.: An AAC personnel framework: adults with acquired complex communication needs. Augment. Altern. Commun. 24(3), 255–267 (2008)CrossRefGoogle Scholar
  4. 4.
    Beukelman, D.R., Fager, S., Ball, L., Dietz, A.: AAC for adults with acquired neurological conditions: a review. Augment. Altern. Commun. 23(3), 230–242 (2007)CrossRefGoogle Scholar
  5. 5.
    Beukelman, D.R., Mirenda, P.: Augmentative and Alternative Communication: Supporting Children and Adults with Complex Communication Needs. Paul H. Brookes Publishing, Baltimore (2013)Google Scholar
  6. 6.
    Bilyeu, D.V., Beukelman, D.R.: Duration of AAC technology use by persons with ALS. J. Med. Speech Lang. Pathol. 15(4), 371–381 (1998)Google Scholar
  7. 7.
    Desai, T., Chow, K., Mumford, L., Hotze, F., Chau, T.: Implementing an iPad-based alternative communication device for a student with cerebral palsy and autism in the classroom via an access technology delivery protocol. Comput. Educ. 79, 148–158 (2014)CrossRefGoogle Scholar
  8. 8.
    Dynavox, T.: myTobiiDynavox (2019). Accessed 28 Mar 2019
  9. 9.
    Higginbotham, D.J.: Humanizing vox artificialis: the role of speech synthesis in augmentative and alternative communication. In: Computer Synthesized Speech Technologies: Tools for Aiding Impairment, pp. 50–70. IGI Global (2010)Google Scholar
  10. 10.
    Hosono, N., Inoue, H., Nakanishi, M., Tomita, Y.: Urgent mobile tool for hearing impaired, language dysfunction and foreigners at emergency situation. In: Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services, pp. 413–416. ACM (2014)Google Scholar
  11. 11.
    Kagohara, D.M., et al.: Behavioral intervention promotes successful use of an iPod-based communication device by an adolescent with autism. Clin. Case Stud. 9(5), 328–338 (2010)CrossRefGoogle Scholar
  12. 12.
    Light, J., et al.: Challenges and opportunities in augmentative and alternative communication: research and technology development to enhance communication and participation for individuals with complex communication needs. Augment. Altern. Commun. 35, 1–12 (2019) CrossRefGoogle Scholar
  13. 13.
    Mizunoya, S., Mitra, S., Yamasaki, I.: Towards inclusive education: the impact of disability on school attendance in developing countries. UNICEF (2016)Google Scholar
  14. 14.
    Modoni, G.E., Veniero, M., Trombetta, A., Sacco, M., Clemente, S.: Semantic based events signaling for AAL systems. J. Ambient Intell. Hum. Comput. 9(5), 1311–1325 (2018)CrossRefGoogle Scholar
  15. 15.
    Pino, A., Kouroupetroglou, G.: Ithaca: an open source framework for building component-based augmentative and alternative communication applications. ACM Trans. Access. Comput. (TACCESS) 2(4), 14 (2010)Google Scholar
  16. 16.
    Rodríguez-Fórtiz, M., Fernández-López, A., Rodríguez, M.: Mobile communication and learning applications for autistic people. In: Autism Spectrum Disorders-From Genes to Environment. IntechOpen (2011)Google Scholar
  17. 17.
    Schelhowe, H., Zare, S.: Intelligent mobile interaction: a learning system for mentally disabled people (IMLIS). In: Stephanidis, C. (ed.) UAHCI 2009, Part I. LNCS, vol. 5614, pp. 412–421. Springer, Heidelberg (2009). Scholar
  18. 18.
    Schlosser, R.: Roles of speech output in augmentative and alternative communication: narrative review. Augment. Altern. Commun. 19(1), 5–27 (2003)CrossRefGoogle Scholar
  19. 19.
    Ware, A.: Proloquo2go (2019). Accessed 28 Mar 2019

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  1. 1.Worcester Polytechnic InstituteWorcesterUSA
  2. 2.Departamento de ComputaçãoUniversidade Federal Rural de PernambucoRecifeBrazil
  3. 3.LivoxOrlandoUSA

Personalised recommendations