Modeling Augmentative Communication with Amazon Lex and Polly

  • Ahmad AbualsamidEmail author
  • Charles E. Hughes
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 794)


We present LEXY, a framework for developing multi-actor, natural language, augmentative communication chatbots. The LEXY framework is unique in that it allows for the building of conversational chatbots whose model of the world is constructed conversationally by a caregiver. The resulting chatbot can then conversationally interact with persons with special needs, such as persons on the autism spectrum or with cognitive disabilities. The framework utilizes Amazon’s Lex and Poly allowing for spoken as well as typed conversations.


Conversational chatbots Special needs Autism Cognitive disability Amazon Alexa 


  1. 1.
    Flippin, M., et al.: Effectiveness of the picture exchange communication system (PECS) on communication and speech for children with autism spectrum disorders: a meta-analysis. Am. J. Speech Lang. Pathol. 19(2), 178 (2010)CrossRefGoogle Scholar
  2. 2.
    Light, J.C., et al.: Augmentative and alternative communication to support receptive and expressive communication for people with autism. J. Commun. Disord. 31(2), 153–180 (1998)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Dooley, P., Wilczenski, F.L., Torem, C.: Using an activity schedule to smooth school transitions. J. Posit. Behav. Interv. 3(1), 57–61 (2001)CrossRefGoogle Scholar
  4. 4.
    Dempsey, P.: The teardown Amazon echo digital personal assistant [Teardown Consumer Electronics]. Eng. Technol. 10(2), 88–89 (2015). Scholar
  5. 5.
    Perez, S.: Amazon sold ‘millions’ of Alexa devices over the holiday shopping weekend. TechCrunch (2018). Accessed 4 Feb 2018
  6. 6.
    Yan, M., Castro, P., Cheng, P., Ishakian, V.: Building a chatbot with serverless computing. In: Proceedings of the 1st International Workshop on Mashups of Things and APIs, p. 5. ACM (2016)Google Scholar
  7. 7. (2018). 2017 Alexa Prize. Accessed 4 Feb 2018

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Modeling and Simulation DepartmentUniversity of Central FloridaOrlandoUSA

Personalised recommendations