Skip to main content

Mobile Application with Image Recognition for Persons with Aphasia

  • 858 Accesses

Part of the Lecture Notes in Computer Science book series (LNAI,volume 11177)


A person with aphasia, caused by a damage to a brain, loses (partially or completely) the ability to use speech or writing. Rehabilitation is based on mental or motor exercises, stimulating the brain areas responsible for communication. The aim of our work was to implement an application (app) for smartphones that could be used for this rehabilitation. We used Google’s Cloud Vision for photo analysis. The initial prototype of the app was modified according to comments from a specialist. The usability tests with the target group of users prove the effectiveness of the app, and suggest the directions of further development.


  • Smartphone application
  • Interactive storytelling
  • Aphasia

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


  1. Allen, M., McGrenere, J., Purves, B.: The field evaluation of a mobile digital image communication application designed for people with aphasia. ACM Trans. Access. Comput. (TACCESS) 1(1), 1–26 (2008)

    CrossRef  Google Scholar 

  2. Al Mahmud, A., Dijkhuis, S.Q., Blummel, L. Elberse, I.: Postboard: free-form tangible messaging for people with aphasia (and other people). In: CHI 2012, Austin, Texas, USA, pp. 1475–1480. ACM (2012)

    Google Scholar 

  3. Beukelman, D., Hux, K., Dietz, A., McKelvey, M., Weissling, K.: Using visual scene displays as communication support options for people with chronic, severe aphasia: a summary of AAC research and future research directions. Augment. Altern. Commun. 31(3), 234–45 (2015)

    CrossRef  Google Scholar 

  4. Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)

    Google Scholar 

  5. Chapey, R.: Language Intervention Strategies in Aphasia and Related Neurogenic Communication Disorders. Kluwer-Lippincott Williams & Wilkins, Philadelphia (2008)

    Google Scholar 

  6. Daemen, E., et al.: Designing a free style, indirect, and interactive storytelling application for people with aphasia. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 221–234. Springer, Heidelberg (2007).

    CrossRef  Google Scholar 

  7. Martin, R.C.: Clean Code. Prentice Hall, Upper Saddle River (2009)

    Google Scholar 

  8. Menger, F., Morris, J., Salis, C.: Aphasia in an Internet age: wider perspectives on digital inclusion. Aphasiology 30(2–3), 112–132 (2015)

    Google Scholar 

  9. Mulfari, D., Celesti, A., Fazio, M., Villari, M., Puliafito, A.: Using Google Cloud Vision in assistive technology scenarios. In: IEEE ISCC, Messina, Italy (2016)

    Google Scholar 

Download references


The authors would like to express thanks to Dr. Aleksandra Bala, a specialist in aphasiac patients, for her comments and help in experiments. This work was partially supported by the Research Center of PJAIT.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Krzysztof Szklanny .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gonera, J., Szklanny, K., Wichrowski, M., Wieczorkowska, A. (2018). Mobile Application with Image Recognition for Persons with Aphasia. In: Ceci, M., Japkowicz, N., Liu, J., Papadopoulos, G., Raś, Z. (eds) Foundations of Intelligent Systems. ISMIS 2018. Lecture Notes in Computer Science(), vol 11177. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-01850-4

  • Online ISBN: 978-3-030-01851-1

  • eBook Packages: Computer ScienceComputer Science (R0)