Developing multimedia interfaces for speech therapy

  • Jennifer GeorgeEmail author
  • Paul Gnanayutham
Long Paper


Multimedia has been used creatively to entertain and educate, and can also be used for therapeutic and medical purposes. This paper addressed this issue by incorporating multimedia to design and develop an assistive device to help disabled children with speech impairments in mainstream education. The appropriate methodology for developing such an interface was investigated. Relevant multimedia, psychology, social and educational theories were taken into account. Based on this literature review, interfaces to enhance pronunciation were designed, developed and tested.


Phonological disorders HCI Inclusive design Assistive technology 



Pauline Philips of Speech and Language Therapy, members of the focus group, participants.


  1. 1.
    Reuters: Mps blast special needs system. (2006). Accessed 6 Jul 2006
  2. 2.
    George, J., Gnanayutham, P.: Research methodology for phonological development. In: HCI International 2007, pp. 907–911. Lecture Notes in Computer Science Series, Posters. Springer, Beijing (2007)Google Scholar
  3. 3.
    Vaknin, S.: In defense of psychoanalysis. In: The Fundamentals of Psychological Theories. (2005). Accessed 31 Aug 2006
  4. 4.
    George, J.: Theories for educational multimedia application development: a case study. In: HCI International 2007, pp. 1211–1215. Lecture Notes in Computer Science Series, Posters. Springer, Beijing (2007)Google Scholar
  5. 5.
    Gimson, A.C.: An Introduction to the Pronunciation of English. Edward Arnold Publications, London (1962)Google Scholar
  6. 6.
    JollyLearning: (2006). Accessed 27 Jul 2006
  7. 7.
    Ager, S.: (2006), Omniglot. Accessed 29 Aug 2006
  8. 8.
    Passy, P.: International Phonetic Alphabet. International Phonetic Association, France (1888)Google Scholar
  9. 9.
    Draheim, D., Weber, G.: Storyboarding form-based interfaces. In: Interact 2003, pp. 343–350. IOS Press, Zurich (2003)Google Scholar
  10. 10.
    Holzinger, A., Ebner, M.: Interaction and usability of simulations and animations: a case study of the flash technology. In: Interact 2003, pp. 777–780. IOS Press, Zurich (2003)Google Scholar
  11. 11.
    Berglund, A., Qvarfordt, P.: Error resolution strategies for interactive television speech interfaces. In: Interact 2003, pp. 105–112. IOS Press, Zurich (2003)Google Scholar
  12. 12.
    George, J.C.: Usability Issues in Multimedia Interface Design. ATINER, Athens (2006)Google Scholar
  13. 13.
    Hvannberg, E.E., Law, L.: Classification of usability problem (CUP) scheme. In: Interact 2003, pp. 655–662. IOS Press, Zurich (2003)Google Scholar
  14. 14.
    Hummels, C., Ross, P., Overbeeke, K.C.J.: In search of resonant human computer interaction: building and testing aesthetic installation. In: Interact 2003, pp. 399–406. IOS Press, Zurich (2003)Google Scholar
  15. 15.
    Baranauskas, C., Scolari, C.A.: Semiotics of interaction: a special interest group proposal. In: Interact 2003, p. 1095. IOS Press, Zurich (2003)Google Scholar
  16. 16.
    Tano, S., Kodera, T., Nakashima, T., Kawano, I., Nakanishi, K., Hamagishi, G., Inoue, M., Watanabe, A., Okamoto, T., Kawagoe, K., Kaneko, K., Hotta, T., Tatsuoka, M.: Godzilla: seamless 2D and 3D sketch environment for reflective and creative design work. In: Interact 2003, pp. 311–318. IOS Press, Zurich (2003)Google Scholar
  17. 17.
    Sturm, C., Mueller, C.H.: Putting theory into practice: how to apply cross-cultural differences to user interface design? In: Interact 2003, pp. 1051–1052. IOS Press, Zurich (2003)Google Scholar
  18. 18.
    Hongpaisanwiwat, C., Lewis, M.: Attentional effect of animated character. In: Interact 2003, pp. 423–430. IOS Press, Zurich (2003)Google Scholar
  19. 19.
    Oh, J., Stuerzlinger, W.: Intelligent manipulation techniques for conceptual 3D design. In: Interact 2003, pp. 319–326. IOS Press, Zurich (2003)Google Scholar
  20. 20.
    Hein, H., Kellermann, G.M., Thomas, C.G.: X-AiD: a shell for building highly interactive and adoptive user interfaces. In: IUCA 1987, August 1987, Milan, Italy, pp. 97–99 (1987)Google Scholar
  21. 21.
    Moran, S., Leiser, D.: The limits of shape constancy: point-to-point mapping of perspective projections of flat figures. Behav. Inform. Technol. 21(2), 97–104 (2002)CrossRefGoogle Scholar
  22. 22.
    Pickford, R.W.: Psychology and Visual Aesthetics, pp. 17–30. Hutchinson Educational, London (1972)Google Scholar
  23. 23.
    Laarni, J.: Effects of color, font type and font style on user preferences. In: Stephanidis, C., (eds.) Adjunct Proceedings of HCI International 2003, pp. 31–32. Crete University Press, Crete, June 2003Google Scholar
  24. 24.
    Hornbæk, K., Frøkjær, E.: Metaphors of human thinking: a new tool in user interface design and evaluation. In: Interact 2003, pp. 781–784. IOS Press, Zurich (2003)Google Scholar
  25. 25.
    Philips, P.: Speech and Language Therapy, Interviewed on 7 Jun 2006 by author (2006)Google Scholar
  26. 26.
    Barendregt, W., Bekker, M.M., Speerstra, M.: Empirical evaluation of usability and fun in computer games for children. In: Interact 2003, pp. 343–350. IOS Press, Zurich (2003)Google Scholar
  27. 27.
    Perdrix, F., Granollers, T., Lorés, J., Zubillaga, A.: Usability evaluation applied to a children’s website. In: Interact 2003, pp. 852–855. IOS Press, Zurich (2003)Google Scholar
  28. 28.
    Garneau, R.W., Holynski, M.: The interactive adoptability of graphic displays. In: Sallvendy, G., Smith, M. (eds.) Designing and Using Human–Computer-Interfaces and Knowledge Based Systems, pp. 321–327. Elsevier, Amsterdam (1989)Google Scholar
  29. 29.
    Bohorquez, J.C., Gonzalez, M., Varela, A., Macias, H., Rivera, J., Rodriguez, N., Gonzalez, M., Toro, I.: Supporting technology for augmentative and alternative communication. In: CWUAAT 2004, Cambridge, UK, p. 197Google Scholar
  30. 30.
    Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.: User Interface Design and Evaluation. Elsevier, Morgan Kaufmann, The Open University, UK (2005)Google Scholar
  31. 31.
    Reeves, N., Jefferies, L., Cunningham, S.-J., Harris, C.: A multimedia PDA/PC speech and language therapy tool for patients with aphasia. Int. J. Electron. Healthc. 3(1), 135–149 (2007)CrossRefGoogle Scholar
  32. 32.
    Glykas, M., Chytas, P.: Technology assisted speech and language therapy. Int. J. Med. Inform. 73, 529–541 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  1. 1.SAE InstituteLondonUK
  2. 2.Department of ComputingUniversity of PortsmouthPortsmouthUK

Personalised recommendations