Multi-modal Framework to Support Users with Special Needs in Interaction with Public Information Systems

  • Kai Richter
  • Marita Enge
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2795)


A framework that provides means for users with special needs to interact with otherwise not accessible public kiosk systems is being introduced. On terminals extended by this framework users can interact with kiosk systems through their own mobile device permitting them customized means for interaction. Additionally personal information stored on the mobile device can be used to provide further assistance to the user. Several psychological studies have been conducted in order to evaluate this approach.


Mobile Device Personal Assistant Agent Platform Impaired People Support User 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abrams, M., Phanouriou, C., Batongbacal, A.L., Williams, S.M., Shuster, J.E.: UIML: Appliance-independent XML User Interface Language. In: 8th International World Wide Web Conference, Toronto, pp. 1695–1708 (1999)Google Scholar
  2. 2.
    Dubinko, M., Dietl, J., Merrick, R., Raggett, D., Raman, T.V., Welsh, L.B.: XForms 1.0 - W3C Working Draft, W3C (2001)Google Scholar
  3. 3.
    Webpage: EMBASSI - Elektronische Multimediale Bedien- und Service- Assistenz (1999), Available at
  4. 4.
    Enge, M., Massow, S.: Needs for assistance of visually and physically disabled and non-disabled persons when using money-/cash dispensers. In: Human-System Interaction: Education, Research and Application in the 21st Century, pp. 263–266Google Scholar
  5. 5.
    Gorski, H., Kempke, G.: Software-ergonomische Gestaltung von Computerarbeitsplätzen für Blinde und Sehbehinderte. In: Software-Ergonomie 1993, Bremen, Germany, p. 2 (1993)Google Scholar
  6. 6.
    Kirste, T.: An experimental communication framework for EMBASSI supporting data-flow based distributed agent systems (2002)Google Scholar
  7. 7.
    Kirste, T., Rapp, S.: Architecture for Multimodal Interactive Assistant Systems. In: Statustagung der Leitprojekte “Mensch-Technik-Interaktion”, Saarbrücken, Germany, pp. 111–115 (2001)Google Scholar
  8. 8.
    Labrou, Y., Finin, T.: A Proposal for a new KQML Specification (1997)Google Scholar
  9. 9.
    Law, C.M., Vanderheiden, G.C.: The development of a Simple, Low Cost Set of Universal Access Features for Electronic Devices. In: ACM CUU 2000 (The Association of Computer Machinery Conference on Universal Usability, Washington D.C., USA (2000)Google Scholar
  10. 10. XPToolkit Project, (1999)Google Scholar
  11. 11.
    Newman, M.W., Izadi, S., Edwards, W.K., Sedivy, J.Z., Smith, T.F.: User interfaces when and where they are needed: an infrastructure for recombinant computing. In: 15th annual ACM Symposium on User Interface Software and Technology, Paris, France, pp. 171–180. ACM Press, New York (2002)CrossRefGoogle Scholar
  12. 12.
    Nichols, J., Myers, B.A.: Studying the use of handhelds to control smart appliances. In: International Workshop on Smart Appliances and Wearable Computers. IWSAWC 2003, Providence, USA (2003)Google Scholar
  13. 13.
    Webpage: XWeb Project (2000), Available at
  14. 14.
    Phanouriou, C.: UIML: A Device-Independent User Interface Markup Language Computer Science and Applications, Virginia Polytechnic Institute and State University, Blacksburg, Virginia, p. 158 (2000)Google Scholar
  15. 15.
    Puerta, A., Eisenstein, J.: XIML: A universal language for User Interfaces, RedWhale Software, Palo Alto, CA, USA (2002)Google Scholar
  16. 16.
    Reimann, E.: Neue Einsatzszenarien für den Handel - Kiosks als Communication Stations für mobile Anwendungen. In: P.O.S Marketing Congress 2002, Düsseldorf, Germany (2002)Google Scholar
  17. 17.
    Richter, K.: An advanced concept of assistance for mobile customers of POS. In: E 2002, Prague, Czech Republic (2002)Google Scholar
  18. 18.
    Richter, K.: Generic Interface Descriptions using XML. In: CADUI, Valenciennes, France (2002)Google Scholar
  19. 19.
    Richter, K.: Remote Access to Public Kiosk Systems. In: 1st International Conference on Universal Access in Human - Computer Interaction, New Orleans, USA (2001)Google Scholar
  20. 20.
    Webpage: The Archimedes Project (2003), Available at
  21. 21.
    Webpage: Tivis: Accessible Kiosks an Assistive Technologies (2003), Available at
  22. 22.
    Webpage: Trace Research and Development Center (2001), Available at
  23. 23.
    Wandke, H.: Assistance in human-machine interaction: a conceptual framework and a proposal for a taxonomy, Humboldt-Universität, Berlin, Germany (2003)Google Scholar
  24. 24.
    Zimmermann, G., Vanderheiden, G., Gilman, A.: Universal Remote Console - Prototyping for the Alternate Interface Access Standard. In: 7th ERCIM Workshop ”User interfaces for All”, Paris, France (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Kai Richter
    • 1
  • Marita Enge
    • 2
  1. 1.Zentrum für Graphische Datenverarbeitung e. V.DarmstadtGermany
  2. 2.Humboldt Universität zu BerlinBerlinGermany

Personalised recommendations