EMA-Tactons: Vibrotactile External Memory Aids in an Auditory Display

  • Johan Kildal
  • Stephen A. Brewster
Conference paper

DOI: 10.1007/978-3-540-74800-7_6

Part of the Lecture Notes in Computer Science book series (LNCS, volume 4663)
Cite this paper as:
Kildal J., Brewster S.A. (2007) EMA-Tactons: Vibrotactile External Memory Aids in an Auditory Display. In: Baranauskas C., Palanque P., Abascal J., Barbosa S.D.J. (eds) Human-Computer Interaction – INTERACT 2007. INTERACT 2007. Lecture Notes in Computer Science, vol 4663. Springer, Berlin, Heidelberg


Exploring any new data set always starts with gathering overview information. When this process is done non-visually, interactive sonification techniques have proved to be effective and efficient ways of getting overview information, particularly for users who are blind or visually impaired. Under certain conditions, however, the process of data analysis cannot be completed due to saturation of the user’s working memory. This paper introduces EMA-Tactons, vibrotactile external memory aids that are intended to support working memory during the process of data analysis, combining vibrotactile and audio stimuli in a multimodal interface. An iterative process led to a design that significantly improves the performance (in terms of effectiveness) of users solving complex data explorations. The results provide information about the convenience of using EMA-Tactons with other auditory displays, and the iterative design process illustrates the challenges of designing multimodal interaction techniques.


vibrotactile external memory aid overview visual impairment high-density sonification 

Copyright information

© IFIP International Federation for Information Processing 2007

Authors and Affiliations

  • Johan Kildal
    • 1
  • Stephen A. Brewster
    • 1
  1. 1.Glasgow Interactive Systems Group, Department of Computing Science, University of Glasgow. Glasgow, G12 8QQUK

Personalised recommendations