EMA-Tactons: Vibrotactile External Memory Aids in an Auditory Display
- Cite this paper as:
- Kildal J., Brewster S.A. (2007) EMA-Tactons: Vibrotactile External Memory Aids in an Auditory Display. In: Baranauskas C., Palanque P., Abascal J., Barbosa S.D.J. (eds) Human-Computer Interaction – INTERACT 2007. INTERACT 2007. Lecture Notes in Computer Science, vol 4663. Springer, Berlin, Heidelberg
Exploring any new data set always starts with gathering overview information. When this process is done non-visually, interactive sonification techniques have proved to be effective and efficient ways of getting overview information, particularly for users who are blind or visually impaired. Under certain conditions, however, the process of data analysis cannot be completed due to saturation of the user’s working memory. This paper introduces EMA-Tactons, vibrotactile external memory aids that are intended to support working memory during the process of data analysis, combining vibrotactile and audio stimuli in a multimodal interface. An iterative process led to a design that significantly improves the performance (in terms of effectiveness) of users solving complex data explorations. The results provide information about the convenience of using EMA-Tactons with other auditory displays, and the iterative design process illustrates the challenges of designing multimodal interaction techniques.