Switching reference frame preferences during verbally assisted haptic graph comprehension
- 114 Downloads
Haptic–audio interfaces allow haptic exploration of statistical line graphs accompanied by sound or speech, thus providing access to exploration by visually impaired people. Verbally assisted haptic graph exploration can be seen as a task-oriented collaborative activity between two partners, a haptic explorer and an observing assistant, who are disposed to individual preferences for using reference frames. The experimental findings reveal that haptic explorers’ spatial reference frames are mostly induced by hand movements, leading to action perspective instead of conventionally left-to-right spatiotemporal perspective. Moreover, the communicational goal may result in a switch in perspective.
KeywordsHaptic graph comprehension Reference frame Spatial perspective
The research reported in this paper has been supported by DFG (German Science Foundation) in ITRG 1247 ‘Cross-modal Interaction in Natural and Artificial Cognitive Systems’, by Marie Curie Actions IRIS (ref. 610986, FP7-PEOPLE-2013-IAPP), and by METU Scientific Research Project scheme BAP–08-11-2012-121 ‘Investigation of Cognitive Processes in Multimodal Communication’.
- Abu Doush I, Pontelli E, Simon D, Son TC, Ma O (2010) Multimodal presentation of two-dimensional charts: an investigation using Open Office XML and Microsoft Excel. ACM Trans Access Comput 3:8Google Scholar
- Alaçam Ö, Habel C, Acartürk C (2013) Towards designing audio assistance for comprehending haptic graphs: a multimodal perspective. In: Stephanidis C, Antona M (eds) Universal access in human–computer interaction. Springer, Berlin, pp 409–418Google Scholar
- Alaçam Ö, Acartürk C, Habel C (2014) Referring expressions in discourse about haptic line graphs. In: Rieser V, Muller P (eds) Proceedings of 18th workshop semantics and pragmatics of dialogue, pp 7–16Google Scholar
- Habel C, Alaçam Ö, Acartürk C (2013) Verbally assisted comprehension of haptic line-graphs: referring expressions in a collaborative activity. In: Proceedings of the CogSci 2013 workshop on production of referring expressions, BerlinGoogle Scholar