Cognitive Processing

, Volume 16, Supplement 1, pp 115–119 | Cite as

Switching reference frame preferences during verbally assisted haptic graph comprehension

  • Özge Alaçam
  • Christopher Habel
  • Cengiz Acartürk
Short Report


Haptic–audio interfaces allow haptic exploration of statistical line graphs accompanied by sound or speech, thus providing access to exploration by visually impaired people. Verbally assisted haptic graph exploration can be seen as a task-oriented collaborative activity between two partners, a haptic explorer and an observing assistant, who are disposed to individual preferences for using reference frames. The experimental findings reveal that haptic explorers’ spatial reference frames are mostly induced by hand movements, leading to action perspective instead of conventionally left-to-right spatiotemporal perspective. Moreover, the communicational goal may result in a switch in perspective.


Haptic graph comprehension Reference frame Spatial perspective 



The research reported in this paper has been supported by DFG (German Science Foundation) in ITRG 1247 ‘Cross-modal Interaction in Natural and Artificial Cognitive Systems’, by Marie Curie Actions IRIS (ref. 610986, FP7-PEOPLE-2013-IAPP), and by METU Scientific Research Project scheme BAP–08-11-2012-121 ‘Investigation of Cognitive Processes in Multimodal Communication’.


  1. Abu Doush I, Pontelli E, Simon D, Son TC, Ma O (2010) Multimodal presentation of two-dimensional charts: an investigation using Open Office XML and Microsoft Excel. ACM Trans Access Comput 3:8Google Scholar
  2. Alaçam Ö, Habel C, Acartürk C (2013) Towards designing audio assistance for comprehending haptic graphs: a multimodal perspective. In: Stephanidis C, Antona M (eds) Universal access in human–computer interaction. Springer, Berlin, pp 409–418Google Scholar
  3. Alaçam Ö, Acartürk C, Habel C (2014) Referring expressions in discourse about haptic line graphs. In: Rieser V, Muller P (eds) Proceedings of 18th workshop semantics and pragmatics of dialogue, pp 7–16Google Scholar
  4. Bergen B, Chang N (2005) Embodied construction grammar in simulation-based language understanding. In: Östman JO, Fried M (eds) Construction grammars: cognitive grounding and theoretical extensions. Benjamins, Amsterdam, pp 147–190CrossRefGoogle Scholar
  5. Beveridge M, Pickering M (2013) Perspective taking in language: integrating the spatial and action domains. Front Hum Neurosci 7:577PubMedCentralCrossRefPubMedGoogle Scholar
  6. Brunyé TT, Ditman T, Mahoney CR, Augustyn JS, Taylor HA (2009) When you and I share perspectives pronouns modulate perspective taking during narrative comprehension. Psychol Sci 20:27–32CrossRefPubMedGoogle Scholar
  7. Ferres L, Lindgaard G, Sumegi L, Tsuji B (2013) Evaluating a tool for improving accessibility to charts and graphs. ACM Trans Comput Hum Interact 20:28CrossRefGoogle Scholar
  8. Garrod S, Pickering M (2004) Why is conversation so easy? Trends Cogn Sci 8:8–11CrossRefPubMedGoogle Scholar
  9. Habel C, Alaçam Ö, Acartürk C (2013) Verbally assisted comprehension of haptic line-graphs: referring expressions in a collaborative activity. In: Proceedings of the CogSci 2013 workshop on production of referring expressions, BerlinGoogle Scholar
  10. Schnotz W (2002) Commentary: towards an integrated view of learning from text and visual displays. Educ Psychol Rev 14(1):101–120CrossRefGoogle Scholar
  11. Shah P, Hoeffner J (2002) Review of graph comprehension research: implications for instruction. Educ Psychol Rev 14(1):47–69CrossRefGoogle Scholar
  12. Yu W, Brewster SA (2003) Evaluation of multimodal graphs for blind people. J Univers Access Inf Soc 2:105–124CrossRefGoogle Scholar

Copyright information

© Marta Olivetti Belardinelli and Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Özge Alaçam
    • 1
  • Christopher Habel
    • 1
  • Cengiz Acartürk
    • 2
  1. 1.Department of InformaticsUniversity of HamburgHamburgGermany
  2. 2.Department of Cognitive ScienceMiddle East Technical UniversityAnkaraTurkey

Personalised recommendations