Skip to main content
SpringerLink
Log in

Linking Spatial Haptic Perception to Linguistic Representations: Assisting Utterances for Tactile-Map Explorations

  • Conference paper
Spatial Information Theory (COSIT 2011)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6899))

Included in the following conference series:

Abstract

Assisting utterances are helpful for blind and visually impaired map users exploring tactile maps. Virtual tactile maps explorable by haptic human-computer interfaces form the basis for multimodal presentations including automatically generated assisting utterances. This paper presents first empirical results regarding the type of utterances suitable for assisting the acquisition of survey knowledge on the basis of virtual tactile maps. The structure of the internal knowledge base, which has to support a connection between dynamic exploration movements and natural language, is presented. An example illustrates the approach and shows its practicability.

The research reported in this paper has been partially supported by DFG (German Science Foundation) in IRTG 1247 ‘Cross-modal Interaction in Natural and Artificial Cognitive Systems’ (CINACS). We thank the anonymous reviewers for their highly useful commentaries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. De Felice, F., Renna, F., Attolico, G., Distante, A.: A haptic/acoustic application to allow blind the access to spatial information. In: World Haptics Conference, pp. 310–315 (2007)

    Google Scholar 

  2. Espinosa, M.A., Ungar, S., Ochaita, E., Blades, M., Spencer, C.: Comparing methods for introducing blind and visually impaired people to unfamiliar urban environments. Journal of Environmental Psychology 18, 277–287 (1998)

    Article  Google Scholar 

  3. Giudice, N., Bakdash, J., Legge, G., Roy, R.: Spatial learning and navigation using a virtual verbal display. ACM Transactions on Applied Perception 7(1) (Article 3), 3:1–3:33 (2010)

    Google Scholar 

  4. Golledge, R.G., Rice, M.T., Jacobson, R.D.: Multimodal interfaces for representing and accessing geospatial information. In: Rana, S., Sharma, J. (eds.) Frontiers of Geographic Information Technology, pp. 181–208. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  5. Guhe, M., Habel, C., Tschander, L.: Incremental generation of interconnected preverbal messages. In: Pechmann, T., Habel, C. (eds.) Multidisciplinary Approaches to Language Production. Trends in Linguistics, pp. 7–52. De Gruyter, Berlin (2004)

    Google Scholar 

  6. Habel, C.: Prinzipien der Referentialität. Springer, Heidelberg (1986)

    Google Scholar 

  7. Habel, C.: Incremental generation of multimodal route instructions. In: Papers from the 2003 AAAI Spring Symposium on Natural Language Generation in Spoken and Written Dialogue, Stanford, CA, pp. 44–51 (2003)

    Google Scholar 

  8. Habel, C., Kerzel, M., Lohmann, K.: Verbal assistance in tactile-map explorations: A case for visual representations and reasoning. In: Proceedings of AAAI Workshop on Visual Representations and Reasoning 2010, Atlanta, GA (2010)

    Google Scholar 

  9. Jacobson, R.D.: Navigating maps with little or no sight: An audio-tactile approach. In: Proceedings of the Workshop on Content Visualization and Intermedia Representations (CVIR), Montreal, pp. 95–102 (1998)

    Google Scholar 

  10. Jacobson, R.D.: Representing spatial information through multimodal interfaces. In: Sixth International Conference on Information Visualisation, IV 2002 (2002)

    Google Scholar 

  11. Kostopoulos, K., Moustakas, K., Tzovaras, D., Nikolakis, G.: Haptic access to conventional 2D maps for the visually impaired. Journal on Multimodal User Interfaces 1(2), 13–19 (2007)

    Article  Google Scholar 

  12. Krueger, M.W., Gilden, D.: KnowWhere: an audio/spatial interface for blind people. In: Ballas, J. (ed.) Proceeding of the International Conference on Auditory Display (ICAD). International Community for Auditory Display, Palo Alto (1997)

    Google Scholar 

  13. Lederman, S.J., Klatzky, R.L.: Haptic perception: A tutorial. Attention, Perception, and Psychophysics 71(7), 1439–1459 (2009)

    Article  Google Scholar 

  14. Levelt, W.: Speaking: From intention to articulation. The MIT Press, Cambridge (1989)

    Google Scholar 

  15. Lobben, A.K.: Tasks, strategies, and cognitive processes associated with navigational map reading: A review perspective. The Professional Geographer 56(2), 270–281 (2004)

    Google Scholar 

  16. Lohmann, K., Kerzel, M., Habel, C.: Generating verbal assistance for tactile-map explorations. In: van der Sluis, I., Bergmann, K., van Hooijdonk, C., Theune, M. (eds.) Proceedings of the 3rd Workshop on Multimodal Output Generation 2010, Dublin (2010)

    Google Scholar 

  17. Loomis, J.M., Klatzky, R.L., Lederman, S.J.: Similarity of tactual and visual picture recognition with limited field of view. Perception 20(2), 167–177 (1991)

    Article  Google Scholar 

  18. Magnusson, C., Rassmus-Gröhn, K.: A dynamic haptic-audio traffic environment. In: Proc. of Eurohaptics, pp. 5–7 (2004)

    Google Scholar 

  19. Miele, J.A., Landau, S., Gilden, D.: Talking TMAP: Automated generation of audio-tactile maps using Smith-Kettlewell’s TMAP software. British Journal of Visual Impairment 24(2), 93–100 (2006)

    Article  Google Scholar 

  20. Mou, W., McNamara, T.P.: Intrinsic frames of reference in spatial memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 28(1), 162–170 (2002)

    Article  Google Scholar 

  21. Palmer, S.E.: Fundamental aspects of cognitive representation. In: Rosch, E., Lloyd, B.B. (eds.) Cognition and Categorization, pp. 259–303. Lawrence Erlbaum, Hillsdale (1978)

    Google Scholar 

  22. Parente, P., Bishop, G.: BATS: the blind audio tactile mapping system. In: Proceedings of the ACM Southeast Regional Conference, Savannah, GA (2003)

    Google Scholar 

  23. Parkes, D.: Audio tactile systems for designing and learning complex environments as a vision impaired person: static and dynamic spatial information access. In: James, S., Hedberg, J. (eds.) Learning Environment Technology: Selected Papers from LETA 1994, vol. 94, pp. 219–223. AJET Publications, Canberra (1994)

    Google Scholar 

  24. Reiter, E., Dale, R.: Building Natural Language Generation Systems. Cambridge University Press, Cambridge (2000)

    Book  Google Scholar 

  25. Roy, D., Reiter, E.: Connecting language to the world. Artificial Intelligence 167(1-2), 1–12 (2005)

    Article  Google Scholar 

  26. Siegel, A.W., White, S.H.: The development of spatial representations of large-scale environments. In: Reese, H. (ed.) Advances in Child Development and Behavior, vol. 10, pp. 9–55. Academic Press, New York (1975)

    Google Scholar 

  27. Tappe, H., Habel, C.: Verbalization of dynamic sketch maps: Layers of representation and their interaction. In: Proc. of 20th Ann. Meeting of the Cog. Sci. Society (CogSci-1998), Madison, WI (1998)

    Google Scholar 

  28. Taylor, H.A., Tversky, B.: Perspective in spatial descriptions. Journal of Memory and Language 35(3), 371–391 (1996)

    Article  Google Scholar 

  29. Tversky, B.: Cognitive maps, cognitive collages, and spatial mental models. In: Campari, I., Frank, A.U. (eds.) COSIT 1993. LNCS, vol. 716, pp. 14–24. Springer, Heidelberg (1993)

    Google Scholar 

  30. Ungar, S.: Cognitive mapping without visual experience. In: Kitchin, R., Freundschuh, S. (eds.) Cognitive Mapping: Past, Present and Future, pp. 221–248. Routledge, London (2000)

    Google Scholar 

  31. Ungar, S., Blades, M., Spencer, C.: The role of tactile maps in mobility training. British Journal of Visual Impairment 11(2), 59–61 (1993)

    Article  Google Scholar 

  32. Waller, D.: Individual differences in spatial learning from computer-simulated environments. Journal of Experimental Psychology: Applied 6(4), 307–321 (2000)

    Article  Google Scholar 

  33. Wang, R.: Spatial processing and view-dependent representations. In: Mast, F., Jäncke, L. (eds.) Spatial Processing in Navigation, Imagery and Perception, pp. 49–65. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  34. Wang, Z., Li, B., Hedgpeth, T., Haven, T.: Instant tactile-audio map: enabling access to digital maps for people with visual impairment. In: Proceeding of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, Pittsburg, PA, pp. 43–50 (2009)

    Google Scholar 

  35. Werner, S., Krieg-Brückner, B., Mallot, H.A., Schweizer, K., Freksa, C.: Spatial cognition: The role of landmark, route, and survey knowledge in human and robot navigation. In: Jarke, M., Pasedach, K., Pohl, K. (eds.) Informatik 1997, pp. 41–50. Springer, Berlin (1997)

    Google Scholar 

  36. Winter, S., Tomko, M., Elias, B., Sester, M.: Landmark hierarchies in context. Environment and Planning B: Planning and Design 35(3), 381–398 (2008)

    Article  Google Scholar 

  37. Zeng, L., Weber, G.: Audio-haptic browser for a geographical information system. In: Miesenberger, K., Zagler, W., Karschmer, A. (eds.) Computers Helping People with Special Needs, Part II, pp. 466–473 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department for Informatics, University of Hamburg, Vogt-Kölln-Str. 30, 22527, Hamburg, Germany

    Kris Lohmann, Carola Eschenbach & Christopher Habel

Authors
  1. Kris Lohmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carola Eschenbach
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christopher Habel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Maine, 04469, Orono, ME, USA

    Max Egenhofer , Nicholas Giudice , Reinhard Moratz  & Michael Worboys , ,  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lohmann, K., Eschenbach, C., Habel, C. (2011). Linking Spatial Haptic Perception to Linguistic Representations: Assisting Utterances for Tactile-Map Explorations. In: Egenhofer, M., Giudice, N., Moratz, R., Worboys, M. (eds) Spatial Information Theory. COSIT 2011. Lecture Notes in Computer Science, vol 6899. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23196-4_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23196-4_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23195-7

  • Online ISBN: 978-3-642-23196-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation