Skip to main content

Extended Verbal Assistance Facilitates Knowledge Acquisition of Virtual Tactile Maps

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 7463)

Abstract

We report on an experiment testing the VAVETaM (Verbally-Assisting Virtual-Environment Tactile Maps) approach for an intelligent multimodal tactile-map system, which was proposed to support blind and visually impaired people in acquiring survey knowledge. In the experiment, participants received two types of assisting utterances while exploring virtual tactile maps in a repeated-measures experiment: (1) only names of map objects and (2) additional information, for example, about spatial relations between the objects. The latter type of verbal assistance was similar to that which humans give when they are asked to verbally assist a map explorer. The virtual tactile maps were presented using a device for haptic human-computer interaction. The data indicate that the spatial knowledge map users acquire consists of two subtypes: knowledge of the structure of map entities that represent objects enabling locomotion (such as streets) and knowledge of the configuration of potential landmarks. Regarding both subtypes together, participants performed significantly better after learning the map with additional verbal information compared to receiving only information about the proper names of objects. A more fine-grained analysis shows that this improvement is only based on knowledge of the configuration of potential landmarks.

Keywords

  • Spatial Knowledge Acquisition
  • Virtual Tactile Map
  • Audio-Tactile Map
  • Maps for People with Low Vision
  • Multimodal Interface
  • Verbal Assisting Utterances
  • Virtual Haptics

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bérla, E.P.: Tactile Scanning and Memory for a Spatial Display By Blind Students. The Journal of Special Education 15(3), 341–350 (1981)

    CrossRef  Google Scholar 

  2. Blades, M.: The Reliability of Data Collected from Sketch Maps. Journal of Environmental Psychology 10(4), 327–339 (1990)

    CrossRef  Google Scholar 

  3. Blades, M., Ungar, S., Spencer, C.: Map Use by Adults with Visual Impairments. The Professional Geographer 51(4), 539–553 (1999)

    CrossRef  Google Scholar 

  4. Brunyé, T.T., Taylor, H.A.: Extended Experience Benefits Spatial Mental Model Development with Route but Not Survey Descriptions. Acta Psychologica 127, 340–354 (2008)

    CrossRef  Google Scholar 

  5. Brunyé, T.T., Taylor, H.A.: Working Memory in Developing and Applying Mental Models from Spatial Descriptions. Journal of Memory and Language 58(3), 701–729 (2008)

    CrossRef  Google Scholar 

  6. Buzzi, M.C., Buzzi, M., Leporini, B., Martusciello, L.: Making Visual Maps Accessible to the Blind. In: Stephanidis, C. (ed.) HCII 2011 and UAHCI 2011, Part II. LNCS, vol. 6766, pp. 271–280. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

  7. Cohen, J.: A Power Primer. Psychological Bulletin 112(1), 155–159 (1992)

    CrossRef  Google Scholar 

  8. Dahlback, N., Jonsson, A., Ahrenberg, L.: Wizard of Oz Studies—Why and How. Knowledge-based Systems 6(4), 258–266 (1993)

    CrossRef  Google Scholar 

  9. Espinosa, M.A., Ungar, S., Ochaíta, E., Blades, M., Spencer, C.: Comparing Methods for Introducing Blind and Visually Impaired People to Unfamiliar Urban Environments. Journal of Environmental Psychology 18, 277–287 (1998)

    CrossRef  Google Scholar 

  10. Field, A.P.: Discovering Statistics Using SPSS. Sage, London (2005)

    Google Scholar 

  11. Giudice, N.A., Bakdash, J.Z., Legge, G.E.: Wayfinding with Words: Spatial Learning and Navigation Using Dynamically Updated Verbal Descriptions. Psychological Research 71(3), 347–358 (2007)

    CrossRef  Google Scholar 

  12. Giudice, N.A., Betty, M.R., Loomis, J.M.: Functional Equivalence of Spatial Images From Touch and Vision: Evidence From Spatial Updating in Blind and Sighted Individuals. Learning, Memory 37(3), 621–634 (2011)

    CrossRef  Google Scholar 

  13. Habel, C., Kerzel, M., Lohmann, K.: Verbal Assistance in Tactile-Map Explorations: A Case for Visual Representations and Reasoning. In: Proceedings of AAAI Workshop on Visual Representations and Reasoning 2010, Menlo Park, CA, USA (2010)

    Google Scholar 

  14. Jacobson, R.D.: Cognitive Mapping Without Sight: Four Preliminary Studies of Spatial Learning. Journal of Environmental Psychology 18, 289–306 (1998)

    CrossRef  Google Scholar 

  15. Jacobson, R.D.: Talking Tactile Maps and Environmental Audio Beacons: An Orientation and Mobility Development Tool for Visually Impaired People. In: Proceedings of Maps and Diagrams for Blind and Visually Impaired People: Needs, Solutions, and Developments, Ljubjiana, Slovenia (1996)

    Google Scholar 

  16. Kitchin, R.M., Blades, M.: The Cognition of Geographic Space, I. B. Tauris, London, New York (2002)

    Google Scholar 

  17. Lohmann, K.: The Use of Sketch Maps as Measures for Spatial Knowledge. In: Wang, J., Brölemann, K., Chipofya, M., Schwering, A., Wallgrün, J.O. (eds.) Understanding and Processing Sketch Maps – Proceedings of the COSIT 2011 Workshop, pp. 45–54. IOS Press, Belfast (2011)

    Google Scholar 

  18. Lohmann, K., Eichhorn, O., Baumann, T.: Generating Situated Assisting Utterances to Facilitate Tactile-Map Exploration: A Prototype System. In: Proceedings of the NAACL Workshop on Speech and Language Processing for Assistive Technologies 2012, Montreal, QC, Canada (2012)

    Google Scholar 

  19. Lohmann, K., Eschenbach, C., Habel, C.: Linking Spatial Haptic Perception to Linguistic Representations: Assisting Utterances for Tactile-Map Explorations. In: Egenhofer, M., Giudice, N., Moratz, R., Worboys, M. (eds.) COSIT 2011. LNCS, vol. 6899, pp. 328–349. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

  20. Lohmann, K., Kerzel, M., Habel, C.: Generating Verbal Assistance for Tactile-Map Explorations. In: van der Sluis, I., Bergmann, K., van Hooijdonk, C., Theune, M. (eds.) Proceedings of the 3rd Workshop on Multimodal Output Generation 2010, Dublin (2010)

    Google Scholar 

  21. Lynch, K.: The Image of the City. MIT Press, Cambridge (1960)

    Google Scholar 

  22. Millar, S.: Understanding and Representing Spatial Information. British Journal of Visual Impairment 13(1), 8–11 (1995)

    CrossRef  MathSciNet  Google Scholar 

  23. Montello, D.R.: A New Framework for Understanding the Acquisition of Spatial Knowledge in Large-scale Environments. In: Kahana, M.J., Golledge, R.G. (eds.) Spatial and Temporal Reasoning in Geographic Information Systems, Oxford, New York, pp. 143–154 (1998)

    Google Scholar 

  24. Newcombe, N.: Methods for the Study of Spatial Cognition. In: Cohen, R. (ed.) The Development of Spatial Cognition, pp. 277–300. Lawrence Erlbaum, Hillsdale (1985)

    Google Scholar 

  25. Shrout, P.E., Fleiss, J.L.: Intraclass Correlations: Uses in Assessing Rater Reliability. Psycholocial Bulletin 86(2), 420–428 (1979)

    CrossRef  Google Scholar 

  26. Siegel, A.W., White, S.H.: The Development of Spatial Representations of Large-scale Environments. Advances in Child Development and Behavior 10, 9–55 (1975)

    CrossRef  Google Scholar 

  27. Taylor, H.A., Tversky, B.: Spatial Mental Models Derived from Survey and Route Descriptions. Journal of Memory and Language 31(2), 261–292 (1992)

    CrossRef  Google Scholar 

  28. Tversky, B.: Cognitive Maps, Cognitive Collages, and Spatial Mental Models. In: Frank, A.U., Campari, I. (eds.) Spatial Information Theory: A Theoretical Basis for GIS, pp. 14–24. Springer, Berlin (1993)

    CrossRef  Google Scholar 

  29. Ungar, S.: Cognitive Mapping Without Visual Experience. In: Kitchin, R., Freundschuh, S. (eds.) Cognitive Mapping: Past, Present and Future, pp. 221–248. Routledge, London (2000)

    Google Scholar 

  30. Wang, Z., Li, B., Hedgpeth, T., Haven, T.: Instant Tactile-audio Map: Enabling Access to Digital Maps for People with Visual Impairment. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 43–50. ACM, Pittsburg (2009)

    CrossRef  Google Scholar 

  31. Wellek, S.: Testing Statistical Hypotheses of Equivalence. CRC Press, Boca Raton (2003)

    Google Scholar 

  32. Wen, W., Ishikawa, T., Sato, T.: Working Memory in Spatial Knowledge Acquisition: Differences in Encoding Processes and Sense of Direction. Applied Cognitive Psychology 25, 654–662 (2011)

    CrossRef  Google Scholar 

  33. Zeng, L., Weber, G.: Audio-Haptic Browser for a Geographical Information System. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 466–473. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lohmann, K., Habel, C. (2012). Extended Verbal Assistance Facilitates Knowledge Acquisition of Virtual Tactile Maps. In: Stachniss, C., Schill, K., Uttal, D. (eds) Spatial Cognition VIII. Spatial Cognition 2012. Lecture Notes in Computer Science(), vol 7463. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32732-2_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32732-2_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32731-5

  • Online ISBN: 978-3-642-32732-2

  • eBook Packages: Computer ScienceComputer Science (R0)