Skip to main content

Learning with Virtual Verbal Displays: Effects of Interface Fidelity on Cognitive Map Development

  • Conference paper
Spatial Cognition VI. Learning, Reasoning, and Talking about Space (Spatial Cognition 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5248))

Included in the following conference series:

Abstract

We investigate verbal learning and cognitive map development of simulated layouts using a non-visual interface called a virtual verbal display (VVD). Previous studies have questioned the efficacy of VVDs in supporting cognitive mapping (Giudice, Bakdash, Legge, & Roy, in revision). Two factors of interface fidelity are investigated which could account for this deficit, spatial language vs. spatialized audio and physical vs. imagined rotation. During training, participants used the VVD (Experiments 1 and 2) or a visual display (Experiment 3) to explore unfamiliar computer-based layouts and seek-out target locations. At test, participants performed a wayfinding task between targets in the corresponding real environment. Results demonstrated that only spatialized audio in the VVD improved wayfinding behavior, yielding almost identical performance as was found in the visual condition. These findings suggest that learning with both modalities led to comparable cognitive maps and demonstrate the importance of incorporating spatial cues in verbal displays.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Taylor, H.A., Tversky, B.: Spatial mental models derived from survey and route descriptions. Journal of Memory and Language 31, 261–292 (1992)

    Article  Google Scholar 

  2. Denis, M., et al.: Spatial Discourse and Navigation: An analysis of route directions in the city of Venice. Applied Cognitive Psychology 13, 145–174 (1999)

    Article  Google Scholar 

  3. Lovelace, K., Hegarty, M., Montello, D.: Elements of good route directions in familiar and unfamiliar environments. In: Freksa, C., Mark, D.M. (eds.) Spatial information theory: Cognitive and computational foundations of geographic information science, pp. 65–82. Springer, Berlin (1999)

    Chapter  Google Scholar 

  4. Tversky, B.: Spatial perspective in descriptions. In: Bloom, P., et al. (eds.) Language and Space, pp. 463–492. MIT Press, Cambridge (1996)

    Google Scholar 

  5. Loomis, J.M., et al.: Assisting wayfinding in visually impaired travelers. In: Allen, G.L. (ed.) Applied spatial cognition: From research to cognitive technology, pp. 179–202. Erlbaum, Mahwah (2007)

    Google Scholar 

  6. Giudice, N.A.: Navigating novel environments: A comparison of verbal and visual learning, Unpublished dissertation, University of Minnesota, Twin Cities (2004)

    Google Scholar 

  7. Giudice, N.A.: Wayfinding without vision: Learning real and virtual environments using dynamically-updated verbal descriptions. In: Conference and Workshop on Assistive Technologies for Vision and Hearing Impairment, Kufstein, Austria (2006)

    Google Scholar 

  8. Giudice, N.A., et al.: Spatial learning and navigation using a virtual verbal display. ACM Transactions on Applied Perception (in revision)

    Google Scholar 

  9. Giudice, N.A., Bakdash, J.Z., Legge, G.E.: Wayfinding with words: Spatial learning and navigation using dynamically-updated verbal descriptions. Psychological Research 71(3), 347–358 (2007)

    Article  Google Scholar 

  10. Giudice, N.A., Legge, G.E.: Comparing verbal and visual information displays for learning building layouts. Journal of Vision 4(8), 889 (2004)

    Article  Google Scholar 

  11. Ruddle, R.A., Payne, S.J., Jones, D.M.: Navigating buildings in “desk-top” virtual environments: Experimental investigations using extended navigational experience. Journal of Experimental Psychology: Applied 3(2), 143–159 (1997)

    Article  Google Scholar 

  12. Bliss, J.P., Tidwell, P., Guest, M.: The effectiveness of virtual reality for administering spatial navigation training to firefighters. Presence 6(1), 73–86 (1997)

    Google Scholar 

  13. Waller, D., Hunt, E., Knapp, D.: The transfer of spatial knowledge in virtual environment training. Presence 7, 129–143 (1998)

    Article  Google Scholar 

  14. Piaget, J., Inhelder, B., Szeminska, A.: The child’s conception of geometry. Basic Books, New York (1960)

    Google Scholar 

  15. Siegel, A., White, S.: The development of spatial representation of large scale environments. In: Reese, H. (ed.) Advances in Child Development and Behavior. Academic Press, New York (1975)

    Google Scholar 

  16. O’Keefe, J., Nadel, L.: The hippocampus as a cognitive map. Oxford University Press, London (1978)

    Google Scholar 

  17. Ehrlich, K., Johnson-Laird, P.N.: Spatial descriptions and referential continuity. Journal of Verbal Learning & Verbal Behavior 21, 296–306 (1982)

    Article  Google Scholar 

  18. Loomis, J.M., et al.: Personal guidance system for people with visual impairment: A comparison of Spatial Displays for route guidance. Journal of Visual Impairment & Blindness 99, 219–232 (2005)

    Google Scholar 

  19. Loomis, J.M., Golledge, R.G., Klatzky, R.L.: Navigation system for the blind: Auditory display modes and guidance. Presence 7, 193–203 (1998)

    Article  Google Scholar 

  20. Marston, J.R., et al.: Evaluation of spatial displays for navigation without sight. ACM Transactions on Applied Perception 3(2), 110–124 (2006)

    Article  Google Scholar 

  21. Simpson, B.D., et al.: Spatial audio as a navigation aid and attitude indicator. In: Human Factors and Ergonomics Society 49th Annual Meeting, Orlando, Florida (2005)

    Google Scholar 

  22. Oving, A.B., Veltmann, J.A., Bronkhorst, A.W.: Effectiveness of 3-D audio for warnings in the cockpit. Int. Journal of Aviation Psychology 14, 257–276 (2004)

    Article  Google Scholar 

  23. Richardson, A.E., Montello, D.R., Hegarty, M.: Spatial knowledge acquisition from maps and from navigation in real and virtual environments. Memory & Cognition 27(4), 741–750 (1999)

    Google Scholar 

  24. Wilson, P.N., Foreman, N., Tlauka, M.: Transfer of spatial information from a virtual to a real environment. Human Factors 39(4), 526–531 (1997)

    Article  Google Scholar 

  25. Klatzky, R.L., et al.: Cognitive load of navigating without vision when guided by virtual sound versus spatial language. Journal of Experimental Psychology: Applied 12(4), 223–232 (2006)

    Article  Google Scholar 

  26. Lathrop, W.B., Kaiser, M.K.: Acquiring spatial knowledge while traveling simple and complex paths with immersive and nonimmersive interfaces. Presence 14(3), 249–263 (2005)

    Article  Google Scholar 

  27. Lathrop, W.B., Kaiser, M.K.: Perceived orientation in physical and virtual environments: Changes in perceived orientation as a function of idiothetic information available. Presence (Camb) 11(1), 19–32 (2002)

    Article  Google Scholar 

  28. Bakker, N.H., Werkhoven, P.J., Passenier, P.O.: The effects of proprioceptive and visual feedback on geographical orientation in virtual environments. Presence 8(1), 36–53 (1999)

    Article  Google Scholar 

  29. Ruddle, R.A., Payne, S.J., Jones, D.M.: Navigating large-scale virtual environments: What differences occur between helmet-mounted and desk-top displays. Presence 8(2), 157–168 (1999)

    Article  Google Scholar 

  30. Wraga, M., Creem-Regehr, S.H., Proffitt, D.R.: Spatial updating of virtual displays during self- and display rotation. Mem. and Cognit. 32(3), 399–415 (2004)

    Google Scholar 

  31. Klatzky, R.L., et al.: Spatial updating of self-position and orientation during real, imagined, and virtual locomotion. Psychological Science 9(4), 293–299 (1998)

    Article  Google Scholar 

  32. Grant, S.C., Magee, L.E.: Contributions of proprioception to navigation in virtual environments. Human Factors 40(3), 489–497 (1998)

    Article  Google Scholar 

  33. Farrell, M.J., et al.: Transfer of route learning from virtual to real environments. Journal of Experimental Psychology: Applied 9(4), 219–227 (2003)

    Article  Google Scholar 

  34. Presson, C.C., Montello, D.R.: Updating after rotational and translational body movements: Coordinate structure of perspective space. Perception 23(12), 1447–1455 (1994)

    Article  Google Scholar 

  35. de Vega, M., Rodrigo, M.J.: Updating spatial layouts mediated by pointing and labelling under physical and imaginary rotation. European Journal of Cognitive Psychology 13, 369–393 (2001)

    Google Scholar 

  36. Avraamides, M.N.: Spatial updating of environments described in texts. Cognitive Psychology 47(4), 402–431 (2003)

    Article  Google Scholar 

  37. Chance, S.S., et al.: Locomotion mode affects the updating of objects encountered during travel: The Contribution of vestibular and proprioceptive inputs to path integration. Presence 7(2), 168–178 (1998)

    Article  Google Scholar 

  38. Klatzky, R.L., et al.: Encoding, learning, and spatial updating of multiple object locations specified by 3-D sound, spatial language, and vision. Experimental Brain Research 149(1), 48–61 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Christian Freksa Nora S. Newcombe Peter Gärdenfors Stefan Wölfl

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Giudice, N.A., Tietz, J.D. (2008). Learning with Virtual Verbal Displays: Effects of Interface Fidelity on Cognitive Map Development. In: Freksa, C., Newcombe, N.S., Gärdenfors, P., Wölfl, S. (eds) Spatial Cognition VI. Learning, Reasoning, and Talking about Space. Spatial Cognition 2008. Lecture Notes in Computer Science(), vol 5248. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87601-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-87601-4_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-87600-7

  • Online ISBN: 978-3-540-87601-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics