Walk This Way: Spatial Grounding for City Exploration

  • Johan Boye
  • Morgan Fredriksson
  • Jana Götze
  • Joakim Gustafson
  • Jürgen Königsmann
Conference paper


Recently there has been an interest in spatially aware systems for pedestrian routing and city exploration, due to the proliferation of smartphones with GPS receivers among the general public. Since GPS readings are noisy, giving good and well-timed route instructions to pedestrians is a challenging problem. This paper describes a spoken-dialogue prototype for pedestrian navigation in Stockholm that addresses this problem by using various grounding strategies.



This paper is supported by the European Commission, project SpaceBook, grant no 270019.


  1. 1.
    Bartie, P., Mackaness, W.: Development of a speech-based augmented reality system to support exploration of cityscape. Trans. GIS 10(1), 63–86 (2006)CrossRefGoogle Scholar
  2. 2.
    Borriello, G., Chalmers, M., LaMarca, A., Nixon, P.: Delivering real-world ubiquitous location systems. Commun. ACM 8(3), 36–41 (2005)CrossRefGoogle Scholar
  3. 3.
    Boye, J., Gustafson, J.: How to do dialogue in a fairy-tale world. Proceedings of the 6th SIGDial Workshop on Discourse and Dialogue, Lisbon, Portugal (2005)Google Scholar
  4. 4.
    Boye, J., Gustafson, J., Wirén, M.: Robust spoken language understanding in a computer game. J. Speech Commun. 48, 335–353 (2006)CrossRefGoogle Scholar
  5. 5.
    Cai, G., Wang, H., MacEachren, A.: Communicating vague spatial concepts in human-gis interactions: a collaborative dialogue approach. In: Spatial Information Theory: Foundations of Geographic Information Science. Lecture Notes in Computer Science, vol. 2825, pp. 287–300. Springer, Berlin (2003)CrossRefGoogle Scholar
  6. 6.
    Cuayáhuitl, H., Dethlefs, N.: Spatially-aware dialogue control using hierarchical reinforcement learning. ACM Trans. Speech Lang. Process (Special Issue on Machine Learning for Adaptive Spoken Dialogue Systems) 7(3), 5:1–5:26 (2011)Google Scholar
  7. 7.
    Denis, M., Pazzaglia, F., Cornoldi, C., Bertolo, L.: Spatial discourse and navigation: an analysis of route directions in the city of Venice. Appl. Cognitive Psychol. 13(2), 145–174 (1999)CrossRefGoogle Scholar
  8. 8.
    Google Inc.: Google maps for mobile. (2012b)
  9. 9.
    Google Inc.: Google maps navigation. (2012a)
  10. 10.
    Gustafson, J., Bell, L., Beskow, J., Boye, J., Carlson, R., Edlund, J., Granström, B., House, D., Wirén, M.: Adapt: a multimodal conversational dialogue system in an apartment domain. In: Proceedings of International Conference on Spoken Language Processing (ICSLP) (2000)Google Scholar
  11. 11.
    Haklay, M.: OpenStreetMap: user-generated street maps. Pervasive Comput. IEEE 7(4), 12–18 (2008)CrossRefGoogle Scholar
  12. 12.
    Johansson, M., Skantze, G., Gustafson, J.: Understanding route directions in human-robot dialogue. Proceedings of SemDial 2011: Proceedings of the 15th Workshop on the Semantics and Pragmatics of Dialogue, Los Angeles, pp. 19–27 (2011)Google Scholar
  13. 13.
    Jöst, M., Häussler, J., Merdes, M., Malaka, R.: Multimodal interaction for pedestrians: an evaluation study. In: IUI ’05: Proceedings of the 10th International Conference on Intelligent User Interfaces, San Diego, pp. 59–66 (2005)Google Scholar
  14. 14.
    Krug, K., Mountain, D., Phan, D.: Webpark: location-based services for mobile users in protected areas. GeoInformatics 26, 26–29 (2003)Google Scholar
  15. 15.
    Lemon, O., Bracy, A., Gruenstein, A., Peters, S.: A multi-modal dialogue system for human-robot conversation. In: Proceedings of North American Chapter of the Association for Computational Linguistics (NAACL), Pittsburgh (2001)Google Scholar
  16. 16.
    Looije, R., te Brake, G., Neerincx, M.: Usability engineering for mobile maps. In: Proceedings of Mobility’07, 4th International Conference on Mobile Technology, Applications, and Systems, Singapore (2007)Google Scholar
  17. 17.
    Lovelace, K., Hegarty, M., Montello, D.: Elements of good route descriptions in familiar and unfamiliar environments. In: Spatial Information Theory: Cognitive and Computational Foundations of Geographic Information Science. Lecture Notes in Computer Science, vol. 1661/1991. Springer, Berlin (1999)Google Scholar
  18. 18.
    MacMahon, M., Stankiewicz, B., Kuijpers, B.: Walk the talk: connecting language, knowledge, action in route instructions. National Conference on Artificial Intelligence (AAAI-06), Boston (2006)Google Scholar
  19. 19.
    Malaka, R., Zipf, A.: Deep map: challenging IT research in the framework of a tourist information system. In: Information and Communication Technologies in Tourism. Springer, New York (2000)Google Scholar
  20. 20.
    Skantze, G.: Making grounding decisions: Data-driven estimation of dialogue costs and confidence thresholds. Proceedings of SigDial, pp. 206–210. Antwerp, Belgium (2007)Google Scholar
  21. 21.
    Skantze, G., Edlund, J., Carlson, R.: Talking with higgins: Research challenges in a spoken dialogue system. In: Perception and Interactive Technologies, pp. 193–196. Springer, New York (2006)CrossRefGoogle Scholar
  22. 22.
    Striegnitz, K., Denis, A., Gargett, A. Garoufi, K., Koller, A., Theune, M.: Report on the second challenge on generating instructions in virtual environments (GIVE-2.5). In: Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation (ENLG), Nancy (2011)Google Scholar
  23. 23.
    Tom, A., Denis, M.: Referring to landmark or street information in route directions: What difference does it make? In: Spatial Information Theory: Foundations of Geographic Science. Lecture Notes in Computer Science, vol. 2825, pp. 362–374. Springer, Berlin (2003)CrossRefGoogle Scholar
  24. 24.
    Traum, D.: Computational models of grounding in collaborative systems. AAAI Technical Report FS-99-03 (1999)Google Scholar
  25. 25.
    Wang, H., Cai, G., MacEachren, A.: GeoDialogue: a software agent enabling collaborative dialogues between a user and a conversational GIS. In: 20th IEEE International Conference on Tools with Artificial Intelligence, 2008 ICTAI ’08, Dayton (2008)Google Scholar
  26. 26.
    Zipf, A., Jöst, M.: Implementing adaptive mobile GI services based on ontologies: examples for pedestrian navigation support. Comput. Environ. Urban Syst. Special Issue on LBS and UbiGIS (2005)Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Johan Boye
    • 1
  • Morgan Fredriksson
    • 2
  • Jana Götze
    • 1
  • Joakim Gustafson
    • 1
  • Jürgen Königsmann
    • 2
  1. 1.KTH, School of Computer Science and CommunicationStockholmSweden
  2. 2.Liquid MediaStockholmSweden

Personalised recommendations