Abstract
People use verbal descriptions and graphical depictions to communicate spatial information, thus externalizing their spatial mental representations. In many situations, such as in emergency response, the ability to translate the content of verbal descriptions into a sketch map could greatly assist with the interpretation of the message. In this paper, we present an outline of a semi-automatic framework enabling seamless transition between verbal descriptions and graphical sketches of precinct-scale urban environments. The proposed framework relies on a three-step approach: NL parsing, with spatial named entity and spatial relation recognition in natural language text; the construction of a spatial Property Graph capturing the spatial relationships between pairs of entities; and the sketch drawing step where the identified entities are dynamically placed on a canvas in a manner that minimizes conflicts between the verbalized spatial relationships, thus providing a plausible representation of the described environment. The approach is manually demonstrated on a natural language description of a university campus, and the opportunities and challenges of the suggested framework are discussed. The paper concludes by highlighting the contributions of the framework and by providing insights for its actual implementation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Sjoo, K., Pronobis, A., Jensfelt, P.: Functional Topological Relations for Qualitative Spatial Representation. In: Proceedings of 15th International Conference on Advanced Robotics (ICAR 2011), pp. 130–136. IEEE, Tallinn (2011)
Egenhofer, M.J.: Query Processing in Spatial-Query-by-Sketch. Journal of Visual Languages and Computing 8, 403–424 (1997)
Blaser, A.D.: User interaction in a sketch-based GIS user interface. In: Hirtle, S.C., Frank, A.U. (eds.) COSIT 1997. LNCS, vol. 1329, pp. 505–505. Springer, Heidelberg (1997)
Blaser, A.D., Egenhofer, M.J.: A visual tool for querying geographic databases. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 211–216. ACM, New York (2000)
Tappan, D.: Knowledge-Based Spatial Reasoning for Scene Generation from Text Description. In: Proceedings of Association for the Advancement of Artificial Intelligence, Chicago, IL (2008)
Denis, M.: The description of routes: A cognitive approach to the production of spatial discourse. Cahiers de Psychologie Cognitive 16, 409–458 (1997)
Wang, J., Schwering, A.: The Accuracy of Sketched Spatial Relations: How Cognitive Errors Influence Sketch Representation. In: Tenbrink, T., Winter, S. (eds.) International Workshop on Spatial Information: Granularity, Relevance, and Integration, In Conjunction with COSIT 2009, pp. 40–47 (2009)
Tversky, B.: What do Sketches say about Thinking? AAAI Spring Symposium, Sketch Understanding Workshop, AAAI Technical Report, Stanford University (2002)
Tversky, B., Lee, P.U.: Pictorial and Verbal Tools for Conveying Routes. In: Freksa, C., Mark, D.M. (eds.) COSIT 1999. LNCS, vol. 1661, pp. 51–64. Springer, Heidelberg (1999)
Tappan, D.A.: Knowledge-Based Spatial Reasoning for Automated Scene Generation from Text Descriptions. PhD Thesis, New Mexico State University, Las Cruces, New Mexico (2004)
Kordjamshidi, P., Van Otterlo, M., Moens, M.-F.: Spatial role labeling: Towards extraction of spatial relations from natural language. ACM Trans. Speech Lang. Process. 8, 4:1–4:36 (2011)
Kordjamshidi, P., Frasconi, P., Van Otterlo, M., Moens, M.-F., De Raedt, L.: Relational Learning for Spatial Relation Extraction from Natural Language. In: Muggleton, S.H., Tamaddoni-Nezhad, A., Lisi, F.A. (eds.) ILP 2011. LNCS, vol. 7207, pp. 204–220. Springer, Heidelberg (2012)
Coyne, B., Sproat, R., Hirschberg, J.: Spatial Relations in Text-to-Scene Conversion. In: Ross, R.J., Hois, J., Kelleher, J.D. (eds.) Proceedings of 1st Workshop on Computational Models of Spatial Language Interpretation (COSLI 2010), pp. 9–16. Mt Hood, Portland (2010)
Coyne, B., Rambow, O., Hirschberg, J., Sproat, R.: Frame semantics in text-to-scene generation. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds.) KES 2010, Part IV. LNCS, vol. 6279, pp. 375–384. Springer, Heidelberg (2010)
Wiebrock, S., Wittenburg, L., Schmid, U., Wysotzki, F.: Inference and Visualization of Spatial Relations. In: Freksa, C., Habel, C., Brauer, W., Wender, K. (eds.) Spatial Cognition II. LNCS (LNAI), vol. 1849, pp. 212–224. Springer, Heidelberg (2000)
Leidner, J.: Toponym Resolution in Text: Annotation, Evaluation and Applications of Spatial Grounding of Place Names. PhD Thesis, Institute for Communicating and Collaborative Systems, School of Informatics, University of Edinburgh (2007)
Egenhofer, M., Herring, J.: Categorizing Binary Topological Relations between Regions, Lines and Point in Geographic Databases. Department of Surveying Engineering. University of Maine, Orono (1990)
Randell, D.A., Cui, Z., Cohn, A.G.: A Spatial Logic based on Regions and Connection. In: Proceedings of 3rd International Conference on Principles of Knowledge, Representation and Reasoning (KR 1992), pp. 165–176. Morgan Kaufmann, San Mateo (1992)
Frank, A.U.: Qualitative spatial reasoning: cardinal directions as an example. International Journal of Geographical Information Systems 10, 269–290 (1996)
Hernández, D.: Relative Representation of Spatial Knowledge. In: Mark, D., Frank, A. (eds.) Cognitive and Linguistic Aspects of Geographic Space, pp. 373–385. Kluwer Academic, Dordrecht (1991)
Kelleher, J.D.: A perceptually based computational framework for the interpretation of spatial language (2003)
Li, H., Zhao, T., Li, S., Zhao, J.: The Extraction of Trajectories from Real Texts Based on Linear Classification. In: Proceedings of the 16th Nordic Conference of Computational Linguistics (NODALIDA 2007), pp. 121–127. University of Tartu, Tartu (2007)
Richter, K.-F., Klippel, A.: Before or After: Prepositions in Spatially Constrained Systems. In: Barkowsky, T., Knauff, M., Ligozat, G., Montello, D.R. (eds.) Spatial Cognition 2007. LNCS (LNAI), vol. 4387, pp. 453–469. Springer, Heidelberg (2007)
Bateman, J.A., Hois, J., Ross, R., Tenbrink, T.: A linguistic ontology of space for natural language processing. Artificial Intelligence 174, 1027–1071 (2010)
Bateman, J.A.: Language and Space: a two-level semantic approach based on principles of ontological engineering. Int. J. Speech Technol. 13, 29–48 (2010)
Bateman, J., Tenbrink, T., Farrar, S.: The Role of Conceptual and Linguistic Ontologies in Interpreting Spatial Discourse. Discourse Processes: A Multidisciplinary Journal 44, 175–212 (2007)
Kordjamshidi, P., van Otterlo, M., Moens, M.-F.: From language towards formal spatial calculi. In: Ross, R.J. (ed.) Proceedings of 1st Workshop on Computational Models of Spatial Language Interpretation (COSLI 2010), pp. 17–24. Mt.Hood, Portland (2010)
Zlatev, J.: Spatial Semantics. In: Cuyckens, H., Geeraerts, D. (eds.) The Oxford Handbook of Cognitive Linguistics, pp. 318–350. Oxford University Press (2007)
Litkowski, K., Hargraves, O.: SemEval-2007 Task 06: Word-Sense Disambiguation of Prepositions. In: Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval), pp. 24–29. Association for Computational Linguistics (2007)
Fellbaum, C. (ed.): WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)
Baker, C., Fillmore, C., Lowe, J.: The Berkeley FrameNet Project. COLING-ACL (1998)
Hidders, J.: Typing Graph-Manipulation Operations. In: Calvanese, D., Lenzerini, M., Motwani, R. (eds.) ICDT 2003. LNCS, vol. 2572, pp. 394–409. Springer, Heidelberg (2002)
Güting, R.H.: GraphDB: Modeling and Querying Graphs in Databases. In: Proceedings of the 20th International Conference on Very Large Databases (VLDB), Santiago, pp. 297–308 (1994)
Kuper, G.M., Vardi, M.Y.: A new approach to database logic. In: Proceedings of the 3rd ACM SIGACT-SIGMOD Symposium on Principles of Database Systems, pp. 86–96. ACM, New York (1984)
Rodriguez, M.A., Neubauer, P.: Constructions from dots and lines. Bulletin of the American Society for Information Science and Technology 36, 35–41 (2010)
Mainguenaud, M.: Modelling the network component of geographical information systems. International Journal of Geographical Information Systems 9, 575–593 (1995)
Freeman, L.C.: The Development of Social Network Analysis: A Study in the Sociology of Science. Empirical Press (2004)
Tversky, B.: Cognitive maps, cognitive collages, and spatial mental models. Presented at the Spatial Information Theory: A Theoretical Basis for GIS (1993)
Downs, R.M., Stea, D.: Cognitive Maps and Spatial Behaviour: Process and Products. In: Dodge, R., Kitchin, R., Perkins, C. (eds.) The Map Reader, pp. 312–317. John Wiley & Sons, Ltd. (2011)
Gould, P., White, R.: Mental Maps. Routledge, New York
Lynch, K.: The Image of the City. MIT Press (1960)
Tversky, B.: Visualizing Thought. Topics in Cognitive Science 3, 499–535 (2011)
Freksa, C.: Using Orientation Information for Qualitative Spatial Reasoning. In: Frank, A.U., Formentini, U., Campari, I. (eds.) GIS 1992. LNCS, vol. 639, pp. 162–178. Springer, Heidelberg (1992)
Hirtle, S., Jonides, J.: Evidence of hierarchies in cognitive maps. Memory & Cognition 13, 208–217 (1985)
McNamara, T.P., Hardy, J.K., Hirtle, S.C.: Subjective hierarchies in spatial memory. Journal of Experimental Psychology Learning Memory and Cognition 15, 211–227 (1989)
Meneghetti, C., Pazzaglia, F., De Beni, R.: The Mental Representation Derived from Spatial Descriptions is North-Up Oriented: The Role of Visuo-spatial Abilities. In: Stachniss, C., Schill, K., Uttal, D. (eds.) Spatial Cognition 2012. LNCS, vol. 7463, pp. 262–278. Springer, Heidelberg (2012)
Agrawala, M., Stolte, C.: Rendering effective route maps: improving usability through generalization. In: SIGGRAPH 2001: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM Request Permissions (2001)
Fraczak, L.: Generating “mental maps” from route descriptions. In: Olivier, P., Gapp, K.-P. (eds.) Representation and Processing of Spatial Expressions, pp. 185–200. L. Erlbaum Associates Inc., Mahwah (1998)
Richter, D., Vasardani, M., Stirling, L., Richter, K.-F., Winter, S.: Zooming In - Zooming Out: Hierarchies in Place Descriptions. In: Proceedings of the 9th Sympo-sium on Location Based Services (LBS 2012), Munich, Germany (2012)
Brunyé, T.T., Mahoney, C.R., Taylor, H.A.: Moving through imagined space: Mentally simulating locomotion during spatial description reading. Acta Psychologica 134, 110–124 (2010)
Grice, P.: Logic and Conversation. Syntax and Semantics 3, 41–58 (1975)
Meilinger, T.: The Network of Reference Frames Theory: A Synthesis of Graphs and Cognitive Maps. In: Freksa, C., Newcombe, N.S., Gärdenfors, P., Wölfl, S. (eds.) Proceedings of the International Conference on Spatial Cognition VI: Learning, Reasoning, and Talking about Space, pp. 344–360. Springer, Heidelberg (2008)
Wallgrün, J.O.: Qualitative spatial reasoning for topological map learning. Spatial Cognition & Computation (2010)
Barsalou, L.W.: Grounded Cognition. Annual Review of Psychology 59, 617–645 (2008)
Johnson-Laird, P.N., Byrne, R.M.J.: Conditionals: A theory of meaning, pragmatics, and inference. Psychological Review 109, 646–678 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Vasardani, M., Timpf, S., Winter, S., Tomko, M. (2013). From Descriptions to Depictions: A Conceptual Framework. In: Tenbrink, T., Stell, J., Galton, A., Wood, Z. (eds) Spatial Information Theory. COSIT 2013. Lecture Notes in Computer Science, vol 8116. Springer, Cham. https://doi.org/10.1007/978-3-319-01790-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-01790-7_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01789-1
Online ISBN: 978-3-319-01790-7
eBook Packages: Computer ScienceComputer Science (R0)