Advertisement

Discovering and Learning Recurring Structures in Building Floor Plans

  • Andreas Sedlmeier
  • Sebastian FeldEmail author
Conference paper
Part of the Lecture Notes in Geoinformation and Cartography book series (LNGC)

Abstract

Autonomous mobile robots show promising opportunities as concrete use cases of location-based services. Such robots are able to perform various tasks in buildings using a wide array of sensors to perceive their surroundings. A connected area of research which forms the basis for a deeper understanding of these perceptions is the numerical representation of visual perception of space. Different structures in buildings like rooms, hallways and doorways form different, corresponding patterns in these representations. Thanks to recent advances in the field of deep learning with neural networks, it now seems possible to explore the idea of automatically learning these recurring structures using machine learning techniques. Combining these topics will enable the creation of new and better location-based services which have a deep awareness of their surroundings. This paper presents a framework to create a data set containing 2D isovist measures calculated along geospatial trajectories that traverse a 3D simulation environment. Furthermore, we show that these isovist measures do reflect the recurring structures found in buildings and the recurring patterns are encoded in a way that unsupervised machine learning is able to identify meaningful structures like rooms, hallways and doorways. These labeled data sets can further be used for neural network based supervised learning. The models generated this way do generalize and are able to identify structures in different environments.

References

  1. blender.org (2017) Home of the blender project—free and open 3d creation software. https://www.blender.org/. Accessed 23 July 2017
  2. Unity (2017) Game engine. http://unity3d.com. Accessed 22 July 2017
  3. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mané D, Monga R, Moore S, MurrayD, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viégas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous systems. http://tensorflow.org/
  4. Ah-Soon C, Tombre K (1997) Variations on the analysis of architectural drawings. In: Proceedings of the fourth international conference on document analysis and recognition, 1997, vol 1. IEEE, pp 347–351Google Scholar
  5. Anguelov D, Koller D, Parker E, Thrun S (2004) Detecting and modeling doors with mobile robots. In: ICRA’04. 2004 IEEE international conference on robotics and automation, 2004. Proceedings, vol 4. IEEE, pp 3777–3784Google Scholar
  6. Balsamo M, Knottenbelt W, Marin A (2013) Computer performance engineering: 10th European workshop, EPEW 2013, Venice, Italy, September 16–17, 2013, Proceedings. Lecture notes in computer science. Springer, BerlinGoogle Scholar
  7. Benedikt ML (1979) To take hold of space: isovists and isovist fields. Environ Plan B: Plan Des 6(1):47–65CrossRefGoogle Scholar
  8. Bhatia S, Chalup SK, Ostwald MJ et al (2012) Analyzing architectural space: identifying salient regions by computing 3d isovists. In: Conference proceedings. 46th annual conference of the architectural science association (AN-ZAScA), Gold Coast, QLDGoogle Scholar
  9. Buschka P, Saffiotti A (2002) A virtual sensor for room detection. In: IEEE/RSJ international conference on intelligent robots and systems, 2002, vol 1. IEEE, pp 637–642Google Scholar
  10. Chen G, Kotz D (2000) A survey of context-aware mobile computing research. Technical report TR2000-381, Dept of Computer Science, Dartmouth CollegeGoogle Scholar
  11. Chen W, Qu T, Zhou Y, Weng K, Wang G, Fu G (2014) Door recognition and deep learning algorithm for visual based robot navigation. In: 2014 IEEE international conference on robotics and biomimetics (ROBIO). IEEE, pp 1793–1798Google Scholar
  12. Chollet F et al (2015) Keras. https://github.com/fchollet/keras
  13. De Smith MJ, Goodchild MF, Longley P (2007) Geospatial analysis: a comprehensive guide to principles, techniques and software tools. Troubador Publishing LtdGoogle Scholar
  14. Deng L, Yu D et al (2014) Deep learning: methods and applications. Foundations and trends®. Signal Proces 7(3–4):197–387Google Scholar
  15. Dey AK, Abowd GD (1999) Towards a better understanding of context and context-awareness. In: International symposium on handheld and ubiquitous computing. Springer, pp 304–307Google Scholar
  16. Dogu U, Erkip F (2000) Spatial factors affecting wayfinding and orientation: a case study in a shopping mall. Environ Behav 32(6):731–755CrossRefGoogle Scholar
  17. Dosch P, Tombre K, Ah-Soon C, Masini G (2000) A complete system for the analysis of architectural drawings. Int J Doc Anal Recogn 3(2):102–116CrossRefGoogle Scholar
  18. Emo B (2015) Exploring isovists: the egocentric perspective. In: International space syntax symposium, pp 1–8Google Scholar
  19. Ester M, Kriegel HP, Sander J, Xu X et al (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. Kdd 96:226–231Google Scholar
  20. Feld S, Lyu H, Keler A (2017) Identifying divergent building structures using fuzzy clustering of isovist features. In: Progress in location-based services. Springer, pp 151–172Google Scholar
  21. Feld S, Werner M, Linnhoff-Popien C (2016) Approximated environment features with application to trajectory annotation. In: 6th IEEE symposium series on computational intelligence (IEEE SSCI 2016)Google Scholar
  22. Goerke N, Braun S (2009) Building semantic annotated maps by mobile robots. In: Proceedings of the conference towards autonomous robotic systems, pp 149–156Google Scholar
  23. Haq S, Zimring C (2003) Just down the road a piece: the development of topological knowledge of building layouts. Environ Behav 35(1):132–160CrossRefGoogle Scholar
  24. Hayward SC, Franklin SS (1974) Perceived openness-enclosure of architectural space. Environ Behav 6(1):37–52CrossRefGoogle Scholar
  25. Hillier B, Hanson J (1984) The social logic of space. Cambridge University PressGoogle Scholar
  26. Jones E, Oliphant T, Peterson P et al (2001) SciPy: open source scientific tools for python. http://www.scipy.org/. Accessed 23 July 2017
  27. Kingma D, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980
  28. Küpper A (2005) Location-based services. Fundamental and operation. Willey,Google Scholar
  29. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRefGoogle Scholar
  30. Leonard JJ, Durrant-Whyte HF (1991) Simultaneous map building and localization for an autonomous mobile robot. In: IEEE/RSJ international workshop on intelligent robots and systems’ 91. Intelligence for mechanical systems, Proceedings IROS’91. IEEE, pp 1442–1447Google Scholar
  31. Lloyd S (1982) Least squares quantization in pcm. IEEE Trans Inf Theory 28(2):129–137CrossRefGoogle Scholar
  32. Lowe R, Wu Y, Tamar A, Harb J, Abbeel P, Mordatch I (2017) Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv:1706.02275
  33. Lu T, Yang H, Yang R, Cai S (2007) Automatic analysis and integration of architectural drawings. Int J Doc Anal Recogn 9(1):31–47CrossRefGoogle Scholar
  34. Mordatch I, Abbeel P (2017) Emergence of grounded compositional language in multi-agent populations. arXiv:1703.04908
  35. Mozos ÓM (2010) Semantic labeling of places with mobile robots, vol 61. SpringerGoogle Scholar
  36. Mozos OM, Burgard W (2006) Supervised learning of topological maps using semantic information extracted from range data. In: 2006 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 2772–2777Google Scholar
  37. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830Google Scholar
  38. Rashidi P, Mihailidis A (2013) A survey on ambient-assisted living tools for older adults. IEEE J Biomed Health Inform 17(3):579–590CrossRefGoogle Scholar
  39. Raubal M (2002) Wayfinding in built environments: the case of airports. IfGIprints 14Google Scholar
  40. Samet H, Soffer A (1994) Automatic interpretation of floor plans using spatial indexing. Prog Image Anal Process 3:233CrossRefGoogle Scholar
  41. Snook G (2000) Simplified 3d movement and pathfinding using navigation meshes. In: DeLoura M (ed) Game programming gems. Charles River Media, pp 288–304Google Scholar
  42. Tandy C (1967) The isovist method of landscape survey. Methods of landscape analysis, pp 9–10Google Scholar
  43. Triebel R, Arras K, Alami R, Beyer L, Breuers S, Chatila R, Chetouani M, Cremers D, Evers V, Fiore M et al (2016) Spencer: a socially aware service robot for passenger guidance and help in busy airports. In: Field and service robotics. Springer, pp 607–622Google Scholar
  44. Weber M, Langenhan C, Roth-Berghofer T, Liwicki M, Dengel A, Petzold F (2010) a. SCatch: semantic structure for architectural floor plan retrieval. In: International conference on case-based reasoning. Springer, pp 510–524Google Scholar
  45. Weiser M (1991) The computer for the 21st century. Sci Am 265(3):94–104CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Mobile and Distributed Systems GroupLMU MunichMunichGermany

Personalised recommendations