Skip to main content

Tangible Mixed Reality On-Site: Interactive Augmented Visualisations from Architectural Working Models in Urban Design

Part of the Communications in Computer and Information Science book series (CCIS,volume 527)


The consequences of architectural planning and design decisions made in the early design phases are hard to foresee. While professionals are used to reading plans and understanding architectural models, most laypeople are not familiar with their abstractions. This can lead to misinterpretations and misunderstandings between the different participants in the design process, especially in complex building situations, and decisions can be made or rejected that can have far-reaching consequences for the remainder of the project.

In this paper we describe the concept and prototypical implementation of a decision-support system for the early design and discussion stages of urban design projects that aims to address precisely this problem. The setup directly connects physical volumetric models and hand-drawn sketches with an interactive, mixed-reality visualization presented on a tablet or mobile phone, making it possible to see an interactive real-time view of an architectural design within the context of the actual site. In addition, the system is able to incorporate interactive simulations conducted on the model and presented in the AR-view.


  • Early design stages
  • Urban design
  • HCI
  • Tangible interfaces
  • Immersive environment
  • Simulations

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-662-47386-3_4
  • Chapter length: 20 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-662-47386-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.
Fig. 12.
Fig. 13.
Fig. 14.
Fig. 15.


  1. Schubert, G., Artinger, E., Petzold, F., Klinker, G.: Bridging the gap - a (collaborative) design platform for early design stages. In: Zupančič-Strojan, T., Juvančič, M., Verovšek, Š., Jutraž, A. (eds.) Respecting fragile places. Proceedings of the 29th Conference on Education in Computer Aided Architectural Design in Europe, Ljubljana, Slovenia, 21–24 September 2011, eCAADe, Education and Research in Computer Aided Architectural Design in Europe; Faculty of Architecture, Brussels, Ljubljana, pp. 187–193 (2011)

    Google Scholar 

  2. Schubert, G., Artinger, E., Petzold, F., Klinker, G.: Tangible tools for architectural design: seamless integration into the architectural workflow. In: Taron, J.M. (ed.) Integration Through Computation. Proceedings of the ACADIA 2011. Association for Computer Aided Design in Architecture, Stoughton, WI, pp. 252–259 (2011)

    Google Scholar 

  3. Schubert, G.: Interaktionsformen für das digitale Entwerfen. Konzeption und Umsetzung einer rechnergestützten Entwurfsplattform für die städtebaulichen Phasen in der Architektur. Dissertation, Technische Universität München (2014)

    Google Scholar 

  4. Chi, H.-L., Kang, S.-C., Wang, X.: Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Autom. Constr. 33, 116–122 (2013)

    CrossRef  Google Scholar 

  5. Underkoffler, J., Ishii, H.: Urp: a luminous-tangible workbench for urban planning and design. CHI 99, 386–393 (1999)

    Google Scholar 

  6. Dalsgaard, P., Halskov, K.: Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection. In: Malmborg, L., Pederson, T. (eds.) NordiCHI 2012. Making Sense Through Design. Proceedings of the 7th Nordic Conference on Human-Computer Interaction, Copenhagen, Denmark, pp. 14–17 (2012)

    Google Scholar 

  7. Broll, W., Stoerring, M., Mottram, C.: The augmented round table - a new interface to urban planning and architectural design. In: Rauterberg et al. (ed.) Human-Computer Interaction - Interact’03, pp. 1103–1104 (2003)

    Google Scholar 

  8. Seichter, H., Schnabel, M.A.: Digital and tangible sensation: an augmented reality urban design studio. In: Lee, H.S., Choi, J.W. (eds.) CAADRIA 2004. Proceedings of the 9th International Conference on Computer-Aided Architectural Design Research in Asia, Yonsei University Press, Seoul, pp. 193–202 (2004)

    Google Scholar 

  9. Seichter, H.: Sketchand+ a collaborative augmented reality sketching application. In: Choutgrajank, A. (ed.) CAADRIA 2003. Proceedings of the 8th International Conference on Computer-Aided Architectural Design Research in Asia. CAADRIA, Bangkok, Thailand, pp. 18–20 October 2003, Master of Science Program in Computer-Aided Architectural Design, Faculty of Architecture, Rangsit University, Thailand, pp. 209–222 (2003)

    Google Scholar 

  10. Välkkynen, P., Siltanen, S., Väätänen, A., Oksman, V., Honkamaa, P., Ylikauppila, M.: Developing mixed reality tools to support citizen participation in urban planning. In: ExS 2.0: Exploring Urban Spaces in the Web 2.0 Era, Munich, Germany (2013)

    Google Scholar 

  11. Wagner, I., Basile, M., Ehrenstrasser, L., Maquil, V., Terrin, J.-J., Wagner, M.: Supporting community engagement in the city: urban planning in the MR-tent. In: Carroll, J.M. (ed.) C & T’09. Proceedings of the 4th International Conference on Communities and Technologies, University Park, Pennsylvania, USA, 25–27 June 2009, ACM Press, New York, pp. 185–194 (2009)

    Google Scholar 

  12. Sareika, M., Schmalstieg, D.: Urban sketcher: mixed reality on site for urban planning and architecture. In: ISMAR 2007, 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, Piscataway (2007)

    Google Scholar 

  13. Allen, M., Regenbrecht, H., Abbott, M.: Smart-phone augmented reality for public participation in urban planning. In: Paris, C., Colineau, N., Farrell, V., Farrell, G., Huang, W. (eds.) Proceedings of the 23rd Australian Computer-Human Interaction Conference (OzCHI 2011). Held at the Australian National University, Canberra in cooperation with the ACM SIGCHI, pp. 11–20, 28 Nov–2 Dec 2011

    Google Scholar 

  14. Wang, X., Truijens, M., Hou, L., Wang, Y., Zhou, Y.: Integrating augmented reality with building information modeling: onsite construction process controlling for liquefied natural gas industry. Autom. Constr. 40, 96–105 (2014)

    CrossRef  Google Scholar 

  15. Kwon, O.-S., Park, C.-S., Lim, C.-R.: A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality. Autom. Constr. 46, 74–81 (2014)

    CrossRef  Google Scholar 

  16. Zollmann, S., Hoppe, C., Kluckner, S., Poglitsch, C., Bischof, H., Reitmayr, G.: Augmented reality for construction site monitoring and documentation. Proc. IEEE 102, 137–154 (2014)

    CrossRef  Google Scholar 

  17. Sørensen, S.S.: Augmented reality for improved communication of construction and maintenance plans in nuclear power plants. In: Yoshikawa, H., Zhang, Z. (eds.) Progress of Nuclear Safety for Symbiosis and Sustainability. Advanced Digital Instrumentation, Control and Information Systems for Nuclear Power Plants, pp. 269–274. Springer, Japan (2014)

    CrossRef  Google Scholar 

  18. Schattel, D.: On-site mobile augmented reality by means of network managed architectural design content. Master’s Thesis, Technische Universität München (2014)

    Google Scholar 

  19. Schubert, G., Riedel, S., Petzold, F.: Seamfully connected: real working models as tangible interfaces for architectural design. In: Zhang, J., Sun, C. (eds.) CAAD Futures 2013. CCIS, vol. 369, pp. 210–221. Springer, Heidelberg (2013)

    CrossRef  Google Scholar 

  20. Schubert, G., Artinger, E., Yanev, V., Petzold, F., Klinker, G.: 3D virtuality sketching: interactive 3D-sketching based on real models in a virtual scen. In: Cabrinha, M., Johnson, J.K., Steinfeld, K. (eds.) Proceedings of the 32nd Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA), Synthetic Digital Technologies. Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA), San Francisco, 18–21 Oktober, pp. 409–418. The Printing House Inc., WI, ACADIA, San Francisco (2012)

    Google Scholar 

  21. Yanev, V.: 3D virtuality sketching: a freehand sketch tool for conceptual urban design in architecture. Master’s Thesis, Technische Universität München (2012)

    Google Scholar 

  22. Goldschwendt, T.: The collaborative design platform protocol - design and implementation of a protocol for networked virtual environments and cave peer development. Bachelor’s Thesis, Ludwig-Maximilians-Universität München (2013)

    Google Scholar 

  23. Metaio GmbH: Metaio |SDK overview. (2015). Accessed 2 Feb 2015

  24. OpenSG. (2015). Accessed 2 Feb 2015

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Gerhard Schubert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2015 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schubert, G., Schattel, D., Tönnis, M., Klinker, G., Petzold, F. (2015). Tangible Mixed Reality On-Site: Interactive Augmented Visualisations from Architectural Working Models in Urban Design. In: Celani, G., Sperling, D., Franco, J. (eds) Computer-Aided Architectural Design Futures. The Next City - New Technologies and the Future of the Built Environment. CAAD Futures 2015. Communications in Computer and Information Science, vol 527. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-47385-6

  • Online ISBN: 978-3-662-47386-3

  • eBook Packages: Computer ScienceComputer Science (R0)