Augmented Reality and the Fabrication of Gestural Form

  • Ryan Luke Johns


Architectural design is developed in conjunction with technological innovations. These developments are not merely informed by new tools and techniques of production, but also by technologies of representation and dissemination (Carpo 2001). The last decade has seen a marked increase in both realms: parametric design, CAAD (Computer Aided Architectural Design) and CAM (Computer Aided Manufacturing) on one side, and networked mobile visualizations on the other (augmented reality, smart phones, Microsoft’s Kinect technology, Web 2.0, etc.). In this paper we utilize a combination of these technologies to explore the design potential of using robotic fabrication tools in conjunction with a specially developed low-cost augmented reality system. We propose and implement a work-flow in which forms are (1) generated using skeleton- tracking and human gesture, (2) visualized, explored and modified in 3D first-person- view in situ with a head-tracked seethrough augmented reality headset, and (3) fabricated in position using a robotic manipulator. We will discuss the communication protocol behind several variations of this procedure and their architectural implications upon design scale, on-site design, and the modular.


augmented reality digital architecture robot programming 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. ABB Robotics AB, 1997 RAPID Overview, VästeråsGoogle Scholar
  2. ABB Robotics AB, Vol. 3HAC 5774-1 for BaseWare OS 3.2.Google Scholar
  3. Bonwetsch, T, Gramazio, F and Kohler, M 2006, “The informed wall: applying additive digital fabrication techniques on architecture”, Proceedings of the 25th Annual Conference of the Association for Computer-Aided Design in Architecture, Louisville, Kentucky pp: 489–495.Google Scholar
  4. Carpo, M 2001, Architecture in the Age of Printing: Orality, Writing, Typography, and Printed Images in the History of Architectural Theory, Benson, S. (trans.), The MIT Press, Boston.Google Scholar
  5. De Luca, A and Flacco, F 2012, “Integrated control for pHRI: Collision avoidance, detection, reaction and collaboration”, The Fourth IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, Rome, Italy, pp. 288–295.Google Scholar
  6. Feiner, S, Macintyre, B, Höllerer, T, and Webster, A 1997, “A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment.” Personal Technologies, Vol. 1., pp. 208–217CrossRefGoogle Scholar
  7. Gramazio, F and Kohler, M 2008, Digital Materiality in Architecture, Lars Müller Publishers, Baden.Google Scholar
  8. Greenwold, S 2003, “Spatial Computing”, Graduate School of Science in Media Arts and Sciences, Massachusetts Institute of Technology, Massachusetts.Google Scholar
  9. Helm, V, Ercan, S, Gramazio, F and Kohler, M, 2012, “In-Situ Robotic Construction: Extending the Digital Fabrication Chain in Architecture”, Proceedings of the 32nd Annual Conference of the Association for Computer-Aided Design in Architecture, San Francisco.Google Scholar
  10. Itauma, II, Kivrak, H and Kose, H 2012, “Gesture Imitation Using Machine Learning Techniques”, Proceedings of the Signal Processing and Communications Applications Conference (SIU), pp. 1–4.Google Scholar
  11. Kean, S, Hall, J and Perry, P 2011, Meet the Kinect: Programming and Scripting Natural User Interfaces, Apress, New York.Google Scholar
  12. Kolarevic, B (ed.) 2003, Architecture in the Digital Age: Design and Manufacturing, Spon Press, New York.Google Scholar
  13. Kwiatek, K 2005, “Generation of a virtual tour in the 3D space applying panoramas, exercised on the sites of Dresden and Cracow”, Thesis (Diploma), AGH University of Science and Technology.Google Scholar
  14. Piller, F 2004, “Mass Customization: Reflections on the State of the Concept”, The International Journal of Flexible Manufacturing Systems, Springer, pp. 313–334.Google Scholar

Copyright information

© Springer-Verlag/Wien 2013

Authors and Affiliations

  • Ryan Luke Johns

There are no affiliations available

Personalised recommendations