Supporting Reusability of VR and AR Interface Elements and Interaction Techniques

  • Wolfgang Broll
  • Jan Herling
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5622)


In contrast to 2D environments which apply well established user interface elements and generally accepted interaction techniques, VR and AR applications typically provide rather individual and specific realizations. This often leads to inconsistent user interfaces and a long and cumbersome development process. In this paper we show how we extended our approach on modeling VR and AR interface elements and interaction techniques represented by interaction and behavior objects by some simple yet powerful mechanisms: modules, templates, and inheritance. We will also show how specific examples could benefit from that approach.


Virtual Reality Augmented Reality Mixed Reality 3D User Interfaces Multi-modal User Interfaces Interaction Techniques 


  1. 1.
    Abrams, M., Phanouriou, C., Batongbacal, A.L., Williams, S.M., Shuster, J.E.: UIML: An Appliance-Independent XML User Interface Language. In: Proceedings of the Eighth International World Wide Web Conference, pp. 1695–1708. Elsevier, Toronto, Canada (1999)Google Scholar
  2. 2.
    Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston (2004)Google Scholar
  3. 3.
    Broll, W., Herling, J., Blum, L.: Interactive Bits: Prototyping of Mixed Reality Applications and Interaction Techniques through Visual Programming. In: Proc. of the 3rd IEEE International Symposium on 3D User Interfaces 2008 (IEEE 3DUI 2008), pp. 109–115. IEEE Computer Society, Los Alamitos (2008)CrossRefGoogle Scholar
  4. 4.
    Broll, W., Lindt, I., Ohlenburg, J., Herbst, I., Wittkämper, M., Novotny, T.: An Infrastructure for Realizing Custom-Tailored Augmented Reality User Interfaces. IEEE Transactions on Visualization and Computer Graphics 11(6), 722–733 (2006)CrossRefGoogle Scholar
  5. 5.
    Burrows, T., England, E.: YABLE—yet another behaviour language. In: Proceedings of the Tenth international Conference on 3D Web Technology, Web3D 2005, Bangor, United Kingdom, March 29-April 01, 2005, pp. 65–73. ACM, New York (2005)CrossRefGoogle Scholar
  6. 6.
    Dachselt, R., Rukzio, E.: Behavior3D: an XML-based framework for 3D graphics behavior. In: Proceeding of the Eighth international Conference on 3D Web Technology, Web3D 2003, Saint Malo, France, March 9-12, 2003, p. 101. ACM, New York (2003)CrossRefGoogle Scholar
  7. 7.
    Figueroa, P., Green, M., Hoover, H.J.: InTml: a description language for VR applications. In: Proceeding of the Seventh international Conference on 3D Web Technology, Web3D 2002, Tempe, Arizona, USA, February 24-28, 2002, pp. 53–58. ACM, New York (2002)CrossRefGoogle Scholar
  8. 8.
    Herbst, I., Braun, A., McCall, R., Broll, W.: TimeWarp: interactive time travel with a mobile mixed reality game. In: Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services, MobileHCI 2008, Amsterdam, The Netherlands, September 2-5, 2008, pp. 235–244. ACM, New York (2008)Google Scholar
  9. 9.
    IPCity – Integrated Project on Interaction and Presence in Urban Environments,
  10. 10.
    Lanier, J., Grimaud, J.-J., Harvill, Y., Lasko-Harvill, A., Blanchard, C., Oberman, M., Teitel, M.: Method and system for generating objects for a multi-person virtual world using data flow networks. United States Patent 5588139 (1993)Google Scholar
  11. 11.
    Lee, G.A., Nelles, C., Billinghurst, M., Kim, G.J.: Immersive Authoring of Tangible Augmented Reality Applications. In: Proceedings of the Third IEEE and ACM international Symposium on Mixed and Augmented Reality (ISMAR 2004), November 2-5, 2004, pp. 172–181. IEEE Computer Society, Los Alamitos (2004)CrossRefGoogle Scholar
  12. 12.
    Olwal, A., Feiner, F.: Unit: modular development of distributed interaction techniques for highly interactive user interfaces. In: Spencer, S.N. (ed.) Proceedings of the 2nd international Conference on Computer Graphics and interactive Techniques in Australasia and South East Asia, GRAPHITE 2004, Singapore, June 15-18, 2004, pp. 131–138. ACM, New York (2004)Google Scholar
  13. 13.
    MacIntyre, B., Gandy, M., Dow, S., Bolter, J.D.: DART: a toolkit for rapid design exploration of augmented reality experiences. In: Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology, UIST 2004, Santa Fe, NM, USA, October 24-27, 2004, pp. 197–206. ACM, New York (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Wolfgang Broll
    • 1
  • Jan Herling
    • 1
  1. 1.Collaborative Virtual and Augmented Environments Fraunhofer FITSankt AugustinGermany

Personalised recommendations