VMR 2009: Virtual and Mixed Reality pp 13-22 | Cite as

Advanced Interaction Techniques for Augmented Reality Applications

  • Mark Billinghurst
  • Hirokazu Kato
  • Seiko Myojin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5622)

Abstract

Augmented Reality (AR) research has been conducted for several decades, although until recently most AR applications had simple interaction methods using traditional input devices. AR tracking, display technology and software has progressed to the point where commercial applications can be developed. However there are opportunities to provide new advanced interaction techniques for AR applications. In this paper we describe several interaction methods that can be used to provide a better user experience, including tangible user interaction, multimodal input and mobile interaction.

Keywords

Augmented Reality Interaction Techniques Tangible User Interfaces Multimodal Input 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Azuma, R.: A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6(4), 355–385 (1997)CrossRefGoogle Scholar
  2. 2.
    Sutherland, I.: The Ultimate Display. International Federation of Information Processing 2, 506–508 (1965)Google Scholar
  3. 3.
    Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In: Proceedings of CHI 1997, Atlanta, Georgia, USA, pp. 234–241. ACM Press, New York (1997)Google Scholar
  4. 4.
    Rekimoto, J.: The World Through the Computer: A New Human-Computer Interaction Style Based on Wearable Computers. Technical Report SCSL-TR-94-013, Sony Computer Science Laboratories Inc. (1994)Google Scholar
  5. 5.
    Feiner, S., MacIntyre, B., Hollerer, T., Webster, A.: A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment. In: Proceedings of the 1st IEEE international Symposium on Wearable Computers, ISWC, October 13-14, 1997, IEEE Computer Society, Washington (1997)Google Scholar
  6. 6.
    Butterworth, J., Davidson, A., Hench, S., Olano, M.T.: 3DM: a three dimensional modeler using a head-mounted display. In: Proceedings of the 1992 Symposium on interactive 3D Graphics, SI3D 1992, Cambridge, Massachusetts, United States, pp. 135–138. ACM, New York (1992)CrossRefGoogle Scholar
  7. 7.
    Poupyrev, I., Billinghurst, M., Weghorst, S., Ichikawa, T.: The Go-Go Interaction Technique. In: Proc. Of UIST 1996, pp. 79–80. ACM Press, New York (1996)Google Scholar
  8. 8.
    Stoakley, R., Conway, M., Pausch, R.: Virtual Reality on a WIM: Interactive Worlds in Miniature. In: Proceedings of CHI 1995, ACM Press, New York (1995)Google Scholar
  9. 9.
    Gabbard, J.L.: A taxonomy of usability characteristics in virtual environments. M.S. Thesis, Virginia Polytechnic Institute and State University (1997), http://www.vpst.org/jgabbard/ve/framework/
  10. 10.
    Bajura, M., Fuchs, H., et al.: Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery Within the Patient. In: SIGGRAPH 1992, ACM, New York (1992)Google Scholar
  11. 11.
    Feiner, S., MacIntyre, B., et al.: Knowledge-Based Augmented Reality. Communications of the ACM 36(7), 53–62 (1993)CrossRefGoogle Scholar
  12. 12.
    Kiyokawa, K., Takemura, H., Yokoya, N.: A Collaboration Supporting Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC 1999), Tokyo, vol. VI, pp. 48–53 (1999)Google Scholar
  13. 13.
    Schmalstieg, D., Fuhrmann, A., et al.: Bridging multiple user interface dimensions with augmented reality systems. In: ISAR 2000, IEEE, Los Alamitos (2000)Google Scholar
  14. 14.
    Butz, A., Hollerer, T., et al.: Enveloping Users and Computers in a Collaborative 3D Augmented Reality. In: Proceedings of IWAR 1999, San Francisco, October 20-21, pp. 35–44 (1999)Google Scholar
  15. 15.
    Rekimoto, J., Ayatsuka, Y., et al.: Augment-able reality: Situated communication through physical and digital spaces. In: ISWC 1998, IEEE, Los Alamitos (1998)Google Scholar
  16. 16.
    Hollerer, T., Feiner, S., et al.: Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. IEEE Computers & Graphics 23, 779–785 (1999)CrossRefGoogle Scholar
  17. 17.
    Anabuki, M., Kakuta, H., et al.: Welbo: An Embodied Conversational Agent Living in Mixed Reality Spaces. In: CHI 2000, Extended Abstracts, ACM, New York (2000)Google Scholar
  18. 18.
    Weiser, M.: The Computer for the Twenty-First Century. Scientific American 265(3), 94–104 (1991)CrossRefGoogle Scholar
  19. 19.
    Gorbet, M., Orth, M., Ishii, H.: Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography. In: Proceedings of CHI 1998, Los Angeles (1998)Google Scholar
  20. 20.
    Underkoffler, J., Ishii, H.: Urp: a luminous-tangible workbench for urban planning and design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit, CHI 1999, Pittsburgh, Pennsylvania, United States, May 15-20, 1999, pp. 386–393. ACM, New York (1999)Google Scholar
  21. 21.
    Bolt, R.A.: Put-That-There: Voice and Gesture at the Graphics Interface. In: Proceedings of ACM SIGGRAPH 1980, Computer Graphics, vol. 14, pp. 262–270 (1980)Google Scholar
  22. 22.
    Weimer, D., Ganapathy, S.K.: A Synthetic Visual Environment with Hand Gesturing and Voice Input. In: Proceedings of ACM Conference on Human Factors in Computing Systems, pp. 235–240 (1989)Google Scholar
  23. 23.
    Laviola Jr., J.J.: Whole-Hand and Speech Input in Virtual Environments. Master Thesis, Brown University (1996)Google Scholar
  24. 24.
    Olwal, A., Benko, H., Feiner, S.: SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In: Proceedings of The Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003), October 2003, pp. 300–301 (2003)Google Scholar
  25. 25.
    Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Xiaoguang, L., Cohen, P., Feiner, S.: Mutual Dissambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In: Proceedings of The Fifth International Conference on Multimodal Interfaces (ICMI 2003), pp. 12–19 (2003)Google Scholar
  26. 26.
    Träskbäck, M., Haller, M.: Mixed reality training application for an oil refinery: user requirements. In: ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry, VRCAI 2004, Singapore, pp. 324–327 (2004)Google Scholar
  27. 27.
    Wagner, D., Schmalstieg, D.: First steps towards handheld augmented reality. In: Proc. of the 7th International Symposium on Wearable Computers (ISWC 2003), White Plains, pp. 127–137. IEEE Computer Society, Los Alamitos (2003)CrossRefGoogle Scholar
  28. 28.
    Moehring, M., Lessig, C., Bimber, O.: AR Video See-Through on Consumer Cell Phones. In: Proc. of International Symposium on Augmented and Mixed Reality (ISMAR 2004), pp. 252–253 (2004)Google Scholar
  29. 29.
    Henrysson, A., Ollila, M.: UMAR - Ubiquitous Mobile Augmented Reality. In: Proc. Third International Conference on Mobile and Ubiquitous Multimedia (MUM 2004), College Park, Maryland, USA, October 27-29, 2004, pp. 41–45 (2004)Google Scholar
  30. 30.
  31. 31.
    Mogilev, D., Kiyokawa, K., Billinghurst, M., Pair, J.: AR Pad: An Interface for Face-to-face AR Collaboration. In: Proc. of the ACM Conference on Human Factors in Computing Systems 2002 (CHI 2002), Minneapolis, pp. 654–655 (2002)Google Scholar
  32. 32.
    Kato, H., Billinghurst, M., Poupyrev, I., Tetsutani, N., Tachibana, K.: Tangible Augmented Reality for Human Computer Interaction. In: Proc. of Nicograph 2001, Tokyo, Japan (2001)Google Scholar
  33. 33.
    Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual Object Manipulation on a Table-Top AR Environment. In: Proceedings of the International Symposium on Augmented Reality (ISAR 2000), October 2000, pp. 111–119 (2000)Google Scholar
  34. 34.
  35. 35.
    Denecke, M.: Rapid Prototyping for Spoken Dialogue Systems. In: Proceedings of the 19th international conference on Computational Linguistics, vol. 1, pp. 1–7 (2002)Google Scholar
  36. 36.
  37. 37.
    Irawati, S., Green, S., Billinghurst, M., Duenser, A., Ko, H.: An evaluation of an augmented reality multimodal interface using speech and paddle gestures. In: Pan, Z., Cheok, D.A.D., Haller, M., Lau, R., Saito, H., Liang, R. (eds.) ICAT 2006. LNCS, vol. 4282, pp. 272–283. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  38. 38.
    Hinckley, K., Pausch, R., Proffitt, D., Patten, J., Kassell, N.: Cooperative Bimanual Action. In: ACM CHI 1997 Conference on Human Factors in Computing Systems, pp. 27–34 (1997)Google Scholar
  39. 39.
    Henrysson, A., Billinghurst, M., Ollila, M.: Virtual object manipulation using a mobile phone. In: Proceedings of the 2005 international conference on Augmented tele-existence, Christchurch, New Zealand, December 5-8 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mark Billinghurst
    • 1
  • Hirokazu Kato
    • 2
  • Seiko Myojin
    • 2
  1. 1.The Human Interface Technology New Zealand (HIT Lab NZ)University of CanterburyChristchurchNew Zealand
  2. 2.Nara Institute of Science and TechnologyNaraJapan

Personalised recommendations