Skip to main content

An augmented reality interface for visualizing and interacting with virtual content

Abstract

In this paper, a novel AR interface is proposed that provides generic solutions to the tasks involved in augmenting simultaneously different types of virtual information and processing of tracking data for natural interaction. Participants within the system can experience a real-time mixture of 3D objects, static video, images, textual information and 3D sound with the real environment. The user-friendly AR interface can achieve maximum interaction using simple but effective forms of collaboration based on the combinations of human–computer interaction techniques. To prove the feasibility of the interface, the use of indoor AR techniques are employed to construct innovative applications and demonstrate examples from heritage to learning systems. Finally, an initial evaluation of the AR interface including some initial results is presented.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

References

  • Angel E (2003) Interactive computer graphics: a top-down approach using OpenGL,3rd edn. Addison–Wesley, Reading, pp 17–18, 69, 107, 322–349, 472

  • Azuma R (1997) A survey of augmented reality. Teleoper Virtual Environ 6(4):355–385

    Google Scholar 

  • Azuma R, Baillot Y et al (2001) Recent advances in augmented reality. IEEE Comput Graph November/December 21(6):34–47

    Article  Google Scholar 

  • Begault DR (1994) 3D Sound for virtual reality and multimedia, Academic, New York, 1, 17–18

  • Billinghurst M, Kato H, Poupyrev I (2001) The magicbook: a traditional AR interface. Comput Graph 25:745–753

    Article  Google Scholar 

  • Butz A, Höllerer T et al (1999) Enveloping users and computers in a collaborative 3D augmented reality. In: Proceedings of the 2nd IEEE and ACM international workshop on augmented reality ‘99. San Francisco, October 20–21

  • Camera calibration toolbox for Matlab, available at: [http://www.vision.caltech.edu/bouguetj/calib_doc/], Accessed at 14/01/2003

  • Dobler D, Haller M, Stampfl P (2002) ASR—augmented sound reality, ACM SIGGRAPH 2002 conference abstracts and applications, San Antonio, p 148

  • Feiner S, MacIntyre B et al (1993) Windows on the world: 2D Windows for 3D augmented reality. In: Proceedings of the ACM symposium on user interface software and technology, Atlanta, November 3–5, Association for Computing Machinery, pp 145–155

  • Fernandes B, Miranda JC (2003) Learning how computer works with augmented reality. In: Proceedings of the 2nd international conference on multimedia and information and communication technologies in education, Badajoz, December 3–6

  • Fuhrmann A, Schmalstieg D (1999) Concept and implementation of a collaborative workspace for augmented reality, GRAPHICS ‘99, 18(3)

  • Gatermann H (2000) From VRML to augmented reality via panorama-integration and EAI-Java, in constructing the digital space. In: Proceeding of the SiGraDi, September, 254–256

  • Grasset R, Gascuel J-D (2002) MARE: multiuser augmented reality environment on table setup. ACM SIGGRAPH conference abstracts and applications

  • Hall T, Ciolfi L et al (2001) The visitor as virtual archaeologist: using mixed reality technology to enhance education and social interaction in the museum. In: Spencer S (ed) Proceedings of the virtual reality, archaeology, and cultural heritage (VAST 2001), New York, ACM SIGGRAPH, Glyfada, Nr Athens, November, pp 91–96

  • Haller M, Hartmann W et al (2002) Combining ARToolKit with scene graph libraries. In: Proceedings of the first IEEE international augmented reality toolkit workshop, Darmstadt, Germany, 29 September

  • Haniff D, Baber C, Edmondson W (2000) Categorizing augmented reality systems. J Three Dimens Images 14(4):105–109

    Google Scholar 

  • Kato H, Billinghurst M, et al (2000a) Virtual object manipulation on a table-top AR environment. In: Proceedings of the international symposium on augmented reality 2000, Munich, 5–6 Oct, pp 111–119

  • Kato H, Billinghurst M, Poupyrev I (2000b) ARToolkit user manual, version 2.33, Human Interface Lab, University of Washington

  • Klinker G, Ahlers KH et al (1997) Confluence of computer vision and interactive graphics for augmented reality, PRESENCE: teleoperations and virtual environments. special issue on augmented reality, August 6(4):433–451

    Google Scholar 

  • Liarokapis F, White M, Lister PF (2004a) Augmented reality interface toolkit. In: Proceedings of the international symposium on augmented and virtual reality, London, pp 761–767

  • Liarokapis F, Sylaiou S, et al (2004b) An interactive visualisation interface for virtual museum. In: Proceedings of the 5th international symposium on virtual reality, Archaeology Cultural Heritage, pp 47–56

  • Liarokapis F (2005) Augmented reality interfaces—architectures for visualising and interacting with virtual information. PhD thesis. University of Sussex, Falmer

  • Liarokapis, Petridis P, Lister PF, White M (2002) Multimedia augmented reality interface for E-learning (MARIE). World Trans Eng Technol Educ 1(2):173–176

    Google Scholar 

  • MacIntyre B, Gandy M, Dow S, Bolter JD (2005) DART: a toolkit for rapid design exploration of augmented reality experiences. ACM Trans Graph (TOG), 24(3):932

    Article  Google Scholar 

  • Mahoney D (1999b) Better than real, computer graphics world, pp 32–40

  • Malbezin P, Piekarski W and Thomas B (2002) Measuring ARToolKit accuracy in long distance tracking experiments. In: Proceedings of the 1st international augmented reality toolkit workshop, Germany, Darmstadt, September 29

  • Milgram P, Colquhoun H (1999) A Taxonomy of real and virtual world display integration, mixed reality merging real and virtual worlds. Ohta Y, Tamura H (eds) Ohmsha Ltd, Chapter 1, pp 5–30

  • Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays, IEICE Trans Inf Syst E77-D(12):1321–1329

  • Moller T (1999) Real-time rendering. AK Peters Ltd, Natick, 23–38, 171

  • Poupyrev I, Tan D et al (2002) Developing a generic augmented reality interface. Computer 35(3):44–50

    Article  Google Scholar 

  • Reitmayr G, Schmalstieg D (2001) A wearable 3D augmented reality workspace. In: Proceedings of the 5th international symposium on wearable computers, October 8–9

  • Rekimoto J, Nagao K (1995) The world through the computer: computer augmented interaction with real world environments. In: Myers BA (ed) Proceedings of UIST ‘95. ACM, Pennsylvania, pp 29–36

  • Shi J, Tomasi C (1994) Good features to track, IEEE conference on computer vision and pattern recognition, Seattle, June, pp 593–600

  • Sinclair P, Martinez K (2001) Adaptive hypermedia in augmented reality. In: Proceedings of the third workshop on adaptive hypertext and hypermedia at the twelfth ACM conference on hypertext and hypermedia, Denmark, August 2001, pp 217–219

  • Slay H, Phillips M et al (2001) Interaction modes for augmented reality visualization, Australian symposium on information visualization, Sydney, December

  • Smith GC (1994) The art of interaction. In: MacDonald L, Vince J (eds) Interacting with virtual environments. Wiley, New York, pp 79–94

  • Tory M, Möller T (2005) Evaluating visualizations: do expert reviews work? IEEE Comput Graph Appl 25(5):8–11

    Article  Google Scholar 

  • Vallino J (1998) Interactive augmented reality. PhD thesis, Department of Computer Science, University of Rochester, pp 1–25

  • Weng J, Cohen P, Herniou M (1992) Camera calibration with distortion models and accuracy evaluation, IEEE transactions on pattern analysis and machine intelligence, 14(10)

  • Woo M, Neider J, Davis T (1999) OpenGL programming guide: the official guide to learning OpenGL, Version 1.2, Addison–Wesley, Reading

  • Yewdall D (1999) Practical art of motion picture sound. Focal Press, Boston

Download references

Acknowledgments

Part of this research work was funded by the EU IST Framework V programme, Key Action III- Multimedia Content and Tools, Augmented Representation of Cultural Objects (ARCO) project IST-2000-28366.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fotis Liarokapis.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Liarokapis, F. An augmented reality interface for visualizing and interacting with virtual content. Virtual Reality 11, 23–43 (2007). https://doi.org/10.1007/s10055-006-0055-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-006-0055-1

Keywords

  • Augmented reality
  • Human–computer interaction
  • Tangible interfaces
  • Virtual heritage
  • Learning systems