An augmented reality interface for visualizing and interacting with virtual content


In this paper, a novel AR interface is proposed that provides generic solutions to the tasks involved in augmenting simultaneously different types of virtual information and processing of tracking data for natural interaction. Participants within the system can experience a real-time mixture of 3D objects, static video, images, textual information and 3D sound with the real environment. The user-friendly AR interface can achieve maximum interaction using simple but effective forms of collaboration based on the combinations of human–computer interaction techniques. To prove the feasibility of the interface, the use of indoor AR techniques are employed to construct innovative applications and demonstrate examples from heritage to learning systems. Finally, an initial evaluation of the AR interface including some initial results is presented.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18


  1. Angel E (2003) Interactive computer graphics: a top-down approach using OpenGL,3rd edn. Addison–Wesley, Reading, pp 17–18, 69, 107, 322–349, 472

  2. Azuma R (1997) A survey of augmented reality. Teleoper Virtual Environ 6(4):355–385

    Google Scholar 

  3. Azuma R, Baillot Y et al (2001) Recent advances in augmented reality. IEEE Comput Graph November/December 21(6):34–47

    Article  Google Scholar 

  4. Begault DR (1994) 3D Sound for virtual reality and multimedia, Academic, New York, 1, 17–18

  5. Billinghurst M, Kato H, Poupyrev I (2001) The magicbook: a traditional AR interface. Comput Graph 25:745–753

    Article  Google Scholar 

  6. Butz A, Höllerer T et al (1999) Enveloping users and computers in a collaborative 3D augmented reality. In: Proceedings of the 2nd IEEE and ACM international workshop on augmented reality ‘99. San Francisco, October 20–21

  7. Camera calibration toolbox for Matlab, available at: [], Accessed at 14/01/2003

  8. Dobler D, Haller M, Stampfl P (2002) ASR—augmented sound reality, ACM SIGGRAPH 2002 conference abstracts and applications, San Antonio, p 148

  9. Feiner S, MacIntyre B et al (1993) Windows on the world: 2D Windows for 3D augmented reality. In: Proceedings of the ACM symposium on user interface software and technology, Atlanta, November 3–5, Association for Computing Machinery, pp 145–155

  10. Fernandes B, Miranda JC (2003) Learning how computer works with augmented reality. In: Proceedings of the 2nd international conference on multimedia and information and communication technologies in education, Badajoz, December 3–6

  11. Fuhrmann A, Schmalstieg D (1999) Concept and implementation of a collaborative workspace for augmented reality, GRAPHICS ‘99, 18(3)

  12. Gatermann H (2000) From VRML to augmented reality via panorama-integration and EAI-Java, in constructing the digital space. In: Proceeding of the SiGraDi, September, 254–256

  13. Grasset R, Gascuel J-D (2002) MARE: multiuser augmented reality environment on table setup. ACM SIGGRAPH conference abstracts and applications

  14. Hall T, Ciolfi L et al (2001) The visitor as virtual archaeologist: using mixed reality technology to enhance education and social interaction in the museum. In: Spencer S (ed) Proceedings of the virtual reality, archaeology, and cultural heritage (VAST 2001), New York, ACM SIGGRAPH, Glyfada, Nr Athens, November, pp 91–96

  15. Haller M, Hartmann W et al (2002) Combining ARToolKit with scene graph libraries. In: Proceedings of the first IEEE international augmented reality toolkit workshop, Darmstadt, Germany, 29 September

  16. Haniff D, Baber C, Edmondson W (2000) Categorizing augmented reality systems. J Three Dimens Images 14(4):105–109

    Google Scholar 

  17. Kato H, Billinghurst M, et al (2000a) Virtual object manipulation on a table-top AR environment. In: Proceedings of the international symposium on augmented reality 2000, Munich, 5–6 Oct, pp 111–119

  18. Kato H, Billinghurst M, Poupyrev I (2000b) ARToolkit user manual, version 2.33, Human Interface Lab, University of Washington

  19. Klinker G, Ahlers KH et al (1997) Confluence of computer vision and interactive graphics for augmented reality, PRESENCE: teleoperations and virtual environments. special issue on augmented reality, August 6(4):433–451

    Google Scholar 

  20. Liarokapis F, White M, Lister PF (2004a) Augmented reality interface toolkit. In: Proceedings of the international symposium on augmented and virtual reality, London, pp 761–767

  21. Liarokapis F, Sylaiou S, et al (2004b) An interactive visualisation interface for virtual museum. In: Proceedings of the 5th international symposium on virtual reality, Archaeology Cultural Heritage, pp 47–56

  22. Liarokapis F (2005) Augmented reality interfaces—architectures for visualising and interacting with virtual information. PhD thesis. University of Sussex, Falmer

  23. Liarokapis, Petridis P, Lister PF, White M (2002) Multimedia augmented reality interface for E-learning (MARIE). World Trans Eng Technol Educ 1(2):173–176

    Google Scholar 

  24. MacIntyre B, Gandy M, Dow S, Bolter JD (2005) DART: a toolkit for rapid design exploration of augmented reality experiences. ACM Trans Graph (TOG), 24(3):932

    Article  Google Scholar 

  25. Mahoney D (1999b) Better than real, computer graphics world, pp 32–40

  26. Malbezin P, Piekarski W and Thomas B (2002) Measuring ARToolKit accuracy in long distance tracking experiments. In: Proceedings of the 1st international augmented reality toolkit workshop, Germany, Darmstadt, September 29

  27. Milgram P, Colquhoun H (1999) A Taxonomy of real and virtual world display integration, mixed reality merging real and virtual worlds. Ohta Y, Tamura H (eds) Ohmsha Ltd, Chapter 1, pp 5–30

  28. Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays, IEICE Trans Inf Syst E77-D(12):1321–1329

  29. Moller T (1999) Real-time rendering. AK Peters Ltd, Natick, 23–38, 171

  30. Poupyrev I, Tan D et al (2002) Developing a generic augmented reality interface. Computer 35(3):44–50

    Article  Google Scholar 

  31. Reitmayr G, Schmalstieg D (2001) A wearable 3D augmented reality workspace. In: Proceedings of the 5th international symposium on wearable computers, October 8–9

  32. Rekimoto J, Nagao K (1995) The world through the computer: computer augmented interaction with real world environments. In: Myers BA (ed) Proceedings of UIST ‘95. ACM, Pennsylvania, pp 29–36

  33. Shi J, Tomasi C (1994) Good features to track, IEEE conference on computer vision and pattern recognition, Seattle, June, pp 593–600

  34. Sinclair P, Martinez K (2001) Adaptive hypermedia in augmented reality. In: Proceedings of the third workshop on adaptive hypertext and hypermedia at the twelfth ACM conference on hypertext and hypermedia, Denmark, August 2001, pp 217–219

  35. Slay H, Phillips M et al (2001) Interaction modes for augmented reality visualization, Australian symposium on information visualization, Sydney, December

  36. Smith GC (1994) The art of interaction. In: MacDonald L, Vince J (eds) Interacting with virtual environments. Wiley, New York, pp 79–94

  37. Tory M, Möller T (2005) Evaluating visualizations: do expert reviews work? IEEE Comput Graph Appl 25(5):8–11

    Article  Google Scholar 

  38. Vallino J (1998) Interactive augmented reality. PhD thesis, Department of Computer Science, University of Rochester, pp 1–25

  39. Weng J, Cohen P, Herniou M (1992) Camera calibration with distortion models and accuracy evaluation, IEEE transactions on pattern analysis and machine intelligence, 14(10)

  40. Woo M, Neider J, Davis T (1999) OpenGL programming guide: the official guide to learning OpenGL, Version 1.2, Addison–Wesley, Reading

  41. Yewdall D (1999) Practical art of motion picture sound. Focal Press, Boston

Download references


Part of this research work was funded by the EU IST Framework V programme, Key Action III- Multimedia Content and Tools, Augmented Representation of Cultural Objects (ARCO) project IST-2000-28366.

Author information



Corresponding author

Correspondence to Fotis Liarokapis.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Liarokapis, F. An augmented reality interface for visualizing and interacting with virtual content. Virtual Reality 11, 23–43 (2007).

Download citation


  • Augmented reality
  • Human–computer interaction
  • Tangible interfaces
  • Virtual heritage
  • Learning systems