Augmented Reality 2.0

  • Dieter Schmalstieg
  • Tobias Langlotz
  • Mark Billinghurst


Augmented Reality (AR) was first demonstrated in the 1960s, but only recently have technologies emerged that can be used to easily deploy AR applications to many users. Camera-equipped cell phones with significant processing power and graphics abilities provide an inexpensive and versatile platform for AR applications, while the social networking technology of Web 2.0 provides a large-scale infrastructure for collaboratively producing and distributing geo-referenced AR content. This combination of widely used mobile hardware and Web 2.0 software allows the development of a new type of AR platform that can be used on a global scale. In this paper we describe the Augmented Reality 2.0 concept and present existing work on mobile AR and web technologies that could be used to create AR 2.0 applications.


  1. [Aar01]
    Aarts E., Harwig R., and Schuurmans M., Ambient intelligence, The invisible future: the seamless integration of technology into everyday life, McGraw-Hill, New York, 2001Google Scholar
  2. [Acq06]
    Acquisti, A. and Gross, R., Imagined Communities: Awareness, Information Sharing, and Privacy on the Facebook. PET 2006, LNCS 4258:36–58, 2006Google Scholar
  3. [Azu97]
    Azuma, R.T., A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (Aug 1997), 355–385, 1997Google Scholar
  4. [Bai01]
    Baillot, Y., Brown D., and Julier S., Authoring of physical models using mobile computers. In Proc. of ISWC 2001, pages 39–46, 2001Google Scholar
  5. [Bar06]
    Barsky E. and Purdon M., Introducing Web 2.0: social networking and social bookmarking for health librarians. Journal of the Medical Library Association 2006Google Scholar
  6. [Bay06a]
    Bay, H., Tuytelaars, T., and Van Gool, L., SURF: Speeded up robust features. In Proc. of the European Conference on Computer Vision, 2006Google Scholar
  7. [Bui09]
    BuildAR website:
  8. [Bur04]
    Burak, A. and Sharon, T., Usage patterns of FriendZone: mobile location-based community services. In Proc. MUM ’04, vol. 83. ACM, New York, 93–100. 2004Google Scholar
  9. [Che05]
    Cheverest, K., et al., Exploring Bluetooth based mobile phone interaction with the Hermes photo display, MobileHCI05, 47–54, ACM, New York, 2005Google Scholar
  10. [Deu09]
    Deusto Sentient Graffiti Project website:
  11. [Dod09]
  12. [Don99]
    Donath, J.S., Visualizing Conversation. Journal of Computer-Mediated Communication, 4(4). 1999Google Scholar
  13. [Don08]
    Dongpyo, H., Looser, J., Seichter, H., Billinghurst, M., and Woontack, W. 2008. A Sensor-Based Interaction for Ubiquitous Virtual Reality Systems. In Ubiquitous Virtual Reality, 2008. ISUVR 2008. International Symposium on, 75–78Google Scholar
  14. [Dru99]
    Drummond, T.W. and Cipolla, R., Visual tracking and control using Line algebra. In Proc. of CVPR 1999, Ft. Collins, CO, USA, June 23–25, 1999Google Scholar
  15. [Dun07]
    Dünser, A., Grasset, R., Seichter, H., and Billinghurst M., Applying HCI principles to AR systems design, presented at MRUI’07: Workshop at IEEE VR 2007, 2007Google Scholar
  16. [Dun08]
    Dünser, A., Grasset, R. and Billinghurst M., A Survey of Evaluation Techniques Used in Augmented Reality Studies. HIT Lab NZ Technical Report TR-2008–02, 2007Google Scholar
  17. [Eag05]
    Eagle N., Pentland A., “Social Serendipity: Mobilizing Social Software,” IEEE Pervasive Computing, vol. 4, no. 2, pp. 28–34, 2005CrossRefGoogle Scholar
  18. [Fei97]
    Feiner S., MacIntyre B., Höllerer T., and Webster A.: A touring machine: Prototyping 3d mobile augmented reality systems for exploring the urban environment. Proceedings of the First International Symposium on Wearable Computers (ISWC), pp. 74–81, 1997Google Scholar
  19. [Fia05]
    Fiala, M., ARTag, A Fiducial Marker System Using Digital Techniques. In Proc. of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) – vol. 2, pp. 590–596, 2005Google Scholar
  20. [Gog06]
    Goggin G., Cell phone culture: Mobile technology in everyday life, Routledge, New York, 2006Google Scholar
  21. [Gra05]
    Grasset R., Looser J., and Billinghurst M., 2005. OSGARToolKit: tangible + transitional 3D collaborative mixed reality framework. In Proc. of the 2005 international Conference on Augmented Tele-Existence (Christchurch, New Zealand, December 05 – 08, 2005). ICAT ’05, vol. 157. ACM, New York, 257–258Google Scholar
  22. [Gre06]
    Greene K., Hyperlinking reality via phones. MIT Technology Review, 2006Google Scholar
  23. [Gri02]
    Grimm P., Haller M., Paelke V., Reinhold S., Reimann C., and Zauner J., AMIRE – Authoring Mixed Reality, The First IEEE International Augmented Reality Toolkit Workshop, Germany, 2002Google Scholar
  24. [Hen05]
    Henrysson A., Billinghurst M., and Ollila M., Face to Face Collaborative AR on Mobile Phones. Proceedings International Symposium on Augmented and Mixed Reality (ISMAR’05), pp. 80–89, Austria, 2005Google Scholar
  25. [Hen06]
    Henrysson A., Billinghurst M., and Ollila M., AR Tennis. ACM Siggraph, ACM, Boston, USA, 2006Google Scholar
  26. [Hen07]
    Henry N. and Fekete J., MatLink: Enhanced Matrix Visualization for Analyzing Social Networks. In Interact 2007, LNCS 4663, Part II, pp. 288–302, 2007Google Scholar
  27. [Hoe99]
    Höllerer T., Feiner S., Terauchi T., Rashid G., and Hallaway D., Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. Computer & Graphics, 23(6):779–785, 1999CrossRefGoogle Scholar
  28. [Hoh99]
    Hohl F., Kubach U., Leonhardi A., Rothermel K., and Schwehm M., Next century challenges: Nexus–an open global infrastructure for spatial-aware applications. In Proc. of International Conference on Mobile Computing and Networking, pp. 249–255, 1999Google Scholar
  29. [Jab09]
  30. [Kat99]
    Kato H. and Billinghurst M., Marker Tracking and HMD Calibration for a video-based Augmented Reality Conferencing System. In Proc. of the 2nd International Workshop on Augmented Reality (IWAR 99), pp. 85–94, USA, 1999Google Scholar
  31. [Kle03]
    Klein G. and Drummond T.W., Robust visual tracking for non-instrumented augmented reality. In Proc. of ISMAR 2003, pages 113–122, Tokyo, Japan, 2003Google Scholar
  32. [Kle04]
    Klein G. and Drummond T.W., Sensor fusion and occlusion refinement for tablet-based AR. In Proc. of ISMAR 2004, pages 38–47, Arlington, VA, USA, Nov 25 2004Google Scholar
  33. [Lee04]
    Lee G., et al., Immersive Authoring of Tangible Augmented Reality Applications. Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality 2004. 2004Google Scholar
  34. [Low04]
    Lowe D.G., Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91–110, 2004CrossRefGoogle Scholar
  35. [Mac04]
    MacIntyre B., Gandy M., Dow S., and Bolter J.D., DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences, User Interface Software and Technology (UIST’04), Sante Fe, New Mexico, 2004Google Scholar
  36. [McD03]
    McDonald D.W., Recommending collaboration with social networks: a comparative evaluation. In Proc. CHI ’03. ACM, 593–600, 2003Google Scholar
  37. [Miz00]
    Mizell D., Augmented Reality Applications in Aerospace, IEEE and ACM International Symposium on Augmented Reality (ISAR’00), 2000Google Scholar
  38. [Mob09]
    Mobilizy, Wikitude – AR Travel Guide, Website:,visitedMar25,2009
  39. [Mob09b]
    IST Mobvis, FP6–511051, Website:, visited March 26, 2009
  40. [Mh04]
    Möhring, M., Lessig, C. and Bimber, C. Video See-Through AR on Consumer Cell Phones. Proceedings of International Symposium on Augmented and Mixed Reality (ISMAR’04), pp. 252–253, 2004Google Scholar
  41. [Nis06]
    Nister, D. and Stewenius, H., Scalable recognition with a vocabulary tree. In Proc. of CVPR, 2006Google Scholar
  42. [New06]
    Newman J., Schall G., Barakonyi I., Schürzinger A., and Schmalstieg D., Wide-Area Tracking Tools for Augmented Reality. In Proc. of the 4th International Conference on Pervasive Computing, 2006Google Scholar
  43. [Ore08]
    O’Reilly T. What is Web 2.0? Design patterns and business models for the next generation of software (accessed Jul 2008)
  44. [Ozu07]
    Ozuysal M., Fua P., and Lepetit V., Fast Keypoint Recognition in Ten Lines of Code. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, 2007Google Scholar
  45. [Pie01]
    Piekarski W. and Thomas B.H., Tinmith-evo5 – An Architecture for Supporting Mobile Augmented Reality Environments. In 2nd Int’l Symposium on Augmented Reality, pp 177–178, New York, Oct 2001Google Scholar
  46. [Pie04]
    Piekarski W. and Thomas B.H., Augmented Reality Working Planes: A Foundation for Action and Construction at a Distance. In 3rd Int’l Symposium on Mixed and Augmented Reality, Arlington, Va, Oct 2004Google Scholar
  47. [Phi07]
    Philbin J., Chum O., Isard M., Sivic J., and Zisserman A., Object retrieval with large vocabularies and fast spatial matching. In Proc. of CVPR, 2007Google Scholar
  48. [Phi08]
    Philbin J., Chum O., Isard M., Sivic J., and Zisserman A., Lost in quantization: Improving particular object retrieval in large scale image databases. In Proc. of CVPR, 2008Google Scholar
  49. [Pla09]
  50. [Rei06]
    Reitmayr G. and Drummond T., Going Out: Robust Model-based Tracking for Outdoor Augmented Reality Proc. IEEE ISMAR’06, Santa Barbara, California, USA, 2006Google Scholar
  51. [Rei07]
    Reitmayr G. and Drummond T., Initialisation for Visual Tracking in Urban EnvironmentsProc. IEEE ISMAR’07, Nara, Japan, 2007Google Scholar
  52. [Riv96]
    Rivera K., Cooke N. and Bauhs J., The effects of emotional icons on remote communication, Conference companion on Human factors in computing systems: common ground, pp. 99–100, Apr 13–18, 1996Google Scholar
  53. [Rum09]
  54. [Sch06]
    Scheibe M., Meissner F.W., Tunbridge I., Investigating clientless mobile phone interaction with a Bluetooth public display, CS06–14–00, University of Cape Town, 2006Google Scholar
  55. [Sch09]
    Schall G., Wagner D., Reitmayr G., Wieser M., Teichmann E., Schmalstieg D., and Hofmann-Wellenhof B., Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 153–162, 2009Google Scholar
  56. [Sch08]
    Schmalstieg D. and Wagner D., Mobile Phones as a Platform for Augmented Reality. In Proc. of the IEEE VR 2008 Workshop on Software Engineering and Architectures for Realtime Interactive Systems, IEEE, Reno, NV, USA, Shaker Publishing, 43–44, 2008Google Scholar
  57. [Sie04]
    Sielhorst T., Obst T., Burgkart R., Riener R., and Navab N., An augmented reality delivery simulator for medical training. In International Workshop on Augmented Environments for Medical Imaging – MICCAI Satellite Workshop, 2004Google Scholar
  58. [Siv03]
    Sivic J. and Zisserman A., Video google: A text retrieval approach to object matching in videos. In Proc. of ICCV, 2003Google Scholar
  59. [Sei03]
    Seichter H., Araya C., Ekasidh C., Kamol K. and Walaiporn N., sketchand + , In CAADRIA 2003, 209–219, 2003Google Scholar
  60. [Son09]
  61. [Spo99]
    Spohrer J., Information in Places, IBM System Journal 38(4):602–628, 1999CrossRefGoogle Scholar
  62. [Sut68]
    Sutherland I., A head-mounted three-dimensional display. In Proc. of the Fall Joint Computer Conference. AFIPS Conference Proceedings, vol. 33. AFIPS, Arlington, VA., 757–764, 1968Google Scholar
  63. [Swa05]
    Swan J.E. and Gabbard J.L., Survey of User-Based Experimentation in Augmented Reality, presented at 1st International Conference on Virtual Reality, Las Vegas, Nevada, 2005Google Scholar
  64. [Sza98]
    Szalavari S., Schmalstieg D., Fuhrmann D., and Gervautz M., “Studierstube” – An Environment for Collaboration in Augmented Reality, Virtual Reality – Systems, Development and Applications, vol. 3, No. 1, pp. 37–49, Springer, New York 1998Google Scholar
  65. [Tak08]
    Takacs G., Chandrasekhar V., Gelfand N., Xiong Y., Chen W.-C., Bismpigiannis T., Grzeszczuk R., Pulli K., and Girod B., Outdoors Augmented Reality on Mobile Phone using Loxel-Based Visual Feature Organization. In Proc. of the 1st ACM International Conference on Multimedia Information Retrieval, pp. 427–434, 2008Google Scholar
  66. [Tho98]
    Thomas B.H., Demczuk V., Piekarski W., Hepworth D., and Gunther B., A wearable computer system with augmented reality to support terrestrial navigation. In Proc. of ISWC’98, pages 168–171, Pittsburgh, PA, USA, Oct 19–20, 1998Google Scholar
  67. [Tur05]
    Turner T., Smith M., Fisher D., and Welser H., Picturing Usenet: Mapping Computer-Mediated Collective Action. Journal of Computer Mediated Communication. 10(4), 2005Google Scholar
  68. [Vac03]
    Vacchetti L., Lepetit V., and Fua P., Stable real-time 3d tracking using online and offline information. IEEE Trans. PAMI 26(10):1385–1391, 2000CrossRefGoogle Scholar
  69. [Vie04]
    Viegas F.B. and Smith M.A., Newsgroup Crowds and Author Lines: Visualizing the Activity of Individuals in Conversational Cyberspaces, 2004Google Scholar
  70. [Wag03]
    Wagner D. and Schmalstieg D., First Steps Towards Handheld Augmented Reality. In Proc. of the 7th IEEE international Symposium on Wearable Computers (Oct 21–23, 2003). ISWC. IEEE Computer Society, Washington, DC, 2003Google Scholar
  71. [Wag06b]
    Wagner D., Billinghurst M., and Schmalstieg D., How Real Should Virtual Characters Be? Conference on Advances in Computer Entertainment Technology 2006 (ACE 2006), 2006Google Scholar
  72. [Wag07]
    Wagner D. and Schmalstieg D., ARToolKitPlus for Pose Tracking on Mobile Devices. In Proc. of 12th Computer Vision Winter Workshop (CVWW’07), pp. 139–146, 2007Google Scholar
  73. [Wag08a]
    Wagner D., Langlotz T. and Schmalstieg D., Robust und Unobtrusive Marker Tracking on Mobile Phones. In Proc. of ISMAR’08, pp. 121–124, 2008Google Scholar
  74. [Wag08b]
    Wagner D., Reitmayr G., Mulloni A., Drummond T.W., and Schmalstieg D., Pose tracking from natural features on mobile phones. In Proc. of ISMAR’08, 125–134, 2008Google Scholar
  75. [Wag10]
    Wagner D., Mulloni A., Langlotz T., and Schmalstieg D., Real-time Panoramic Mapping and Tracking on Mobile Phones. In Proc. of Virtual Reality’10, pp. 211–218, 2010Google Scholar
  76. [Wit08]
    Wither J., Coffin C., Ventura J., and Höllerer T., Fast Annotation and Modeling with a Single-Point Laser Range Finder In Proc. ACM/IEEE Symposium on Mixed and Augmented Reality, Sept. 15–18, 2008Google Scholar

Copyright information

© Springer-Verlag/Wien 2011

Authors and Affiliations

  • Dieter Schmalstieg
    • 1
  • Tobias Langlotz
    • 1
  • Mark Billinghurst
    • 2
  1. 1.Institute for Computer Graphics and VisionGraz University of TechnologyGrazAustria
  2. 2.HIT Lab New ZealandUniversity of CanterburyChristchurchNew Zealand

Personalised recommendations