The Visual Computer

, 25:1121 | Cite as

Framework for context-aware smartphone applications

  • Stelios Papakonstantinou
  • Vesna Brujic-Okretic
Original Article


This paper presents research and development of a dedicated system architecture, designed to enable its users to interact with each other as well as to access information on points of interest that exist in their immediate environment. This is accomplished through managing personal preferences and contextual information in a distributed manner and in real time. The advantage of this system is that it uses mobile devices, heterogeneous sensors and a selection of user interface paradigms to produce a sociotechnical framework to enhance the perception of the environment and promote intuitive interactions. Representation of the real-world objects, their spatial relations and other captured features are visualised on scalable interfaces, ranging from 2D to 3D models and from photorealism to stylised clues and symbols. The conceptual design and implementation of our location and orientation based algorithm for mobile augmented reality is presented in detail. The framework is fit for use in unknown environments and therefore suitable for ubiquitous operation. The presented prototype is multifaceted and capable of supporting peer-to-peer exchange of information in a pervasive fashion, usable in various contexts. The modalities of these interactions are explored and laid out particularly in the context of entertainment and urban navigation.


Context-awareness Virtual and augmented reality Mobile interactions 


  1. 1.
    Magerkurth, C., Cheok, A.D., Mandryk, R.L., Nilsen, T.: Pervasive games: bringing computer entertainment back to the real world. ACM Comput. Entertain. (CIE) 3, 19 (2005) Google Scholar
  2. 2.
    Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36, 75–84 (1993) CrossRefGoogle Scholar
  3. 3.
    Milgram, P., Kishino, F.: A Taxonomy of Mixed Reality Visual Displays. IEICE Trans. Inf. Syst. E77-D, 15 (1994) Google Scholar
  4. 4.
    Cheok, A.D., Teh, K.S., Nguyen, T.H.D., Qui, T.C.T., Lee, S.P., Liu, W., Li, C.C., Diaz, D., Boj, C.: Social and physical interactive paradigms for mixed-reality entertainment. Comput. Entertain. (CIE) 4, 20 (2006) Google Scholar
  5. 5.
    Montola, M.: Exploring the edge of the magic circle. Defining pervasive games. In: Proceedings of Digital Experience: Design, Aesthetics, Practice Conference (DAC), IT University of Copenhagen, p. 4 (2005) Google Scholar
  6. 6.
    Rashid, O., Mullins, I., Coulton, P., Edwards, R.: Extending Cyberspace: Location based games using cellular phones. ACM Comput. Entertain. (CIE) 4, 4 (2006) Google Scholar
  7. 7.
    Burigat, S., Chittaro, L.: Location-aware visualization of VRML models in GPS-based mobile guides. In: Proceedings of the 10th International Conference on 3D Web Technology, pp. 57–64. ACM Press, Bangor (2005) Google Scholar
  8. 8.
    Reitmayr, G., Schmalstieg, D.: Collaborative augmented reality for outdoor navigation and information browsing. In: Proceedings of the Symposium of Location Based Services and TeleCartography, Vienna, Austria, pp. 31–41 (2004) Google Scholar
  9. 9.
    Liarokapis, F., Brujic-Okretic, V., Papakonstantinou, S.: Exploring urban environments using virtual and augmented reality. In: GRAPP 2006 Special Issue, vol. 3, pp. 1–13 (2007) Google Scholar
  10. 10.
    Nieuwdorp, E.: The pervasive discourse: an analysis. Comput. Entertain. (CIE) 5, 13 (2007) CrossRefGoogle Scholar
  11. 11.
    Eyles, M., Eglin, R.: Entering an age of playfulness where persistent, pervasive ambient games create moods and modify behaviour. In: Third International Conference on Games Research and Development 2007 (CyberGames 2007), Manchester Metropolitan University, U.K. (2007) Google Scholar
  12. 12.
    Lindley, C.A.: Trans-reality gaming. In: Proceedings of the 2nd Annual International Workshop in Computer Game Design and Technology, John Moores University, Liverpool, UK, p. 10 (2004) Google Scholar
  13. 13.
    Walther, B.K.: Reflections on the methodology of pervasive gaming. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 176–179. ACM, Valencia (2005) CrossRefGoogle Scholar
  14. 14.
    Hinske, S., Lampe, M., Magerkurth, C., Roecker, C.: Classifying pervasive games: on pervasive computing and mixed reality. In: Magerkurth, C., Roecker, C. (eds.) Concepts and Technologies for Pervasive Games—A Reader for Pervasive Gaming Research, vol. 1, p. 20. Shaker, Aachen (2007) Google Scholar
  15. 15.
    Capra, M., Radenkovic, M., Benford, S., Oppermann, L., Drozd, A., Flintham, M.: The multimedia challenges raised by pervasive games. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, pp. 89–95. ACM, Singapore (2005) CrossRefGoogle Scholar
  16. 16.
    Broll, W., Ohlenburg, J., Lindt, I., Herbst, I., Braun, A.-K.: Meeting technology challenges of pervasive augmented reality games. In: Proceedings of 5th ACM SIGCOMM Workshop on Network and System Support for Games, p. 28. ACM, Singapore (2006) CrossRefGoogle Scholar
  17. 17.
    Benford, S., Seager, W., Flintham, M., Anastasi, R., Rowland, D., Humble, J., Stanton, D., Bowers, J., Tandavanitj, N., Adams, M., Farr, J.R., Oldroyd, A., Sutton, J.: The error of our ways: the experience of self-reported position in a location-based game. In: Proceedings of the 6th International Conference on Ubiquitous Computing (UbiComp), vol. 3205, pp. 70–87. Springer, Nottingham (2004) Google Scholar
  18. 18.
    Benford, S., Capra, M., Flintham, M., Crabtree, A., Drozd, A., Oppermann, L., PankokeBabatz, U., Waern, A., Ermi, L., Jäppinen, A., Montola, M.: A review of design and evaluation methods for IPerG. In: Benford, S., Capra, M. (eds.) WP5 Design and Evaluation, p. 54 (2005) Google Scholar
  19. 19.
    Saha, D., Mukherjee, A.: Pervasive computing: a paradigm for the 21st century. IEEE Comput. 36 (2003) Google Scholar
  20. 20.
    Mostefaoui, G.K., Pasquier-Rocha, J., Brezillon, P.: Context-Aware Computing: A guide for the pervasive computing community. In: The IEEE/ACS International Conference on Pervasive Services (ICPS’04), American University of Beirut (AUB), Lebanon, pp. 39–48. IEEE Comput. Soc., Los Alamitos (2004) CrossRefGoogle Scholar
  21. 21.
    Klatzky, R.L.: Allocentric and egocentric spatial representations: Definitions, distinctions, and interconnections. In: Christian, F., Christopher, H., Karl Friedrich, W. (eds.) Spatial Cognition, an Interdisciplinary Approach to Representing and Processing Spatial Knowledge, pp. 1–18. Springer, London (1998) Google Scholar
  22. 22.
    Roecker, C., Magerkurth, C., Hinske, S., Lampe, M.: Designing user-friendly interfaces for pervasive gaming applications. In: Magerkurth, C., Roecker, C. (eds.) Concepts and Technologies for Pervasive Games—A Reader for Pervasive Gaming Research, vol. 1, p. 12. Shaker, Aachen (2007) Google Scholar
  23. 23.
    Reitmayr, G., Drummond, T.: Going out: robust model-based tracking for outdoor augmented reality. In: Fifth IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR ’06), University of California, Santa Barbara, USA, pp. 109–118 (2006) Google Scholar
  24. 24.
    Salvi, J., Armangué, X., Batlle, J.: A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recogn. 35, 1617–1635 (2002) MATHCrossRefGoogle Scholar
  25. 25.
    Hall, E.L., Tio, J.B.K., McPherson, C.A., Sadjadi, F.A.: Measuring Curved Surfaces for Robot Vision. Computer, vol. 15, pp. 42–54. IEEE Comput. Soc., Los Alamitos (1982) Google Scholar
  26. 26.
    Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. J. Robot. Autom. 3, 323–344 (1987) CrossRefGoogle Scholar
  27. 27.
    Vezhnevets, V., Velizhev, A.: GML C++ camera calibration toolbox. (2005)

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  • Stelios Papakonstantinou
    • 1
  • Vesna Brujic-Okretic
    • 1
  1. 1.Department of Information ScienceCity UniversityLondonUK

Personalised recommendations