Personal and Ubiquitous Computing

, Volume 11, Issue 2, pp 97–106 | Cite as

Interacting with mobile services: an evaluation of camera-phones and visual tags

  • Eleanor ToyeEmail author
  • Richard Sharp
  • Anil Madhavapeddy
  • David Scott
  • Eben Upton
  • Alan Blackwell
Original Article


We present a study of using camera-phones and visual-tags to access mobile services. Firstly, a user-experience study is described in which participants were both observed learning to interact with a prototype mobile service and interviewed about their experiences. Secondly, a pointing-device task is presented in which quantitative data was gathered regarding the speed and accuracy with which participants aimed and clicked on visual-tags using camera-phones. We found that participants’ attitudes to visual-tag-based applications were broadly positive, although they had several important reservations about camera-phone technology more generally. Data from our pointing-device task demonstrated that novice users were able to aim and click on visual-tags quickly (well under 3 s per pointing-device trial on average) and accurately (almost all meeting our defined speed/accuracy tradeoff of 6% error-rate). Based on our findings, design lessons for camera-phone and visual-tag applications are presented.


Mobile Phone Augmented Reality Mobile Service Interaction Technique Novice User 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The authors would like to thank Rob Ennals for his valuable comments and suggestions.


  1. 1.
    NTT DoCoMo Unveils New mova 506i i-mode Phone Series. Press release. Available from NTT DoCoMo press centerGoogle Scholar
  2. 2.
    Raw data from pointing-device task. Available from
  3. 3.
    Semacode website.
  4. 4.
    New York Times (7th October 2004). Connecting paper and online worlds by cellphone cameraGoogle Scholar
  5. 5.
    Azuma RT (1997) A survey of augmented reality. Presence 6(4):355–385Google Scholar
  6. 6.
    Brewster SA (2002) Overcoming the lack of screen space on mobile computers. Pers Ubiquitous Comput 6(3):188–205CrossRefGoogle Scholar
  7. 7.
    de Ipiña DL, Mendonça P, Hopper A (2002) Trip: a low-cost vision-based location system for ubiquitous computing. Pers Ubiquitous Comput 6(3):206–219CrossRefGoogle Scholar
  8. 8.
    Dorfmueller-Ulhaas K, Schmalstieg D (2001) Finger tracking for interaction in augmented environments. In: Proceedings of the IEEE international symposium on augmented reality. IEEE Press, New YorkGoogle Scholar
  9. 9.
    Fails J, Olsen D (2003) A design tool for camera-based interaction. In: Proceedings of CHI. ACM Press, New York, pp 449–456Google Scholar
  10. 10.
    Gutwin C, Fedak C (2004) Interacting with big interfaces on small screens: a comparison of fisheye, zoom, and panning techniques. In: Proceedings of the 2004 conference on Graphics interface. Canadian Human-Computer Communications Society, pp 145–152Google Scholar
  11. 11.
    IDC Research. Moving pictures 2003: Worldwide camera phone survey, forecast, and analysis, 2003–2007.
  12. 12.
    Johnson J (1995) A comparison of user interfaces for panning on a touch-controlled display. In: Proceedings ACM CHI, pp 218–225Google Scholar
  13. 13.
    Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: International workshop on augmented reality (IWAR), pp 85–94Google Scholar
  14. 14.
    Kindberg T, Barton J, Morgan J, Becker G, Caswell D, Debaty P, Gopal G, Frid M, Krishnan V, Morris H, Schettino J, Serra B, Spasojevic M. People, places, things: web presence for the real world. In: Proceedings of the 3rd IEEE workshop on mobile computing systems and applications (WMCSA’00). IEEE Press, New YorkGoogle Scholar
  15. 15.
    Kindberg T, Sellen A, Geelhoed E (2004) Security and trust in mobile interactions: a study of users perceptions and reasoning. In: Proceedings of UbiComp 2004, vol 3205 of LNCS. Springer, Berlin Heidelberg New YorkGoogle Scholar
  16. 16.
    Krueger MW, Gionfriddo T, Hinrichsen K (1985) Videoplace—an artificial reality. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New YorkGoogle Scholar
  17. 17.
    Bango Ltd. Bango spots link camera phones straight to mobile content. Press release, available from
  18. 18.
    High Energy Magic Ltd. The spotcode framework. Available for download from:
  19. 19.
    Scott MacKenzie I, Buxton W (1992) Extending fitts’ law to two-dimensional tasks. In: CHI ’92: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, pp 219–226Google Scholar
  20. 20.
    MacKenzie IS (1991) Fitts’ law as a performance model in human-computer interaction. PhD Thesis, University of TorontoGoogle Scholar
  21. 21.
    Masnik M (2004) Mobile barcode scanning catching on in Japan. The feature (2nd July 2004).
  22. 22.
    Rekimoto J, Nagao K (1995) The world through the computer: computer augmented interaction with real world environments. In: ACM symposium on user interface software and technology. pp 29–36Google Scholar
  23. 23.
    Rohs M, Zweifel P (2005) A conceptual framework for camera phone-based interaction techniques. In: Proceedings of pervasive 2005, vol 3468 of LNCS. Springer, Berlin Heidelberg New YorkGoogle Scholar
  24. 24.
    Scott D, Sharp R, Madhavapeddy A, Upton E (2005) Using visual tags to bypass bluetooth device discovery. SIGMOBILE Mob Comput Commun Rev 9(1):41–53CrossRefGoogle Scholar
  25. 25.
    Sharp R (2004) New ways to maximize cameraphone technology. DeviceForge (1st July 2004).
  26. 26.
    Smith M, Davenport D, Hwa H (2003) Aura: a mobile platform for object and location annotation. In: Adjunct proceedings of Ubicomp 2003Google Scholar
  27. 27.
    Toye E, Sharp R, Madhavapeddy A, Scott D (2005) Using smart phones to access site-specific services. Pervasive Computing 4(2):60–66CrossRefGoogle Scholar
  28. 28.
    Want R, Fishkin KP, Gujar A, Harrison BL (1999) Bridging physical and virtual worlds with electronic tags. In: CHI ’99: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, pp 370–377Google Scholar

Copyright information

© Springer-Verlag London Limited 2006

Authors and Affiliations

  • Eleanor Toye
    • 1
    Email author
  • Richard Sharp
    • 1
  • Anil Madhavapeddy
    • 2
  • David Scott
    • 2
  • Eben Upton
    • 2
  • Alan Blackwell
    • 2
  1. 1.Intel Research CambridgeCambridgeUK
  2. 2.Computer LaboratoryCambridge UniversityCambridgeUK

Personalised recommendations