An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning

  • Enrico Rukzio
  • Karin Leichtenstern
  • Vic Callaghan
  • Paul Holleis
  • Albrecht Schmidt
  • Jeannette Chin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4206)


This paper presents an analysis, implementation and evaluation of the physical mobile interaction techniques touching, pointing and scanning. Based on this we have formulated guidelines that show in which context which interaction technique is preferred by the user. Our main goal was to identify typical situations and scenarios in which the different techniques might be useful or not. In support of these aims we have developed and evaluated, within a user study, a low-fidelity and a high-fidelity prototype to assess scanning, pointing and touching interaction techniques within different contexts. Other work has shown that mobile devices can act as universal remote controls for interaction with smart objects but, to date, there has been no research which has analyzed when a given mobile interaction technique should be used. In this research we analyze the appropriateness of three interaction techniques as selection techniques in smart environments.


Mobile Phone Mobile Device Interaction Technique Smart Device Near Field Communication 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kindberg, T., Barton, J., Morgan, J., Becker, G., Caswell, D., Debaty, P., Gopal, G., Frid, M., Krishnan, V., Morris, H., Schettino, J., Serra, B., Spasojevic, M.: People, places, things: web presence for the real world. Mobile Networks and Applications 7(5) (2002)Google Scholar
  2. 2.
    Abramson, D., Lowe, G., Atkinson, P.: Are you interested in Computers and Electronics? In: Proceedings of the ACE 2000, Melbourne, Australia (2000)Google Scholar
  3. 3.
    EURESCOM: Strategic Study Project P946-GI. When Things Start to Think? (2000),
  4. 4.
    Tarrini, L., Bianchi Bandinelli, R., Miori, V., Bertini, G.: Remote control of home automation systems with mobile devices. In: Paternó, F. (ed.) Mobile HCI 2002. LNCS, vol. 2411, p. 364. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Meyers, B.A., Nichols, J., Wobbrock, J.O., Miller, R.C.: Taking Handheld Devices to the Next Level. IEEE Computer Society 36(12), 36–43 (2004)Google Scholar
  6. 6.
    Ballagas, R., Rohs, M., Sheridan, J., Borchers, J.: The Smart Phone: A Ubiquitous Input Device. IEEE Pervasive Computing 5(1), 70–77 (2006)CrossRefGoogle Scholar
  7. 7.
    Want, R., Fishkin, K.P., Gujar, A., Harrison, B.L.: Bridging physical and virtual worlds with electronic tags. In: Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit. ACM Press, Pittsburgh (1999)Google Scholar
  8. 8.
    Välkkynen, P., Tuomisto, T.: Physical Browsing Research. In: Workshop Pervasive Mobile Interaction Devices (PERMID 2005), Munich, Germany (2005)Google Scholar
  9. 9.
    Near Field Communication (NFC),
  10. 10.
    Fitzmaurice, G.W.: Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36(7), 39–49 (1993)CrossRefGoogle Scholar
  11. 11.
    Rekimoto, J., Nagao, K.: The World Through the Computer: Computer Augmented Interaction with Real World Environments. In: Proceedings of the 8th ACM Symposium on User Interface Software and Technology (UIST 1995), Pittsburgh, PA, USA, pp. 29–36 (1995)Google Scholar
  12. 12.
  13. 13.
  14. 14.
    Rohs, M., Gfeller, B.: Using Camera-Equipped Mobile Phones for Interacting with Real-World Objects. In: Advances in Pervasive Computing, Austrian Computer Society (OCG), pp. 265–271 (2004)Google Scholar
  15. 15.
    Föckler, P., Zeidler, T., Brombach, B., Bruns, E., Bimber, O.: PhoneGuide: Museum Guidance Supported by On-Device Object Recognition on Mobile Phones. In: International Conference on Mobile and Ubiquitous Computing (MUM 2005), New Zealand, (2005)Google Scholar
  16. 16.
    Deutsche Post – Mobilepoint,
  17. 17.
  18. 18.
  19. 19.
  20. 20.
    Decker, C., Krohn, A., Beigl, M., Zimmer, T.: The Particle Computer System. In: Proceedings of the 4th International Symposium on Information Processing in Sensor Networks (IPSN), Los Angeles, California, USA (2005)Google Scholar
  21. 21.
    Ma, H., Paradiso, J.A.: The findIT flashlight: Responsive tagging based on optically triggered microprocessor wakeup. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, p. 160. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  22. 22.
    Shafer, S., Brummit, B., Cadiz, J.: Interaction Issues in Context-Aware Intelligent Environments. Human-Computer Interaction 16(2,3,4), 363–378 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Enrico Rukzio
    • 1
  • Karin Leichtenstern
    • 1
    • 2
  • Vic Callaghan
    • 2
  • Paul Holleis
    • 1
  • Albrecht Schmidt
    • 1
  • Jeannette Chin
    • 2
  1. 1.Research Group Embedded Interaction, Media Informatics GroupUniversity of Munich 
  2. 2.Intelligent Inhabited Environment GroupUniversity of Essex 

Personalised recommendations