Personal and Ubiquitous Computing

, Volume 13, Issue 4, pp 255–264

Supporting device discovery and spontaneous interaction with spatial references

  • Hans Gellersen
  • Carl Fischer
  • Dominique Guinard
  • Roswitha Gostner
  • Gerd Kortuem
  • Christian Kray
  • Enrico Rukzio
  • Sara Streng
Original Article


The RELATE interaction model is designed to support spontaneous interaction of mobile users with devices and services in their environment. The model is based on spatial references that capture the spatial relationship of a user’s device with other co-located devices. Spatial references are obtained by relative position sensing and integrated in the mobile user interface to spatially visualize the arrangement of discovered devices, and to provide direct access for interaction across devices. In this paper we discuss two prototype systems demonstrating the utility of the model in collaborative and mobile settings, and present a study on usability of spatial list and map representations for device selection.


Spontaneous interaction Spatial user interface Relative positioning 


  1. 1.
    Addlesee M, Curwen R, Hodges S, Newman J, Steggles P, Ward A, Hopper A (2001) Implementing a sentient computing system. Computer 34(8):50–56CrossRefGoogle Scholar
  2. 2.
    Baudisch P, Rosenholtz R (2003) Halo: a technique for visualizing off-screen objects. In: Proceedings SIGCHI conference on human factors in computing systems (CHI ‘03), pp 481–488Google Scholar
  3. 3.
    Biehl JT, Bailey BP (2004) ARIS: an interface for application relocation in an interactive space. In: Proceedings of the 2004 conference on graphics interface, London, Ontario, Canada, May 2004. pp 107–116Google Scholar
  4. 4.
    Brumitt B, Krumm J, Meyers B, Shafer S (2000) Ubiquitous computing and the role of geometry. IEEE Pers Commun 41–43Google Scholar
  5. 5.
    Danesh A, Inkpen K, Lau F, Shu K, Booth K (2001) Geney: designing a collaborative activity for the palm handheld computer. In: Proceedings of CHI, conference on human factors incomputing systems (CHI 2001), pp 388–395Google Scholar
  6. 6.
    Edwards WK (2006) Discovery systems in ubiquitouscomputing. IEEE Pervasive Comput 5(2):70–77CrossRefGoogle Scholar
  7. 7.
    Fröhlich P, Simon R, Baillie L, Roberts J, Murray-Smith R (2007). Mobile spatial interaction. Extended abstracts of CHI2007, conference on human factors in computing systems, San JoséGoogle Scholar
  8. 8.
    Guinard D, Gellersen H, Streng S (2007) Extending mobile devices with spatially arranged gateways to pervasive services. In: Proceedings international workshop on pervasive mobile interaction devices (PERMID 2007)Google Scholar
  9. 9.
    Hazas M, Kray C, Gellersen H, Agbota H, Kortuem G, Krohn A (2005) A relative positioning system for co-located mobile devices. In: Proceedings of the 3rd international conference on mobile systems, applications, and services, Seattle, June 2005. MobiSys ’05. pp 177–190Google Scholar
  10. 10.
    Hinckley K (2003) Synchronous gestures for multiple users and computers. In: Proceedings of UIST 2003, pp 149–158Google Scholar
  11. 11.
    Kindberg T, Fox A (2002) System software for ubiquitous computing. IEEE Pervasive Comput 1(1):70–81CrossRefGoogle Scholar
  12. 12.
    Kindberg T, Barton J, Morgan J, Becker G, Caswell D, Debaty P, Gopal G, Frid M, Krishnan V, Morris H, Schettino J, Serra B, Spasojevic M (2002) People, places, things: web presence for the real world. Mob Netw Appl 7(5):365–376MATHCrossRefGoogle Scholar
  13. 13.
    Kortuem G, Kray C, Gellersen H (2005) Sensing and visualizing spatial relations of mobile devices. In: Proceedings of the 18th annual ACM symposium on user interface software and technology, Seattle, WA, USA, 23–26 October 2005. UIST ‘05. ACM Press, pp 93–102Google Scholar
  14. 14.
    Mayrhofer R, Gellersen H, Hazas M (2007) Security by spatial reference: using relative positioning to authenticate devices for spontaneous interaction. In: Proceedings ubicomp 2007: 9th international conference on ubiquitous computing, Innsbruck, September 2007. pp 199–216Google Scholar
  15. 15.
    Newman MW, Sedivy JZ, Neuwirth CM, Edwards WK, Hong JI, Izadi S, Marcelo K Smith TF (2002) Designing for serendipity: supporting end-user configuration of ubiquitous computing environments. In: Proceedings of the conference on designing interactive systems: processes, practices, methods, and techniques, London, England, 25–28 June 2002. DIS ‘02. pp 147–156Google Scholar
  16. 16.
    Ponnekanti S, Lee B, Fox A, Hanrahan P, Winograd W (2001) ICrafter: a service framework for ubiquitous computing environments. In: Proceedings of the 3rd international conference on ubiquitous computing, Atlanta, September 2001. pp 56–75Google Scholar
  17. 17.
    Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the 10th annual ACM symposium on user interface software and technology, 14–17 October 1997. Banff, Alberta, Canada, pp 31–39Google Scholar
  18. 18.
    Rekimoto J, Ayatsuka Y, Kohno M, Oba H (2003) Proximal interactions: a direct manipulation technique for wireless networking. In: Proceedings of Interact’2003, pp 511–518Google Scholar
  19. 19.
    Rukzio E, Leichtenstern K, Callaghan V, Holleis P, Schmidt A, Chin J (2006) An experimental comparison of physical mobile interaction techniques: touching, pointing and scanning. In: Proceedings ubicomp 2006, pp 87–104Google Scholar
  20. 20.
    Schilit BN, Adams NI, Want R (1994) Context-aware computing applications. In: Proceedings of workshop on mobile computing systems and applications (WMCSA), Santa Cruz, December 1994. IEEE Computer Society. pp 85–90Google Scholar
  21. 21.
    Strachan S, Williamson J, Murray-Smith R, Show me the way to Monte Carlo: density-based trajectory navigation. In: Proceedings of ACM SIG CHI conference, San Jose, 2007Google Scholar
  22. 22.
    Suzuki G, Aoki S, Iwamoto T, Maruyama D, Koda T, Kohtake N, Takashio K, Tokuda H (2005) u-photo: interacting with pervasive services using digital still images. In: Proceedings pervasive 2005, pp 190–207Google Scholar

Copyright information

© Springer-Verlag London Limited 2008

Authors and Affiliations

  • Hans Gellersen
    • 1
  • Carl Fischer
    • 1
  • Dominique Guinard
    • 2
  • Roswitha Gostner
    • 1
  • Gerd Kortuem
    • 1
  • Christian Kray
    • 3
  • Enrico Rukzio
    • 1
  • Sara Streng
    • 4
  1. 1.Computing DepartmentLancaster UniversityLancasterUK
  2. 2.ETH Zurich/SAP ResearchZurichSwitzerland
  3. 3.Informatics Research InstituteUniversity of NewcastleNewcastleUK
  4. 4.Ludwig-Maximilians-UniversitätMunichGermany

Personalised recommendations