Abstract
The prevalent visions of ambient intelligence emphasise natural interaction between user and functions and services embedded in the environment or available through mobile devices. In these scenarios the physical and virtual worlds seamlessly gear into each other, making crossing the border between these worlds natural or even invisible to the user. The bottleneck in reaching these scenarios appear in the natural mapping between the physical objects and their virtual counterparts. The emergence of local connectivity in mobile devices opens possibilities for implementing novel user interface paradigms to enhance this mapping. We present physical selection paradigm for implementing an intuitive human technology interaction for mobile devices. In order to demonstrate the feasibility of the paradigm we implemented two experimental set-ups using commercially available smart phones with IrDA connectivity. The experiments involved selecting a website by physically pointing at its symbol and making a phone call by pointing at an icon representing the person to be called. In tentative user experiments the physical selection method was more time-efficient and it was perceived more positively by the users than a conventional method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The term virtual world meaning here loosely all the computerised services and digital information available to the user.
By natural interaction we mean that the interaction is intuitive with minimum amount of actions and time required from the user, and resulting to a positive user experience.
Potentially, with some technologies and in the presence of a multitude of tags, there may be occasions that not all the tags successfully reply to the scan, for example due to communication channel overload. This would represent a problem to the UI paradigm unless there is some way of warning the mobile device of the unread tags, in which case the scan could be repeated until all tags are successfully read.
Barcode reading software for mobile phones, see e.g. www.geracap.com.
Long-range electromagnetic technologies, such as bluetooth or RFID (UHF), can be used for PointMe paradigm, when they are equipped with a photo sensor which is activated by a light beam from the user’s device. This kind of implementation can be regarded as a ‘hybrid solution’.
References
Aarts E, Marzano S (eds) (2003) The new everyday: visions of ambient intelligence. 010 Publishing, Rotterdam, The Netherlands
Ailisto H, Plomp J, Pohjanheimo L, Strömmer E (2003) Physical selection paradigm for ubiquitous computing. In: Aarts E et al (eds) EUSAI 2003. Lecture notes in computer science, vol 2875. Springer, Berlin Heidelberg New York
Bunszel C (2001) Magnetic induction: a low-power wireless alternative. RFDesign 24(11):78–80
ECMA (2004) Near field communication white paper, ECMA/TC32-TG19/2004/1
Finkenzeller K (2003) RFID handbook, fundamentals and applications in contactless smart cards and identification. Wiley, England
Fizmaurice G, Ishii H, Buxton W (1995) Bricks: laying the foundations of graspable user interfaces. In: Proceedings of CHI’95
Kindberg T et al (2000) People, places, things: web presence for real world. In: IEEE workshop on mobile computing systems and applications WMCSA’00, IEEE Press, Monterey
Ljungstrand P, Holmqvist L (1999) WebStickers: using physical objects as WWW bookmarks. In: Extended abstracts of CHI’99, ACM Press, New York
Ma H, Paradiso J (2002) The FindIT flashlight: responsive tagging based on optically triggered microprocessor wakeup, in UbiComp, LNCS 2498, Springer, Berlin Heidelberg New York, pp 160–167
Norman D (1988) The psychology of everyday things. Basic books, New York, p 257
Philips semiconductors. Philips Near Field Communication WWW page. http://www.semiconductors.philips.com/markets/identification/products/nfc/. Referenced April 1st, 2004
Plain-Jones C (1995) Data matrix identification. Sensor Rev 15(1):12–15
Rekimoto J, Ayatsuka Y (2000) CyberCode: designing augmented reality environments with visual Tags. In: Proceedings on the designing augmented reality environments (DARE 2000), ACM Press, pp 1–10
Rekimoto J, Ayatsuka Y, Kohno M, Oba H (2003) Proximal interactions: a direct manipulation technique for wireless networking. INTERACT 2003, IOS Press, Amsterdam
Sarma S, Brock D, Ashton K (2000) The networked physical world. http://www.autoidlabs.com/whitepapers/
Siegemund F, Flörkemeier C (2003) Interaction in pervasive computing settings using bluetooth-enabled active tags and passive RFID technology together with mobile phones. In: Proceedings of the first IEEE international conference on pervasive computing and communications, Forth Worth
Streitz N, Tandler P, Müller-tomfelde C, Konomi S (2001) Roomware: towards the next generation of human-computer interaction based on an integrated design of real and virtual worlds. In: Carroll J (ed) Human-computer interaction in the new millennium. Addison-Wesley, Boston
Strömmer E, Suojanen M (2003) Micropower IR tag—a new technology for ad-hoc interconnections between hand-held terminals and smart objects. In: Smart objects conference sOc’2003, Grenoble, France, May 2003 (http://www.grenoble-soc.com/proceedings03/Pdf/13-Strommer.pdf)
Swindells C, Inkpen K, Dill J, Tory M (2002) That one there! pointing to establish device identity. UIST’02 4(2):151–160
Ullmer B, Ishii H, Glas D (1998) Mediablocks: physical containers, transports, and controls for online media. In: Proceedings of SIGGRAPH ‘98, ACM Press, New York
Want R, Weiser M, Mynatt E (1998) Activating everyday objects. In: Darpa/NIST smart spaces workshop, USC Information Sciences Institute, Marina del Rey
Want R, Fishkin K, Gujar A, Harrison BL (1999) Bridging physical and virtual worlds with electronic tags. In: Proceedings of 1999 conference on human factors in computing systems, Pittsburgh, pp 370–377
Weiser M (1991) The computer of the 21st century. Scientific American
Välkkynen P, Korhonen I, Plomp J, Tuomisto T, Cluitmans L, Ailisto H, Seppä H (2003) A user interaction paradigm for physical browsing and near-object control based on tags. In: Proceedings of physical interaction workshop on real world user interfaces, Udine, IT, pp 31–34
Acknowledgements
The authors wish to thank B.Sc.(Eng.) Sanna Boström for implementing the phone call trial with the two elderly test subjects.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ailisto, H., Pohjanheimo, L., Välkkynen, P. et al. Bridging the physical and virtual worlds by local connectivity-based physical selection. Pers Ubiquit Comput 10, 333–344 (2006). https://doi.org/10.1007/s00779-005-0057-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-005-0057-0