Passive Identification and Control of Arbitrary Devices in Smart Environments

  • Andreas Braun
  • Felix Kamieth
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6763)


Modern smart environments are comprised of multiple interconnected appliances controlled by a central system. Pointing at devices in order to control them is an intuitive way of interaction, often unconsciously performed when switching TV stations with an infrared remote, even though it is usually not required. However, only a limited number of devices have the required facilities for this kind of interaction since it does require attaching transceivers and often results in the necessity to use multiple remote controls. We propose a system giving a user the ability to intuitively control arbitrary devices in smart environments by identifying the appliance an interaction device is pointed at and providing means to manipulate these. The system is based on identifying the position and orientation of said interaction device, registering these values to a virtual representation of the physical environment, which is used to identify the selected appliance. We have created a prototype interaction device that manipulates the environment using gesture-based interaction.


Pointing device gesture-based interaction smart environments 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Borodulkin, L., Ruser, H., Tränkler, H.-R.: 3D virtual smart home user interface. In: Proceedings of the IEEE International Symposium on Virtual and Intelligent Measurement Systems, Girdwood, AK (2002)Google Scholar
  2. 2.
    Shirehjini, A.A.N.: A novel interaction metaphor for personal environment control: Direct manipulation of physical environment based on 3d visualization. In: Computers & Graphics, Special Issue on Pervasive Computing and Ambient Intelligence, vol. 28, pp. 667–675. Elsevier Science, Amsterdam (2004)Google Scholar
  3. 3.
    Kamieth, F., Roeder, P., Hellenschmidt, M.: Accelerated User-Centred Design of AAL solutions using simulated environments. In: Proceedings Ambient Assisted Living, January 27-28. VDE Verlag GmbH, Berlin (2009)Google Scholar
  4. 4.
    Lim, H., Kung, L., Hou, J.C., Luo, H.: Zero-Configuration, Robust Indoor Localization: Theory and Experimentation. In: Proceedings of IEEE INFOCOM, pp. 123–125 (2006)Google Scholar
  5. 5.
    Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M., Shafer, S.: Multi-camera multi-person tracking for easyliving. In: Proceedings of the Third IEEE International Work-shop on Visual Surveillance (2000)Google Scholar
  6. 6.
    Joint Project SensFloor,
  7. 7.
    Swindells, C., Inkpen, K., Dill, J., Tory, M.: That one there! Gesture for on-demand device identity. In: Proceedings UIST, Paris (2002)Google Scholar
  8. 8.
    Welch, G., Bishop, G., Vicci, L., Brumback, S., Keller, K., Colucci, D.: The HiBall tracker: High-performance wide-area tracking for virtual and augmented environments. In: Proceedings ACM Symposium on Virtual Reality Software and Technology (December 1999)Google Scholar
  9. 9.
    Taneja, S., Akcamete, A., Akinci, B., Garrett, J.H., East, E.W., Soibelman, L.: Analysis of three indoor localization technologies to support facility management field activities. In: Proceedings of the International Conference on Computing in Civil and Building Engineering, Nottingham, UK (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Andreas Braun
    • 1
  • Felix Kamieth
    • 1
  1. 1.Fraunhofer Institute for Computer Graphics Research - IGDDarmstadtGermany

Personalised recommendations