Providing Visual Support for Selecting Reactive Elements in Intelligent Environments

  • Martin Majewski
  • Andreas Braun
  • Alexander Marinc
  • Arjan Kuijper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7848)


When realizing gestural interaction in a typical living environment there often is an offset between user-perceived and machine-perceived direction of pointing, which can hinder reliable selection of elements in the surroundings. This work presents a support system that provides visual feedback to a freely gesturing user; thus enabling reliable selection of and interaction with reactive elements in intelligent environments. We have created a prototype that is showcasing this feedback method based on gesture recognition using the Microsoft Kinect and visual support provision using a custom built laser-robot. Finally an evaluation has been performed, in order to prove the efficiency of such a system, acquire usability feedback and determine potential learning effects for gesture-based interaction.


Gesture based interaction Human-computer interaction Feedback Ambient intelligence 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Majewski, M., Braun, A., Marinc, A., Kuijper, A.: Visual Support System for Selecting Reactive Elements in Intelligent Environments. In: International Conference on Cyberworlds, pp. 251–255 (2012)Google Scholar
  2. 2.
    Weiser, M.: The Computer for the 21st Century. Scientific American 265, 94–104 (1991)CrossRefGoogle Scholar
  3. 3.
    Valli, A.: The design of natural interaction. Multimedia Tools and Applications 38, 295–305 (2008)CrossRefGoogle Scholar
  4. 4.
    Aarts, E.: Ambient intelligence drives open innovation. Interactions 12, 66 (2005)CrossRefGoogle Scholar
  5. 5.
    Massachusetts Institute of Technology: Oxygen project,
  6. 6.
    Wright, S., Steventon, A.: Intelligent spaces — the vision, the opportunities and the barriers. BT Technology Journal 22, 15–26 (2004)CrossRefGoogle Scholar
  7. 7.
    Heilig, M.L.: Sensorama simulator (1962),
  8. 8.
    Sutherland, I.E.: Sketchpad: A man-machine graphical communication system. In: Afips Conference Proceedings, vol. 2, pp. 329–346 (1963)Google Scholar
  9. 9.
    Rovner, P.D., Henderson, D.A.: On the implementation of AMBIT/G: a graphical programming language, pp. 9–20 (1969)Google Scholar
  10. 10.
    Kessler, G.D., Hodges, L.F., Walker, N.: Evaluation of the CyberGlove as a whole-hand input device. ACM Transactions on Computer-Human Interaction 2, 263–283 (1995)CrossRefGoogle Scholar
  11. 11.
    Lee, J.C.: Interaction Techniques Using The Wii Remote Nintendo Wii. Applied Sciences (2008)Google Scholar
  12. 12.
    Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: CVPR 2011, pp. 1297–1304 (2011)Google Scholar
  13. 13.
    PrimeSense: PrimeSensor,
  14. 14.
    Wilson, A., Shafer, S.: XWand: UI for intelligent spaces. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 545–552. ACM (2003)Google Scholar
  15. 15.
    Wilson, A., Pham, H.: Pointing in intelligent environments with the worldcursor. In: INTERACT International Conference on Human Computer Interaction (2003)Google Scholar
  16. 16.
    Miller, G.A., Galanter, E., Pribram, K.H.: Plans and the structure of behavior. Holt (1960)Google Scholar
  17. 17.
    Kammer, D., Keck, M., Freitag, G., Wacker, M.: Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features. Architecture, 1–5 (2010)Google Scholar
  18. 18.
    Akenine-Möller, T., Haines, E., Hoffman, N.: Real-Time Rendering. AK Peters (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Martin Majewski
    • 1
  • Andreas Braun
    • 1
  • Alexander Marinc
    • 1
  • Arjan Kuijper
    • 1
  1. 1.Fraunhofer Institute for Computer Graphics Research - IGD DarmstadtGermany

Personalised recommendations