Providing Visual Support for Selecting Reactive Elements in Intelligent Environments

  • Martin Majewski
  • Andreas Braun
  • Alexander Marinc
  • Arjan Kuijper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7848)

Abstract

When realizing gestural interaction in a typical living environment there often is an offset between user-perceived and machine-perceived direction of pointing, which can hinder reliable selection of elements in the surroundings. This work presents a support system that provides visual feedback to a freely gesturing user; thus enabling reliable selection of and interaction with reactive elements in intelligent environments. We have created a prototype that is showcasing this feedback method based on gesture recognition using the Microsoft Kinect and visual support provision using a custom built laser-robot. Finally an evaluation has been performed, in order to prove the efficiency of such a system, acquire usability feedback and determine potential learning effects for gesture-based interaction.

Keywords

Gesture based interaction Human-computer interaction Feedback Ambient intelligence 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Majewski, M., Braun, A., Marinc, A., Kuijper, A.: Visual Support System for Selecting Reactive Elements in Intelligent Environments. In: International Conference on Cyberworlds, pp. 251–255 (2012)Google Scholar
  2. 2.
    Weiser, M.: The Computer for the 21st Century. Scientific American 265, 94–104 (1991)CrossRefGoogle Scholar
  3. 3.
    Valli, A.: The design of natural interaction. Multimedia Tools and Applications 38, 295–305 (2008)CrossRefGoogle Scholar
  4. 4.
    Aarts, E.: Ambient intelligence drives open innovation. Interactions 12, 66 (2005)CrossRefGoogle Scholar
  5. 5.
    Massachusetts Institute of Technology: Oxygen project, http://oxygen.lcs.mit.edu/
  6. 6.
    Wright, S., Steventon, A.: Intelligent spaces — the vision, the opportunities and the barriers. BT Technology Journal 22, 15–26 (2004)CrossRefGoogle Scholar
  7. 7.
    Heilig, M.L.: Sensorama simulator (1962), http://www.freepatentsonline.com/3050870.html
  8. 8.
    Sutherland, I.E.: Sketchpad: A man-machine graphical communication system. In: Afips Conference Proceedings, vol. 2, pp. 329–346 (1963)Google Scholar
  9. 9.
    Rovner, P.D., Henderson, D.A.: On the implementation of AMBIT/G: a graphical programming language, pp. 9–20 (1969)Google Scholar
  10. 10.
    Kessler, G.D., Hodges, L.F., Walker, N.: Evaluation of the CyberGlove as a whole-hand input device. ACM Transactions on Computer-Human Interaction 2, 263–283 (1995)CrossRefGoogle Scholar
  11. 11.
    Lee, J.C.: Interaction Techniques Using The Wii Remote Nintendo Wii. Applied Sciences (2008)Google Scholar
  12. 12.
    Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: CVPR 2011, pp. 1297–1304 (2011)Google Scholar
  13. 13.
    PrimeSense: PrimeSensor, http://www.primesense.com/
  14. 14.
    Wilson, A., Shafer, S.: XWand: UI for intelligent spaces. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 545–552. ACM (2003)Google Scholar
  15. 15.
    Wilson, A., Pham, H.: Pointing in intelligent environments with the worldcursor. In: INTERACT International Conference on Human Computer Interaction (2003)Google Scholar
  16. 16.
    Miller, G.A., Galanter, E., Pribram, K.H.: Plans and the structure of behavior. Holt (1960)Google Scholar
  17. 17.
    Kammer, D., Keck, M., Freitag, G., Wacker, M.: Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features. Architecture, 1–5 (2010)Google Scholar
  18. 18.
    Akenine-Möller, T., Haines, E., Hoffman, N.: Real-Time Rendering. AK Peters (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Martin Majewski
    • 1
  • Andreas Braun
    • 1
  • Alexander Marinc
    • 1
  • Arjan Kuijper
    • 1
  1. 1.Fraunhofer Institute for Computer Graphics Research - IGD DarmstadtGermany

Personalised recommendations