Personal and Ubiquitous Computing

, Volume 10, Issue 5, pp 285–299 | Cite as

Accelerometer-based gesture control for a design environment

  • Juha KelaEmail author
  • Panu Korpipää
  • Jani Mäntyjärvi
  • Sanna Kallio
  • Giuseppe Savino
  • Luca Jozzo
  • Sergio Di Marca
Original Article


Accelerometer-based gesture control is studied as a supplementary or an alternative interaction modality. Gesture commands freely trainable by the user can be used for controlling external devices with handheld wireless sensor unit. Two user studies are presented. The first study concerns finding gestures for controlling a design environment (Smart Design Studio), TV, VCR, and lighting. The results indicate that different people usually prefer different gestures for the same task, and hence it should be possible to personalise them. The second user study concerns evaluating the usefulness of the gesture modality compared to other interaction modalities for controlling a design environment. The other modalities were speech, RFID-based physical tangible objects, laser-tracked pen, and PDA stylus. The results suggest that gestures are a natural modality for certain tasks, and can augment other modalities. Gesture commands were found to be natural, especially for commands with spatial association in design environment control.


Gesture recognition Gesture control Multimodal interaction Mobile device Accelerometer 



We gratefully acknowledge research funding from the National Technology Agency of Finland (Tekes) and the Italian Ministry of Education, University and Research (MIUR). We would also like to thank our partners in the ITEA Ambience project.


  1. 1.
    Starner T, Auxier J, Ashbrook D, Gandy M (2000) The gesture pendant: a self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In: proceedings of the fourth international symposium on wearable computers, ISWC 2000, pp 87–95Google Scholar
  2. 2.
    Rekimoto J (2001) GestureWrist and gesturepad : unobtrusive wearable interaction devices. In: proceedings of the fifth international symposium on wearable computers, ISWC 2001, pp 21–31Google Scholar
  3. 3.
    Sawada H, Hashimoto S (2000) Gesture recognition using an accelerometer sensor and its application to musical performance control. Electron Commun Jpn Part 3, pp 9–17Google Scholar
  4. 4.
    Hoffman F, Heyer P, Hommel G (1997) Velocity profile based recognition of dynamic gestures with discrete hidden markov models. Proceedings of gesture workshop ‘97, Springer, Berlin Heidelberg, NewyorkGoogle Scholar
  5. 5.
    Tsukada K, Yasumura M (2002) Ubi-finger: gesture input device for mobile use. In: Proceedings of APCHI 2002, Vol. 1, pp 388-400Google Scholar
  6. 6.
    Wilson A, Shafer S (2003) Between u and i: XWand: UI for intelligent spaces. In: Proceedings of the conference on human factors in computing systems, CHI 2003, April 2003, pp 545–552Google Scholar
  7. 7.
    Flanagan J, Mäntyjärvi J, Korpiaho K, Tikanmäki J (2002) Recognizing movements of a handheld device using symbolic representation and coding of sensor signals. In: Proceedings of the first international conference on mobile and ubiquitous multimedia, pp 104–112Google Scholar
  8. 8.
    Mäntylä V-M, Mäntyjärvi J, Seppänen T, Tuulari E (2000) Hand gesture recognition of a mobile device user. In: Proceedings of the international IEEE conference on multimedia and expo, pp 281–284Google Scholar
  9. 9.
    Theodoridis S, Koutroumbas K (1999) Pattern recognition. Academic press, LondonGoogle Scholar
  10. 10.
    Pirhonen A, Brewster S, Holgiun C (2002) Gestural and audio metaphors as a means of control for mobile devices. CHI 2002, April 2002, pp 291–298Google Scholar
  11. 11.
    Tuulari E, Ylisaukko-oja A (2002) SoapBox: a platform for ubiquitous computing research and applications. In: First international conference, Pervasive 2002, pp 26-28Google Scholar
  12. 12.
    Rabiner L (1998) Tutorial on hidden markov models and selected applications in speech recognition. In: Proceedings of the IEEE, Vol. 77, No. 2Google Scholar
  13. 13.
    Kay S (2000) Can detectability be improved by adding noise? IEEE Signal Process Lett, 7(1):8–10CrossRefMathSciNetGoogle Scholar
  14. 14.
    Ailisto H, Plomp J, Pohjanheimo L, Strömmer E (2003) A physical selection paradigm for ubiquitous computing. In: 1st European symposium on ambient intelligence (EUSAI 2003). ambient intelligence, Lecture Notes in Computer Science Vol. 2875. Aarts, Emile et al (eds) Springer, Berlin Heidelberg, Newyork, pp 372–383Google Scholar
  15. 15.
    Peltola J, Plomp J, Seppänen T (1999) A dictionary-adaptive speech driven user interface for distributed multimedia platform. In: Euromicro Workshop on multimedia and telecommunications, Milan, ItalyGoogle Scholar
  16. 16.
    Kallio S, Kela J, Mäntyjärvi J (2003) Online gesture recognition system for mobile interaction. IEEE International Conference on Systems, Man & Cybernetics, Vol. 3, Washington DC, USA, pp 2070–2076Google Scholar
  17. 17.
    Mäntyjärvi J (2003) Sensor-based context recognition for mobile applications. VTT Publications 511Google Scholar
  18. 18.
    Iacucci G, Kela J, Pehkonen P (2004) Computational support to record and re-experience visits. Personal and ubiquitous computing, Vol 8 No 2, Springer, Berlin Heidelberg, Newyork, pp 100–109Google Scholar
  19. 19.
    Gersho A, Gray RM (1991) Vector Quantization and signal compression. Kluwer, DordrechtGoogle Scholar
  20. 20.
    Yoon HS (2001) Hand gesture recognition using combined features of location, angle and velocity. Pattern Recogn 34:491–501CrossRefGoogle Scholar
  21. 21.
    Mäntylä V-M (2001) Discrete hidden markov models with application to isolated user-dependent hand gesture recognition. VTT Publications 449Google Scholar
  22. 22.
    Mäntyjärvi J, Kela J, Korpipää P, Kallio S (2004) Enabling fast and effortless customisation in accelerometer based gesture interaction. In: Proceedings of the third international conference on mobile and ubiquitous multimedia, ACM, pp 25–31Google Scholar

Copyright information

© Springer-Verlag London Limited 2005

Authors and Affiliations

  • Juha Kela
    • 1
    Email author
  • Panu Korpipää
    • 1
  • Jani Mäntyjärvi
    • 1
  • Sanna Kallio
    • 1
  • Giuseppe Savino
    • 2
  • Luca Jozzo
    • 2
  • Sergio Di Marca
    • 2
  1. 1.VTT ElectronicsOuluFinland
  2. 2.Italdesign-GiugiaroMoncalieriItaly

Personalised recommendations