Distributed Accelerometers for Gesture Recognition and Visualization

  • Pedro Trindade
  • Jorge Lobo
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 349)

Abstract

Acceleration information captured from inertial sensors on the hand can provide valuable information of its 3D angular pose. From this we can recognize hand gestures and visualize them. The applications for this technology range from touchless human-machine interfaces to aiding gesture communication for humans not familiar with sign language. The development of silicon chip manufacture allowed these sensors to fit in the top of a nail or implanted in the skin and still wirelessly communicate to a processing unit. Our work demonstrates that it is possible to have gesture recognition from a clutter-free system by wearing very small devices and connect them to a nearby processing unit. This work will focus on the processing of the acceleration information. Methods are shown to estimate hand pose, finger joints’ position, and from that recognize gestures. A visualization of the angular pose of the hand is also presented. This visualization can show a single render of the pose of a recognized gesture or it can provide a simple real-time (low-latency) rendering of the hand pose. The processing of the acceleration information uses the gravity acceleration as a vertical reference.

Keywords

Accelerometers Hand Gesture Recognition Gesture Visualization 

References

  1. 1.
    Wang, R., Popovic, J.: Real-Time Hand-Tracking with a Color Glove. ACM Transaction on Graphics (2009)Google Scholar
  2. 2.
    Jones, L., Lederman, S.: Human Hand Function. Oxford University Press, Oxford (2006)CrossRefGoogle Scholar
  3. 3.
    Kapandji, I.A.: The Physiology of the joints: Upper limb, 2nd edn. E & S Living- stone, Edinburgh (1970)Google Scholar
  4. 4.
    Li, K., Chen, I.-M., Yeo, S.H.: Design and Validation of a Multi-finger Sensing Device Based on Optical Linear Encoder. In: IEEE International Conference on Robotics and Automation. Anchorage, Alaska, USA (2010)Google Scholar
  5. 5.
  6. 6.
    Lobo, J., Dias, J.: Relative Pose Calibration Between Visual and Inertial Sensors. Int. J. Rob. Res. 26, 561–575 (2007)CrossRefGoogle Scholar
  7. 7.
    Oliver, J.: Buffering Bergson: Matter and Memory in 3D Games (2008)Google Scholar
  8. 8.
    HANDLE European Project website, http://www.handle-project.eu
  9. 9.
    AnthroTronix Acceleglove, http://www.acceleglove.com/
  10. 10.
    Barbour, N.M.: Inertial Navigation Sensors, Sensors & Electronics Technology Panel. Draper Report no. P-4151 (2003)Google Scholar
  11. 11.
    Baudel, T., Beaudoin-Lafon, M.: Charade: remote control of objects using free-hand gestures. Communications of the ACM 36(7), 28–35 (1993)CrossRefGoogle Scholar
  12. 12.
    Fraden, J.: Handbook of Modern Sensors: Physics, designs, and applications, 3rd edn. Springer, Heidelberg (2003)Google Scholar
  13. 13.
    Ferreira, A., et al.: Gestuário - Língua Gestual Portuguesa. Secretariado Nacional para a Reabilitação e Integração das Pessoas com Deficiência (1997)Google Scholar
  14. 14.
    Horn, B.K.P.: Closed-Form Solution of Absolute Orientation Using Unit Quaternions. Journal of the Optical Society of America 4(4), 462–629 (1987)CrossRefMathSciNetGoogle Scholar
  15. 15.
    Khan, S., Gupta, G., Bailey, D., Demidenko, S., Messom, C.: Sign Language Analysis and Recognition: A Preliminary Investigation. IVC New Zealand (2009)Google Scholar
  16. 16.
    Takayuki, H., Ozake, S., Shinoda, H.: Three-Dimensional Shape Capture Sheet Using Distribuited Triaxial Accelerometers. In: 4th Int. Conf. on Networked Sens. Syst. (2007)Google Scholar
  17. 17.
    Taylor, C.L., Schwarz, R.J.: The anatomy and mechanics of the human hand. Selected Articles From Artificial Limbs, 49–62 (1970)Google Scholar
  18. 18.
    Weinberg, M.S., Kourepenis, A.: Error Sources in In-Plane Silicon Tuning-Fork MEMS Gyroscopes. Journal of Microelectromechanical Systems 15(3) (2006)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Pedro Trindade
    • 1
  • Jorge Lobo
    • 1
  1. 1.Institute of Systems and Robotics, Department of Electrical and Computer Engineering, Faculty of Science and TechnologyUniversity of CoimbraCoimbraPortugal

Personalised recommendations