Preliminary Study on Wearable System for Multiple Finger Tracking
Devices that track the human body movement are heavily used in numerous and various fields like medicine, automation and entertainment. The work proposed is focused on the design of a modular device able track the flection of human hand phalanxes. The overall system composed by two parts: a computer program interface and a modular wearable system applied to the finger whose motion is to be monitored. The wearable device is equipped with an Inertial Motion Unit (IMU) with the purpose to detect the first phalanx orientation and a stretch sensor applied between the first and the second phalanx to recognize the flection angle. The configuration is completed with a microcontroller unit (ATmega328P) and a Bluetooth Low Power Module (RN4871) to ensure a reliable and easy to implement communication channel. We conduct two main set of tests to verify the global functionalities. In the first set the device is used to track the full flexion of a single finger while in the second we test the device capability to recognize different grabbed objects starting from the data retrieved from two fingers. The preliminary results open the possibility of a future development focused on a modular device composed by five elements, one for each hand finger and able to detect complex gesture like pinch, spread or tap.
KeywordsData glove Finger tracking Stretch sensor Inertial motion unit Human machine interface
This work was supported by the Italian Ministry of Instruction, University and Research, under Grant PRIN 2015C37B25.
- 2.Jackowski, A., Gebhard M., Gräser A.: A novel head gesture based interface for hands-free control of a robot. In: Proceedings of the IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp. 262–267, Benevento, Italy (2016)Google Scholar
- 3.Kumar, P., Rautaray, S., Agrawal, A.: Hand data glove: a new generation real-time mouse for Human-Computer Interaction. In: 2012 1st International Conference on Recent Advances in Information Technology (RAIT) (2012)Google Scholar
- 5.Sharp, T., Wei, Y., Freedman, D., Kohli, P., et al.: Accurate, robust, and flexible real-time hand tracking. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems—CHI’15As (2015)Google Scholar
- 7.Images Scientific Instruments Inc. Flexible Stretch Sensors. http://www.imagesco.com/sensors/stretch.pdf
- 8.Durlach, N., Mavor, A.: Virtual reality. National Academy Press, Washington, D.C. ISBN 0309051355 (1995)Google Scholar