Gestures as Interface for a Home TV Digital Divide Solutions through Inertial Sensors
Seniors are the fastest growing segment of populations not only in many parts of Europe, but also in Japan and the United States. ICT technologies are not very popular among many elderly and also are not designed around their cultural necessities and ergonomic needs. The risk is that in the very near future this growing segment will be digitally isolated, in a society that is more and more based on ICT as infrastructure for service, and communications.
Easy Reach Project proposes an ergonomic application to break social isolation through social interaction to help the elderly to overcome barrier of the digital divide. This paper focuses its attention on the development of the technology and algorithms used as Human Computer Interface of the Easy Reach Project, that exploits inertial sensors to detect gestures.
Many experimental algorithms for gesture recognition have been developed using inertial sensors in conjunction with other sensors or devices, or by themselves, but they have not been thoroughly tested in real situations, they are not devoted to adapt to the elderly and their way of executing gestures. The elderly are not used to modern interfaces and devices, and – due to aging – they can face problems in executing even very simple gestures.
Our algorithm based on Pearson index and Hamming distance for gestures recognition has been tested both with young and elderly, and was shown to be resilient to changes in velocity and individual differences, still maintaining great accuracy of recognition (97.4% in user independent mode; 98.79% in user dependent mode). The algorithm has been adopted by the Easy Reach consortium (2009-2013) to pilot the human machine gesture-based interface.
KeywordsSensors Inertial Sensors Gestures Human Machine Interfaces Ambient Intelligence Assisted Living Elderly Social Digital Divide Home TV
Unable to display preview. Download preview PDF.
- 1.Bisiani, R., Merico, D., Pinardi, S., Dominoni, M., Cesta, A., Orlandini, A., Rasconi, R., Suriano, M., Umbrico, A., Sabuncu, O., Schaub, T., D’Aloisi, D., Nicolussi, R., Papa, F., Bouglas, V., Giakas, G., Kavatzikidis, T., Bonfiglio, S.: Fostering Social Interaction of Home-Bound Elderly People: The EasyReach System. In: IEA/AIE 2013, Amsterdam (2013)Google Scholar
- 2.Hans-Helmut, K., Dirk, H., Thomas, L., Steffi, G.R.-H., Matthias, C.A., Herbert, M., Vilagut, G., Ronny, B., Josep, M.H., Giovanni, D.G., Ron, D.G., Viviane, K., Jordi, A.: Health status of the advanced elderly in six european countries: Results from a representative survey using EQ-5D and SF-12. Health and Quality of Life Outcomes 2010 143(8), 143 (2010)Google Scholar
- 3.Hoffman, F.G., Heyer, P., Hommel, G.: Velocity Profile Based Recognition of Dynamic Gestures with Discrete Hidden Markov Models (1996)Google Scholar
- 4.Mäntylä, V.M., Mäntyjärvi, J., Seppänen, T., Tuulari, E.: Hand gesture recognition of a mobile device user. IEEE (2000)Google Scholar
- 5.Schlömer, T., Poppinga, B., Henze, N., Boll, S.: Gesture Recognition with a Wii Controller. In: Proceedings of the Second International Conference on Tangible and Embedded Interaction, Bonn (2008)Google Scholar
- 6.Prekopcsák, Z.: Accelerometer Based Real-Time Gesture Recognition. Poster (2008)Google Scholar
- 7.Cho, S.J., Oh, J.K., Bang, W.C., Chang, W., Choi, E., Jing, Y., Cho, J., Kim, D.Y.: Magic Wand: A Hand-Drawn Gesture Input Device in 3-D Space with Inertial Sensors. In: Proceedings of the 9th Int’l Workshop on Frontiers in Handwriting Recognition (2004)Google Scholar
- 9.Kratz, S., Rohs, M.: A $3 Gesture Recognizer – Simple Gesture Recognition for Devices Equipped with 3D Acceleration Sensors. ACM (2010)Google Scholar
- 10.Chen, M., AlRegib, G., Juang, B.: A new 6D motion gesture database and the benchmark results of feature-based statistical recognition (2011)Google Scholar
- 11.Pinardi, S., Bisiani, R.: Movements Recognition with Intelligent Multisensor Analysis, A Lexical Approach. In: Proceedings of the 6th Int. Conf. on Intelligent Environments, Kuala Lumpur (2010)Google Scholar
- 12.Gupta, S., Morris, D., Patel, S.N., Desney, T.: SoundWave: Using the Doppler Effect to Sense Gestures. Redmond (2012)Google Scholar
- 13.Xu, R., Zhou, S., Li, W.J.: MEMS Accelerometer Based Nonspecific-User Hand Gesture Recognition. IEEE Sensors Journal (May 5, 2012)Google Scholar
- 14.Kratz, L., Saponas, T.S., Morris, D.: Making Gestural Input from Arm-Worn Inertial Sensors More Practical. ACM (2012)Google Scholar
- 15.XSens, XM-B Technical Documentation (2009) Google Scholar
- 16.STMicroelectronics, LIS331DLH - MEMS digital output motion sensor ultra low-power high performance 3-axes “nano” accelerometer (2009)Google Scholar
- 17.Zhou, S., Dong, Z., Li, W.J., Kwong, C.P.: Hand-Written Character Recognition Using MEMS Motion Sensing Technology. In: Proceedings of the 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (2008)Google Scholar
- 18.Keir, P., Elgoyhen, J., Naef, M., Payne, J., Horner, M., Anderson, P.: Gesture-recognition with Non-referenced Tracking. In: Proceedings of the 2006 IEEE Symposium on 3D User interfaces (2006)Google Scholar
- 19.Fihl, P., Holte, M., Moeslund, T., Reng, L.: Action Recognition using Motion Primitives and Probabilistic Edit Distance (2006)Google Scholar
- 22.Vogler, C., Sun, H., Metaxas, D.: A Framework for Motion Recognition with Applications to American Sign Language and Gait Recognition. IEEE (2000)Google Scholar
- 23.Gavrila, D.M.: The Visual Analisys of Human Movement: A Survey. Academic Press (1998)Google Scholar
- 24.Wang, J.S., Chuang, F.C.: An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition. IEEE (2011)Google Scholar
- 25.Choi, E., Bang, W., Cho, S., Yang, J., Kim, D., Kim, S.: Beatbox Music Phone: Gesture-based Interactive Mobile Phone using a Tri-axis Accelerometer. IEEE (2005)Google Scholar