Abstract
We present a development of a gesture-based interface for the elderly and people with mobility impairment in a smart house environment. To reduce a burden of memorizing a variety of gesture commands, we introduce baby signs which are natural and easy-to-remember body signs without special education. The baby signs can be applied not only to communicate with others but also to interact with a computer for people with low level of proficiency in conventional peripherals. To achieve this purpose, we have attempted to create a real application working under illumination change and real-time requirement. The system observes the user’s sign by a monitor-mounted camera and color gloves. Introducing a robust hand segmentation method against illumination change and adopting HMMs, our initial result shows 94.33% success rate for 6 sign words.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Seo, K.-H., Oh, C., Choi, T.-Y., Lee, J.-J.: Bed-type Robotic System for the Bedridden. IEEE, Los Alamitos
Lee, H.-E., Kim, Y., Park, K.-H.: Development of Steward Robot for Human-friendly Interaction. IEEE, Los Alamitos
Do, J.-H., Jang, H., Jung, S.H., Jung, J., Bien, Z.: Soft Remote Control System in the Intelligent Sweet Home
Stern, H.I., Wachs, J.P., Edan, Y.: Optimal Consensus Intuitive Hand Gesture Vocabulary Design. IEEE, Los Alamitos (2008)
Kim, Y.-h., Lee, H.-E., Kim, H.-H., Park, K.-H., Bien, Z.Z.: A Task Planning System of Steward Robot for Human-friendly Human-Robot Interaction. In: Proceedings of the 5th International Conference on Smart Homes and Health Telematic (ICOST 2007), Nara, Japan, June 21-23, pp. 100–109 (2007)
Sigal, L., Sclaroff, S., Athitsos, V.: Skin color-based video segmentation under time-varying illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(7), 862–877 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, TY., Kim, HH., Park, KH. (2010). Gesture-Based Interface Using Baby Signs for the Elderly and People with Mobility Impairment in a Smart House Environment. In: Lee, Y., et al. Aging Friendly Technology for Health and Independence. ICOST 2010. Lecture Notes in Computer Science, vol 6159. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13778-5_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-13778-5_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13777-8
Online ISBN: 978-3-642-13778-5
eBook Packages: Computer ScienceComputer Science (R0)