Abstract
Applications for the control and automation of residential environments (domotics) are an emerging area of study within Human-Computer Interaction (HCI). One of the related challenges is to design gestural interaction with these applications. This paper explores socio-technical aspects of gestural interaction in intelligent domotic environments. An analysis of literature in the area revealed that some HCI-related aspects are treated in a restricted manner that neglects socio-technical dimensions. We propose a framework for discussing related challenges in an integrated manner, considering the dimensions people, gestural mode of interaction, and domotics. Some of these challenges are addressed by literature outside the area of domotics. Many open research questions remain, e.g. how to design gestural vocabularies that minimize ambiguity and consider cultural and social aspects. The proposed framework might contribute to answering these questions thus to designing meaningful interaction that is intuitive and easy to learn.
Chapter PDF
Similar content being viewed by others
References
Aldrich, F.K.: Smart Homes: Past, Present and Future, pp. 17–39. Springer (2003)
Audel, T., Beaudouin-Lafon, M.: Charade: Remote Control of Objects Using Free-Hand Gestures. Communications of the ACM 36(7), 28–35 (1993)
Bannon, L.: Reimagining HCI: Toward a more Human-Centered Perspective. Interactions 18(4), 50–57 (2011)
Bardzell, S., Churchill, E., Bardzell, J., Forlizzi, J., Grinter, R., Tatar, D.: Feminism and Interaction Design. In: CHI 2011, pp. 1–4. ACM (2011)
Bonino, D., Corno, F., Russis, L.: dWatch: A Personal Wrist Watch for Smart Environments. Procedia Computer Science 10, 300–307 (2012)
Cabral, M.C., Morimoto, C.H., Zuffo, M.K.: On the Usability of Gesture Interfaces in Virtual Reality Environments. In: CLIHC 2005, pp. 100–108 (2005)
Carrino, S., Péclat, A., Mugellini, E., Khaled, O.A., Ingold, R.: Humans and Smart Environments: A Novel Multimodal Interaction Approach. In: ICMI 2011, Alicante, Spain, pp. 105–112 (2011)
Choe, E.K., Consolvo, S., Jung, J., Harrison, B., Kientz, J.A.: Living in a Glass House: A Survey of Private Moments in the Home. In: UbiComp 2011, pp. 41–44 (2011)
Cook, D.J., Das, S.K.: How Smart are Our Environments? An Updated Look at the State of the Art. Pervasive Mob. Comput. 3(2), 53–73 (2007)
Dovey, K.: Home and Homeless. In: Home Environments, pp. 36–61. Plenum Press (1985)
Fails, J.A., Olsen, D.: Light Widgets: Interacting in Every-Day Spaces. In: IUI 2002, pp. 63–69. ACM (2002)
Gandy, M., Starner, T., Auxier, J., Ashbrook, D.: The Gesture Pendant: A Self-Illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring. In: ISWC 2000, pp. 1–8. IEEE (2000)
Henze, N., Löcken, A., Boll, S., Hesselmann, T., Pielot, M.: Free-Hand Gestures for Music Playback: Deriving Gestures with a User-Centred Process. In: MUM 2010, pp. 1–10. ACM (2010)
Hosoya, E., Kitabata, M., Sato, H., Harada, I., Nojima, H., Morisawa, F., Mutoh, S., Onozawa, A.: A Mirror Metaphor Interaction System: Touching Remote Real Objects in an Augmented Reality Environment. In: ISMAR 2003, Tokyo, Japan, pp. 1–2 (2003)
Irie, K., Wakamura, N., Umeda, K.: Construction of an Intelligent Room Based on Gesture Recognition: Operation of Electric Appliances with Hand Gestures. In: IROS 2004, Sendai, Japan, pp. 193–198 (2004)
Jing, L., Yamagishi, K., Wang, J., Zhou, Y., Huang, T., Cheng, Z.: A Unified Method for Multiple Home Appliances Control through Static Finger Gestures. In: SAINT 2011, pp. 82–90. IEEE (2011)
Jung, J., Do, J., Kim, Y., Suh, K., Kim, D., Bien, Z.Z.: Advanced Robotic Residence for the Elderly/the Handicapped: Realization and User Evaluation. In: ICORR 2005, Chicago, Illinois, pp. 492–495 (2005)
Kane, S.K., Wobbrock, J.O., Ladner, R.E.: Usable Gestures for Blind People: Understanding Preference and Performance. In: CHI 2011, pp. 413–422 (2011)
Karam, M., Schraefel, M.: A Taxonomy of Gestures in Human Computer Interactions. Technical Report ECSTR-IAM05-009, University of Southampton (2005)
Kim, D., Kim, D.: An Intelligent Smart Home Control Using Body Gestures. In: ICHIT 2006, pp. 439–446. IEEE (2006)
Kim, H., Jeong, K., Kim, S., Han, T.: Ambient Wall: Smart Wall Display Interface which can be Controlled by Simple Gesture for Smart Home. In: SA 2011, Hong Kong, China, pp. 1–2 (2011)
Kita, S.: Cross-Cultural Variation of Speech-Accompanying Gesture: A review. Language and Cognitive Processes 24(2), 145–167 (2009)
Kleindienst, J., Macek, T., Serédi, L., Šedivý, J.: Vision-Enhanced Multi-Modal Interactions in Domotic Environments. In: ERCIM 2004 (2004)
Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S.: I’m Home: Defining and Evaluating a Gesture Set for Smart-Home Control. Int. J. Hum.-Comput. Stud. 69, 693–704 (2011)
Lenman, S., Bretzner, L., Thuresson, B.: Using Marking Menus to Develop Command Sets for Computer Vision Based Hand Gesture Interfaces. In: NordiCHI 2002, pp. 239–242 (2002)
Lim, C.J., Pan, Y., Lee, J.: Human Factors and Design Issues in Multimodal (Speech/Gesture) Interface. In: JDCTA 2008, pp. 67–77 (2008)
Liu, J., Zhong, L., Wickramasuriya, J., Vasudevan, V.: uWave: Accelerometer-Based Personalized Gesture Recognition and its Applications. Pervasive Mob. Comput. 5(6), 657–675 (2009)
Miranda, L.C., Hornung, H.H., Baranauskas, M.C.C.: Adjustable Interactive Rings for iDTV. IEEE Trans. Consum. Electron. 56(3), 1988–1996 (2010)
Neßelrath, R., Lu, C., Schulz, C.H., Frey, J., Alexandersson, J.: A Gesture Based System for Context-Sensitive Interaction with Smart Homes. Ambient Assisted Living, 1–12 (2011)
Nielsen, J.: Usability Engineering. Morgan Kauffmann, San Diego (1993)
Nielsen, M., Moeslund, T., Störring, M., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for Human Computer Interaction. In: Internation Gesture Workshop, Genova, Italy (2003)
Norman, D.A., Nielsen, J.: Gestural Interfaces: A Step Backward in Usability. Interactions 17(5), 46–49 (2010)
Norman, D.A.: Natural User Interfaces are Not Natural. Interactions 17(3), 6–10 (2010)
Oh, O., Jung, Y., Cho, Y., Hahm, C., Sin, H., Lee, J.: Hands-up: Motion Recognition Using Kinect and a Ceiling to Improve the Convenience of Human Life. In: CHI EA 2012, Texas, USA, pp. 1655–1660 (2012)
Ouchi, K., Esaka, N., Tamura, Y., Hirahara, M., Doi, M.: Magic Wand: An Intuitive Gesture Remote Control for Home Appliances. In: AMT 2005. IEEE (2005)
Panger, G.: Kinect in the Kitchen: Testing Depth Camera Interactions in Practical Home Environments. In: CHI 2012, pp. 1985–1990. ACM (2012)
Rahman, A.M., Hossain, M.A., Parra, J., Saddik, A.E.: Motion-Path Based Gesture Interaction with Smart Home Services. In: MM 2009, pp. 761–764. ACM (2009)
Rahman, A.S.M.M., Saboune, J., Saddik, A.E.: Motion-Path Based in Car Gesture Control of the Multimedia Devices. In: DIVANet 2011, pp. 69–76. ACM (2011)
Richarz, J., Plötz, T., Fink, G.A.: Real-Time Detection and Interpretation of 3D Deictic Gestures for Interaction with an Intelligent Environment. In: Int. Conf. on Pattern Recognition, pp. 1–4 (2008)
Rode, J.A.: A Theoretical Agenda for Feminist HCI. Interacting with Computer 23(5), 393–400 (2011)
Sadri, F.: Ambient Intelligence: A Survey. ACM Computing Surveys 43(4), 1–66 (2011)
Saizmaa, T., Kim, H.C.C.: A Holistic Understanding of HCI Perspectives on Smart Home. In: NCM 2008, pp. 59–65. IEEE (2008)
Solanki, U.V., Desai, N.H.: Hand Gesture Based Remote Control for Home Appliances: Handmote. In: WICT 2011, pp. 419–423. IEEE (2011)
Wahlster, W., Reithinger, N., Blocher, A.: SmartKom: Multimodal Communication with a Life-Like Character. In: Eurospeech 2001, pp. 1547–1550. ISCA (2001)
Wilson, A., Shafer, S.: XWand: UI for Intelligent Spaces. In: CHI 2003, pp. 545–552. ACM (2003)
Yamamoto, Y., Yoda, I., Sakaue, K.: Arm-Pointing Gesture Interface Using Surrounded Stereo Cameras System. In: ICPR 2004, pp. 965–970. IEEE (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
de Carvalho Correia, A.C., de Miranda, L.C., Hornung, H. (2013). Gesture-Based Interaction in Domotic Environments: State of the Art and HCI Framework Inspired by the Diversity. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40480-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-40480-1_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40479-5
Online ISBN: 978-3-642-40480-1
eBook Packages: Computer ScienceComputer Science (R0)