Abstract
Gesture-based interfaces offer great opportunity for achieving natural and intuitive interactions in the age of ambient intelligence. Therefore,many efforts have been dedicated in the recent years for proposing gesture acquisition, recognition, and interaction techniques. The age of ambient intelligence has also incorporated gestures into practical applications having as main goals adaptive and personalized interactions. However, practitioners are faced with several issues when implementing gesture-based interfaces for public displays. Let alone the acquisition technologies and recognition algorithms, there are currently little to no rules for creating the specific set of gestures for a given application. Therefore, a compromise is usually made by associating gestures and functions based on the designer’s expertize and experience. This contradicts the goals of ambient intelligence where the interaction should be personalized to each user. With this respect, we propose a novel concept for reusing a set of user-defined and user-specific gestures for interacting with public ambient displays. The concept relies on an important shift of perspective: it is not the users that adapt to the interface but instead the interface employs the users’ own gesture set with their own preferred meanings.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Appert, C., Zhai, S.: Using strokes as command shortcuts: cognitive benefits and toolkit support. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI 2009), pp. 2289–2298. ACM Press, New York (2009)
Ballagas, R., Rohs, M., Sheridan, J.G.: Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI 2005 extended abstracts, pp. 1200–1203. ACM Press, New York (2005)
Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st Annual Conference of the Australian CHI Special interest Group, OZCHI 2009, vol. 411, pp. 161–168. ACM, New York (2009)
Dachselt, R., Buchholz, R.: Natural throw and tilt interaction between mobile phones and distant displays. In: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI 2009), pp. 3253–3258. ACM, New York (2009)
Duggan, M.: Wii Game Creation for Teens, 1st edn. Course Technology Press, Boston (2010)
Jorda, S., Hunter, S.E., i Conesa, P.P., Gallardo, D., Leithinger, D., Kaufman, H., Julia, C.F., Kaltenbrunner, M.: Development strategies for tangible interaction on horizontal surfaces. In: Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2010), pp. 369–372. ACM, New York (2010)
Kray, C., Nesbitt, D., Dawson, J., Rohs, M.: User-defined gestures for connecting mobile phones, public displays, and tabletops. In: Proceedings of MobileHCI 2010, pp. 239–248. ACM, New York (2010)
Malik, S., Ranjan, A., Balakrishnan, R.: Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proceedings of UIST 2005, pp. 43–52. ACM, New York (2005)
Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104(2), 90–126 (2006)
Nakamura, T., Takahashi, S., Tanaka, J.: Double-Crossing: A New Interaction Technique for Hand Gesture Interfaces. In: Lee, S., Choo, H., Ha, S., Shin, I.C. (eds.) APCHI 2008. LNCS, vol. 5068, pp. 292–300. Springer, Heidelberg (2008)
Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004)
Patel, S.N., Pierce, J.S., Abowd, G.D.: A gesture-based authentication scheme for untrusted public terminals. In: Proceedings of UIST 2004, pp. 157–160. ACM, New York (2004)
Paulson, B., Cummings, D., Hammond, T.: Object interaction detection using hand posture cues in an office setting. International Journal of Human-Computer Studies (2010), in press, accepted manuscript, Available online (October 14, 2010) doi: 10.1016/j.ijhcs.2010.09.003
Poppe, R.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108(1-2), 4–18 (2007)
Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of CHI 2010, pp. 887–896. ACM, New York (2010)
Shoemaker, G., Tang, A., Booth, K.S.: Shadow reaching: a new perspective on interaction for large displays. In: Proceedings of UIST 2007, pp. 53–56. ACM, New York (2007)
Vatavu, R.D.: Understanding challenges in designing interactions for the age of ambient media. In: Proceedings of the 3rd International Workshop on Semantic Ambient Media Experience (SAME 2010), Malaga, Spain, pp. 8–13. Tampere University Press (2010)
Wang, R.Y., Popović, J.: Real-time hand-tracking with a color glove. ACM Transactions on Graphics 28(3) (2009)
Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 33–42. ACM, New York (2005)
Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI 2009), pp. 1083–1092. ACM, New York (2009)
Zhai, S., Kristensson, P.O., Gong, P., Greiner, M., Peng, S.A., Liu, L.M., Dunnigan, A.: Shapewriter on the iphone: from the laboratory to the real world. In: Proceedings of CHI 2009, pp. 2667–2670. ACM, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vatavu, RD. (2011). Reusable Gestures for Interacting with Ambient Displays in Unfamiliar Environments. In: Novais, P., Preuveneers, D., Corchado, J.M. (eds) Ambient Intelligence - Software and Applications. Advances in Intelligent and Soft Computing, vol 92. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19937-0_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-19937-0_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19936-3
Online ISBN: 978-3-642-19937-0
eBook Packages: EngineeringEngineering (R0)