Skip to main content

Reusable Gestures for Interacting with Ambient Displays in Unfamiliar Environments

  • Conference paper

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 92))

Abstract

Gesture-based interfaces offer great opportunity for achieving natural and intuitive interactions in the age of ambient intelligence. Therefore,many efforts have been dedicated in the recent years for proposing gesture acquisition, recognition, and interaction techniques. The age of ambient intelligence has also incorporated gestures into practical applications having as main goals adaptive and personalized interactions. However, practitioners are faced with several issues when implementing gesture-based interfaces for public displays. Let alone the acquisition technologies and recognition algorithms, there are currently little to no rules for creating the specific set of gestures for a given application. Therefore, a compromise is usually made by associating gestures and functions based on the designer’s expertize and experience. This contradicts the goals of ambient intelligence where the interaction should be personalized to each user. With this respect, we propose a novel concept for reusing a set of user-defined and user-specific gestures for interacting with public ambient displays. The concept relies on an important shift of perspective: it is not the users that adapt to the interface but instead the interface employs the users’ own gesture set with their own preferred meanings.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Appert, C., Zhai, S.: Using strokes as command shortcuts: cognitive benefits and toolkit support. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI 2009), pp. 2289–2298. ACM Press, New York (2009)

    Chapter  Google Scholar 

  2. Ballagas, R., Rohs, M., Sheridan, J.G.: Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI 2005 extended abstracts, pp. 1200–1203. ACM Press, New York (2005)

    Chapter  Google Scholar 

  3. Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st Annual Conference of the Australian CHI Special interest Group, OZCHI 2009, vol. 411, pp. 161–168. ACM, New York (2009)

    Google Scholar 

  4. Dachselt, R., Buchholz, R.: Natural throw and tilt interaction between mobile phones and distant displays. In: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI 2009), pp. 3253–3258. ACM, New York (2009)

    Chapter  Google Scholar 

  5. Duggan, M.: Wii Game Creation for Teens, 1st edn. Course Technology Press, Boston (2010)

    Google Scholar 

  6. Jorda, S., Hunter, S.E., i Conesa, P.P., Gallardo, D., Leithinger, D., Kaufman, H., Julia, C.F., Kaltenbrunner, M.: Development strategies for tangible interaction on horizontal surfaces. In: Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2010), pp. 369–372. ACM, New York (2010)

    Chapter  Google Scholar 

  7. Kray, C., Nesbitt, D., Dawson, J., Rohs, M.: User-defined gestures for connecting mobile phones, public displays, and tabletops. In: Proceedings of MobileHCI 2010, pp. 239–248. ACM, New York (2010)

    Google Scholar 

  8. Malik, S., Ranjan, A., Balakrishnan, R.: Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proceedings of UIST 2005, pp. 43–52. ACM, New York (2005)

    Chapter  Google Scholar 

  9. Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104(2), 90–126 (2006)

    Article  Google Scholar 

  10. Nakamura, T., Takahashi, S., Tanaka, J.: Double-Crossing: A New Interaction Technique for Hand Gesture Interfaces. In: Lee, S., Choo, H., Ha, S., Shin, I.C. (eds.) APCHI 2008. LNCS, vol. 5068, pp. 292–300. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  11. Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  12. Patel, S.N., Pierce, J.S., Abowd, G.D.: A gesture-based authentication scheme for untrusted public terminals. In: Proceedings of UIST 2004, pp. 157–160. ACM, New York (2004)

    Chapter  Google Scholar 

  13. Paulson, B., Cummings, D., Hammond, T.: Object interaction detection using hand posture cues in an office setting. International Journal of Human-Computer Studies (2010), in press, accepted manuscript, Available online (October 14, 2010) doi: 10.1016/j.ijhcs.2010.09.003

    Google Scholar 

  14. Poppe, R.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108(1-2), 4–18 (2007)

    Article  Google Scholar 

  15. Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of CHI 2010, pp. 887–896. ACM, New York (2010)

    Google Scholar 

  16. Shoemaker, G., Tang, A., Booth, K.S.: Shadow reaching: a new perspective on interaction for large displays. In: Proceedings of UIST 2007, pp. 53–56. ACM, New York (2007)

    Chapter  Google Scholar 

  17. Vatavu, R.D.: Understanding challenges in designing interactions for the age of ambient media. In: Proceedings of the 3rd International Workshop on Semantic Ambient Media Experience (SAME 2010), Malaga, Spain, pp. 8–13. Tampere University Press (2010)

    Google Scholar 

  18. Wang, R.Y., Popović, J.: Real-time hand-tracking with a color glove. ACM Transactions on Graphics 28(3) (2009)

    Google Scholar 

  19. Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 33–42. ACM, New York (2005)

    Chapter  Google Scholar 

  20. Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI 2009), pp. 1083–1092. ACM, New York (2009)

    Chapter  Google Scholar 

  21. Zhai, S., Kristensson, P.O., Gong, P., Greiner, M., Peng, S.A., Liu, L.M., Dunnigan, A.: Shapewriter on the iphone: from the laboratory to the real world. In: Proceedings of CHI 2009, pp. 2667–2670. ACM, New York (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vatavu, RD. (2011). Reusable Gestures for Interacting with Ambient Displays in Unfamiliar Environments. In: Novais, P., Preuveneers, D., Corchado, J.M. (eds) Ambient Intelligence - Software and Applications. Advances in Intelligent and Soft Computing, vol 92. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19937-0_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19937-0_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19936-3

  • Online ISBN: 978-3-642-19937-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics