Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

International Conference on Human-Centred Software Engineering

HCSE 2012: Human-Centered Software Engineering pp 34–52Cite as

  1. Home
  2. Human-Centered Software Engineering
  3. Conference paper
A Compositional Model for Gesture Definition

A Compositional Model for Gesture Definition

  • Lucio Davide Spano19,
  • Antonio Cisternino20 &
  • Fabio Paternò19 
  • Conference paper
  • 2403 Accesses

  • 19 Citations

Part of the Lecture Notes in Computer Science book series (LNPSE,volume 7623)

Abstract

The description of a gesture requires temporal analysis of values generated by input sensors and does not fit well the observer pattern traditionally used by frameworks to handle user input. The current solution is to embed particular gesture-based interactions, such as pinch-to-zoom, into frameworks by notifying when a whole gesture is detected. This approach suffers from a lack of flexibility unless the programmer performs explicit temporal analysis of raw sensors data. This paper proposes a compositional, declarative meta-model for gestures definition based on Petri Nets. Basic traits are used as building blocks for defining gestures; each one notifies the change of a feature value. A complex gesture is defined by the composition of other sub-gestures using a set of operators. The user interface behaviour can be associated to the recognition of the whole gesture or to any other sub-component, addressing the problem of granularity for the notification events. The meta-model can be instantiated for different gesture recognition supports and its definition has been validated through a proof of concept library. Sample applications have been developed for supporting multitouch gestures on iOS and full body gestures with Microsoft Kinect.

Keywords

  • Input and Interaction Technologies
  • Model-based design
  • Software architecture and engineering
  • Gestural Interaction

Download conference paper PDF

References

  1. Accot, J., Chatty, S., Palanque, P.A.: A formal description of low level interaction and its application to multimodal interactive system. In: 3rd DSVIS EUROGRAPHICS, pp. 92–105. Springer (1996)

    Google Scholar 

  2. Bastide, R., Palanque, P.A.: A Petri-Net based Environment for the Design of Event-driven Interfaces. In: DeMichelis, G., Díaz, M. (eds.) ICATPN 1995. LNCS, vol. 935, pp. 66–83. Springer, Heidelberg (1995)

    CrossRef  Google Scholar 

  3. Buxton, W.: Lexical and pragmatic considerations of input structures. SIGGRAPH Comput. Graph. 17(1), 31–37 (1983)

    CrossRef  Google Scholar 

  4. González-Calleros, J.M., Vanderdonckt, J.: 3D User Interfaces for Information Systems based on UsiXML. In: Proc. of 1st Int. Workshop on User Interface Extensible Markup Language, UsiXML 2010, Berlin, Germany. Thales Research and Technology, France, Paris (2010)

    Google Scholar 

  5. Jacob, R.J.K., Giroaud, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zingelbaum, J.: Reality-based interaction: a framework for post-WIMP interafaces. In: CHI 2008, Florence, Italy, pp. 201–210. ACM Press (April 2008)

    Google Scholar 

  6. Kin, K., Hartmann, B., DeRose, T., Agrawala, M.: Proton: multitouch gestures as regular expressions. In: CHI 2012, Austin, Texas, U.S., pp. 2885–2894 (May 2012)

    Google Scholar 

  7. Kammer, D., Wojdziak, J., Keck, M., Groh, R., Taranko, S.: Towards a formalization of multi-touch gestures. In: ITS 2010, ACM International Conference on Interactive Tabletops and Surfaces, Saabrucken, Germany, pp. 49–58. ACM Press (November 2010)

    Google Scholar 

  8. Luyten, K., Vanacken, D., Weiss, M., Borchers, J., Izadi, S., Wigdor, D.: Engineering patterns for multi-touch interfaces. In: EICS 2010, Proceedings of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, Berlin, Germany, pp. 365–366. ACM Press (June 2010)

    Google Scholar 

  9. NUI Group, Gesture Recognition, http://wiki.nuigroup.com/Gesture_Recognition (Website retrieved: May 27, 2012)

  10. Palanque, P.A., Bastide, R., Sengès, V.: Validating interactive system design through the verification of formal task and system models. In: EHCI 1995, Yellowstone Park, USA, pp. 189–212. Chapman & Hall (1995)

    Google Scholar 

  11. Paternò, F.: Model-based design and evaluation of interactive applications. Applied Computing (2000)

    Google Scholar 

  12. Paternò, F., Santoro, C., Spano, L.D.: MARIA: A Universal Language for Service-Oriented Applications in Ubiquitous Environment. ACM Transactions on Computer-Human Interaction 16(4), 1–30 (2009)

    CrossRef  Google Scholar 

  13. René, D., Alla, H.: Discrete, Continuous and Hybrid Petri Nets. Springer (2005)

    Google Scholar 

  14. Scottidi, A., Blanch, R., Coutaz, J.: A Novel Taxonomy for Gestural Interaction techniques based on accelerometers. In: IUI 2011, Proceedings of the 16th International Conference on Intelligent User Interfaces, Palo Alto, CA, USA, pp. 63–72. ACM Press (February 2011)

    Google Scholar 

  15. Vanacken, D., Boeck, J.D., Raymaekers, C., Coninx, K.: NIMMIT: A notation for modeling multimodal interaction techniques. In: GRAPP 2006, Setubal, Portugal, pp. 224–231 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ISTI-CNR, Via G. Moruzzi 1, 56127, Pisa, France

    Lucio Davide Spano & Fabio Paternò

  2. Dipartimento di Informatica, Università di Pisa, Largo Bruno Potencorvo 3, 56127, Pisa, France

    Antonio Cisternino

Authors
  1. Lucio Davide Spano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Antonio Cisternino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabio Paternò
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. IRIT, Université Paul Sabatier, France

    Marco Winckler

  2. Computer Science Department, University of Rostock, Albert-Einstein-Str. 21, D-18051, Rostock, Germany

    Peter Forbrig

  3. ICS-IRIT, University Paul Sabatier, 118 route de Narbonne, 31062, Toulouse Cedex 9, France

    Regina Bernhaupt

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Spano, L.D., Cisternino, A., Paternò, F. (2012). A Compositional Model for Gesture Definition. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds) Human-Centered Software Engineering. HCSE 2012. Lecture Notes in Computer Science, vol 7623. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34347-6_3

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-34347-6_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34346-9

  • Online ISBN: 978-3-642-34347-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature