Gestures to Intuitively Control Large Displays

  • Wim Fikkert
  • Paul van der Vet
  • Han Rauwerda
  • Timo Breit
  • Anton Nijholt
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5085)


Large displays are highly suited to support discussions in empirical science. Such displays can display project results on a large digital surface to feed the discussion. This paper describes our approach to closely involve multidisciplinary omics scientists in the design of an intuitive display control through hand gestures. This interface is based upon a gesture repertoire. This paper describes how this repertoire is designed based on observations of, and scripted task experiments with, omics scientists.


Hand Gesture Large Display Display Control Omics Research Display Content 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kipp, M.: Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. PhD thesis, Saarland University, Saarbruecken, Germany, Boca Raton, Florida (2004)Google Scholar
  2. 2.
    Rauwerda, H., Roos, M., Hertzberger, B., Breit, T.: The promise of a virtual lab in drug discovery. Drug Discovery Today 11, 228–236 (2006)CrossRefGoogle Scholar
  3. 3.
    Gill, S., Borchers, J.: Knowledge in co-action: social intelligence in collaborative design activity. AI and Society 17(3), 322–339 (2003)CrossRefGoogle Scholar
  4. 4.
    Fikkert, W., D’Ambros, M., Bierz, T., Jankun-Kelly, T.J.: Interacting with visualizations. In: Kerren, A., Ebert, A., Meyer, J. (eds.) GI-Dagstuhl Research Seminar 2007. LNCS, vol. 4417, pp. 77–162. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  5. 5.
    Carletta, J., Evert, S., Heid, U., Kilgour, J., Robertson, J., Voormann, H.: The NITE XML toolkit: Flexible annotation for multimodal language data. Behavior Research Methods, Instruments, and Computers 35(3), 353–363 (2003)CrossRefGoogle Scholar
  6. 6.
    Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J.: Hamburg Notation System for Sign Languages - An introductory guide, vol. 5. Signum, Hamburg (1989)Google Scholar
  7. 7.
    Kranstedt, A., Kühnlein, P., Wachsmuth, I.: Deixis in multimodal Human Computer Interaction: An interdisciplinary approach. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915, pp. 112–123. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Vilhjálmsson, H., Cantelmo, N., Cassell, J., Chafai, N., Kipp, M., Kopp, S., Mancini, M., Marsella, S., Marshall, A., Pelachaud, C., Ruttkay, Z., Thórisson, K., van Welbergen, H., van der Werf, R.: The behavior markup language: Recent developments and challenges (2007)Google Scholar
  9. 9.
    Elliott, R., Glauert, J., Kennaway, R., Parsons, K.: Sigml definition. Technical Report ViSiCAST Deliverable D5-2, University of East Anglia (2001)Google Scholar
  10. 10.
    Kranstedt, A., Lücking, A., Pfeiffer, T., Rieser, H., Wachsmuth, I.: Deixis: How to determine demonstrated objects using a pointing cone. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS, vol. 3881, pp. 300–311. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Kulyk, O., Wassink, I.: Getting to know bioinformaticians: Results of an exploratory user study. In: Workshop on Combining Visualisation and Interaction to Facilitate Scientific Exploration and Discovery in conjunction with British HCI 2006, pp. 30–38. ACM Press, New York (2006)Google Scholar
  12. 12.
    Pantic, M., Pentland, A., Nijholt, A., Huang, T.: Human computing and machine understanding of human behavior: A survey. In: ICMI 2006: Proceedings of the 8th international conference on Multimodal interfaces, vol. 8, pp. 239–248. ACM Press, New York (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Wim Fikkert
    • 1
  • Paul van der Vet
    • 1
  • Han Rauwerda
    • 2
  • Timo Breit
    • 2
  • Anton Nijholt
    • 1
  1. 1.Human Media InteractionUniversity of TwenteThe Netherlands
  2. 2.Microarray DepartmentUniversity of AmsterdamThe Netherlands

Personalised recommendations