Advertisement

Multi-Touch pp 89-116 | Cite as

Kombinierte Multi-Touch und Stift-Interaktion: Ein Gesten-Set zum Editieren von Diagrammen

  • Mathias Frisch
  • Raimund Dachselt
Chapter
Part of the Xpert.press book series (XPERT.PRESS)

Zusammenfassung

In diesem Kapitel wird die Entwicklung von Interaktionstechniken vorgestellt, die Stift- und Multi-Touch-Eingabe effektiv kombinieren. Ausgehend von einer Pilotstudie, bei der Nutzer Gesten vorschlugen, wurde ein Prototyp implementiert und evaluiert. Das Editieren von Node-Link-Diagrammen (z.B. für UML-Softwaremodelle oder Geschäftsprozesse) diente dabei als Beispiel-Domäne.

Literatur

  1. 1.
    Anoto Group AB: Digital Pen Technology. http://www.anoto.com/
  2. 2.
    Brandl, P., Forlines, C., Wigdor, D., Haller, M., Shen, C.: Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In: AVI ’08 Proceedings of the Working Conference on Advanced Visual Interfaces, S. 154–161. ACM, New York (2008)Google Scholar
  3. 3.
    Chen, Q., Grundy, J., Hosking, J.: An e-whiteboard application to support early design-stage sketching of UML diagrams. In: Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments, S. 219–226. IEEE Computer Society, New York (2003)Google Scholar
  4. 4.
    Cherubini, M., Venolia, G., DeLine, R., Ko, AJ.: Let’s go to the whiteboard: how and why software developers use drawings. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, S. 557–566. ACM, New York (2007)Google Scholar
  5. 5.
    Damm, C.H., Hansen, K.M., Thomsen, M.: Tool support for cooperative object-oriented design: gesture based modelling on an electronic whiteboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’00, S. 518–525. ACM, New York (2000)Google Scholar
  6. 6.
    Dekel, U., Herbsleb, J.D.: Notation and representation in collaborative object-oriented design: an observational study. SIGPLAN Not. 42(10), 261–280 (2007)Google Scholar
  7. 7.
    Dwyer, T., Lee, B., Fisher, D., Quinn, K.I., Isenberg, P., Robertson, G., North, C.: A comparison of user-generated and automatic graph layouts. IEEE Trans. Visual Comput. Graph. 15, 961–968 (2009)Google Scholar
  8. 8.
    Epps, J., Lichman, S., Wu, M.: A study of hand shape use in tabletop gesture interaction. In: Proceedings of Extended Abstracts on Human Factors in Computing Systems, CHI ’06, S. 748–753. ACM, New York (2006)Google Scholar
  9. 9.
    Frisch, M., Heydekorn, J., Dachselt, R.: Diagram editing on interactive displays using multi-touch and pen gestures. In: Proceedings of the 6th International Conference on Diagrammatic Representation and Inference, Diagrams’10, S. 182–196. Springer, Berlin (2010)Google Scholar
  10. 10.
    Frisch, M., Heydekorn, J., Dachselt, R.: Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS ’09, S. 149–156. ACM, New York (2009)Google Scholar
  11. 11.
    Frisch, M., Kleinau, S., Langner, R., Dachselt, R.: Grids & guides: multi-touch layout and alignment tools. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, CHI ’11, S.1615–1618. ACM, New York (2011)Google Scholar
  12. 12.
    Frisch, M., Langner, R. Dachselt, R.: NEAT: a set of flexible tools and gestures for layout tasks on interactive displays. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2011), S. 1–10. ACM, Kobe (2011)Google Scholar
  13. 13.
    Frisch, M.: Visualization and Interaction Techniques for Node-link Diagram Editing and Exploration. Dr. Hut Verlag, München (2012)Google Scholar
  14. 14.
    Greenberg, S., Buxton, B.: Usability evaluation considered harmful (some of the time). In: Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, S. 111–120. ACM, New York (2008)Google Scholar
  15. 15.
    Guiard, Y.: Asymmetric Division of Labor in Human Skilled Bimanual Action: the Kinematic Chain as a Model (1987)Google Scholar
  16. 16.
    Hammond, T., Davis, R.: Tahuti: a geometrical sketch recognition system for UML class diagrams. In: ACM SIGGRAPH 2006 Courses, SIGGRAPH ’06. ACM, New York (2006)Google Scholar
  17. 17.
    Han, J.: Low-cost multi-touch sensing through frustrated total internal reflection. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, UIST ’05, S. 115–118. ACM, New York (2005)Google Scholar
  18. 18.
    Heydekorn, J., Frisch, M., Dachselt, R.: Evaluating a user-elicited gesture set for interactive displays. In: Proceedings of Mensch und Computer 2011, S. 191–200. Oldenbourg Publishing, München (2011)Google Scholar
  19. 19.
    Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., Buxton, B.: Manual deskterity: an exploration of simultaneous pen + touch direct input. In: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’10, S. 2793–2802. ACM, New York (2010)Google Scholar
  20. 20.
    Hinckley, K., Yatani, K., Pahud, M. Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., Buxton, B.: Pen + touch = new tools. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST ’10, S. 27–36. ACM, New York (2010)Google Scholar
  21. 21.
    Isenberg, P., Tang, A., Carpendale, S.: An exploratory study of visual information analysis. In: Proceedings of the 26th SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, S. 1217–1226. ACM, New York (2008)Google Scholar
  22. 22.
    Krueger, M.W., Gionfriddo, T., Hinrichsen, K.: Videoplace: an artificial reality. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’85, S. 35–40. ACM, New York (1985)Google Scholar
  23. 23.
    Leitner, J., Powell, J., Brandl, P., Seifried, T., Haller, M., Dorray, B., To, P.: Flux: a tilting multi-touch and pen based surface. In: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, CHI ’09, S. 3211–3216. ACM, New York (2009)Google Scholar
  24. 24.
    Micire, M., Desai, M., Courtemanche, A., Tsui, K.M., Yanco, H.A.: Analysis of natural gestures for controlling robot teams on multi-touch tabletop surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS ’09, S. 41–48. ACM, New York (2009)Google Scholar
  25. 25.
    Morris, M.R., Wobbrock, J.O., Wilson, A.D.: Understanding users’ preferences for surface gestures. In: Proceedings of Graphics Interface 2010, GI ’10, S. 261–268. Canadian Information Processing Society, Toronto (2010)Google Scholar
  26. 26.
    Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Gesture-Based Communication in Human-Computer Interaction. Lecture Notes in Computer Science, Bd. 2915, S. 105–106. Springer, Heidelberg (2004)Google Scholar
  27. 27.
    Perceptive Pixel by Microsoft. http://www.microsoft.com/office/perceptivepixel/
  28. 28.
    Plimmer, B., Freeman, I.: A toolkit approach to sketched diagram recognition. In: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI but not as we know it Bd. 1, - BCS-HCI ’07, S. 205–213. British Computer Society, Swinton (2007)Google Scholar
  29. 29.
    Rekimoto, J.: SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’02, S. 113–120. ACM, New York (2002)Google Scholar
  30. 30.
    Ringel, M., Ryall, K., Shen, C., Forlines, C., Vernier, F.: Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables. In: Extended Abstracts on Human Factors in Computing Systems, CHI ’04, S. 1441–1444. ACM, New York (2004)Google Scholar
  31. 31.
    Schmidt, S., Nacenta, M.A., Dachselt, R., Scarpendale, S.C.: A set of multi-touch graph interaction techniques. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS ’10, S. 113–116. ACM, New York (2010)Google Scholar
  32. 32.
    Systems Biology Graphical Notation (SBGN): A Visual Notation for Network Diagrams in Biology. http://www.sbgn.org
  33. 33.
    Terrenghi, L., Kirk, D., Sellen, A., Izadi, S.: Affordances for manipulation of physical versus digital media on interactive surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, S. 1157–1166. ACM, New York (2007)Google Scholar
  34. 34.
    Wacom: Graphic Tablets and Wacom Inkling. www.wacom.com
  35. 35.
    Walny, J., Jagoda, W., Jonathan, H., Haber, J., Dörk, M., Sillito, J., Cheelagh. S.: Follow that Sketch: Lifecycles of diagrams and sketches in software development. In: IEEE International Workshop on Visualizing Software for Understanding and Analysis (2011)Google Scholar
  36. 36.
    Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST ’10, S. 273–282. ACM, New York (2010)Google Scholar
  37. 37.
    Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza A., Kirk, D.: Bringing physics to the surface. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST ’08, S. 67–76. ACM, New York (2008)Google Scholar
  38. 38.
    Wobbrock, J.O., Wilson, A.D., Li, Y.: Gestures without libraries, toolkits or training: a \({\$}\) recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, UIST ’07, S. 159–168. ACM, New York (2007)Google Scholar
  39. 39.
    Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI ’09, S. 1083–1092. ACM, New York (2009)Google Scholar
  40. 40.
    Wu, M., Shen, C., Ryall, K., Forlines, C., Balakrishnan, R.: Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In: Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TABLETOP ’06, S. 185–192. Computer Society IEEE, Washington (2006)Google Scholar
  41. 41.
    Zeleznik,R., Bragdon, A., Adeputra, F., Ko, H.: Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST ’10, S. 17–26. ACM, New York (2010)Google Scholar
  42. 42.
    Zeleznik, R., Bragdon, A., Liu, C.C., Forsberg, A.: Lineogrammer: creating diagrams by drawing. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST ’08, S. 161–170. ACM, New York (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.MID GmbHNürnbergDeutschland
  2. 2.Interactive Media Lab DresdenTU DresdenDresdenDeutschland

Personalised recommendations