A Multitouch Drawing Application with Occlusion-Free Interaction Strategies

  • Yi Ren Tan
  • Hyowon LeeEmail author
  • Insuk Ko
  • Dongliang Zhang
  • Chunxiao Li
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11749)


Increasing number of desktop applications are becoming available on smartphones and tablets today with multitouch capabilities, allowing the users’ fingers to perform sophisticated or fine-grained interactivities. However, finger occlusion and imprecision continue to limit the performance of multitouch interactions. Quite a few studies proposed the ways to address this issue, and some of them are now used in commonly encountered situations such as text editing. Many occlusion-avoiding techniques used today focus on initial target acquisition step of touch interaction (e.g. accurately selecting an item or touching a desired starting point in drawing a line), having possible consequences to any further intended action (e.g. dragging the selected item to a different location or drawing a line on the canvas). In order to better understand the influence of finger occlusion-free techniques on other parts of the overall interactions, in this paper we report a full-fledged sketch app that incorporates combinations of basic target acquisition features. As the app is a full-featured, end-to-end tablet prototype, such usability issues can be more readily revealed and discussed in the context of realistic drawing situations.


Finger occlusion Pointing precision Multitouch interaction 

Supplementary material

Supplementary material 1 (MP4 27850 kb)


  1. 1.
    Lee, D., Son, K., Lee, J., Bae, S.: PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST 2012), pp. 331–340 (2012)Google Scholar
  2. 2.
    Matejka, J., Grossman, T., Lo, J., Fitzmaurice, G.: The design and evaluation of multi-finger mouse emulation techniques. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009), pp. 1073–1082 (2009)Google Scholar
  3. 3.
    Vogel, D., Balakrishnan, R.: Occlusion-aware interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010), pp. 263–272 (2010)Google Scholar
  4. 4.
    Roudaut, A., Huot, S., Lecolinet, E.: TapTap and MagStick: improving one-handed target acquisition on small touch-screens. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2008), pp. 146–153 (2008)Google Scholar
  5. 5.
    Lai, J., Zhang, D.: ExtendedThumb: a motion-based virtual thumb for improving one-handed target acquisition on touch-screen mobile devices. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2014), pp. 1825–1830 (2014)Google Scholar
  6. 6.
    Fennedy, K., Lee, H., Ko, I., Tan, Y., Zhang, D., Li, C.: Augmenting user-maintained interaction through mode locking and reversing. In: 32nd British Computer Society Human Computer Interaction Conference (2018)Google Scholar
  7. 7.
    Lee, H., Ko, I., Tan, Y.R., Zhang, D., Li, C.: Usability impact of occlusion-free techniques on commonly-used multitouch actions. In: 5th International ACM in Cooperation HCI and UX Conference (CHIuXiD 2019) (2019)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Yi Ren Tan
    • 1
  • Hyowon Lee
    • 1
    Email author
  • Insuk Ko
    • 1
  • Dongliang Zhang
    • 2
  • Chunxiao Li
    • 2
  1. 1.Singapore University of Technology and DesignSingaporeSingapore
  2. 2.Zhejiang UniversityHangzhouChina

Personalised recommendations