CTAT: Tilt-and-Tap Across Devices

  • Linda Di GeronimoEmail author
  • Maria Husmann
  • Abhimanyu Patel
  • Can Tuerk
  • Moira C. Norrie
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9671)


Motion gestures have been proposed as an interaction para-digm for pairing, and sharing data between, mobile devices. They have also been used for interaction with large screens such as semi-public displays where a mobile phone can be used as a form of remote control in an eyes-free manner. Yet, so far, little attention has been paid to their potential use in cross-device web applications. We therefore decided to develop a framework that would support investigations into the use of a combination of touch and tilt interactions in cross-device scenarios. We first report on a study that motivated the development of the framework and informed its design. We then present the resulting Cross-Tilt-and-Tap (CTAT) framework for the rapid development of applications that make use of various motion gestures for communication between two or more devices. We conclude by describing an applications developed using CTAT.


Web interaction framework Cross-device Motion sensors 


  1. 1.
    Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–104 (1991)CrossRefGoogle Scholar
  2. 2.
    Facebook: Finding simplicity in a multi-device world, March 2014.
  3. 3.
    Santosa, S., Wigdor, D.: A field study of multi-device workflows in distributed workspaces. In: Proceedings of the UbiComp. (2013)Google Scholar
  4. 4.
    Yatani, K., Tamura, K., Hiroki, K., Sugimoto, M., Hashizume, H.: Toss-it: intuitive information transfer techniques for mobile devices. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1881–1884. ACM (2005)Google Scholar
  5. 5.
    Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, pp. 161–168. ACM (2009)Google Scholar
  6. 6.
    Di Geronimo, L., Aras, E., Norrie, M.C.: Tilt-and-Tap: framework to support motion-based web interaction techniques. In: Cimiano, P., Frasincar, F., Houben, G.-J., Schwabe, D. (eds.) ICWE 2015. LNCS, vol. 9114, pp. 565–582. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  7. 7.
    Baglioni, M., Lecolinet, E., Guiard, Y.: Jerktilts: using accelerometers for eight-choice selection on mobile devices. In: Proceedings of the 13th International Conference on Multimodal Interfaces, pp. 121–128. ACM (2011)Google Scholar
  8. 8.
    Hinckley, K., Song, H.: Sensor synaesthesia: touch in motion, and motion in touch. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,pp. 801–810. ACM (2011)Google Scholar
  9. 9.
    Seifert, J., Bayer, A., Rukzio, E.: PointerPhone: using mobile phones for direct pointing interactions with remote displays. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part III. LNCS, vol. 8119, pp. 18–35. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  10. 10.
    Dachselt, R., Buchholz, R.: Natural throw and tilt interaction between mobile phones and distant displays. In: CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 3253–3258. ACM (2009)Google Scholar
  11. 11.
    Aumi, M.T.I., Gupta, S., Goel, M., Larson, E., Patel, S.: Doplink: using the doppler effect for multi-device interaction. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 583–586. ACM (2013)Google Scholar
  12. 12.
    Pering, T., Anokwa, Y., Want, R.: Gesture connect: facilitating tangible interaction with a flick of the wrist. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction, pp. 259–262. ACM (2007)Google Scholar
  13. 13.
    Hassan, N., Rahman, M.M., Irani, P., Graham, P.: Chucking: a one-handed document sharing technique. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 264–278. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  14. 14.
    Kray, C., Nesbitt, D., Dawson, J., Rohs, M.: User-defined gestures for connecting mobile phones, public displays, and tabletops. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 239–248. ACM (2010)Google Scholar
  15. 15.
    Marquardt, N., Hinckley, K., Greenberg, S.: Cross-device interaction via micro-mobility and f-formations. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 13–22. ACM (2012)Google Scholar
  16. 16.
    Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.: Interactive development of cross-device user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2793–2802. ACM (2014)Google Scholar
  17. 17.
    Chi, P.Y.P., Li, Y.: Weave: Scripting cross-device wearable interaction. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3923–3932. ACM (2015)Google Scholar
  18. 18.
    Krug, M., Wiedemann, F., Gaedke, M.: SmartComposition: a component-based approach for creating multi-screen mashups. In: Casteleyn, S., Rossi, G., Winckler, M. (eds.) ICWE 2014. LNCS, vol. 8541, pp. 236–253. Springer, Heidelberg (2014)Google Scholar
  19. 19.
    Kovachev, D., Renzel, D., Nicolaescu, P., Klamma, R.: DireWolf - distributing and migrating user interfaces for widget-based web applications. In: Daniel, F., Dolog, P., Li, Q. (eds.) ICWE 2013. LNCS, vol. 7977, pp. 99–113. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  20. 20.
    Wolf, K., Henze, N.: Comparing pointing techniques for grasping hands on tablets. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 53–62. ACM (2014)Google Scholar
  21. 21.
    Paternò, F., Santoro, C., Spano, L.D.: Model-based design of multi-device interactive applications based on web services. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 892–905. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Linda Di Geronimo
    • 1
    Email author
  • Maria Husmann
    • 1
  • Abhimanyu Patel
    • 1
  • Can Tuerk
    • 1
  • Moira C. Norrie
    • 1
  1. 1.Department of Computer ScienceETH ZurichZurichSwitzerland

Personalised recommendations