Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work

  • Ricardo LangnerEmail author
  • Ulrich von Zadow
  • Tom Horak
  • Annett Mitschick
  • Raimund Dachselt


Large vertical displays are increasingly widespread, and content sharing between them and personal mobile devices is central to many collaborative usage scenarios. In this chapter we present FlowTransfer, bidirectional transfer techniques which make use of the mobile phone’s position and orientation. We focus on three main aspects: multi-item transfer and layout, the dichotomy of casual versus precise interaction, and support for physical navigation. Our five techniques explore these aspects in addition to being contributions in their own right. They leverage physical navigation, allowing seamless transitions between different distances to the display, while also supporting arranging content and copying entire layouts within the transfer process. This is enabled by a novel distance-dependent pointing cursor that supports coarse pointing from distance as well as precise positioning at close range. We fully implemented all techniques and conducted a qualitative study documenting their benefits. Finally, based on a literature review and our holistic approach in designing the techniques, we also contribute an analysis of the underlying design space.


Mobile Phone Mobile Device Design Space Interaction Technique Transfer Technique 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



We thank Wolfgang Büschel, Ulrike Kister, Fabrice Matulic, and other members of the Interactive Media Lab for their feedback and helpful suggestions. We would also like to thank students of the lab for their support on the prototype. Finally, we thank our anonymous reviewers for their valuable and helpful comments.


  1. 1.
    Alt F, Shirazi AS, Kubitza T, Schmidt A (2013) Interaction techniques for creating and exchanging content with public displays. In: Proceedings CHI 2013. ACM, pp. 1709–1718Google Scholar
  2. 2.
    Andrews C, Endert A, Yost B, North C (2011) Information visualization on large, high-resolution displays: issues, challenges, and opportunities. Inf Vis 10(4):341–355CrossRefGoogle Scholar
  3. 3.
    Ballagas R, Rohs M, Sheridan JG (2005) Sweep and point and shoot: Phonecam-based interactions for large public displays. In: Proceedings CHI 2005 Extended Abstracts. ACM, pp 1200–1203Google Scholar
  4. 4.
    Ball R, North C, Bowman DA (2007) Move to improve: promoting physical navigation to increase user performance with large displays. In: Proceedings CHI 2007. ACM, pp 191–200Google Scholar
  5. 5.
    Baur D, Boring S, Feiner S (2012) Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In: Proceedings CHI 2012. ACM, pp 1693–1702Google Scholar
  6. 6.
    Bezerianos A, Balakrishnan R (2005) The vacuum: facilitating the manipulation of distant objects. In: Proceedings CHI 2005. ACM, pp 361–370Google Scholar
  7. 7.
    Bolt RA (1980) “Put-that-there”: Voice and gesture at the graphics interface. In: Proceedings SIGGRAPH. ACM, pp 262–270Google Scholar
  8. 8.
    Boring, S, Altendorfer M, Broll G, Hilliges O, Butz A (2007) Shoot & copy: Phonecam-based information transfer from public displays onto mobile phones. In: Proceedings Mobility 2007. ACM, pp 24–31Google Scholar
  9. 9.
    Boring S, Baur D, Butz A., Gustafson S, Baudisch P (2010) Touch projector: Mobile interaction through video. In: Proceedings CHI 2010. ACM, pp 2287–2296Google Scholar
  10. 10.
    Bragdon A, DeLine R, Hinckley K, Morris MR (2011) Code space: Combining touch, devices, and skeletal tracking to support developer meetings. In: Proceedings ITS 2011. ACM, pp 212–221Google Scholar
  11. 11.
    Chung H, North C, Self JZ, Chu S, Quek F (2014) Visporter: facilitating information sharing for collaborative sensemaking on multiple displays. Pers Ubiquit Comput 18(5):1169–1186CrossRefGoogle Scholar
  12. 12.
    Dachselt R, Buchholz R (2008) Throw and Tilt—seamless interaction across devices using mobile phone gestures. In: Proceedings Workshop MEIS 2008. German Informatics Society (GI), pp 272–278Google Scholar
  13. 13.
    Frisch M, Langner R, Dachselt R (2011) Neat: a set of flexible tools and gestures for layout tasks on interactive displays. In: Proceedings ITS 2011. ACM, pp 1–10Google Scholar
  14. 14.
    Greenberg S, Marquardt N, Ballendat T, Diaz-Marino R, Wang M (2011) Proxemic interactions: the new ubicomp? Interactions 18(1):42–50CrossRefGoogle Scholar
  15. 15.
    Hardy R, Rukzio E (2008) Touch & interact: touch-based interaction of mobile phones with displays. In: Proceedings MobileHCI 2008. ACM, pp 245–254Google Scholar
  16. 16.
    Hassan N, Rahman MM, Irani P, Graham P (2009) Chucking: a one-handed document sharing technique. In: Proceedings INTERACT 2009. Springer, Berlin, Heidelberg, pp 264–278Google Scholar
  17. 17.
    Houben S, Marquardt N (2015) Watchconnect: a toolkit for prototyping smartwatch-centric cross-device applications. In: Proceedings CHI 2015. ACM, New York, NY, USA, pp 1247–1256Google Scholar
  18. 18.
    Jakobsen MR, Hornbæk K (2015) Is moving improving?: Some effects of locomotion in wall-display interaction. In: Proceedings CHI 2015. ACM, pp 4169–4178Google Scholar
  19. 19.
    Jokela T, Ojala J, Grassel G, Piippo P, Olsson T (2015) A comparison of methods to move visual objects between personal mobile devices in different contexts of use. In: Proceedings MobileHCI 2015. ACM, pp 172–181Google Scholar
  20. 20.
    Kabbash P, Buxton WAS (1995) The “prince” technique: Fitts’ law and selection using area cursors. In: Proceedings CHI 1995. ACM Press/Addison-Wesley Publishing Co., pp 273–279Google Scholar
  21. 21.
    Keefe DF, Gupta A, Feldman D, Carlis JV, Keefe SK, Griffin TJ (2012) Scaling up multi-touch selection and querying: Interfaces and applications for combining mobile multi-touch input with large-scale visualization displays. Int J Hum Comput Stud 70(10):703–713CrossRefGoogle Scholar
  22. 22.
    Kopper R, Bowman DA, Silva MG, McMahan RP (2010) A human motor behavior model for distal pointing tasks. Int J Hum Comput Stud 68(10):603–615CrossRefGoogle Scholar
  23. 23.
    Lehmann A, Staadt O (2013) Distance-aware bimanual interaction for large high-resolution displays. In: Computer vision, imaging and computer graphics. Theory and application, communications in computer and information science, vol 359. Springer, Berlin, pp 97–111Google Scholar
  24. 24.
    Marquardt N, Ballendat T, Boring S, Greenberg S, Hinckley K (2012) Gradual engagement: facilitating information exchange between digital devices as a function of proximity. In: Proceedings ITS 2012. ACM, pp 31–40Google Scholar
  25. 25.
    Müller J, Alt F, Michelis D, Schmidt A (2010) Requirements and design space for interactive public displays. In: Proceedings MM 2010. ACM, pp 1285–1294Google Scholar
  26. 26.
    Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings CHI 2002. ACM, pp 33–40Google Scholar
  27. 27.
    Nancel M, Chapuis O, Pietriga E, Yang XD, Irani PP, Beaudouin-Lafon M (2013) High-precision pointing on large wall displays using small handheld devices. In: Proceedings CHI 2013. ACM, pp 831–840Google Scholar
  28. 28.
    Nancel M, Pietriga E, Chapuis O, Beaudouin-Lafon M (2015) Mid-air pointing on ultra-walls. ACM Trans Comput Hum Interact 22(5), 21:1–21:62 (2015)Google Scholar
  29. 29.
    Norman DA (2002) The design of everyday things. Basic Books, IncGoogle Scholar
  30. 30.
    Peck SM, North C, Bowman D (2009) A multiscale interaction technique for large, high-resolution displays. In: IEEE symposium on 3D user interfaces 2009. IEEE, pp 31–38Google Scholar
  31. 31.
    Pohl H, Murray-Smith R (2013) Focused and casual interactions: allowing users to vary their level of engagement. In: Proceedings CHI 2013. ACM, pp 2223–2232Google Scholar
  32. 32.
    Rädle R, Jetter HC, Butscher S, Reiterer H (2013) The effect of egocentric body movements on users’ navigation performance and spatial memory in zoomable user interfaces. In: Proceedings ITS 2013. ACM, pp 23–32Google Scholar
  33. 33.
    Rashid U, Nacenta MA, Quigley A (2012) The cost of display switching: a comparison of mobile, large display and hybrid ui configurations. In: Proceedings AVI 2012. ACM, pp 99–106Google Scholar
  34. 34.
    Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings UIST 1997. ACM, pp 31–39Google Scholar
  35. 35.
    Schmidt D, Chehimi F, Rukzio E, Gellersen H (2010) Phonetouch: a technique for direct phone interaction on surfaces. In: Proceedings UIST 2010. ACM, pp 13–16Google Scholar
  36. 36.
    Schmidt D, Seifert J, Rukzio E, Gellersen H (2012) A cross-device interaction style for mobiles and surfaces. In: Proceedings DIS 2012. ACM, pp 318–327Google Scholar
  37. 37.
    Seifert J, Bayer A, Rukzio E (2013) Pointerphone: using mobile phones for direct pointing interactions with remote displays. In: Kotzé P, Marsden G, Lindgaard G, Wesson J, Winckler M (eds) Human-Computer Interaction—INTERACT 2013, vol 8119. Springer, Berlin, Heidelberg, pp 18–35CrossRefGoogle Scholar
  38. 38.
    Seifert J, Dobbelstein D, Schmidt D, Holleis P, Rukzio E (2014) From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces. Pers Ubiquit Comput 18(4):1013–1026CrossRefGoogle Scholar
  39. 39.
    Tan DS, Czerwinski M (2003) Effects of visual separation and physical discontinuities when distributing information across multiple displays. Proc INTERACT 2003:252–255Google Scholar
  40. 40.
    Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings UIST 2005. ACM, pp 33–42Google Scholar
  41. 41.
    von Zadow U, Büschel W, Langner R, Dachselt R (2014) Sleed: using a sleeve display to interact with touch-sensitive display walls. In: Proceedings ITS 2014. ACM, pp 129–138Google Scholar
  42. 42.
    Wagner J, Nancel M, Gustafson SG, Huot S, Mackay WE (2013) Body-centric design space for multi-surface interaction. In: Proceedings CHI 2013. ACM, pp 1299–1308Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ricardo Langner
    • 1
    Email author
  • Ulrich von Zadow
    • 1
  • Tom Horak
    • 1
  • Annett Mitschick
    • 1
  • Raimund Dachselt
    • 1
  1. 1.Interactive Media LabTechnische Universität DresdenDresdenGermany

Personalised recommendations