Skip to main content

Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work

Abstract

Large vertical displays are increasingly widespread, and content sharing between them and personal mobile devices is central to many collaborative usage scenarios. In this chapter we present FlowTransfer, bidirectional transfer techniques which make use of the mobile phone’s position and orientation. We focus on three main aspects: multi-item transfer and layout, the dichotomy of casual versus precise interaction, and support for physical navigation. Our five techniques explore these aspects in addition to being contributions in their own right. They leverage physical navigation, allowing seamless transitions between different distances to the display, while also supporting arranging content and copying entire layouts within the transfer process. This is enabled by a novel distance-dependent pointing cursor that supports coarse pointing from distance as well as precise positioning at close range. We fully implemented all techniques and conducted a qualitative study documenting their benefits. Finally, based on a literature review and our holistic approach in designing the techniques, we also contribute an analysis of the underlying design space.

Keywords

  • Mobile Phone
  • Mobile Device
  • Design Space
  • Interaction Technique
  • Transfer Technique

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-45853-3_5
  • Chapter length: 22 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   119.00
Price excludes VAT (USA)
  • ISBN: 978-3-319-45853-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   159.99
Price excludes VAT (USA)
Hardcover Book
USD   169.99
Price excludes VAT (USA)
Fig. 5.1
Fig. 5.2
Fig. 5.3
Fig. 5.4
Fig. 5.5
Fig. 5.6
Fig. 5.7
Fig. 5.8
Fig. 5.9
Fig. 5.10

Notes

  1. 1.

    see https://imld.de/flowtransfer/.

  2. 2.

    http://www.optitrack.com/.

  3. 3.

    https://www.libavg.de/.

  4. 4.

    http://opensoundcontrol.org/.

  5. 5.

    Photos from Flickr by    @dhilung (https://www.flickr.com/photos/dhilung),

                          @mualphachi (https://www.flickr.com/photos/mualphachi), and

                          @duncanh1 (https://www.flickr.com/photos/duncanh1),

     Map by GoogleMaps (https://maps.google.com).

References

  1. Alt F, Shirazi AS, Kubitza T, Schmidt A (2013) Interaction techniques for creating and exchanging content with public displays. In: Proceedings CHI 2013. ACM, pp. 1709–1718

    Google Scholar 

  2. Andrews C, Endert A, Yost B, North C (2011) Information visualization on large, high-resolution displays: issues, challenges, and opportunities. Inf Vis 10(4):341–355

    CrossRef  Google Scholar 

  3. Ballagas R, Rohs M, Sheridan JG (2005) Sweep and point and shoot: Phonecam-based interactions for large public displays. In: Proceedings CHI 2005 Extended Abstracts. ACM, pp 1200–1203

    Google Scholar 

  4. Ball R, North C, Bowman DA (2007) Move to improve: promoting physical navigation to increase user performance with large displays. In: Proceedings CHI 2007. ACM, pp 191–200

    Google Scholar 

  5. Baur D, Boring S, Feiner S (2012) Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In: Proceedings CHI 2012. ACM, pp 1693–1702

    Google Scholar 

  6. Bezerianos A, Balakrishnan R (2005) The vacuum: facilitating the manipulation of distant objects. In: Proceedings CHI 2005. ACM, pp 361–370

    Google Scholar 

  7. Bolt RA (1980) “Put-that-there”: Voice and gesture at the graphics interface. In: Proceedings SIGGRAPH. ACM, pp 262–270

    Google Scholar 

  8. Boring, S, Altendorfer M, Broll G, Hilliges O, Butz A (2007) Shoot & copy: Phonecam-based information transfer from public displays onto mobile phones. In: Proceedings Mobility 2007. ACM, pp 24–31

    Google Scholar 

  9. Boring S, Baur D, Butz A., Gustafson S, Baudisch P (2010) Touch projector: Mobile interaction through video. In: Proceedings CHI 2010. ACM, pp 2287–2296

    Google Scholar 

  10. Bragdon A, DeLine R, Hinckley K, Morris MR (2011) Code space: Combining touch, devices, and skeletal tracking to support developer meetings. In: Proceedings ITS 2011. ACM, pp 212–221

    Google Scholar 

  11. Chung H, North C, Self JZ, Chu S, Quek F (2014) Visporter: facilitating information sharing for collaborative sensemaking on multiple displays. Pers Ubiquit Comput 18(5):1169–1186

    CrossRef  Google Scholar 

  12. Dachselt R, Buchholz R (2008) Throw and Tilt—seamless interaction across devices using mobile phone gestures. In: Proceedings Workshop MEIS 2008. German Informatics Society (GI), pp 272–278

    Google Scholar 

  13. Frisch M, Langner R, Dachselt R (2011) Neat: a set of flexible tools and gestures for layout tasks on interactive displays. In: Proceedings ITS 2011. ACM, pp 1–10

    Google Scholar 

  14. Greenberg S, Marquardt N, Ballendat T, Diaz-Marino R, Wang M (2011) Proxemic interactions: the new ubicomp? Interactions 18(1):42–50

    CrossRef  Google Scholar 

  15. Hardy R, Rukzio E (2008) Touch & interact: touch-based interaction of mobile phones with displays. In: Proceedings MobileHCI 2008. ACM, pp 245–254

    Google Scholar 

  16. Hassan N, Rahman MM, Irani P, Graham P (2009) Chucking: a one-handed document sharing technique. In: Proceedings INTERACT 2009. Springer, Berlin, Heidelberg, pp 264–278

    Google Scholar 

  17. Houben S, Marquardt N (2015) Watchconnect: a toolkit for prototyping smartwatch-centric cross-device applications. In: Proceedings CHI 2015. ACM, New York, NY, USA, pp 1247–1256

    Google Scholar 

  18. Jakobsen MR, Hornbæk K (2015) Is moving improving?: Some effects of locomotion in wall-display interaction. In: Proceedings CHI 2015. ACM, pp 4169–4178

    Google Scholar 

  19. Jokela T, Ojala J, Grassel G, Piippo P, Olsson T (2015) A comparison of methods to move visual objects between personal mobile devices in different contexts of use. In: Proceedings MobileHCI 2015. ACM, pp 172–181

    Google Scholar 

  20. Kabbash P, Buxton WAS (1995) The “prince” technique: Fitts’ law and selection using area cursors. In: Proceedings CHI 1995. ACM Press/Addison-Wesley Publishing Co., pp 273–279

    Google Scholar 

  21. Keefe DF, Gupta A, Feldman D, Carlis JV, Keefe SK, Griffin TJ (2012) Scaling up multi-touch selection and querying: Interfaces and applications for combining mobile multi-touch input with large-scale visualization displays. Int J Hum Comput Stud 70(10):703–713

    CrossRef  Google Scholar 

  22. Kopper R, Bowman DA, Silva MG, McMahan RP (2010) A human motor behavior model for distal pointing tasks. Int J Hum Comput Stud 68(10):603–615

    CrossRef  Google Scholar 

  23. Lehmann A, Staadt O (2013) Distance-aware bimanual interaction for large high-resolution displays. In: Computer vision, imaging and computer graphics. Theory and application, communications in computer and information science, vol 359. Springer, Berlin, pp 97–111

    Google Scholar 

  24. Marquardt N, Ballendat T, Boring S, Greenberg S, Hinckley K (2012) Gradual engagement: facilitating information exchange between digital devices as a function of proximity. In: Proceedings ITS 2012. ACM, pp 31–40

    Google Scholar 

  25. Müller J, Alt F, Michelis D, Schmidt A (2010) Requirements and design space for interactive public displays. In: Proceedings MM 2010. ACM, pp 1285–1294

    Google Scholar 

  26. Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings CHI 2002. ACM, pp 33–40

    Google Scholar 

  27. Nancel M, Chapuis O, Pietriga E, Yang XD, Irani PP, Beaudouin-Lafon M (2013) High-precision pointing on large wall displays using small handheld devices. In: Proceedings CHI 2013. ACM, pp 831–840

    Google Scholar 

  28. Nancel M, Pietriga E, Chapuis O, Beaudouin-Lafon M (2015) Mid-air pointing on ultra-walls. ACM Trans Comput Hum Interact 22(5), 21:1–21:62 (2015)

    Google Scholar 

  29. Norman DA (2002) The design of everyday things. Basic Books, Inc

    Google Scholar 

  30. Peck SM, North C, Bowman D (2009) A multiscale interaction technique for large, high-resolution displays. In: IEEE symposium on 3D user interfaces 2009. IEEE, pp 31–38

    Google Scholar 

  31. Pohl H, Murray-Smith R (2013) Focused and casual interactions: allowing users to vary their level of engagement. In: Proceedings CHI 2013. ACM, pp 2223–2232

    Google Scholar 

  32. Rädle R, Jetter HC, Butscher S, Reiterer H (2013) The effect of egocentric body movements on users’ navigation performance and spatial memory in zoomable user interfaces. In: Proceedings ITS 2013. ACM, pp 23–32

    Google Scholar 

  33. Rashid U, Nacenta MA, Quigley A (2012) The cost of display switching: a comparison of mobile, large display and hybrid ui configurations. In: Proceedings AVI 2012. ACM, pp 99–106

    Google Scholar 

  34. Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings UIST 1997. ACM, pp 31–39

    Google Scholar 

  35. Schmidt D, Chehimi F, Rukzio E, Gellersen H (2010) Phonetouch: a technique for direct phone interaction on surfaces. In: Proceedings UIST 2010. ACM, pp 13–16

    Google Scholar 

  36. Schmidt D, Seifert J, Rukzio E, Gellersen H (2012) A cross-device interaction style for mobiles and surfaces. In: Proceedings DIS 2012. ACM, pp 318–327

    Google Scholar 

  37. Seifert J, Bayer A, Rukzio E (2013) Pointerphone: using mobile phones for direct pointing interactions with remote displays. In: Kotzé P, Marsden G, Lindgaard G, Wesson J, Winckler M (eds) Human-Computer Interaction—INTERACT 2013, vol 8119. Springer, Berlin, Heidelberg, pp 18–35

    CrossRef  Google Scholar 

  38. Seifert J, Dobbelstein D, Schmidt D, Holleis P, Rukzio E (2014) From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces. Pers Ubiquit Comput 18(4):1013–1026

    CrossRef  Google Scholar 

  39. Tan DS, Czerwinski M (2003) Effects of visual separation and physical discontinuities when distributing information across multiple displays. Proc INTERACT 2003:252–255

    Google Scholar 

  40. Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings UIST 2005. ACM, pp 33–42

    Google Scholar 

  41. von Zadow U, Büschel W, Langner R, Dachselt R (2014) Sleed: using a sleeve display to interact with touch-sensitive display walls. In: Proceedings ITS 2014. ACM, pp 129–138

    Google Scholar 

  42. Wagner J, Nancel M, Gustafson SG, Huot S, Mackay WE (2013) Body-centric design space for multi-surface interaction. In: Proceedings CHI 2013. ACM, pp 1299–1308

    Google Scholar 

Download references

Acknowledgements

We thank Wolfgang Büschel, Ulrike Kister, Fabrice Matulic, and other members of the Interactive Media Lab for their feedback and helpful suggestions. We would also like to thank students of the lab for their support on the prototype. Finally, we thank our anonymous reviewers for their valuable and helpful comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ricardo Langner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Langner, R., von Zadow, U., Horak, T., Mitschick, A., Dachselt, R. (2016). Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. In: Anslow, C., Campos, P., Jorge, J. (eds) Collaboration Meets Interactive Spaces. Springer, Cham. https://doi.org/10.1007/978-3-319-45853-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45853-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45852-6

  • Online ISBN: 978-3-319-45853-3

  • eBook Packages: Computer ScienceComputer Science (R0)