Advertisement

A taxonomy for and analysis of multi-person-display ecosystems

  • Lucia TerrenghiEmail author
  • Aaron Quigley
  • Alan Dix
Original Article

Abstract

Interactive displays are increasingly being distributed in a broad spectrum of everyday life environments: they have very diverse form factors and portability characteristics, support a variety of interaction techniques, and can be used by a variable number of people. The coupling of multiple displays creates an interactive “ecosystem of displays”. Such an ecosystem is suitable for particular social contexts, which in turn generates novel settings for communication and performance and challenges in ownership. This paper aims at providing a design space that can inform the designers of such ecosystems. To this end, we provide a taxonomy that builds on the size of the ecosystem and on the degree of individual engagement as dimensions. We recognize areas where physical constraints imply certain kinds of social engagement, versus other areas where further work on interaction techniques for coupling displays can open new design spaces.

Keywords

Human computer interaction Surface interfaces Tabletop Gesture Interaction design Display systems Social interaction Display ecosystem scale 

References

  1. 1.
    Abowd G, Atkeson C, Feinstein A, Hmelo C, Kooper R, Long S, Sawhney N, Tani M (1996) Teaching and learning as multimedia authoring: The Classroom 2000 Project. In the proceedings of the ACM Multimedia’96 conference, pp 187–198Google Scholar
  2. 2.
    Apted T, Kay J, Quigley A (2006) Tabletop sharing of digital photographs for the elderly. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ‘06, ACM, pp 781–790Google Scholar
  3. 3.
    Ayatsuka Y, Rekimoto J (2005) tranSticks: physically manipulatable virtual connections. In: Proceedings of the SIGCHI conference on human factors in computing systems (Portland, Oregon, USA, 02–07 April 2005). CHI ‘05. ACM, New York, pp 251–260Google Scholar
  4. 4.
    Ballagas R, Rohs M, Sheridan JG (2005) Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI ‘05 extended abstracts on human factors in computing systems (Portland, OR, USA, 02–07 April 2005). CHI ‘05. ACM, New York, pp 1200–1203Google Scholar
  5. 5.
    Ballagas R, Borchers J, Rohs M, Sheridan JG (2006) The smart phone: a ubiquitous input device. IEEE Pervasive Comput 5(1):70–77CrossRefGoogle Scholar
  6. 6.
    BBC.co.uk. Rugby at the Big Screen. 16 March 2006. http://www.bbc.co.uk/liverpool/content/articles/2006/03/16/big_screen_rugbykick_feature.shtml. Accessed Sept 2008
  7. 7.
    Biehl JT, Bailey BP (2004) ARIS: an interface for application relocation in an interactive space. In: Proceedings of graphics interface 2004 (London, Ontario, Canada, May 17–19, 2004). ACM International Conference Proceeding Series, vol 62. Canadian Human–Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, pp 107–116Google Scholar
  8. 8.
    Biehl JT, Baker WT, Bailey BP, Tan DS, Inkpen KM, Czerwinski M (2008) Impromptu: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems (Florence, Italy, 05–10 April 2008). CHI‘08. ACM, New York, pp 939–948Google Scholar
  9. 9.
    Björk S, Falk J, Hansson R, Ljungstrand P (2001) Pirates!—using the physical world as a game board. In: Proceedings of interact 2001, IFIP TC.13 conference on human–computer interaction, 9–13 July 2001, Tokyo, JapanGoogle Scholar
  10. 10.
    Blinkenlights art installation http://www.blinkenlights.de. Accessed Sept 2008
  11. 11.
    Coyne R, Williams R, Stewart J, Wright M, Lee J, Travlou P, Boldrick S (2008) Branded meeting places: ubiquitous technologies and the design of places for meaningful human encounter. Edinburgh University, UK. http://ace.caad.ed.ac.uk/branded/. Accessed Sept 2008
  12. 12.
    Danesh A, Inkpen K, Lau F, Shu K, Booth K, Geney TM (2001) Designing a collaborative activity for the PalmTM handheld computer. In Proceedings of CHI’01, Conference on human factors in computing systems, Seattle, 2001, pp 388–395Google Scholar
  13. 13.
    Day N, Sas C, Dix A, Toma M, Bevan C, Clare D (2007) Breaking the campus bubble: informed, engaged, connected. In: Procedings of BCS HCI 2007, people and computers XXI, vol 2, BCS eWiCGoogle Scholar
  14. 14.
    Dietz P, Leigh D (2001) Diamond Touch: a multi-user touch technology. In: Proceesing of UIST‘01, the 14th annual ACM symposium on user interface software and technology, pp 219–226Google Scholar
  15. 15.
    Dix A, Sheridan J, Reeves S, Benford S, O’Malley C (2005) Formalising performative interaction. In: Proceedings of DSVIS’2005 (Newcastle, UK, 13–15 July 2005). Lecture Notes in Computer Science, vol 3941. Springer, Heidelberg, pp 15–25Google Scholar
  16. 16.
    Dix A, Sas C (2008). Public displays and private devices: a design space analysis. In: Workshop on designing and evaluating mobile phone-based interaction with public displays. CHI2008, Florence, 5 April 2008Google Scholar
  17. 17.
    Facer K, Joiner R, Stanton D, Reid J, Hull R, Kirk D (2004) Savannah: mobile gaming and learning? J Comput Assist Learn 20:399–409CrossRefGoogle Scholar
  18. 18.
    Hazas M, Kray C, Gellersen H, Agbota H, Kortuem G, Krohn A (2005) A relative positioning system for co-located mobile devices. In: Proceedings of the third international conference on mobile systems, applications, and services (Seattle, Washington, 06–08 June 2005). MobiSys‘05. ACM, New York, pp 177–190Google Scholar
  19. 19.
    Hinckley K (2003) Synchronous gestures for multiple persons and computers. In: Proceedings of the 16th annual ACM symposium on user interface software and technology (Vancouver, Canada, 02–05 November 2003). UIST‘03. ACM, New York, pp 149–158Google Scholar
  20. 20.
    Hinckley K, Ramos G, Guimbretiere F, Baudisch P, Smith M (2004) Stitching: pen gestures that span multiple displays. In: Proceedings of the working conference on advanced visual interfaces (Gallipoli, Italy, 25–28 May 2004). AVI‘04. ACM, New York, pp 23–31Google Scholar
  21. 21.
    Holmquist L, Mattern F, Schiele B, Alahuhta P, Beigl M, Gellersen H (2001) Smart-its friends: a technique for users to easily establish connections between smart artefacts, Ubicomp 2001: Ubiquitous Computing, pp 116–122Google Scholar
  22. 22.
    Inkpen KM, Hawkey K, Kellar M, Mandryk RL, Parker JK, Reilly D, Scott SD, Whalen T (2005) Exploring display factors that influence co-located collaboration: angle, size, number, and user arrangement. In: Proceedings of HCI international 2005. Las Vegas, USA, July 2005Google Scholar
  23. 23.
    Izadi S, Brignull H, Rodden T, Rogers Y, Underwood M (2003) Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media. In: Proceedings of the 16th annual ACM symposium on user interface software and technology (Vancouver, Canada, 02–05 November 2003). UIST‘03. ACM, New York, pp 159–168Google Scholar
  24. 24.
    Jiang H, Wigdor D, Forlines C, Shen C (2008) System design for the WeSpace: linking personal devices to a table-centered multi-user, multi-surface environment. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 105–112Google Scholar
  25. 25.
    Johanson B, Fox A, Winograd T (2002) The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing, vol 01, no 2. April–June 2002, pp 67–74Google Scholar
  26. 26.
    Kakehi Y, Naemura T (2008) UlteriorScape: interactive optical superimposition on a view-dependant tabletop display. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 201–204Google Scholar
  27. 27.
    Kray C, Rohs M, Hook J, Kratz S (2008) Group coordination and negotiation through spatial proximity regions around mobile devices on augmented Tabletops. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 3–10Google Scholar
  28. 28.
    Lewis T (1997) Cars, Phones, and Tamagotchi Tribes. IEEE Comput 11(30):142–143Google Scholar
  29. 29.
    Mayrhofer R, Gellersen H (2007) Shake well before use: authentication based on accelerometer data. In: Proceeding of the fifth international conference on pervasive computing, Toronto, Canada, May 2007, pp 144–161Google Scholar
  30. 30.
    Mulfinger J, Budgett G, Magagnosc C (2005) Regrets [Cambridge] (Accessed Oct 2008). http://www.arts.ucsb.edu/faculty/budgett/regrets/ also see Regrets Event (Cambridge, 1/11/05–20/11/05) home page (Accessed Oct 2008) http://www.regrets.co.uk/
  31. 31.
    Myers BA (2001) Using handhelds and PCs together. Commun ACM 44(11):34–41Google Scholar
  32. 32.
    Nacenta MA, Sakurai S, Yamaguchi T, Miki Y, Itoh Y, Kitamura Y, Subramanian S, Gutwin C (2007) E-conic: a perspective-aware interface for multi-display environments. In Proceedings of the 20th Annual ACM symposium on user interface software and technology (Newport, Rhode Island, USA, 07–10 October 2007). UIST‘07. ACM, New York, pp 279–288Google Scholar
  33. 33.
    O’Murchú N (2008) “tune_eile”: A platform for social interactions through handheld musical devices. In: Proceedings of the Workshop on designing multi-touch interaction techniques for coupled public and private displays, AVI 2008, pp 54–58Google Scholar
  34. 34.
    Park DG, Kim JK, Sung JB, Hwang JH, Hyung CH, Kang SW (2006) TAP: touch-and-play. In: Grinter R, Rodden T, Aoki P, Cutrell E, Jeffries R, Olson G (eds) Proceedings of the SIGCHI conference on human factors in computing systems (Montréal, Québec, Canada, 22–27 April 2006). CHI‘06. ACM, New York, pp 677–680Google Scholar
  35. 35.
    Pierce JS, Mahaney HE, Abowd GD (2003) Opportunistic annexing for handheld devices: opportunities and challenges, GVU Technical Report; GIT-GVU-03-31, http://hdl.handle.net/1853/3242
  36. 36.
    Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the tenth annual ACM symposium on user interface software and technology (Banff, Alberta, Canada, October 14–17, 1997). UIST‘97. ACM, New York, pp 31–39Google Scholar
  37. 37.
    Rekimoto J, Saitoh M (1999) Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the SIGCHI conference on human factors in computing systems: the CHI Is the Limit (Pittsburgh, Pennsylvania, USA, 15–20 May 1999), CHI‘99. ACM, New York, pp 378–385Google Scholar
  38. 38.
    Rekimoto J (2004) Synctap: synchronous user operation for spontaneous network connection. Pers Ubiquitous Comput 8(2):126–134CrossRefGoogle Scholar
  39. 39.
    Rekimoto J, Miyaki T, Kohno M (2004) ProxNet: secure dynamic wireless connection by proximity sensing. In: Proceeding of the second international conference on pervasive computing, pp 213–218Google Scholar
  40. 40.
    Sanneblad J, Holmquist LE (2003) OpenTrek: a platform for developing interactive networked games on mobile devices. In: Proceedings of Mobile HCI 2003, Udine, ItalyGoogle Scholar
  41. 41.
    Scott SD, Sheelagh M, Carpendale T, Inkpen KM (2004) Territoriality in collaborative tabletop workspaces. In: Proceedings of the 2004 ACM conference on computer supported cooperative work (Chicago, IL, USA, 06–10 November 2004). CSCW‘04. ACM, New York, pp 294–303Google Scholar
  42. 42.
    Shen C, Everitt KM, Ryall K (2003) UbiTable: impromptu face-to-face collaboration on horizontal interactive surfaces. In: ACM international conference on Ubiquitous Computing (UbiComp), October 2003, pp 281–288Google Scholar
  43. 43.
    Stefik M, Bobrow DG, Foster G, Lanning S, Tatar D (1987) WYSIWIS revised: early experiences with multi-user interfaces. In: Proceedings of the conference on computer-supported cooperative work, Austin, Texas, 3–5 December 1986, pp 276–290 (Reprinted by invitation in ACM Trans Office Inf Syst 5(2):147–167, April 1987)Google Scholar
  44. 44.
    Streitz NA, Geißler J, Holmer T, Konomi S, M¨uller-Tomfelde C, Reischl W, Rexroth P, Seitz P, Steinmetz R (1999) i-Land: an interactive landscape for creativity and innovation. In: Proceedings of the CHI‘99 conference on human factors in computing systems (CHI’99), ACM Press, New York, pp 120–127Google Scholar
  45. 45.
    Taylor N, Cheverst K, Fitton D, Race NJ, Rouncefield M, Graham C (2007) Probing communities: study of a village photo display. In: Proceedings of the 2007 conference of the computer–human interaction Special Interest Group (Chisig) of Australia on computer–human interaction: design: activities, artifacts and environments (Adelaide, Australia, 28–30 November 2007). OZCHI‘07, vol 251. ACM, New York, pp 17–24Google Scholar
  46. 46.
    Terrenghi L (2007) Designing hybrid interactions through an understanding of the Affordances of Physical and Digital Technologies. Published on the digital library of the Ludwig-Maximilians Universität München, PhD Thesis. http://edoc.ub.uni-muenchen.de/7874/1/terrenghi_lucia.pdf
  47. 47.
    Tandler P, Prante T, Müller-Tomfelde C, Streitz N, Steinmetz R (2001) Connectables: dynamic coupling of displays for the flexible creation of shared workspaces. In: Proceedings of the 14th annual ACM symposium on user interface Software and Technology (Orlando, Florida, 11–14 November 2001). UIST‘01. ACM, New York, pp 11–20Google Scholar
  48. 48.
    Wagner D, Pintaric T, Ledermann F, Schmalstieg D (2005) Towards massively multi-user augmented reality on handheld devices. In: Proceedings of the third international conference on pervasive computing (Pervasive 2005), Munich, Germany, pp 208–219Google Scholar
  49. 49.
    Weiser M (1991) The Computer for the twenty-first century. Sci Am 265(3):94–104Google Scholar
  50. 50.
    Wigdor D, Shen C, Forlines C, Balakrishnan R (2006) Table-centric interactive spaces for real-time collaboration. In: Proceedings of the working conference on advanced visual interfaces (Venezia, Italy, 23–26 May 2006). AVI‘06. ACM, New York, 103–107. doi:http://doi.acm.org/10.1145/1133265.1133286
  51. 51.
    Wilson AD, Sarin R (2007) BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In: Proceedings of graphics interface 2007 (Montreal, Canada, 28–30 May 2007). GI‘07, vol 234. ACM, New York, pp 119–125Google Scholar
  52. 52.
    Zimmerman TG (1996) Personal area networks: near-field intrabody communication. IBM Syst J 35:609–617Google Scholar

Copyright information

© Springer-Verlag London Limited 2009

Authors and Affiliations

  1. 1.Vodafone Group Services R&DMunichGermany
  2. 2.School of Computer Science and Informatics, Complex and Adaptive Systems LaboratoryUniversity College DublinDublinIreland
  3. 3.Computing Department, InfoLab21Lancaster UniversityLancasterUK

Personalised recommendations