Skip to main content
Log in

A taxonomy for and analysis of multi-person-display ecosystems

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Interactive displays are increasingly being distributed in a broad spectrum of everyday life environments: they have very diverse form factors and portability characteristics, support a variety of interaction techniques, and can be used by a variable number of people. The coupling of multiple displays creates an interactive “ecosystem of displays”. Such an ecosystem is suitable for particular social contexts, which in turn generates novel settings for communication and performance and challenges in ownership. This paper aims at providing a design space that can inform the designers of such ecosystems. To this end, we provide a taxonomy that builds on the size of the ecosystem and on the degree of individual engagement as dimensions. We recognize areas where physical constraints imply certain kinds of social engagement, versus other areas where further work on interaction techniques for coupling displays can open new design spaces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Abowd G, Atkeson C, Feinstein A, Hmelo C, Kooper R, Long S, Sawhney N, Tani M (1996) Teaching and learning as multimedia authoring: The Classroom 2000 Project. In the proceedings of the ACM Multimedia’96 conference, pp 187–198

  2. Apted T, Kay J, Quigley A (2006) Tabletop sharing of digital photographs for the elderly. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ‘06, ACM, pp 781–790

  3. Ayatsuka Y, Rekimoto J (2005) tranSticks: physically manipulatable virtual connections. In: Proceedings of the SIGCHI conference on human factors in computing systems (Portland, Oregon, USA, 02–07 April 2005). CHI ‘05. ACM, New York, pp 251–260

  4. Ballagas R, Rohs M, Sheridan JG (2005) Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI ‘05 extended abstracts on human factors in computing systems (Portland, OR, USA, 02–07 April 2005). CHI ‘05. ACM, New York, pp 1200–1203

  5. Ballagas R, Borchers J, Rohs M, Sheridan JG (2006) The smart phone: a ubiquitous input device. IEEE Pervasive Comput 5(1):70–77

    Article  Google Scholar 

  6. BBC.co.uk. Rugby at the Big Screen. 16 March 2006. http://www.bbc.co.uk/liverpool/content/articles/2006/03/16/big_screen_rugbykick_feature.shtml. Accessed Sept 2008

  7. Biehl JT, Bailey BP (2004) ARIS: an interface for application relocation in an interactive space. In: Proceedings of graphics interface 2004 (London, Ontario, Canada, May 17–19, 2004). ACM International Conference Proceeding Series, vol 62. Canadian Human–Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, pp 107–116

  8. Biehl JT, Baker WT, Bailey BP, Tan DS, Inkpen KM, Czerwinski M (2008) Impromptu: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems (Florence, Italy, 05–10 April 2008). CHI‘08. ACM, New York, pp 939–948

  9. Björk S, Falk J, Hansson R, Ljungstrand P (2001) Pirates!—using the physical world as a game board. In: Proceedings of interact 2001, IFIP TC.13 conference on human–computer interaction, 9–13 July 2001, Tokyo, Japan

  10. Blinkenlights art installation http://www.blinkenlights.de. Accessed Sept 2008

  11. Coyne R, Williams R, Stewart J, Wright M, Lee J, Travlou P, Boldrick S (2008) Branded meeting places: ubiquitous technologies and the design of places for meaningful human encounter. Edinburgh University, UK. http://ace.caad.ed.ac.uk/branded/. Accessed Sept 2008

  12. Danesh A, Inkpen K, Lau F, Shu K, Booth K, Geney TM (2001) Designing a collaborative activity for the PalmTM handheld computer. In Proceedings of CHI’01, Conference on human factors in computing systems, Seattle, 2001, pp 388–395

  13. Day N, Sas C, Dix A, Toma M, Bevan C, Clare D (2007) Breaking the campus bubble: informed, engaged, connected. In: Procedings of BCS HCI 2007, people and computers XXI, vol 2, BCS eWiC

  14. Dietz P, Leigh D (2001) Diamond Touch: a multi-user touch technology. In: Proceesing of UIST‘01, the 14th annual ACM symposium on user interface software and technology, pp 219–226

  15. Dix A, Sheridan J, Reeves S, Benford S, O’Malley C (2005) Formalising performative interaction. In: Proceedings of DSVIS’2005 (Newcastle, UK, 13–15 July 2005). Lecture Notes in Computer Science, vol 3941. Springer, Heidelberg, pp 15–25

  16. Dix A, Sas C (2008). Public displays and private devices: a design space analysis. In: Workshop on designing and evaluating mobile phone-based interaction with public displays. CHI2008, Florence, 5 April 2008

  17. Facer K, Joiner R, Stanton D, Reid J, Hull R, Kirk D (2004) Savannah: mobile gaming and learning? J Comput Assist Learn 20:399–409

    Article  Google Scholar 

  18. Hazas M, Kray C, Gellersen H, Agbota H, Kortuem G, Krohn A (2005) A relative positioning system for co-located mobile devices. In: Proceedings of the third international conference on mobile systems, applications, and services (Seattle, Washington, 06–08 June 2005). MobiSys‘05. ACM, New York, pp 177–190

  19. Hinckley K (2003) Synchronous gestures for multiple persons and computers. In: Proceedings of the 16th annual ACM symposium on user interface software and technology (Vancouver, Canada, 02–05 November 2003). UIST‘03. ACM, New York, pp 149–158

  20. Hinckley K, Ramos G, Guimbretiere F, Baudisch P, Smith M (2004) Stitching: pen gestures that span multiple displays. In: Proceedings of the working conference on advanced visual interfaces (Gallipoli, Italy, 25–28 May 2004). AVI‘04. ACM, New York, pp 23–31

  21. Holmquist L, Mattern F, Schiele B, Alahuhta P, Beigl M, Gellersen H (2001) Smart-its friends: a technique for users to easily establish connections between smart artefacts, Ubicomp 2001: Ubiquitous Computing, pp 116–122

  22. Inkpen KM, Hawkey K, Kellar M, Mandryk RL, Parker JK, Reilly D, Scott SD, Whalen T (2005) Exploring display factors that influence co-located collaboration: angle, size, number, and user arrangement. In: Proceedings of HCI international 2005. Las Vegas, USA, July 2005

  23. Izadi S, Brignull H, Rodden T, Rogers Y, Underwood M (2003) Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media. In: Proceedings of the 16th annual ACM symposium on user interface software and technology (Vancouver, Canada, 02–05 November 2003). UIST‘03. ACM, New York, pp 159–168

  24. Jiang H, Wigdor D, Forlines C, Shen C (2008) System design for the WeSpace: linking personal devices to a table-centered multi-user, multi-surface environment. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 105–112

  25. Johanson B, Fox A, Winograd T (2002) The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing, vol 01, no 2. April–June 2002, pp 67–74

  26. Kakehi Y, Naemura T (2008) UlteriorScape: interactive optical superimposition on a view-dependant tabletop display. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 201–204

  27. Kray C, Rohs M, Hook J, Kratz S (2008) Group coordination and negotiation through spatial proximity regions around mobile devices on augmented Tabletops. In: Proceedings of the third annual IEEE international workshop on horizontal interactive human–computer systems (Tabletop) (Amsterdam, The Netherlands, 01–03 October 2008), IEEE Computer Society, pp 3–10

  28. Lewis T (1997) Cars, Phones, and Tamagotchi Tribes. IEEE Comput 11(30):142–143

    Google Scholar 

  29. Mayrhofer R, Gellersen H (2007) Shake well before use: authentication based on accelerometer data. In: Proceeding of the fifth international conference on pervasive computing, Toronto, Canada, May 2007, pp 144–161

  30. Mulfinger J, Budgett G, Magagnosc C (2005) Regrets [Cambridge] (Accessed Oct 2008). http://www.arts.ucsb.edu/faculty/budgett/regrets/ also see Regrets Event (Cambridge, 1/11/05–20/11/05) home page (Accessed Oct 2008) http://www.regrets.co.uk/

  31. Myers BA (2001) Using handhelds and PCs together. Commun ACM 44(11):34–41

    Google Scholar 

  32. Nacenta MA, Sakurai S, Yamaguchi T, Miki Y, Itoh Y, Kitamura Y, Subramanian S, Gutwin C (2007) E-conic: a perspective-aware interface for multi-display environments. In Proceedings of the 20th Annual ACM symposium on user interface software and technology (Newport, Rhode Island, USA, 07–10 October 2007). UIST‘07. ACM, New York, pp 279–288

  33. O’Murchú N (2008) “tune_eile”: A platform for social interactions through handheld musical devices. In: Proceedings of the Workshop on designing multi-touch interaction techniques for coupled public and private displays, AVI 2008, pp 54–58

  34. Park DG, Kim JK, Sung JB, Hwang JH, Hyung CH, Kang SW (2006) TAP: touch-and-play. In: Grinter R, Rodden T, Aoki P, Cutrell E, Jeffries R, Olson G (eds) Proceedings of the SIGCHI conference on human factors in computing systems (Montréal, Québec, Canada, 22–27 April 2006). CHI‘06. ACM, New York, pp 677–680

  35. Pierce JS, Mahaney HE, Abowd GD (2003) Opportunistic annexing for handheld devices: opportunities and challenges, GVU Technical Report; GIT-GVU-03-31, http://hdl.handle.net/1853/3242

  36. Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the tenth annual ACM symposium on user interface software and technology (Banff, Alberta, Canada, October 14–17, 1997). UIST‘97. ACM, New York, pp 31–39

  37. Rekimoto J, Saitoh M (1999) Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the SIGCHI conference on human factors in computing systems: the CHI Is the Limit (Pittsburgh, Pennsylvania, USA, 15–20 May 1999), CHI‘99. ACM, New York, pp 378–385

  38. Rekimoto J (2004) Synctap: synchronous user operation for spontaneous network connection. Pers Ubiquitous Comput 8(2):126–134

    Article  Google Scholar 

  39. Rekimoto J, Miyaki T, Kohno M (2004) ProxNet: secure dynamic wireless connection by proximity sensing. In: Proceeding of the second international conference on pervasive computing, pp 213–218

  40. Sanneblad J, Holmquist LE (2003) OpenTrek: a platform for developing interactive networked games on mobile devices. In: Proceedings of Mobile HCI 2003, Udine, Italy

  41. Scott SD, Sheelagh M, Carpendale T, Inkpen KM (2004) Territoriality in collaborative tabletop workspaces. In: Proceedings of the 2004 ACM conference on computer supported cooperative work (Chicago, IL, USA, 06–10 November 2004). CSCW‘04. ACM, New York, pp 294–303

  42. Shen C, Everitt KM, Ryall K (2003) UbiTable: impromptu face-to-face collaboration on horizontal interactive surfaces. In: ACM international conference on Ubiquitous Computing (UbiComp), October 2003, pp 281–288

  43. Stefik M, Bobrow DG, Foster G, Lanning S, Tatar D (1987) WYSIWIS revised: early experiences with multi-user interfaces. In: Proceedings of the conference on computer-supported cooperative work, Austin, Texas, 3–5 December 1986, pp 276–290 (Reprinted by invitation in ACM Trans Office Inf Syst 5(2):147–167, April 1987)

  44. Streitz NA, Geißler J, Holmer T, Konomi S, M¨uller-Tomfelde C, Reischl W, Rexroth P, Seitz P, Steinmetz R (1999) i-Land: an interactive landscape for creativity and innovation. In: Proceedings of the CHI‘99 conference on human factors in computing systems (CHI’99), ACM Press, New York, pp 120–127

  45. Taylor N, Cheverst K, Fitton D, Race NJ, Rouncefield M, Graham C (2007) Probing communities: study of a village photo display. In: Proceedings of the 2007 conference of the computer–human interaction Special Interest Group (Chisig) of Australia on computer–human interaction: design: activities, artifacts and environments (Adelaide, Australia, 28–30 November 2007). OZCHI‘07, vol 251. ACM, New York, pp 17–24

  46. Terrenghi L (2007) Designing hybrid interactions through an understanding of the Affordances of Physical and Digital Technologies. Published on the digital library of the Ludwig-Maximilians Universität München, PhD Thesis. http://edoc.ub.uni-muenchen.de/7874/1/terrenghi_lucia.pdf

  47. Tandler P, Prante T, Müller-Tomfelde C, Streitz N, Steinmetz R (2001) Connectables: dynamic coupling of displays for the flexible creation of shared workspaces. In: Proceedings of the 14th annual ACM symposium on user interface Software and Technology (Orlando, Florida, 11–14 November 2001). UIST‘01. ACM, New York, pp 11–20

  48. Wagner D, Pintaric T, Ledermann F, Schmalstieg D (2005) Towards massively multi-user augmented reality on handheld devices. In: Proceedings of the third international conference on pervasive computing (Pervasive 2005), Munich, Germany, pp 208–219

  49. Weiser M (1991) The Computer for the twenty-first century. Sci Am 265(3):94–104

    Google Scholar 

  50. Wigdor D, Shen C, Forlines C, Balakrishnan R (2006) Table-centric interactive spaces for real-time collaboration. In: Proceedings of the working conference on advanced visual interfaces (Venezia, Italy, 23–26 May 2006). AVI‘06. ACM, New York, 103–107. doi:http://doi.acm.org/10.1145/1133265.1133286

  51. Wilson AD, Sarin R (2007) BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In: Proceedings of graphics interface 2007 (Montreal, Canada, 28–30 May 2007). GI‘07, vol 234. ACM, New York, pp 119–125

  52. Zimmerman TG (1996) Personal area networks: near-field intrabody communication. IBM Syst J 35:609–617

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lucia Terrenghi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Terrenghi, L., Quigley, A. & Dix, A. A taxonomy for and analysis of multi-person-display ecosystems. Pers Ubiquit Comput 13, 583–598 (2009). https://doi.org/10.1007/s00779-009-0244-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-009-0244-5

Keywords

Navigation