Skip to main content
SpringerLink
Log in

A taxonomy for and analysis of tangible interfaces

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

There have been many research efforts devoted to tangible user interfaces (TUIs), but it has proven difficult to create a definition or taxonomy that allows us to compare and contrast disparate research efforts, integrate TUIs with conventional interfaces, or suggest design principles for future efforts. To address this problem, we present a taxonomy, which uses metaphor and embodiment as its two axes. This 2D space treats tangibility as a spectrum rather than a binary quantity. The further from the origin, the more “tangible” a system is. We show that this spectrum-based taxonomy offers multiple advantages. It unifies previous categorizations and definitions, integrates the notion of “calm computing,” reveals a previously un-noticed trend in the field, and suggests design principles appropriate for different areas of the spectrum.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. This is not to be confused with the “embodied interaction” of Dourish [14], which denotes “the way that physical and social phenomena unfold in real time and real space as a part of the world in which we are situated.” As Dourish [14] points out, that sense of “embodiment” incorporates all of TUIs as a small subset. Here, we refer to a much narrower sense.

References

  1. Ambient Orb. Available at http://www.ambientdevices.com/cat/orb/orborder.html

  2. Antifakos S, Schiele B (2003) Laughing lily: using a flower as a real world information display. In: Adjunct proceedings of the 5th international conference on ubiquitous computing (Ubicomp 2003), Seattle, Washington, October 2003, pp 161–162

  3. Back M, Cohen J, Gold R, Harrison S, Minneman S (2001) Listen reader: an electronically augmented paper-based book. In: Proceedings of the CHI 2001 conference on human factors in computing systems, Seattle, Washington, April 2001, pp 23–29

  4. Balakrishnan R, Fitzmaurice G, Kurtenbach G, Buxton W (1999) Digital tape drawing. In: Proceedings of the 12th annual ACM symposium on user interface software and technology (UIST’99), Ashville, North Carolina, November 1999, pp 161–169

  5. Bier E, Stone M, Pier K, Buxton W, DeRose T (1993) Toolglass and magic lenses: the see-through interface. In: Proceedings of the 20th annual conference on computer graphics and interactive techniques (SIGGRAPH’93), Anaheim, California, August 1993, pp 73–80

  6. Blackwell A, Stringer M, Toye E, Rode J (2004) Tangible interface for collaborative information retrieval. In: Proceedings of the CHI 2004 conference on human factors in computing systems, Vienna, Austria, April 2004, pp 1473–1476

  7. Brereton M, McGarry B (2000) An observational study of how objects support engineering design thinking and communication: implications for the design of tangible media. In: Proceedings of the CHI 2000 conference on human factors in computing systems, The Hague, The Netherlands, April 2000, pp 217–224

  8. Brown T (2003) Making truth: metaphor in science. University of Illinois Press, Champaign, Illinois

    Google Scholar 

  9. Camarata K, Do EY, Gross M, Johnson BR (2002) Navigational blocks: tangible navigation of digital information. In: Extended abstracts of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 752–754

  10. Chang A, Resner B, Koerner B, Wang X, Ishii H (2001) LumiTouch: an emotional communication device. In: Proceedings of the CHI 2001 conference on human factors in computing systems, Seattle, Washington, April 2001, pp 313–314

  11. Churi A, Lin V (2003) Platypus amoeba. In: Adjunct proceedings of the 5th international conference on ubiquitous computing (Ubicomp 2003), Seattle, Washington, October 2003, pp 28–30

  12. Citeseer. Available at http://citeseer.nj.nec.com/ishii97tangible.html

  13. Cohen J, Withgott M, Piernot P (1999) Logjam: a tangible multi-person interface for video logging. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 128–135

  14. Dourish P (2001) Where the action is: the foundations of embodied interaction. MIT Press, Cambridge, Massachusetts

    Google Scholar 

  15. Fishkin K, Gujar A, Harrison B, Moran P, Want R (2000) Embodied user interfaces for really direct manipulation. Commun ACM 43(9):74–80

    Article  Google Scholar 

  16. Fishkin K, Moran T, Harrison B (1998) Embodied user interfaces: towards invisible user interfaces. In: Chatty S, Dewan P (eds) Engineering for human–computer interaction, proceedings of the 7th IFIP working conference on engineering for human–computer interaction (EHCI’98), Heraklion, Crete, Greece, September 1998, pp 1–18

    Google Scholar 

  17. Fishkin K, Wang M, Borriello G (2004) A ubiquitous system for medication monitoring. In: Proceedings of the 2nd international conference on pervasive computing (Pervasive 2004), Linz, Vienna, April 2004

  18. Fitzmaurice G, Ishii H, Buxton W (1995) Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the CHI’95 conference on human factors in computing systems, Denver, Colorado, May 1995, pp 442–449

  19. Frei P, Su V, Mikhak B, Ishii H (2000) Curlybot: designing a new class of computational toys. In: Proceedings of the CHI 2000 conference on human factors in computing systems, The Hague, The Netherlands, April 2000, pp 129–136

  20. Goldin-Meadow S (1979) Structure in a manual communication system developed without a conventional language model: language without a helping hand. In: Whitaker H, Whitaker HA (eds) Studies in neurolinguistics, vol 4. Academic Press, New York, pp 125–209

  21. Goldin-Meadow S (1975) The representation of semantic relations in a manual language created by deaf children of hearing parents: a language you can’t dismiss out of hand. PhD thesis, University of Pennsylvania, Philadelphia, Pennsylvania

    Google Scholar 

  22. Gorbet M (1998) Beyond input devices: a new conceptual framework for the design of physical–digital objects. Masters thesis, MIT Media Laboratory, Cambridge, Massachusetts

    Google Scholar 

  23. Gorbet M, Orth M, Ishii H (1998) Triangles: tangible interface for manipulation and exploration of digital information topography. In: Proceedings of the CHI’98 conference on human factors in computing systems, Los Angeles, California, April 1998, pp 49–56

  24. Greenberg S, Fitchett C (2001) Phidgets: easy development of physical interfaces through physical widgets. In: Proceedings of the 14th annual ACM symposium on user interface software and technology (UIST 2001), Orlando, Florida, November 2001, pp 209–218

  25. Harrison B, Fishkin K, Want R, Gujar A, Mochon C (1998) Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In: Proceedings of the CHI’98 conference on human factors in computing systems, Los Angeles, California, April 1998, pp 17–24

  26. Hinckley K, Pausch R, Goble JC, Kassell NF (1994) Passive real-world interface props for neurosurgical visualization. In: Proceedings of the CHI’94 conference on human factors in computing systems, Boston, Massachusetts, April 1994, pp 452–458

  27. Holmquist L, Redström J, Ljungstrand P (1999) Token-based access to digital information. In: Proceedings of the 1st international symposium on handheld and ubiquitous computing (HUC’99), Karlsruhe, Germany, September 1999, pp 234–245

  28. Ishii H, Ullmer B (1997) Tangible bits: towards seamless interfaces between people, bits, and atoms. In: Proceedings of the CHI‘97 conference on human factors in computing systems, Atlanta, Georgia, March 1997, pp 234–241

  29. Ishii H, Wisneski C, Orbanes J, Chun B, Paradiso J (1999) PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 394–401

  30. Jacob R, Ishii H, Pangaro G, Patten J (2002) A tangible interface for organizing information using a grid. In: Proceedings of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002,

  31. Johnson M, Wilson A, Blumberg B, Kline C, Bobick A (1999) Sympathetic interfaces: using a plush toy to direct synthetic characters. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 152–158

  32. Kuhn TS (1993) Metaphor in science. In: Ortony A (ed) Metaphor and thought, 2nd edn. Cambridge University Press, Cambridge, p 539

    Google Scholar 

  33. Lackner T, Dobson K, Rodenstein R, Weisman L (1999) Sensory puzzles. In: Extended abstracts of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 270–271

  34. Lertsithichai S, Seegmiller M (2002) CUBIK: a bi-directional tangible modeling interface. In: Extended abstracts of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 756–757

  35. Levin G, Yarin P (1999) Bringing sketching tools to keychain computers with an acceleration-based interface. In: Extended abstracts of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 268–269

  36. Lifton J, Broxton M, Paradiso J (2003) Distributed sensor networks as sensate skin. In: Proceedings of the 2nd IEEE international conference on sensors (Sensors 2003), Toronto, Canada, October 2003, pp 743–747

  37. Mankoff J, Dey AK, Hsieh G, Kientz J, Ames M, Lederer S (2003) Heuristic evaluation of ambient displays. In: Proceedings of the CHI 2003 conference on human factors in computing, Fort Lauderdale, Florida, April 2003, pp 169–176

  38. Mansley K, Beresford A, Scott D (2004) The carrot approach: encouraging use of location systems. In: Proceedings of the 6th international conference on ubiquitous computing (Ubicomp 2004), Nottingham, England, September 2004 (Ubicomp 2004)

  39. McGee D, Cohen P, Wesson M, Horman S (2002) Comparing paper and tangible, multimodal tools. In: Proceedings of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 407–414

  40. Mithen S (1996) The prehistory of the mind. Thames and Hudson, London

    Google Scholar 

  41. Nelson L, Ichimura S, Pedersen E, Adams L (1999) Palette: a paper interface for giving presentations. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 354–361

  42. Nemirovsky P, Davenport G (1999) GuideShoes: navigation based on musical patterns. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 266–267

  43. Parikh T, Ghosh K, Chavan A, Syal P, Arora S (2003) Design studies for a financial management system for micro-credit groups in rural India. In: Proceedings of the ACM conference on universal usability (Usability 2003), Vancouver, Canada, November 2003

  44. Patten J, Griffith L, Ishii H (2002) A tangible interface for controlling robotic toys. In: Extended abstracts of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 277–278

  45. Piper B, Ratti C, Ishii H (2002) Illuminating clay: a 3-D tangible interface for landscape analysis. In: Proceedings of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 355–362

  46. Raffle H, Parkes A, Ishii H (2004) Topobo: a constructive assembly system with kinetic memory. In: Proceedings of the CHI 2004 conference on human factors in computing systems, Vienna, Austria, April 2004, pp 647–654

  47. Rekimoto J (1996) Tilting operations for small screen interfaces. In: Proceedings of the 9th annual ACM symposium on user interface software and technology (UIST’96), Seattle, Washington, November 1996, UIST ’96, pp 167–168

  48. Rekimoto J, Sciammarella E (2000) ToolStone: effective use of physical manipulation vocabularies of input devices. In: Proceedings of the 13th annual ACM symposium on user interface software and technology (UIST 2000), San Diego, California, November 2000, pp 109–118

  49. Rekimoto J, Ullmer B, Oba H (2001) DataTiles: a modular platform for mixed physical and graphical interactions. In: Proceedings of the CHI 2001 conference on human factors in computing systems, Seattle, Washington, April 2001, pp 276–283

  50. Resnick M, Martin F, Berg R, Borovoy R, Colella V, Kramer K, Silverman B (1998) Digital manipulatives: new toys to think with. In: Proceedings of the CHI’98 conference on human factors in computing systems, Los Angeles, California, April 1998, pp 281–287

  51. Ryokai K, Cassell J (1999) StoryMat: a play space for collaborative storytelling. In: Extended abstracts of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 272–273

  52. Ryokai K, Marti S, Ishii H (2004) I/O brush: drawing with everyday objects as ink. In: Proceedings of the CHI 2004 conference on human factors in computing systems, Vienna, Austria, April 2004, pp 303–310

  53. Scarlatos L, Dushkina Y, Landy S (1999) TICLE: a tangible interface for collaborative learning environments. In: Extended abstracts of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 260–261

  54. Schkolne S, Pruett M, Schroder P (2001) Surface drawing: creating organic 3D shapes with the hand and tangible tools. In: Proceedings of the CHI 2001 conference on human factors in computing systems, Seattle, Washington, April 2001, pp 261–269

  55. Schwesig C, Poupyrev I, Mori E (2004) Gummi: a bendable computer. In: Proceedings of the CHI 2004 conference on human factors in computing systems, Vienna, Austria, April 2004, pp 263–270

  56. Sharlin E, Itoh Y, Watson B, Kitamura Y, Sutphen S, Liu L (2002) Cognitive cubes: a tangible user interface for cognitive assessment. In: Proceedings of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 347–354

  57. Singer A, Hindus D, Stifelman L, White S (1999) ToonTown: less is more in somewire audio spaces. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 104–111

  58. Skelly M (1979) Amer-Ind gestural code based on universal American Indian hand talk. Elsevier, Amsterdam, The Netherlands

    Google Scholar 

  59. Small D, Ishii H (1997) Design of spatially aware graspable displays. In: Extended abstracts of the CHI‘97 conference on human factors in computing systems, Atlanta, Georgia, March 1997, pp 367–368

  60. Snibbe S, MacLean K (2001) Haptic techniques for media control. In: Proceedings of the 14th annual ACM symposium on user interface software and technology (UIST 2001), Orlando, Florida, November 2001, pp 199–208

  61. Strommen E (1998) When the interface is a talking dinosaur: learning across media with ActiMates Barney. In: Proceedings of the CHI’98 conference on human factors in computing systems, Los Angeles, California, April 1998, pp 288–295

  62. Tandler P, Prante T, Muller-Tomfelde C, Streitz N, Steinmetz R (2001) ConnecTables: dynamic coupling of displays for the flexible creation of shared workspaces. In: Proceedings of the 14th annual ACM symposium on user interface software and technology (UIST 2001), Orlando, Florida, November 2001, pp 11–20

  63. Taylor AR (1975) Nonverbal communications systems in native North America. Semiotica 13(4):329–374

    Google Scholar 

  64. Tolmie P, Pycock J, Diggins T, MacLean A, Karsenty A (2002) Unremarkable computing. In: Proceedings of the CHI 2002 conference on human factors in computing systems, Minneapolis, Minnesota, April 2002, pp 399–406

  65. Ullmer B, Ishii H (2001) Emerging frameworks for tangible user interfaces. In: Carroll JM (ed) Human–computer interaction in the new millennium. Addison-Wesley, New York, pp 579–601

  66. Underkoffler J, Ishii H (1998) Illuminating light: an optical design tool with a luminous-tangible interface. In: Proceedings of the CHI’98 conference on human factors in computing systems, Los Angeles, California, April 1998, pp 542–549

  67. Underkoffler J, Ishii H (1999) Urp: a luminous-tangible workbench for urban planning and design. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 386–393

  68. Want R, Fishkin K, Gujar A, Harrison B (1999) Bridging physical and virtual worlds with electronic tags. In: Proceedings of the CHI’99 conference on human factors in computing systems, Pittsburgh, Pennsylvania, May 1999, pp 370–377

  69. Weinberg G, Orth M, Russio P (2000) The embroidered musical ball: a squeezable instrument for expressive performance. In: Extended abstracts of the CHI 2000 conference on human factors in computing systems, The Hague, The Netherlands, April 2000, pp 283–284

  70. Weiser M, Brown JS (1996) Designing calm technology. Powergrid Journal v1.01. Available at http://www.ubiq.com/weiser/calmtech/calmtech.htm

    Google Scholar 

  71. Wellner P, Mackay W, Gold R (1993) Back to the real world. Commun ACM 36(7):24–97

    Article  Google Scholar 

  72. Yim J-D, Nam T-J (2004) Developing tangible interaction and augmented reality in director. In: Proceedings of the CHI 2004 conference on human factors in computing systems, Vienna, Austria, April 2004, pp 1541–1542

Download references

Acknowledgements

We thank Brygg Ullmer, Matt Gorbet, and Scott Klemmer for their many helpful comments and discussions.

Author information

Authors and Affiliations

  1. Intel Research Seattle, 1100 NE 45th St, Seattle, WA, USA

    Kenneth P. Fishkin

Authors
  1. Kenneth P. Fishkin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kenneth P. Fishkin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fishkin, K.P. A taxonomy for and analysis of tangible interfaces. Pers Ubiquit Comput 8, 347–358 (2004). https://doi.org/10.1007/s00779-004-0297-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-004-0297-4

Keywords

Search

Navigation