Skip to main content
SpringerLink
Log in

Tangible Interaction in Mixed Reality Systems

  • Chapter
  • First Online:
The Engineering of Mixed Reality Systems

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

In this chapter, we discuss the design of tangible interaction techniques for mixed reality environments. We begin by recalling some conceptual models of tangible interaction. Then, we propose an engineering-oriented software/hardware co-design process, based on our experience in developing tangible user interfaces. We present three different tangible user interfaces for real-world applications and analyze the feedback from the user studies that we conducted. In summary, we conclude that since tangible user interfaces are part of the real world and provide a seamless interaction with virtual words, they are well adapted to mix together reality and virtuality. Hence, tangible interaction optimizes users’ virtual tasks, especially in manipulating and controlling 3D digital data in 3D space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Actuation means “to put in action,” “to move.”

References

  1. Bailly, G., Nigay, L., Auber, D.: 2 M: Un espace de conception pour l’interaction bi-manuelle. In: UbiMob’05 the 2nd French-speaking conference on Mobility and ubiquitous computing, pp. 177–184. ACM (2005)

    Google Scholar 

  2. Balakrishnan, R., Fitzmaurice, G., Kurtenbach, G., Singh, K.: Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In I3D '99 the 1999 symposium on Interactive 3D graphics, pp. 111–118. ACM (1999)

    Google Scholar 

  3. Beaudoin-Lafon, M.: Instrumental interaction: An interaction model for designing post-WIMP user interfaces. In: CHI’00 the 18th SIGCHI conference on Human factors in computing systems, pp. 446–453. ACM (2000)

    Google Scholar 

  4. Boothroyd, G., Dewhurst, P.: Product Design for Assembly – A Designer’s Handbook. Department of Mechanical Engineering, University of Massachusetts (1993)

    Google Scholar 

  5. Calvary, G., Daassi, O., Coutaz, J., Demeure, A.: Des widgets aux comets pour la Plasticité des Systèmes Interactifs. J. RIHM Revue d’Interaction Homme-Machine. 6, 1, 33–53 (2005)

    Google Scholar 

  6. Coelho, M., Ishii, H., Maes, P.: Surflex: A programmable surface for the design of tangible interfaces. In: CHI’08 extended abstracts of the 26th SIGCHI conference on Human factors in computing systems, pp. 3429–3434. ACM (2008)

    Google Scholar 

  7. Coelho, M., Maes, P.: Sprout I/O: A texturally rich interface. In: TEI’08 the 2nd international conference on Tangible and embedded interaction, pp. 221–222. ACM (2008)

    Google Scholar 

  8. Coutrix, C., Nigay, L.: Mixed reality: A model of mixed interaction. In: AVI’06 the 8th International Working Conference on Advanced Visual Interfaces, pp. 43–50. ACM (2006)

    Google Scholar 

  9. Couture, N., Minel, S.: TactiMod dirige et oriente un piéton. In: UbiMob '06 the 3rd French-speaking conference on Mobility and Ubiquitous computing, pp. 9–16. ACM (2006)

    Google Scholar 

  10. Couture, N., Rivière, G., Reuter, P.: GeoTUI: A tangible user interface for geoscience. In: TEI’08 the 2nd international conference on Tangible and Embedded Interaction, pp. 89–96. ACM (2008)

    Google Scholar 

  11. Fishkin, K.: A taxonomy for and analysis of tangible interfaces. J. PUC Personal Ubiquitous Comput. 8, 5, 347–358 (2004)

    Google Scholar 

  12. Fitzmaurice, G.: Graspable User Interfaces. PhD thesis, University of Toronto (1996)

    Google Scholar 

  13. Fitzmaurice, G., Buxton, W.: An empirical evaluation of graspable user interfaces: Towards specialized space-multiplexed input. In: CHI’97 the 15th SIGCHI conference on Human factors in computing systems, pp. 43–50. ACM Press (1997)

    Google Scholar 

  14. Fitzmaurice, G., Ishii, H., Buxton, W.: Bricks: Laying the foundations for graspable user interfaces. In: CHI’95 the 13th SIGCHI conference on Human factors in computing systems, pp. 442–449. ACM Press/Addison-Wesley Publishing Co (1995)

    Google Scholar 

  15. Gabriel, R., Sandsjö, J., Shahrokni, A., Fjeld, M.: BounceSlider: Actuated sliders for music performance and composition. In: TEI’08 the 2nd international conference on Tangible and embedded interaction, pp. 127–130. ACM (2008)

    Google Scholar 

  16. Garreau, L., Legardeur, J., Rouillon-Couture, N.: Une plate-forme basée sur les interfaces tangibles pour l‘assemblage en CFAO. J. Ingénierie Numérique, Interaction Homme-Machine et CAO. 1, 2, 133–148. Lavoisier-Hermes (2005)

    Google Scholar 

  17. Guiard, Y.: Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behavior. 19, 486–517 (1987)

    Google Scholar 

  18. Hartson, H.R., Siochi, A.C., Hix, D.: The UAN: A user-oriented representation for direct manipulation interface designs. J. TOIS ACM Trans. Inf. Syst. 8, 3, 181–203 (1990)

    Article  Google Scholar 

  19. Hinckley, K., Pausch, R., Goble, J., Kassell, N.: Passive real-world interface props for neurosurgical visualization. In: CHI’94 the 12th SIGCHI conference on Human factors in computing systems, pp. 452–458. ACM (1994)

    Google Scholar 

  20. Ishii, H.: Tangible bits: Beyond pixels. In: TEI’08 the 2nd International Conference on Tangible and Embedded Interaction, pp. XV–XXV. ACM Press (2008)

    Google Scholar 

  21. Ishii, H., Ren, S., Frei, P.: Pinwheels: Visualizing information flow in an architectural space. In: CHI’01 extended abstracts of the 19th SIGCHI conference Human factors in computing systems, pp. 111–112. ACM (2001)

    Google Scholar 

  22. Ishii, H., Ullmer, B.: Tangible bits: Towards seamless interfaces between people, bits and atoms. In: CHI’97 the 15th SIGCHI conference on Human factors in computing systems, pp. 234–241. ACM (1997)

    Google Scholar 

  23. Jurado, F., Sinoquet, D., Lailly, P.: Jerry: A 3D reflection tomography designed for complex structures. Technical report, KIM 1996 Annual Report, Institut Français du Pétrole (1996)

    Google Scholar 

  24. Kabbash, P., Buxton, W., Sellen, A.: Two-handed input in a compound task. In: CHI '94 the 12th SIGCHI conference on Human factors in computing systems, pp. 417–423. ACM (1994)

    Google Scholar 

  25. Kitamura, Y., Itoh, Y., Kishino, F.: ActiveCube: A Bi-directional user interface using Cubes. In: CHI’01 extended abstracts of the 19th SIGCHI conference on Human factors in computing systems, pp. 355–356. ACM (2001)

    Google Scholar 

  26. Leganchuk, A., Zhai, S., Buxton, W.: Manual and cognitive benefits of two-handed input: An experimental study. J. TOCHI. 5, 4, 326–359 (1998)

    Article  Google Scholar 

  27. Legardeur, J., Garreau, L., Couture, N.: Experiments to evolve toward a tangible user interface for CAD parts assembly. In: SPIE'04 Electronic Imaging'04, pp. 438–445. SPIE (2004)

    Google Scholar 

  28. Llamas, I., Kim, B., Gargus, J., Rossignac, J,. Shaw, C.: Twister: A space-warp operator for the two-handed editing of 3D shapes. In: SIGGRAPH '03: ACM SIGGRAPH 2003 Papers, pp. 663–668. ACM (2003)

    Google Scholar 

  29. Mazzone, A., Spagno, C., Kunz, A.: The HoverMesh: A deformable structure based on vacuum cells: New advances in the research of tangible user interfaces. In: ACE’04 the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, pp. 187–193. ACM (2004)

    Google Scholar 

  30. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. J. IEICE Trans. Inf. Syst. E77-D, 12, 1321–1329 (1994)

    Google Scholar 

  31. Norman, D.: The Psychology of Everyday Things. Basic Books, New York (1988)

    Google Scholar 

  32. Norman, D.: Affordance, conventions, and design. J. Interactions. 6, 3, 38–43 (1999)

    Article  Google Scholar 

  33. Pangaro, G., Maynes-Aminzade, D., Ishii, H.: The actuated workbench: Computer-controlled actuation in tabletop tangible interfaces. In: UIST’02 the 15th annual ACM symposium on User Interface Software and Technology, pp. 181–190. ACM (2002).

    Google Scholar 

  34. Patten, J., Ishii, H.: Mechanical constraints as computational constraints in tabletop tangible interfaces. In: CHI’07 the 25th SIGCHI conference on Human factors in computing systems, pp. 809–818. ACM (2007)

    Google Scholar 

  35. Pierce, J., Stearns, B., Pausch, R.: Voodoo dolls: seamless interaction at multiple scales in virtual environments. In: I3D '99 the 1999 symposium on Interactive 3D graphics, pp. 141–145. ACM (1999)

    Google Scholar 

  36. Polson, P.G., Lewis, C., Rieman, J., Wharton, C.: Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. J. Man-Mach. Stud. 36, 5, 741–773 (1992)

    Article  Google Scholar 

  37. Piper, B., Ratti, C., Ishii, H.: Illuminating Clay: A 3-D tangible interface for landscape analysis. In: CHI’02 the 20th SIGCHI conference on Human factors in computing systems, pp. 355–362. ACM (2002)

    Google Scholar 

  38. Reuter, P., Rivière, G., Couture, N., Sorraing, N., Espinasse, L., Vergnieux, R.: ArcheoTUI – A tangible user interface for the virtual reassembly of fractured archeological objects. In: VAST2007 the 8th EuroGraphics International symposium on Virtual Reality, Archaeology and Cultural Heritage, pp. 15–22. EuroGraphics Association (2007)

    Google Scholar 

  39. Ullmer, B.: Tangible Interfaces for Manipulating Aggregates of Digital Information. PhD thesis, Massachusetts Institute of Technology (2002)

    Google Scholar 

  40. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. J. IBM Syst. 39, 3/4, 915–931 (2000)

    Article  Google Scholar 

  41. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces In: Human–Computer Interaction in the New Millennium, pp. 579–601. ACM Press/Addison-Wesley Publishing Co. (2001)

    Google Scholar 

  42. Ullmer, B., Ishii, H., Jacob, R.: Token+constraint systems for tangible interaction with digital information. J. TOCHI 12, 1, 81–118 (2005)

    Article  Google Scholar 

  43. Underkoffler, J., Ishii, H.: Urp: A luminous-tangible workbench for urban planning and design. In: CHI’99 the 17th SIGCHI conference on Human factors in computing systems, pp. 386–393. ACM (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ESTIA-RECHERCHE, Technopole Izarbel, 64210, Bidart, France

    Nadine Couture & Guillaume Rivière

  2. LaBRI, 351, cours de la Libération, 33405, Talence, France

    Guillaume Rivière & Patrick Reuter

  3. INRIA Bordeaux – Sud Ouest, 351, cours de la Libération, 33405, Talence, France

    Patrick Reuter

  4. Université Bordeaux 2, 146 rue Léo Saignat, 33076, Bordeaux, France

    Patrick Reuter

Authors
  1. Nadine Couture
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guillaume Rivière
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patrick Reuter
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nadine Couture .

Editor information

Editors and Affiliations

  1. Institut de Recherches en, Université Toulouse III, route de Narbonne 118 , Toulouse CX 4, 31062, France

    Emmanuel Dubois

  2. Dept. Computing Science, University of Glasgow, Lilybank Gdns. 17, Glasgow, G12 8QQ, United Kingdom

    Philip Gray

  3. Labo. d'Informatique de Grenoble (LIG), Université Grenoble I, rue de la Bibliotheque 385, Grenoble, 38041, France

    Laurence Nigay

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Couture, N., Rivière, G., Reuter, P. (2010). Tangible Interaction in Mixed Reality Systems. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-733-2_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-732-5

  • Online ISBN: 978-1-84882-733-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation