Advertisement

Tangible Interaction in Mixed Reality Systems

  • Nadine Couture
  • Guillaume Rivière
  • Patrick Reuter
Chapter
Part of the Human-Computer Interaction Series book series (HCIS)

Abstract

In this chapter, we discuss the design of tangible interaction techniques for mixed reality environments. We begin by recalling some conceptual models of tangible interaction. Then, we propose an engineering-oriented software/hardware co-design process, based on our experience in developing tangible user interfaces. We present three different tangible user interfaces for real-world applications and analyze the feedback from the user studies that we conducted. In summary, we conclude that since tangible user interfaces are part of the real world and provide a seamless interaction with virtual words, they are well adapted to mix together reality and virtuality. Hence, tangible interaction optimizes users’ virtual tasks, especially in manipulating and controlling 3D digital data in 3D space.

Keywords

Tangible user interface Augmented virtuality Design process Case studies 

References

  1. 1.
    Bailly, G., Nigay, L., Auber, D.: 2 M: Un espace de conception pour l’interaction bi-manuelle. In: UbiMob’05 the 2nd French-speaking conference on Mobility and ubiquitous computing, pp. 177–184. ACM (2005)Google Scholar
  2. 2.
    Balakrishnan, R., Fitzmaurice, G., Kurtenbach, G., Singh, K.: Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In I3D '99 the 1999 symposium on Interactive 3D graphics, pp. 111–118. ACM (1999)Google Scholar
  3. 3.
    Beaudoin-Lafon, M.: Instrumental interaction: An interaction model for designing post-WIMP user interfaces. In: CHI’00 the 18th SIGCHI conference on Human factors in computing systems, pp. 446–453. ACM (2000)Google Scholar
  4. 4.
    Boothroyd, G., Dewhurst, P.: Product Design for Assembly – A Designer’s Handbook. Department of Mechanical Engineering, University of Massachusetts (1993)Google Scholar
  5. 5.
    Calvary, G., Daassi, O., Coutaz, J., Demeure, A.: Des widgets aux comets pour la Plasticité des Systèmes Interactifs. J. RIHM Revue d’Interaction Homme-Machine. 6, 1, 33–53 (2005)Google Scholar
  6. 6.
    Coelho, M., Ishii, H., Maes, P.: Surflex: A programmable surface for the design of tangible interfaces. In: CHI’08 extended abstracts of the 26th SIGCHI conference on Human factors in computing systems, pp. 3429–3434. ACM (2008)Google Scholar
  7. 7.
    Coelho, M., Maes, P.: Sprout I/O: A texturally rich interface. In: TEI’08 the 2nd international conference on Tangible and embedded interaction, pp. 221–222. ACM (2008)Google Scholar
  8. 8.
    Coutrix, C., Nigay, L.: Mixed reality: A model of mixed interaction. In: AVI’06 the 8th International Working Conference on Advanced Visual Interfaces, pp. 43–50. ACM (2006)Google Scholar
  9. 9.
    Couture, N., Minel, S.: TactiMod dirige et oriente un piéton. In: UbiMob '06 the 3rd French-speaking conference on Mobility and Ubiquitous computing, pp. 9–16. ACM (2006)Google Scholar
  10. 10.
    Couture, N., Rivière, G., Reuter, P.: GeoTUI: A tangible user interface for geoscience. In: TEI’08 the 2nd international conference on Tangible and Embedded Interaction, pp. 89–96. ACM (2008)Google Scholar
  11. 11.
    Fishkin, K.: A taxonomy for and analysis of tangible interfaces. J. PUC Personal Ubiquitous Comput. 8, 5, 347–358 (2004)Google Scholar
  12. 12.
    Fitzmaurice, G.: Graspable User Interfaces. PhD thesis, University of Toronto (1996)Google Scholar
  13. 13.
    Fitzmaurice, G., Buxton, W.: An empirical evaluation of graspable user interfaces: Towards specialized space-multiplexed input. In: CHI’97 the 15th SIGCHI conference on Human factors in computing systems, pp. 43–50. ACM Press (1997)Google Scholar
  14. 14.
    Fitzmaurice, G., Ishii, H., Buxton, W.: Bricks: Laying the foundations for graspable user interfaces. In: CHI’95 the 13th SIGCHI conference on Human factors in computing systems, pp. 442–449. ACM Press/Addison-Wesley Publishing Co (1995)Google Scholar
  15. 15.
    Gabriel, R., Sandsjö, J., Shahrokni, A., Fjeld, M.: BounceSlider: Actuated sliders for music performance and composition. In: TEI’08 the 2nd international conference on Tangible and embedded interaction, pp. 127–130. ACM (2008)Google Scholar
  16. 16.
    Garreau, L., Legardeur, J., Rouillon-Couture, N.: Une plate-forme basée sur les interfaces tangibles pour l‘assemblage en CFAO. J. Ingénierie Numérique, Interaction Homme-Machine et CAO. 1, 2, 133–148. Lavoisier-Hermes (2005)Google Scholar
  17. 17.
    Guiard, Y.: Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behavior. 19, 486–517 (1987)Google Scholar
  18. 18.
    Hartson, H.R., Siochi, A.C., Hix, D.: The UAN: A user-oriented representation for direct manipulation interface designs. J. TOIS ACM Trans. Inf. Syst. 8, 3, 181–203 (1990)CrossRefGoogle Scholar
  19. 19.
    Hinckley, K., Pausch, R., Goble, J., Kassell, N.: Passive real-world interface props for neurosurgical visualization. In: CHI’94 the 12th SIGCHI conference on Human factors in computing systems, pp. 452–458. ACM (1994)Google Scholar
  20. 20.
    Ishii, H.: Tangible bits: Beyond pixels. In: TEI’08 the 2nd International Conference on Tangible and Embedded Interaction, pp. XV–XXV. ACM Press (2008)Google Scholar
  21. 21.
    Ishii, H., Ren, S., Frei, P.: Pinwheels: Visualizing information flow in an architectural space. In: CHI’01 extended abstracts of the 19th SIGCHI conference Human factors in computing systems, pp. 111–112. ACM (2001)Google Scholar
  22. 22.
    Ishii, H., Ullmer, B.: Tangible bits: Towards seamless interfaces between people, bits and atoms. In: CHI’97 the 15th SIGCHI conference on Human factors in computing systems, pp. 234–241. ACM (1997)Google Scholar
  23. 23.
    Jurado, F., Sinoquet, D., Lailly, P.: Jerry: A 3D reflection tomography designed for complex structures. Technical report, KIM 1996 Annual Report, Institut Français du Pétrole (1996)Google Scholar
  24. 24.
    Kabbash, P., Buxton, W., Sellen, A.: Two-handed input in a compound task. In: CHI '94 the 12th SIGCHI conference on Human factors in computing systems, pp. 417–423. ACM (1994)Google Scholar
  25. 25.
    Kitamura, Y., Itoh, Y., Kishino, F.: ActiveCube: A Bi-directional user interface using Cubes. In: CHI’01 extended abstracts of the 19th SIGCHI conference on Human factors in computing systems, pp. 355–356. ACM (2001)Google Scholar
  26. 26.
    Leganchuk, A., Zhai, S., Buxton, W.: Manual and cognitive benefits of two-handed input: An experimental study. J. TOCHI. 5, 4, 326–359 (1998)CrossRefGoogle Scholar
  27. 27.
    Legardeur, J., Garreau, L., Couture, N.: Experiments to evolve toward a tangible user interface for CAD parts assembly. In: SPIE'04 Electronic Imaging'04, pp. 438–445. SPIE (2004)Google Scholar
  28. 28.
    Llamas, I., Kim, B., Gargus, J., Rossignac, J,. Shaw, C.: Twister: A space-warp operator for the two-handed editing of 3D shapes. In: SIGGRAPH '03: ACM SIGGRAPH 2003 Papers, pp. 663–668. ACM (2003)Google Scholar
  29. 29.
    Mazzone, A., Spagno, C., Kunz, A.: The HoverMesh: A deformable structure based on vacuum cells: New advances in the research of tangible user interfaces. In: ACE’04 the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, pp. 187–193. ACM (2004)Google Scholar
  30. 30.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. J. IEICE Trans. Inf. Syst. E77-D, 12, 1321–1329 (1994)Google Scholar
  31. 31.
    Norman, D.: The Psychology of Everyday Things. Basic Books, New York (1988)Google Scholar
  32. 32.
    Norman, D.: Affordance, conventions, and design. J. Interactions. 6, 3, 38–43 (1999)CrossRefGoogle Scholar
  33. 33.
    Pangaro, G., Maynes-Aminzade, D., Ishii, H.: The actuated workbench: Computer-controlled actuation in tabletop tangible interfaces. In: UIST’02 the 15th annual ACM symposium on User Interface Software and Technology, pp. 181–190. ACM (2002).Google Scholar
  34. 34.
    Patten, J., Ishii, H.: Mechanical constraints as computational constraints in tabletop tangible interfaces. In: CHI’07 the 25th SIGCHI conference on Human factors in computing systems, pp. 809–818. ACM (2007)Google Scholar
  35. 35.
    Pierce, J., Stearns, B., Pausch, R.: Voodoo dolls: seamless interaction at multiple scales in virtual environments. In: I3D '99 the 1999 symposium on Interactive 3D graphics, pp. 141–145. ACM (1999)Google Scholar
  36. 36.
    Polson, P.G., Lewis, C., Rieman, J., Wharton, C.: Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. J. Man-Mach. Stud. 36, 5, 741–773 (1992)CrossRefGoogle Scholar
  37. 37.
    Piper, B., Ratti, C., Ishii, H.: Illuminating Clay: A 3-D tangible interface for landscape analysis. In: CHI’02 the 20th SIGCHI conference on Human factors in computing systems, pp. 355–362. ACM (2002)Google Scholar
  38. 38.
    Reuter, P., Rivière, G., Couture, N., Sorraing, N., Espinasse, L., Vergnieux, R.: ArcheoTUI – A tangible user interface for the virtual reassembly of fractured archeological objects. In: VAST2007 the 8th EuroGraphics International symposium on Virtual Reality, Archaeology and Cultural Heritage, pp. 15–22. EuroGraphics Association (2007)Google Scholar
  39. 39.
    Ullmer, B.: Tangible Interfaces for Manipulating Aggregates of Digital Information. PhD thesis, Massachusetts Institute of Technology (2002)Google Scholar
  40. 40.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. J. IBM Syst. 39, 3/4, 915–931 (2000)CrossRefGoogle Scholar
  41. 41.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces In: Human–Computer Interaction in the New Millennium, pp. 579–601. ACM Press/Addison-Wesley Publishing Co. (2001)Google Scholar
  42. 42.
    Ullmer, B., Ishii, H., Jacob, R.: Token+constraint systems for tangible interaction with digital information. J. TOCHI 12, 1, 81–118 (2005)CrossRefGoogle Scholar
  43. 43.
    Underkoffler, J., Ishii, H.: Urp: A luminous-tangible workbench for urban planning and design. In: CHI’99 the 17th SIGCHI conference on Human factors in computing systems, pp. 386–393. ACM (1999)Google Scholar

Copyright information

© Springer-Verlag London 2010

Authors and Affiliations

  • Nadine Couture
    • 1
  • Guillaume Rivière
    • 1
    • 2
  • Patrick Reuter
    • 2
    • 3
    • 4
  1. 1.ESTIA-RECHERCHE, Technopole IzarbelBidartFrance
  2. 2.LaBRITalenceFrance
  3. 3.INRIA Bordeaux – Sud OuestTalenceFrance
  4. 4.Université Bordeaux 2BordeauxFrance

Personalised recommendations