Abstract
Technological advances in hardware manufacturing led to an extended range of possibilities for designing physical–digital objects involved in a mixed system. Mixed systems can take various forms and include augmented reality, augmented virtuality, and tangible systems. In this very dynamic context, it is difficult to compare existing mixed systems and to systematically explore the design space. Addressing this design problem, this chapter presents a unified point of view on mixed systems by focusing on mixed objects involved in interaction, i.e., hybrid physical–digital objects straddling physical and digital worlds. Our integrating framework is made of two complementary facets of a mixed object: we define intrinsic as well as extrinsic characteristics of an object by considering its role in the interaction. Such characteristics of an object are useful for comparing existing mixed systems at a fine-grain level. The taxonomic power of these characteristics is discussed in the context of existing mixed systems from the literature. Their generative power is illustrated by considering a system, Roam, which we designed and developed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abowd, G., Coutaz, J., Nigay, L., 1992. Structuring the Space of Interactive System Properties. In Proceedings of EHCI’92, 113–130.
Bailly, G., Nigay, L., Auber, D., 2006. NAVRNA: Visualization – Exploration – Edition of RNA. In Proceedings of AVI’06, ACM Press, New York, NY, 504–507.
Beaudoin-Lafon, M., 2004. Designing Interaction, not Interfaces. In Proceedings of AVI’04, ACM Press, New York, NY, 15–22.
Benford, S. et al., 2005. Expected, Sensed, and Desired: A Framework for Designing Sensing-Based Interaction. ACM Transactions on Computer–Human Interaction, 12, 1 (March 2005), 3–30.
Bernsen, N., 1993. Taxonomy of HCI Systems: State of the Art. ESPRIT BR GRACE, Deliverable 2.1.
Buxton, W., 1983. Lexical and Pragmatic Considerations of Input Structures, Computer Graphics, 17, 1 (January 1983), 31–37.
Chin, T., Chevallet, J.-P., Coutrix, C., Lim, J., Nigay, L., You, Y., 2008. Snap2Play:A Mixed-Reality Game based on Scene Identification. In Proceedings of MMM’08, Springer-Verlag, LNCS (Lecture Notes in Computer Science), Volume 4903/2008, pp. 220–229.
Coutrix, C., Nigay, L., 2006. Mixed Reality: A Model of Mixed Interaction. In Proceedings of AVI’06, ACM Press, New York, NY, 43–50.
Coutrix, C., Nigay, L., 2008. Balancing Physical and Digital Properties in Mixed Objects. In Proceedings of AVI’08, ACM Press, New York, NY, pp. 305–308.
Dix, A., et al., 2007. Modeling Devices for Natural Interaction. In Electronic Notes in Theoretical Computer Science. FMIS 2007.
Dubois, E., Nigay, L., Troccaz, J., 2001. Consistency in Augmented Reality Systems. In Proceedings of EHCI'01, LNCS, Springer, 117–130.
Dubois, E. Gray, A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model, EIS’07.
Fishkin, K., 2004. A Taxonomy for and Analysis of Tangible Interfaces. Personal Ubiquitous Computing, 8, 5 (September 2004), 347–358.
Fitzmaurice, G., Ishii, H., Buxton, W., 1995. Bricks: Laying the foundations for Graspable User Interfaces. In Proceedings of CHI’95, ACM Press, New York, NY, 442–449.
Ishii, H., Mazalek, A., Lee, J., 2001. Bottles as a Minimal Interface to Access Digital Information. In CHI’01 Extended Abstracts, ACM Press, New York, NY, 187–188.
Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M., 2007. The reacTable: Exploring the Synergy between Live Music Performance and Tabletop Tangible Interfaces. In Proceedings of TEI’07, ACM Press, pp. 139–146.
Mackinlay, J., Card, S., Robertson, G., 1990. A Semantic Analysis of the Design Space of Input Devices, Human Computer Interaction, 5, 2&3 (1990), Lawrence Erlbaum, 145–190.
Norman, D., 1999. Affordance, Conventions and Design. Interactions, 6, 3 (May, June 1999), 38–43.
Pangaro, G., Maynes-Aminzade, D., Ishii, H., 2002. The Actuated Workbench: Computer-Controlled Actuation in Tabletop Tangible Interfaces. In Proceedings of UIST’02, ACM Press, New York, NY, 181–190.
Patten, J., Ishii, H., 2007. Mechanical Constraints as Computational Constraints in Tabletop Tangible Interfaces. In Proceedings of CHI’07, ACM Press, New York, NY, 809–818.
Shaer, O., Leland, N., Calvillo, E., Jacob, R., 2004. The TAC Paradigm: Specifying Tangible User Interfaces, Personal and Ubiquitous Computing, 8, 5 (September 2004), 359–369.
Ullmer, B., Ishii, H., 1997. The metaDESK: Models and Prototypes for Tangible User Interfaces. In Proceedings of UIST’97, ACM Press, New York, NY, 223–232.
Ullmer, B., Ishii, H., Jacob, R., 2005. Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer–Human Interaction, 12, 1 (March 2005), 81–118.
Vernier, F., Nigay, L., 2000. A Framework for the Combination and Characterization of Output Modalities. In Proceedings of DSVIS'00, LNCS, Springer, 32–48.
Wellner, P., 1993. Interacting with paper on the DigitalDesk, Communications of the ACM, 36, 7 (July 1993), 87–96.
Acknowledgments
We would like to thank the authors of the example systems for using their illustrations, Jérôme Drouin, designer, for his participation in the Roam project, and George Serghiou for reviewing the paper. The work presented in the article is partly funded by the “Plan Pluri-Formation” on Multimodal Interaction (financed by four Universities in Grenoble), by the French Research Agency under contract CARE (CulturalExperience: Augmented Reality and Emotion) – http://www.careproject.fr – and by the European Commission under contract OpenInterface (FP6-35182), http://www.oi-project.org.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London
About this chapter
Cite this chapter
Coutrix, C., Nigay, L. (2010). An Integrating Framework for Mixed Systems. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_2
Download citation
DOI: https://doi.org/10.1007/978-1-84882-733-2_2
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-732-5
Online ISBN: 978-1-84882-733-2
eBook Packages: Computer ScienceComputer Science (R0)