Skip to main content

Developing Mixed Interactive Systems: A Model-Based Process for Generating and Managing Design Solutions

  • Chapter
  • First Online:
The Engineering of Mixed Reality Systems

Abstract

Taking advantage of the physical objects surrounding the user and the human ability to manipulate them fosters the development of multiple, new and advanced interaction techniques, called mixed interactive systems (MIS). Much work has been done to address specific aspects of the development of MIS. However, there is still no unifying conceptual framework to link these contributions and that presents a global approach for the development of MIS. In this context, this chapter presents a domain-specific development process that goes beyond ad hoc approaches and attempts to overcome barriers between different types of developer expertise, through a set of connections between steps of the MIS development process. Furthermore, to facilitate iteration in the design, these connections are observable, thus allowing a designer to review their decisions. The development process is illustrated via a concrete museum application.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arduino: http://www.arduino.cc/, last access 2008/10/24.

  2. Charfi S, Dubois E, Bastide R (2007) Articulating interaction and task models for the design of advanced interactive systems, TAMODIA, France: Springer, Berlin, pp. 70–83.

    Google Scholar 

  3. Cheung D F W, Tigli J Y, Lavirotte S, Riveill M (2006) WComp: A multi-design approach for prototyping applications using heterogeneous resources. In Proceedings of the 17th IEEE International Workshop on Rapid System Prototyping, Crete, pp. 119–125.

    Google Scholar 

  4. Cladistics Definition: http://en.wikipedia.org/wiki/Cladistic, last access 2008/10/24.

  5. Coutrix C, Nigay L (2006) Mixed reality: A model of mixed interaction. In Proceedings of the Working Conference on Advanced Visual interfaces (Venezia, Italy, May 23–26, 2006). AVI '06. ACM, New York, NY, pp. 43–50.

    Google Scholar 

  6. Delotte O, David B, Chalon R (2004) Task modelling for capillary collaborative systems based on scenarios. In Proceedings of TAMODIA'04. ACM Press, NY, pp. 25–31.

    Google Scholar 

  7. Dubois E, Gray P D (2007) A design-oriented information-flow refinement of the ASUR interaction model, engineering interactive systems (EHCI-HCSE-DSVIS), Spain.

    Google Scholar 

  8. Eclipse Modeling Project, http://www.eclipse.org/modeling/, last access 2008/11/02.

  9. Fishkin K P (2004) A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing, 8 (5): Springer-Verlag, 347–358.

    Article  Google Scholar 

  10. Gauffre G, Dubois E, Bastide R (2008) Domain-specific methods and tools for the design of advanced interactive techniques. In: H. Giese (Ed.): MoDELS 2007 Workshops, LNCS 5002, Springer, Heidelberg, pp. 65–76.

    Google Scholar 

  11. Gandy M, MacIntyre B, Dow S (2004) Making tracking technology accessible in a rapid prototyping environment. In Proceedings of the 3rd IEEE/ACM international Symposium on Mixed and Augmented Reality (November 2–5, 2004). Symposium on Mixed and Augmented Reality. IEEE Computer Society, Washington DC, pp. 282–283.

    Google Scholar 

  12. Gram C, Cockton G (1997) Design principles for interactive software. Chapman & Hall, Ltd., London, UK.

    Google Scholar 

  13. Greenberg S, Fitchett C (2001). Phidgets: Easy development of physical interfaces through physical widgets. In Proceedings of the ACM Symposium on UIST, USA, ACM, New York, NY, pp. 209–218.

    Google Scholar 

  14. Herbst I., Braun A, McCall R, Broll W (2008) TimeWarp: Interactive time travel with a mobile mixed reality game. In Proceedings of the ACM Conference on Mobile HCI, The Netherlands, pp. 235–244.

    Google Scholar 

  15. Hilliges O, Sandor C, Klinker G (2006) Interactive prototyping for ubiquitous augmented reality user interfaces. Proceedings of the 11th international conference on Intelligent user interfaces, ACM.

    Google Scholar 

  16. Jacob R J, Girouard A, Hirshfield L M, Horn M S, Shaer O, Solovey E T, Zigelbaum J (2008) Reality-based interaction: A framework for Post-WIMP interfaces. In Proceedings of the ACM conference on CHI’08, Italy, ACM, New York, pp. 201–210.

    Google Scholar 

  17. Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In Proceedings of the 2nd International Workshop on Augmented Reality (IWAR 99). October, San Francisco, USA.

    Google Scholar 

  18. Klemmer S R, Hartmann B, Takayama L (2006) How bodies matter: Five themes for interaction design. In Proceedings of the 6th Conference on Designing interactive Systems (University Park, PA, June 26–28, 2006). DIS '06. ACM, New York, NY, pp. 140–149.

    Google Scholar 

  19. Klug T, Mülhauser M (2007) Modeling human interaction resources to support the design of wearable multimodal systems, in Proceedings of the ACM Conference on ICMI’07, Japan, pp. 299–306.

    Google Scholar 

  20. Krasner G E, Pope T (1988) A cookbook for using the model-view-controller user interface paradigm in Smalltalk-80. Journal of Object Oriented Programming, 1 (3): 26–49.

    Google Scholar 

  21. Kurtev I, Bézivin J, Jouault F, Valduriez P (2006) Model-Based DSL Frameworks. In Proceedings of OOPSLA '06. ACM, NY, pp. 602–616.

    Google Scholar 

  22. Liarokapis F, White M, Lister P (2004) Augmented reality interface toolkit. In Proceedings of the information Visualisation, Eighth international Conference (July 14–16, 2004). IV. IEEE Computer Society, Washington, DC, pp. 761–767.

    Google Scholar 

  23. MacIntyre B, Gandy M, Dow S, Bolter J D (2004) DART: A Toolkit for rapid design exploration of augmented reality experiences. In Proceedings of the ACM Symposium on UIST’04, USA, ACM, New York, pp. 197–206.

    Google Scholar 

  24. Nigay L, Coutaz J (1997) Software architecture modelling: Bridging two worlds using ergonomics and software properties. In P. Palanque and F. Paterno (Eds.) Formal methods in human–computer interaction, Springer-Verlag, Berlin, pp. 49–73.

    Google Scholar 

  25. Oda O, Lister L J, White S, Feiner S (2008) Developing an augmented reality racing game. In Proceedings of the 2nd international Conference on intelligent Technologies For interactive Entertainment, Mexico, pp. 1–8.

    Google Scholar 

  26. Protégé Tool, http://protege.stanford.edu/, last access 2008/11/02.

  27. Renevier P, Nigay L, Bouchet J, Pasqualetti L (2004) Generic interaction techniques for mobile collaborative mixed systems. In Proceedings of CADUI'04. ACM, NY, pp. 307–320.

    Google Scholar 

  28. Scapin D L (2007) K-MADe, COST294-MAUSE 3rd International Workshop, Review, Report and Refine Usability Evaluation Methods (R3 UEMs) Athens, March 5.

    Google Scholar 

  29. Schmalstieg D, Fuhrmann A, Hesina G, Szalavári Z, Encarnaçäo L M, Gervautz M, Purgathofer W (2002) The Studierstube augmented reality project. Presence: Teleoperators and Virtual Environments 11(1): (February 2002), 33–54.

    Article  Google Scholar 

  30. Schmalstieg D, Wagner D (2007) Experiences with handheld augmented reality, 6th IEEE and ACM International Symposium on ISMAR 2007, Japan, pp. 3–18.

    Google Scholar 

  31. Schmidt D C (2006) Guest editor’s introduction: model-driven engineering. Computer, 39(2): 25–31, February.

    Article  Google Scholar 

  32. Shaer O, Leland N, Calvillo-Gamez E H, Jacob R J K (2004) The TAC paradigm: specifying tangible user interfaces. Personal and Ubiquitous Computing 8, 359–369.

    Article  Google Scholar 

  33. Smith S P (2006) Exploring the specification of haptic interaction. In 13th International Workshop, DSVIS 2006, Ireland, LNCS vol. 4323, Springer, Berlin, pp. 171–184.

    Google Scholar 

  34. UML Profile Specifications, http://www.omg.org/technology/documents/profile_catalog.htm, last access 2008/11/02.

Download references

Acknowledgments

This work has been done as part of a collaboration with the Museum of Toulouse. The authors wish to thank F. Duranthon for the Museum’s involvement in the definition of the case study and subsequent design solutions. The work presented in the article is partly funded by the French Research Agency under contract CARE (Cultural experience: Augmented Reality and Emotion) – http://www.careproject.fr

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guillaume Gauffre .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Gauffre, G., Charfi, S., Bortolaso, C., Bach, C., Dubois, E. (2010). Developing Mixed Interactive Systems: A Model-Based Process for Generating and Managing Design Solutions. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-733-2_10

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-732-5

  • Online ISBN: 978-1-84882-733-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics