A Software Engineering Method for the Design of Mixed Reality Systems

  • S. Dupuy-ChessaEmail author
  • G. Godet-Bar
  • J.-L. Pérez-Medina
  • D. Rieu
  • D. Juras
Part of the Human-Computer Interaction Series book series (HCIS)


The domain of mixed reality systems is currently making decisive advances on a daily basis. However, the knowledge and know-how of HCI scientists and interaction engineers, used in the design of such systems, are not well understood. This chapter addresses this issue by proposing a software engineering method that couples a process for designing mixed reality interaction with a process for developing the functional core. Our development method features a Y-shaped development cycle that separates the description of functional requirements and their analysis from the study of technical requirements of the application. These sub-processes produce Business Objects and Interactional Objects, which are connected to produce a complete mixed reality system. The whole process is presented via a case study, with a particular emphasis on the design of the interactive solution.


Mixed reality Interaction design Model Functional core Process 



We are grateful to the Foundation “Gran Mariscal de Ayacucho, the university UCLA-Venezuela” for their financial support.


  1. 1.
    Wellner, P.: Interacting with Paper on DigitalDesk. Communications of the ACM (36)7, (1993), 87–96.CrossRefGoogle Scholar
  2. 2.
    Müller, D.: Mixed Reality Learning and Working Environments – The MARVEL Approach. In Proceedings of the 12th European Conference for Educational and Information Technology (Learntec’04), Karlsruhe, Germany (2004).Google Scholar
  3. 3.
    Troccaz, J., Lavallée, S., Cinquin, P.: Computer Augmented Surgery. Human Movement Science 15, (1996), 445–475.CrossRefGoogle Scholar
  4. 4.
    Ullmer, B., Ishii, H., Glas, D.: mediaBlocks: Physical Containers, Transports, and Controls for Online Media. In Proceedings of SIGGRAPH '98, Orlando, Florida USA, ACM Press (1998), 379–386.Google Scholar
  5. 5.
    Dubois, E., Gray, P., Nigay, L.: ASUR++: A Design Notation for Mobile Mixed Systems. Interacting with Computers 15(4), (2003), 497–520.CrossRefGoogle Scholar
  6. 6.
    Coutrix, C., Nigay, L.: Mixed reality: A Model of Mixed Interaction. In: Proceedings of the 8th International Conference on Advanced Visual Interfaces AVI'2006, Venezia, ACM Press (2006) 43–50.Google Scholar
  7. 7.
    Kulas, C., Sandor, C., Klinker, G.: Toward a Development Methodology for Augmented Reality Users Interfaces. In Dubois, E, Gray, P., Nigay, L. (eds.): Proceedings of MIXER ’04, Exploring the Design and Engineering of Mixed Reality Systems, Proceedings of the IUI-CADUI’04 Workshop on Exploring the Design and Engineering of Mixed Reality Systems, Madeira (2004).Google Scholar
  8. 8.
    Nigay, L., Salembier, P., Marchand, T., Renevier, P., Pasqualetti, L.: Mobile and Collaborative Augmented Reality: A Scenario Based Design Approach. In Paterno, F. (ed.): Proceedings of the 4th International Symposium on Mobile HCI 2002, LNCS 2411, Springer, Pisa, Italy (2002) 241–255.Google Scholar
  9. 9.
    Gauffre, G., Dubois, E., Bastide, R.: Domain Specific Methods and Tools for the Design of Advanced Interactive Techniques, 3rd Workshop on Model Driven Development of Advanced User Interfaces at MoDELS'07, Nashville, TN – USA, CEUR-WS Proceedings (2007).Google Scholar
  10. 10.
    Tarby, J.C., Barthet, M.F.: Analyse et modélisation des tâches dans la conception des systèmes d’information: la méthode Diane+. In: Analyse et conception de l’IHM, Hermès (2001) 117–144 (In French).Google Scholar
  11. 11.
    Lim, K. Y., Long, J.: The MUSE Method for Usability Engineering, Cambridge University Press, Cambridge (1994).CrossRefGoogle Scholar
  12. 12.
    Gulliksen, J., Göransson, B.: Usability Design: Integrating User-Centred Systems Design in the Systems Development Process. In Tutorial at CHI'2005, Portland, USA (2005).Google Scholar
  13. 13.
    Sousa, K., Furtado, E.: From Usability Tasks to Usable User Interfaces. In Dix, A., Dittmar, A., (eds.): TAMODIA ’05: Proceedings of the 4th International Workshop on Task Models and Diagrams, New York, USA, ACM Press (2005) 103–110.Google Scholar
  14. 14.
    Constantine, L., Biddle, R., Noble, J.: Usage-Centered Design and Software Engineering: Models for Integration. In Harning, M.B., Vanderdonckt, J., (eds.): Proceedings of the IFIP TC13 Workshop on Closing the Gaps: Software Engineering and Human-Computer Interaction. (2003)Google Scholar
  15. 15.
    Hassine, I., Rieu, D., Bounaas, F., Seghrouchni, O.: Symphony: A Conceptual Model Based on Business Components. In: SMC’02, IEEE International Conference on Systems, Man, and Cybernetics. Volume 2. (2002)Google Scholar
  16. 16.
    Jacobson, I., Booch, G., Rumbaugh, J.: The Unified Software Development Process, Addison-Wesley, Reading, MA (1999).Google Scholar
  17. 17.
    Paterno, F.: ConcurTaskTrees: An Engineered Notation for Task Models. In: The Handbook of Task Analysis for Human-Computer Interaction, Lawrence Erlbaum Associates, Mahwah, NJ (2003) pp. 483–503.Google Scholar
  18. 18.
    Godet-Bar, G., Rieu, D., Dupuy-Chessa, S., Juras, D.: Interactional Objects: HCI Concerns In the Analysis Phase of the Symphony Method, Proceedings of the 9th International Conference on Enterprise Information System (ICEIS’2007), Madeira (2007).Google Scholar
  19. 19.
    Roques, P., Vallée, F.: UML2 en action, de l’analyse des besoins à la conception J2EE, collection Architecte Logiciel, Eyrolle, 2004 (In French).Google Scholar
  20. 20.
    Godet-Bar, G., Dupuy-Chessa, S., Rieu, D.: When interaction choices trigger business evolution, 20th International Conference on Advanced Information Systems Engineering (CAiSE'08), LNCS 5074, Springer, Montpellier, France, 16–20 June 2008, pp. 144–147.Google Scholar
  21. 21.
    Buschmann, F., Meunier, R., Rohnert, H., Sommerlad, P., Stal, M.: Pattern-Oriented Software Architecture – A System of Patterns. John Wiley and Sons, Chichester (1996).Google Scholar
  22. 22.
    Maclean, A., Young, R.M., Bellotti, V.M.E, Moran, T.P.: Questions, Options and Criteria: Element of Design Space Analysis. Human-Computer Interaction 6(3), (1991), 201–250.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2010

Authors and Affiliations

  • S. Dupuy-Chessa
    • 1
    Email author
  • G. Godet-Bar
    • 2
  • J.-L. Pérez-Medina
    • 2
  • D. Rieu
    • 2
  • D. Juras
    • 2
  1. 1.Laboratory of Informatics of GrenobleGrenoble UniversitéGrenoble Cedex 9France
  2. 2.Laboratory of Informatics of GrenobleGrenoble UniversitéGrenoble Cedex 9France

Personalised recommendations