Modelling and Analysing Mixed Reality Applications

  • Johan Arcile
  • Tadeusz Czachórski
  • Raymond Devillers
  • Jean-Yves Didier
  • Hanna KlaudelEmail author
  • Artur Rataj
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 391)


Mixed reality systems overlay real data with virtual information in order to assist users in their current task. They generally combine several hardware components operating at different time scales, and software that has to cope with these timing constraints. MIRELA, for MIxed REality LAnguage, is a framework aimed at modelling, analysing and implementing systems composed of sensors, processing units, shared memories and rendering loops, communicating in a well-defined manner and submitted to timing constraints. The framework is composed of (i) a language allowing a high level, and partially abstract, specification of a concurrent real–time system, (ii) the corresponding semantics, which defines the translation of the system to concrete networks of timed automata, (iii) a methodology for analysing various real-time properties, and (iv) an implementation strategy. We present here a summary of several of our papers about this framework, as well as some recent extensions concerning probability and non–deterministic choices.


Mixed reality Timed automata Deadlocks Temporal properties 



This work has been partly supported by French ANR project Synbiotic and Polish-French project Polonium.


  1. 1.
    Alur, R., Dill, D.L.: Automata for modeling real-time systems. Automata, Languages and Programming. LNCS, vol. 443, pp. 322–335. Springer, Berlin (1990)CrossRefGoogle Scholar
  2. 2.
    Alur, R., Dill, D.L.: The theory of timed automata. In: de Bakker, J.W., Huizing, C., de Roever, W.P., Rozenberg, G. (eds.) Real Time: Theory in Practice. LNCS, vol. 600, pp. 45–73. Springer, Berlin (1991)CrossRefGoogle Scholar
  3. 3.
    Alur, R., Dill, D.L.: A theory of timed automata. Theor. Comput. Sci. 126(2), 183–235 (1994)zbMATHMathSciNetCrossRefGoogle Scholar
  4. 4.
    Arcile, J., Didier, J.Y., Klaudel, H., Devillers, R., Rataj, A.: Analysis of real-time properties of mixed reality applications. Submitted paper (2015)Google Scholar
  5. 5.
    Arcile, J., Didier, J.Y., Klaudel, H., Devillers, R., Rataj, A.: Indefinite Waitings in MIRELA systems. In: ESSS 2015. pp. 5–18. Oslo, Norway (2015)Google Scholar
  6. 6.
    Chouiten, M., Domingues, C., Didier, J.Y., Otmane, S., Mallem, M.: Distributed mixed reality for remote underwater telerobotics exploration. In: VRIC 2012. pp. 1:1–1:6. Laval, France (2012)Google Scholar
  7. 7.
    Devillers, R., Didier, J.Y., Klaudel, H.: Implementing timed automata specifications: the “Sandwich” approach. In: ACSD 2013. pp. 226–235. Barcelona, Spain (2013)Google Scholar
  8. 8.
    Didier, J.Y., Djafri, B., Klaudel, H.: The MIRELA framework: modeling and analyzing mixed reality applications using timed automata. J. Virtual Real. Broadcast. 6(1) (2009)Google Scholar
  9. 9.
    Didier, J.Y., Klaudel, H., Moine, M., Devillers, R.: An improved approach to build safer mixed reality systems by analysing time constraints. In: JVRC 2013 (2013)Google Scholar
  10. 10.
    Figueroa, P., Bischof, W.F., Boulanger, P., Hoover, H.J., Taylor, R.: Intml: a dataflow oriented development system for virtual reality applications. Presence: Teleoperators Virtual Environ. 17(5), 492–511 (2008)CrossRefGoogle Scholar
  11. 11.
    Figueroa, P., Hoover, J., Boulanger, P.: Intml concepts. Technical Report, University of Alberta, Edmonton, Canada (2004)Google Scholar
  12. 12.
    Kwiatkowska, M., Norman, G., Parker, D.: Probabilistic symbolic model checking with PRISM: a hybrid approach. Int. J. Softw. Tools Technol. Transf. 6(2), 128–142 (2004)CrossRefGoogle Scholar
  13. 13.
    Latoschik, M.E.: Designing transition networks for multimodal VR-interactions using a markup language. In: ICMI 2002. p. 411. Pittsburgh, USA (2002)Google Scholar
  14. 14.
    Moine, M.: Implementation tool of Timed Automata specifications. Master’s thesis, ENSIIE - Université d’Evry-val d’Essonne (2013)Google Scholar
  15. 15.
    Navarre, D., Palanque, P., Bastide, R., Schyn, A., Winckler, M., Nedel, L.P., Freitas, C.M.: A formal description of multimodal interaction techniques for immersive virtual reality applications. In: Costabile, M.F., Paternó, F. (eds.) Human-Computer Interaction–INTERACT 2005, pp. 170–183. LNCS, Springer, Berlin Heidelberg (2005)Google Scholar
  16. 16.
    Rataj, A., Wozna, B., Zbrzezny, A.: A Translator of Java Programs to TADDs. Fundamenta Informaticae 93(1–3), 305–324 (2009)zbMATHMathSciNetGoogle Scholar
  17. 17.
    Sandor, C., Reicher, T.: CUIML: A Language for the Generation of Multimodal Human-Computer Interfaces. In: UIML 2001. vol. 124 (2001)Google Scholar
  18. 18.
    Uppsala Universitet: Uppaal,
  19. 19.
    Waez, M.T.B., Dingel, J., Rudie, K.: Timed automata for the development of real-time systems. Research Report 2011–579, Queen’s University, Kingston, Canada (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Johan Arcile
    • 1
  • Tadeusz Czachórski
    • 3
  • Raymond Devillers
    • 2
  • Jean-Yves Didier
    • 1
  • Hanna Klaudel
    • 1
    Email author
  • Artur Rataj
    • 3
  1. 1.Laboratoire IBISCUniversité d’Evry-Val d’EssonneÉvryFrance
  2. 2.Département d’InformatiqueUniversité Libre de BruxellesBrusselsBelgium
  3. 3.Institute of Theoretical and Applied Computer ScienceGliwicePoland

Personalised recommendations