Very-High-Fidelity Prototyping for Both Presentation and Dialogue Parts of Multimodal Interactive Systems

  • David Navarre
  • Pierre Dragicevic
  • Philippe Palanque
  • Rémi Bastide
  • Amélie Schyn
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3425)


This paper presents a tool suite (made up of two previously unrelated approaches) for the engineering of multimodal Post-WIMP Interactive Systems. The first element of this integration is ICOM (a data-flow model dedicated to low-level input modelling) and its environment ICON which allows for editing and simulating ICOM models. The other element is ICOs (a formal description technique mainly dedicated to dialogue modelling) and its environment PetShop which allows for editing, simulating and verifying ICOs models. This paper shows how these two approaches have been integrated and how they support multimodal interactive systems engineering. We show on a classical rubber banding case study how these tools can be used for prototyping interactive systems. We also present in details how the changes in the interaction techniques impact the models at various levels of the software architecture.


Interactive Systems Engineering Multimodal interaction Prototyping CASE tools Formal methods formal description techniques Post-WIMP 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bass, L., Little, R., Pellegrino, R., Reed, S., Seacord, R., Sheppard, S., Szezur, M.R.: The Arch Model: Seeheim Revisited. In: User Interface Developpers’ Workshop. Version 1.0 (1991)Google Scholar
  2. 2.
    Bastide, R., Palanque, P.: A Petri-Net Based Environment for the Design of Event-Driven Interfaces. In: DeMichelis, G., Díaz, M. (eds.) ICATPN 1995. LNCS, vol. 935, pp. 66–83. Springer, Heidelberg (1995)Google Scholar
  3. 3.
    Bastide, R., Palanque, P., Le Duc, H., Muńoz, J.: Integrating Rendering Specifications into a Formalism for the Design of Interactive Systems. In: Proceedings of the 5th Eurographics Workshop on Design, Specification and Verification of Interactive systems DSV-IS 1998, Springer, Heidelberg (1998)Google Scholar
  4. 4.
    Bastide, R., Sy, O., Palanque, P., Navarre, D.: Formal specification of CORBA services: experience and lessons learned. In: ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA 2000), ACM SIGPLAN Notices, Minneapolis, Minnesota USA, vol. 35 (10), pp. 105–117. ACM Press, New York (2000)Google Scholar
  5. 5.
    Berry, G.: The Esterel v5 language primer. Technical report (April 1999),
  6. 6.
    Coutaz, J., Paterno, F., Faconti, G., Nigay, L.: A Comparison of Approaches for Specifying MultiModal Interactive Systems. In: Proceedings of the ERCIM Workshop on Multimodal Human-Computer Interaction, pp. 165–174 (1993)Google Scholar
  7. 7.
    Dragicevic, P., Fekete, J.-D.: Input Device Selection and Interaction Configuration with ICON. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds.) Proceedings of IHM-HCI 2001, People and Computers XV - Interaction without Frontiers, Lille, France, Lille, France, pp. 543–548. Springer, Heidelberg (2001)Google Scholar
  8. 8.
    Dragicevic, P., Fekete, J.-D.: ICON: Input Device Selection and Interaction Configuration. In: Companion Proceedings of UIST 2002. 15th Annual Symposium on User Interface Software and Technology, Paris (October 2002)Google Scholar
  9. 9.
    Dragicevic, P., Fekete, J.-D.: ICON: Towards High Input Adaptability of Interactive Applications. Internal Report 04/01/INFO, Ecole des Mines de Nantes, Nantes, France (2004)Google Scholar
  10. 10.
    Esteban, O., Chatty, S., Palanque, P.: Whizz’Ed: a visual environment for building highly interactive interfaces. In: Proceedings of the Interact 1995 Conference, pp. 121–126 (1995)Google Scholar
  11. 11.
    Genrich, H.J.: Predicate/Transition Nets. In: Jensen, K., Rozenberg, G. (eds.) High-Level Petri Nets: Theory and Application, pp. 3–43. Springer, BerlinGoogle Scholar
  12. 12.
    Halbwachs, N., Caspi, P., Raymond, P., Pilaud, D.: The synchronous data-flow programming language LUSTRE. Proceedings of the IEEE 79 (September 1991)Google Scholar
  13. 13.
    Hinckley, K., Czerwinski, M., Sinclair, M.: Interaction and Modeling Techniques for Desktop Two-Handed Input. In: ACM UIST 1998 Symposium on User Interface Software & Technology, pp. 49–58 (1998)Google Scholar
  14. 14.
    Navarre, D., Palanque, P., Bastide, R., Sy, O.: Structuring Interactive Systems Specifications for Executability and Prototypability. In: Palanque, P., Paternó, F. (eds.) DSV-IS 2000. LNCS, vol. 1946, p. 97. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  15. 15.
    OMG. The Common Object Request Broker: Architecture and Specification. CORBA IIOP 2.2 /98-02-01, Framingham, MA (1998)Google Scholar
  16. 16.
    Palanque, P., Schyn, A.: A Model-Based Approach for Engineering Multimodal Interactive Systems. In: INTERACT 2003, IFIP TC 13 Conference on Human Computer Interaction (2003)Google Scholar
  17. 17.
    Wieting, R.: Hybrid High-Level Nets. In: Proceedings of the 1996 Winter Simulation Conference, pp. 848–855. ACM Press, New York (1996)Google Scholar
  18. 18.
    Willans, J.S., Harrison, M.D.: Prototyping pre-implementation designs of virtual environment behaviour. In: Nigay, L., Little, M.R. (eds.) EHCI 2001. LNCS, vol. 2254, p. 91. Springer, Heidelberg (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • David Navarre
    • 1
  • Pierre Dragicevic
    • 1
  • Philippe Palanque
    • 1
  • Rémi Bastide
    • 1
  • Amélie Schyn
    • 1
  1. 1.LIIHS-IRITUniversité Paul SabatierToulouse CedexFrance

Personalised recommendations