The MSM framework: A design space for Multi-Sensori-Motor systems

  • Joëlle Coutaz
  • Laurence Nigay
  • Daniel Salber
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 753)


One of the new design goals in Human Computer Interaction is to extend the sensory-motor capabilities of computer systems to better match the natural communication means of human beings. This article proposes a dimension space that should help reasoning about current and future Multi-Sensori-Motor systems (MSM). To do so, we adopt a system centered perspective although we draw upon the “Interacting Cognitive Subsystems” psychological model. Our problem space is comprised of 6 dimensions. The first two dimensions deal with the notion of communication channel: the number and direction of the channels that a particular MSM system supports. The other four dimensions are used to characterize the degree of built-in cognitive sophistication of the system: levels of abstraction, context, fusion/fission, and granularity of concurrency. We illustrate the discussion with examples of multimedia and multimodal systems, both MSM systems but with distinct degrees of built-in cognitive sophistication.


Communication Channel Physical Level Task Level Interpretation Function Multimodal System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    S. Balbo, J. Coutaz, D. Salber: Towards Automatic Evaluation of Multimodal User Interfaces; International Workshop on Intelligent User Interfaces, Orlando, USA, Jan., 1993.Google Scholar
  2. 2.
    P. Barnard, “Cognitive Resources and the Learning of Computer Dialogs”, in Interfacing Thought, Cognitive aspects of Human Computer Interaction, J.M. Carroll Ed., MIT Press Publ., pp. 112–158.Google Scholar
  3. 3.
    L. Bass, J. Coutaz: Developing Software for the User Interface; Addison Wesley, 1991.Google Scholar
  4. 4.
    E. Bier, S. Freeman, K. Pier, “MMM: The Multi-Device Multi-User Multi-Editor”, in CHI'92 Proceedings, 1992, pp. 645–646.Google Scholar
  5. 5.
    M.L. Bourguet, J. Caelen: Interfaces Homme-Machine Multimodales: gestion des événements et représentation des informations; ERGO-IA'92 Proceedings, pp. 124–134, 1992.Google Scholar
  6. 6.
    M.L. Bourguet: Conception et réalisation d'une interface de dialogue personnemachine multimodales; Thèse de docteur de lTNPG, mars 1992.Google Scholar
  7. 7.
    J. Conklin, “Hypertext, an Introduction and Survey”, IEEE Computer, 20(9), September, 1987, 17–41.Google Scholar
  8. 8.
    J. Coutaz, S. Balbo: Applications: A Dimension Space for User Interface Management Systems. In Proc. CHI'91, ACM Publ., May, 1991, pp. 27–32.Google Scholar
  9. 9.
    Multimedia and Multimodal User Interfaces: A Taxonomy for Software Engineering Research Issues, East-West HCI'92, St Petersburg, August, 1992., August, 1992.Google Scholar
  10. 10.
    D. Duke, M. Harrison: Abstract Models for Interaction Objects; ESPRIT BR 7040 Amodeus Project document, System Modelling/WP1, Nov. 1992.Google Scholar
  11. 11.
    S.S. Fels, “Building Adaptative Interfaces with Neural Networks: the Glove-Talk Pilot Study”, University of Toronto, Technical Report, CRG-TR-90-1, February, 1990.Google Scholar
  12. 12.
    J. Neal, C. Thielman, K. Bettinger, J. Byoun, “Multi-modal References in Human-Computer Dialogue”, Proceedings of AAAI-88, 1988, pp. 819–823.Google Scholar
  13. 13.
    L. Nigay, J. Coutaz: A design space for multimodal interfaces: concurrent processing and data fusion, Interchi'93, Amsterdam, May, 1993.Google Scholar
  14. 14.
    M. W. Salisbury, J. H. Hendrickson, T. L. Lammers, C. Fu, S. A. Moody, “Talk and Draw: Bundling Speech and Graphics”, IEEE Computer, 23(8), August, 1990, 59–65.Google Scholar
  15. 15.
    C. Schmandt, M. S. Ackerman, D. Hndus, “Augmenting a Window System with Speech Input”, IEEE Computer, 23(8), August, 1990, 50–58.Google Scholar
  16. 16.
    J. Wretö, J. Caelen, “ICP-DRAW, rapport final du projet ESPRIT MULTIWORKS no 2105.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Joëlle Coutaz
    • 1
  • Laurence Nigay
    • 1
  • Daniel Salber
    • 1
  1. 1.IMAGLaboratoire de Génie InformatiqueGrenoble CedexFrance

Personalised recommendations