Skip to main content

Miamm — A Multimodal Dialogue System Using Haptics

  • Chapter

Part of the book series: Text, Speech and Language Technology ((TLTB,volume 30))

Abstract

In this chapter we describe the MIAMM project. Its objective is the development of new concepts and techniques for user interfaces employing graphics, haptics and speech to allow fast and easy navigation in large amounts of data. This goal poses challenges as to how can the information and its structure be characterized by means of visual and haptic features, how the architecture of such a system is to be defined, and how we can standardize the interfaces between the modules of a multi-modal system.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Beyer, L. and Weiss, T. (2001). Elementareinheiten des Somatosensorischen Systems als Physiologische Basis der Taktil-Haptischen Wahrnehmung. In Grunewald, M. and Beyer, L., editors, Der Bewegte Sinn, pages 25–38. Birkhäuser Verlag, Basel.

    Google Scholar 

  • Card, S. K., Mackinlay, J. D., and Shneiderman, B., editors (1999). Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers Inc.

    Google Scholar 

  • Fedeler, D. and Lauer, C. (2002). Technical Foundation of the Graphical Interface. Technical report, DFKI, Saarbrücken, Germany. Project MIAMM — Multidimensional Information Access using Multiple Modalities, EU project IST-20000-29487, Deliverable D2.2.

    Google Scholar 

  • Gärdenfors, P. (2000). Conceptual Spaces: The Geometry of Thought. MIT Press, USA.

    Google Scholar 

  • Kumar, A., Pecourt, E., and Romary, L. (2002). Dialogue Module Technical Specification. Technical report, LORIA, Nancy, France. Project MIAMM — Multidimensional Information Access using Multiple Modalities, EU project IST-20000-29487, Deliverable D5.1.

    Google Scholar 

  • Kumar, A. and Romary, L. (2003). A Comprehensive Framework for Multi-Modal Meaning Representation. In Proceedings of the Fifth International Workshop on Computational Semantics, Tilburg, Netherlands.

    Google Scholar 

  • Maybury, M. T. and Wahlster, W., editors (1998). Readings in Intelligent User Interfaces. Morgan Kaufmann Publishers Inc.

    Google Scholar 

  • Pecourt, E. and Reithinger, N. (2004). Multimodal Database Access on Handheld Devices. In The Companion Volume to the Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL), pages 206–209, Barcelona, Spain. Association for Computational Linguistics.

    Google Scholar 

  • Reithinger, N., Alexandersson, J., Becker, T., Blocher, A., Engel, R., Löckelt, M., Müller, J., Pfleger, N., Poller, P., Streit, M., and Tschernomas, V. (2003). SmartKom: Adaptive and Flexible Multimodal Access to Multiple Applications. In Proceedings of the Fifth International Conference on Multimodal Interfaces (ICMI), pages 101–108, Vancouver, Canada. ACM Press.

    Google Scholar 

  • Romary, L. (2001). Towards an Abstract Representation of Terminological Data Collections-the TMF Model. In Proceedings of Terminology in Advanced Microcomputer Applications (TAMA), Antwerp, Belgium.

    Google Scholar 

  • Romary, L. (2002a). MMIL Requirements Specification. Technical report, LORIA, Nancy, France. Project MIAMM — Multidimensional Information Access using Multiple Modalities, EU project IST-20000-29487, Deliverable D6.1.

    Google Scholar 

  • Romary, L. (2002b). MMIL Technical Specification. Technical report, LORIA, Nancy, France. Project MIAMM — Multidimensional Information Access using Multiple Modalities, EU project IST-20000-29487, Deliverable D6.3.

    Google Scholar 

  • Salmon-Alt, S. (2000). Reference Resolution within the Framework of Cognitive Grammar. In Proceedings of International Colloquium on Cognitive Science, San Sebastian, Spain.

    Google Scholar 

  • van Esch-Bussemakers, M. P. and Cremers, A. H. M. (2004). User Walkthrough of Multimodal Access to Multidimensional Databases. In Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI), pages 220–226, State College, PA, USA. ACM Press.

    Google Scholar 

  • Wahlster, W., editor (2005). SmartKom: Foundations of Multimodal Dialogue Systems. Springer, Berlin.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer

About this chapter

Cite this chapter

Reithinger, N., Fedeler, D., Kumar, A., Lauer, C., Pecourt, E., Romary, L. (2005). Miamm — A Multimodal Dialogue System Using Haptics. In: van Kuppevelt, J.C.J., Dybkjær, L., Bernsen, N.O. (eds) Advances in Natural Multimodal Dialogue Systems. Text, Speech and Language Technology, vol 30. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3933-6_14

Download citation

Publish with us

Policies and ethics