Summary
SmartKom provides an adaptive and reusable dialogue shell for multimodal interaction that has been employed successfully to realize fully-fledged prototype systems for various application scenarios. Taking the perspective of system architects, we review the overall design and specific architecture framework being applied within SmartKom. The basic design principles underlying our approach are described, and the different instantiations of the conceptual architecture are presented to illustrate the adaptibility and flexibility of the generic framework.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Allen, D. Byron, M. Dzikovska, G. Ferguson, L. Galescu, and A. Stent. An Architecture for a Generic Dialogue Shell. Natural Language Engineering, 6(3):1–16, 2000.
N.O. Bernsen and L. Dybkjær. Is Speech the Right Thing for Your Application? In: Proc. ICSLP-98, pp. 3209–3212, Sydney, Australia, 1998.
M.M. Blattner and R.B. Dannenberg (eds.). Multimedia Interface Design. ACM, New York, 1992.
M. Bordegoni, G. Faconti, S. Feiner, M.T. Maybury, T. Rist, S. Ruggieri, P. Trahanias, and M. Wilson. A Standard Reference Model for Intelligent Multimedia Presentation Systems. Computer Standards & Interfaces, 18(6–7):477–496, 1997.
H. Bunt, M.T. Maybury, and W. Wahlster. Coordination and Fusion in Multimodal Interaction. Dagstuhl Seminar Report 325, IBFI, Wadern, Germany, 2001.
P. Clements, F. Bachmann, L. Bass, D. Garlan, J. Ivers, R. Little, R. Nord, and J. Stafford. Documenting Software Architectures: Views and Beyond. Addison-Wesley, Boston, MA, 2003.
C. Elting, S. Rapp, G. Möhler, and M. Strube. Architecture and Implementation of Multimodal Plug and Play. In: Proc. 5th Int. Conf. on Multimodal Interfaces, pp. 93–100, Vancouver, Canada, 2003. ACM.
S. Feiner. An Architecture for Knowledge-Based Graphical Interfaces. In: J.W. Sullivan and S.W. Tyler (eds.), Intelligent User Interfaces, pp. 259–279, New York, 1991. ACM.
I. Gurevych, S. Merten, and R. Porzel. Automatic Creation of Interface Specifications from Ontologies. In: H. Cunningham and J. Patrick (eds.), Proc. HLT-NAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 59–66, Edmonton, Canada, 2003. Association for Computational Linguistics.
G. Herzog, A. Ndiaye, S. Merten, H. Kirchmann, T. Becker, and P. Poller. Large-Scale Software Integration for Spoken Language and Multimodal Dialog Systems. Natural Language Engineering, 10(3–4):283–305, 2004. Special Issue on Software Architecture for Language Engineering.
W. Hill, D. Wroblewski, T. McCandless, and R. Cohen. Architectural Qualities and Principles for Multimodal and Multimedia Interfaces. In: Blattner and Dannenberg (1992), pp. 311–318.
P. Maes and D. Nardi (eds.). Meta-Level Architecture and Reflection. North-Holland, Amsterdam, The Netherlands, 1988.
M.T. Maybury (ed.). Intelligent Multi-Media Interfaces. AAAI/MIT Press, Menlo Park, CA, 1993.
M.T. Maybury and W. Wahlster. Intelligent User Interfaces: An Introduction. In: M.T. Maybury and W. Wahlster (eds.), Readings in Intelligent User Interfaces, pp. 1–13, San Francisco, CA, 1998a. Morgan Kaufmann.
M.T. Maybury and W. Wahlster (eds.). Readings in Intelligent User Interfaces. Morgan Kaufmann, San Francisco, CA, 1998b.
S. Oviatt. Multimodal Interfaces. In: J.A. Jacko and A. Sears (eds.), The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, pp. 286–304, Mahwah, NJ, 2003. Lawrence Erlbaum.
G.E. Pfaff (ed.). User Interface Management Systems: Proc. the Seeheim Workshop. Springer, Berlin Heidelberg New York, 1985.
N. Reithinger, J. Alexandersson, T. Becker, A. Blocher, R. Engel, M. Löckelt, J. Müller, N. Pfleger, P. Poller, M. Streit, and V. Tschernomas. SmartKom: Adaptive and Flexible Multimodal Access to Multiple Applications. In: Proc. 5th Int. Conf. on Multimodal Interfaces, pp. 101–108, Vancouver, Canada, 2003a. ACM.
N. Reithinger, G. Herzog, and A. Ndiaye. Situated Multimodal Interaction in SmartKom. Computers & Graphics, 27(6):899–903, 2003b.
T. Richardson, Q. Stafford-Fraser, K.R. Wood, and A. Hopper. Virtual Network Computing. IEEE Internet Computing, 2(1):33–38, 1998.
J.W. Sullivan and S.W. Tyler (eds.). Intelligent User Interfaces. ACM, New York, 1991.
W. Wahlster. SmartKom: Fusion and Fission of Speech, Gestures, and Facial Expressions. In: Proc. 1st Int. Workshop on Man-Machine Symbiotic Systems, pp. 213–225, Kyoto, Japan, 2002.
W. Wahlster. SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: R. Krahl and D. Günther (eds.), Proc. Human Computer Interaction Status Conference 2003, pp. 47–62, Berlin, Germany, June 2003. DLR.
W. Wahlster, N. Reithinger, and A. Blocher. SmartKom: Multimodal Communication with a Life-like Character. In: Proc. EUROSPEECH-01, vol. 3, pp. 1547–1550, Aalborg, Denmark, September 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Herzog, G., Reithinger, N. (2006). The SmartKom Architecture: A Framework for Multimodal Dialogue Systems. In: Wahlster, W. (eds) SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-36678-4_4
Download citation
DOI: https://doi.org/10.1007/3-540-36678-4_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23732-7
Online ISBN: 978-3-540-36678-2
eBook Packages: Computer ScienceComputer Science (R0)