A Discourse and Dialogue Infrastructure for Industrial Dissemination

  • Daniel Sonntag
  • Norbert Reithinger
  • Gerd Herzog
  • Tilman Becker
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6392)


We think that modern speech dialogue systems need a prior usability analysis to identify the requirements for industrial applications. In addition, work from the area of the Semantic Web should be integrated. These requirements can then be met by multimodal semantic processing, semantic navigation, interactive semantic mediation, user adaptation/personalisation, interactive service composition, and semantic output representation which we will explain in this paper.We will also describe the discourse and dialogue infrastructure these components develop and provide two examples of disseminated industrial prototypes.


Service Composition Automatic Speech Recognition Image Annotation Execution Plan Dialogue System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Allen, J., Byron, D., Dzikovska, M., Ferguson, G., Galescu, L., Stent, A.: An Architecture for a Generic Dialogue Shell. Natural Language Engineering 6(3), 1–16 (2000)Google Scholar
  2. 2.
    Boselli, R., Paoli, F.D.: Semantic navigation through multiple topic ontologies. In: Proceedings of Semantic Web Applications and Perspectives (SWAP), Trento, Italy (2005)Google Scholar
  3. 3.
    Cimiano, P., Haase, P., Heizmann, J.: Porting natural language interfaces between domains: an experimental user study with the orakel system. In: IUI 2007: Proceedings of the 12th International Conference on Intelligent User interfaces, pp. 180–189. ACM, New York (2007)Google Scholar
  4. 4.
    Engel, R.: SPIN: A Semantic Parser for Spoken Dialog Systems. In: Proceedings of the 5th Slovenian and First International Language Technology Conference, IS-LTC 2006 (2006)Google Scholar
  5. 5.
    Euzenat, J., Shvaiko, P.: Ontology matching. Springer, Heidelberg (2007)MATHGoogle Scholar
  6. 6.
    Fensel, D., Hendler, J.A., Lieberman, H., Wahlster, W. (eds.): Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential. MIT Press, Cambridge (2003)Google Scholar
  7. 7.
    Hall, F.M.: The radiology report of the future. Radiology 251(2), 313–316 (2009)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Hitzler, P., Krötzsch, M., Rudolph, S.: Foundations of Semantic Web Technolo-gies, Chapman & Hall/CRC, Boca Raton (August 2009)Google Scholar
  9. 9.
    Jameson, A.D., Spaulding, A., Yorke-Smith, N.: Introduction to the Special Issue on Usable AI. AI Magazine 3(4), 11–16 (2009)CrossRefGoogle Scholar
  10. 10.
    Lopez, V., Pasin, M., Motta, E.: Aqualog: An ontology-portable question answering system for the semantic web. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 546–562. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  11. 11.
    Martin, D., Cheyer, A., Moran, D.: The Open Agent Architecture: a framework for building distributed software systems. Applied Artificial Intelligence 13(1/2), 91–128 (1999)CrossRefGoogle Scholar
  12. 12.
    Oviatt, S.: Ten myths of multimodal interaction. Communications of the ACM 42(11), 74–81 (1999)CrossRefGoogle Scholar
  13. 13.
    Pfleger, N.: FADE - An Integrated Approach to Multimodal Fusion and Discourse Processing. In: Proceedings of the Dotoral Spotlight at ICMI 2005,Trento, Italy (2005)Google Scholar
  14. 14.
    Pieraccini, R., Huerta, J.: Where do we go from here? research and commercial spoken dialog systems. In: Proceedings of the 6th SIGDdial Worlshop on Discourse and Dialogue, pp. 1–10 (September 2005)Google Scholar
  15. 15.
    Porta, D., Sonntag, D., Neßelrath, R.: A Multimodal Mobile B2B Dialogue Interface on the iPhone. In: Proceedings of the 4th Workshop on Speech in Mobile and Pervasive Environments (SiMPE 2009) in Conjunction with MobileHCI 2009. ACM, New York (2009)Google Scholar
  16. 16.
    Ramachandran, V.A., Krishnamurthi, I.: Nlion: Natural language interface for querying ontologies. In: COMPUTE 2009: Proceedings of the 2nd Bangalore Annual Compute Conference on 2nd Bangalore Annual Compute Conference, pp. 1–4. ACM, New York (2009)Google Scholar
  17. 17.
    Reithinger, N., Fedeler, D., Kumar, A., Lauer, C., Pecourt, E., Romary, L.: MIAMM- A Multimodal Dialogue System Using Haptics. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N.O. (eds.) Advances in Natural Multimodal Dia-logue Systems. Springer, Heidelberg (2005)Google Scholar
  18. 18.
    Reithinger, N., Sonntag, D.: An integration frame modaldialogue system accessing the Semantic Web. In: Proceedings of INTERSPEECH, Lisbon, Portugal, pp. 841–844 (2005)Google Scholar
  19. 19.
    Seneff, S., Lau, R., Polifroni, J.: Organization, Communication, and Control in the Galaxy-II Conversational System. In: Proceedings of Eurospeech 1999, Budapest, Hungary, pp. 1271–1274 (1999)Google Scholar
  20. 20.
    Sonntag, D.: Towards dialogue-based interactive semantic mediation in the medical domain. In: Proceedings of the Third International Workshop on Ontology Matching (OM) Collocated with the 7th International Semantic Web Conference, ISWC (2008)Google Scholar
  21. 21.
    Sonntag, D.: Ontologies and Adaptivity in Dialogue for Question Answering. AKA and IOS Press, Heidelberg (2010)MATHGoogle Scholar
  22. 22.
    Sonntag, D., Deru, M., Bergweiler, S.: Design and Implementation of Combined Mobile and Touchscreen-Based Multimodal Web 3.0 Interfaces. In: Proceedings of the International Conference on Artificial Intelligence (ICAI), pp. 974–979 (2009)Google Scholar
  23. 23.
    Sonntag, D., Engel, R., Herzog, G., Pfalzgraf, A., Pfleger, N., Romanelli, M., Reithinger, N.: SmartWeb Handheld—Multimodal Interaction with Ontological Knowl-edge Bases and Semantic Web Services. In: Huang, T.S., Nijholt, A., Pantic, M., Pentland, A. (eds.) ICMI/IJCAI Workshops 2007. LNCS (LNAI), vol. 4451, pp. 272–295. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  24. 24.
    Sonntag, D., Möller, M.: Unifying semantic annotation and querying in biomedical image repositories. In: Proceedings of International Conference on Knowledge Management and Information Sharing, KMIS (2009)Google Scholar
  25. 25.
    Sonntag, D., Sonnenberg, G., Nesselrath, R., Herzog, G.: Supporting a rapid dialogue engineering process. In: Proceedings of the First International Workshop On Spoken Dialogue Systems Technology, IWSDS (2009)Google Scholar
  26. 26.
    Tran, T., Wang, H., Rudolph, S., Cimiano, P.: Top-k Exploration of Query Candidates for Efficient Keyword Search on Graph-Shaped (RDF) Data. In: ICDE 2009: Proceedings of the 2009 IEEE International Conference on Data Engineering, Washington, DC, USA, pp. 405–416. IEEE Computer Society Press, Los Alamitos (2009)Google Scholar
  27. 27.
    Wahlster, W.: SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: Krahl, R., Günther, D. (eds.) Proceedings of the Human Computer Interaction Status Conference 2003, Berlin, Germany, pp. 47–62. DLR (2003)Google Scholar
  28. 28.
    Weiss, D.L., Langlotz, C.: Structured reporting: Patient care enhancement or productivity nightmare? Radiology 249(3), 739–747 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Daniel Sonntag
    • 1
  • Norbert Reithinger
    • 1
  • Gerd Herzog
    • 1
  • Tilman Becker
    • 1
  1. 1.German Research Center for AI (DFKI)SaarbrueckenGermany

Personalised recommendations