A Context Sensitive Natural Language Modality for an Intelligent Room

  • Michael Coen
  • Luke Weisman
  • Kavita Thomas
  • Marion Groh


This paper describes the design and implementation of a natural language interface to a highly interactive space known as the Intelligent Room. We introduce a data structure called a recognition forest, which simplifies incorporation of non-linguistic contextual information about the human-level events going on in the Intelligent Room into its speech understanding system. This aim of using context has been to allow multiple applications—all of which support a relatively high degree of natural syntactic variability—to run simultaneously in the Intelligent Room.


Software Agent Information Retrieval System Interactive Space Continuous Speech Speech Recognition System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Andry, F., Fraser, N.M., McGlashan, S., Thornton, S., and Youd, J. Making DATR Work for Speech: Lexicon Compilation in SUNDIAL. Computational Linguistics, 18(3), pp. 245–267. 1992.Google Scholar
  2. [2]
    Bobick, A.; Intille, S.; Davis, J.; Baird, F.; Pinhanez, C.; Campbell, L.; Ivanov, Y.; Schütte, A.; and Wilson, A. Design Decisions for Interactive Environments: Evaluating the KidsRoom. Proceedings of the 1998 AAAI Spring Symposium on Intelligent Environments. AAAI TR SS-98-02. 1998.Google Scholar
  3. [3]
    Chung, G., and Seneff, S. Improvements in Speech Understanding Accuracy Through the Integration of Hierarchical Linguistic, Prosodic and Phonological Constraints in the Jupiter Domain, Proc. ICSLP’ 98, November 1998.Google Scholar
  4. [4]
    Coen, M. A Prototype Intelligent Environment. In Streitz, N., et al. (Eds.), Cooperative Buildings — Integrating Information, Organization, and Architecture. Proceedings of the First International Workshop on Cooperative Buildings (CoBuild’98). Lecture Notes in Computer Science. Springer: Heidelberg. 1998.Google Scholar
  5. [5]
    Coen, M. Building Brains for Rooms: Designing Distributed Software Agents. In Proceedings of the Ninth Conference on Innovative Applications of Artificial Intelligence. (IAAI97). Providence, R.I. 1997.Google Scholar
  6. [6]
    Coen, M. Design Principles for Intelligent Environments. In Proceedings of The Fifteenth National Conference on Artificial Intelligence. (AAAJ98). Madison, Wisconsin. 1998.Google Scholar
  7. [7]
    Coen, M. (ed.) Proceedings of the 1998 AAAI Spring Symposium on Intelligent Environments. AAAI TR SS-98-02. 1998.Google Scholar
  8. [8]
    Federico, M. and Vernesoni, F. “A speech understanding architecture for an information query system”. Proceedings of EUROSPEECH 95, Madrid, Spain, 1995.Google Scholar
  9. [9]
    Katz, B.. Using English for Indexing and Retrieving. In Artificial Intelligence at MIT: Expanding Frontiers. Winston, P.; and Shellard, S. (editors). MIT Press, Cambridge, MA. Volume 1. 1990.Google Scholar
  10. [10]
    Mozer, M. The Neural Network House: An Environment that Adapts to its Inhabitants. Proceedings of the AAAI 1998 Spring Symposium on Intelligent Environments. AAAI TR SS-98-02. 1998.Google Scholar
  11. [11]
    Stock, O., Carenini, G., Cecconi, F., Franconi, E., Lavelli, Magnini, B., Pianesi, F., Ponzi, M., Samek-Lodovici, V., and Strapparava, C.. ALFRESCO: Enjoying the Combination of Natural Language Processing and Hypermedia for Information Exploration. In Maybury, M. (ed.), Intelligent Multimedia Interfaces, The MIT Press, pp. 197–224.Google Scholar
  12. [12]
    Winograd, T. Five lectures on artificial intelligence. Technical Report, Stanford-CS, Number AI Memo 246, Stanford University, 1974.Google Scholar
  13. [13]
    Woods, W., Kaplan, R., and Nash-Weber, B. The Lunar Sciences Natural Language Information System: Final Report. Technical Report, Bolt Beranek and Newman, Number 2378, June 1972.Google Scholar
  14. [14]
    Zue, V. Human Computer Interactions Using Language Based Technology. IEEE International Symposium on Speech, Image Processing & Neural Networks. Hong Kong. 1994Google Scholar

Copyright information

© Springer-Verlag London Limited 2000

Authors and Affiliations

  • Michael Coen
    • 1
  • Luke Weisman
    • 1
  • Kavita Thomas
    • 1
  • Marion Groh
    • 1
  1. 1.MIT Artificial Intelligence LabCambridgeUSA

Personalised recommendations