, Volume 20, Issue 2, pp 202–220 | Cite as

Meetings and meeting modeling in smart environments

Original Article


In this paper we survey our research on smart meeting rooms and its relevance for augmented reality meeting support and virtual reality generation of meetings in real time or off-line. The research reported here forms part of the European 5th and 6th framework programme projects multi-modal meeting manager (M4) and augmented multi-party interaction (AMI). Both projects aim at building a smart meeting environment that is able to collect multimodal captures of the activities and discussions in a meeting room, with the aim to use this information as input to tools that allow real-time support, browsing, retrieval and summarization of meetings. Our aim is to research (semantic) representations of what takes place during meetings in order to allow generation, e.g. in virtual reality, of meeting activities (discussions, presentations, voting, etc.). Being able to do so also allows us to look at tools that provide support during a meeting and at tools that allow those not able to be physically present during a meeting to take part in a virtual way. This may lead to situations where the differences between real meeting participants, human-controlled virtual participants and (semi-) autonomous virtual participants disappear.


Multi-party interaction Ambient intelligence Smart environments Meeting support Virtual reality 



This work was partly supported by the European Union 6th FWP IST Integrated Project augmented multi-party interaction (AMI, FP6-506811, publication AMI-32).


  1. Aarts E, Collier R, van Loenen E, de Ruyter B (2003) (eds) Ambient intelligence. In: Proceedings first European symposium, EUSAI 2003, Lecture Notes in Computer Science. Springer, Berlin Heidelberg New YorkGoogle Scholar
  2. Bales RF (2001) Social interaction systems. Theory and measurement. Tranaction Publishers, New BrunswickGoogle Scholar
  3. Ellis C, Barthelmess P (2003) The Neem dream. In: Proceedings Tapia ’03, Atlanta, USA, pp 23–29Google Scholar
  4. Goffman E (1963) Behavior in public spaces. Notes on the social organization of gatherings. The Free Press, New YorkGoogle Scholar
  5. Hofs H, op den Akker R, Nijholt A (2003) A generic architecture and dialogue model for multimodal interaction. In: Paggio P, Jokinen K, Jönsson A (eds) Proceedings 1st Nordic symposium on multimodal communication. CST Publication, Center for Sprokteknologi, Copenhagen, pp 79–92Google Scholar
  6. Jovanovic N (2003) Recognition of meeting actions using information obtained from different modalities: a semantic approach. TR-CTIT-03–48, p 44Google Scholar
  7. McCowan I, Bengio S, Gatica-Perez D, Lathoud G, Monay F, Moore D, Wellner P, Bourlard H (2003) Modeling human interaction in meetings. In: Proceedings IEEE ICASSP 2003, Hong KongGoogle Scholar
  8. Mikic I, Huang K, Trivedi M (2000) Activity monitoring and summarization for an intelligent meeting room. In: Proceedings IEEE workshop on human motion, Austin, TexasGoogle Scholar
  9. Morgan N, Baron D, Edwards J, Ellis D, Gelbart D, Janin A, Pfau T, Shriberg E, Stolcke A (2001) The meeting project at ICSI. Human Language Technologies Conference, San DiegoGoogle Scholar
  10. Nijholt A (2000) Towards virtual communities on the Web: actors and audience. In: Naghdy F et al (eds) Proceedings intelligent systems & applications (ISA’2000), vol. II, ICSC. Academic Press, Canada, pp 725–731Google Scholar
  11. Nijholt A (2003) Multimodality and ambient intelligence. In: Verhaegh WFJ, Aarts EHL, Korst J (eds) Algorithms in ambient intelligence. Kluwer, Boston, Dordrecht, London, pp 21–53Google Scholar
  12. Nijholt A (2004) Where computers disappear, virtual humans appear. Comput Graph 28(4):465–476CrossRefGoogle Scholar
  13. Nijholt A, Rist T, Tuinenbreijer K (2004) Lost in ambient intelligence? In: Proceedings ACM Conference on Computer Human Interaction (CHI 2004), Vienna, Austria, ACM New York, pp 1725–1726Google Scholar
  14. Nomay T, Zhaoz L, Badler NI (2000) Design of a virtual human presenter. Internal report, University of PennsylvaniaGoogle Scholar
  15. Pertaub DP, Slater M, Barker C (2001) An experiment on public speaking anxiety in response to three different types of virtual audience. Presence Teleoper Virtual Environ 11(1):68–78CrossRefGoogle Scholar
  16. Schultz T, Waibel A, Bett M, Metze F, Pan Y, Ries K, Schaaf T, Soltau H, Westphal M, Hua Yu, Zechner K (2001) The ISL meeting room system. In: Proceedings of the workshop on hands-free speech communication (HSC-2001), Kyoto JapanGoogle Scholar
  17. Stiefelhagen R (2002) Tracking focus of attention in meetings. In: Proceedings IEEE international conference on multimodal interfaces, Pittsburgh, pp 273–280Google Scholar
  18. Traum D, Rickel J (2001) Embodied agents for multi-party dialogue in immersive virtual worlds. In: Agents 2001 workshop on representing, annotating, and evaluating non-verbal and verbal communicative acts to achieve contextual embodied agents, pp 766–773Google Scholar
  19. Trivedi M, Mikic I, Bhonsle S (2000) Active camera networks and semantic event databases for intelligent environments. In: IEEE workshop on human modeling, analysis and synthesis (in conjunction with CVPR), Hilton Head, South CarolinaGoogle Scholar
  20. Vertegaal R (1998) Look who’s talking to whom. Mediating joint attention in multiparty communication & collaboration. PhD Thesis, University of TwenteGoogle Scholar
  21. Vilhjálmsson H (2003) Avatar augmented online conversation, PhD Dissertation, Program in Media Arts and Sciences, Massachusetts Institute of Technology, CambridgeGoogle Scholar
  22. Vilhjálmsson H, Cassell J (1998) BodyChat: autonomous communicative behaviors in avatars. In: Proceedings 2nd annual ACM international conference on autonomous agents, Minneapolis, pp 269–276Google Scholar
  23. Zobl M, Wallhoff F, Rigoll G (2003) Action recognition in meeting scenarios using global motion features. In: Proceedings of IEEE international workshop on performance evaluation of tracking and surveillance, pp 32–36Google Scholar

Copyright information

© Springer-Verlag London Limited 2005

Authors and Affiliations

  • Anton Nijholt
    • 1
  • Rieks op den Akker
    • 1
  • Dirk Heylen
    • 1
  1. 1.Centre of Telematics and Information Technology (CTIT)University of TwenteEnschedeThe Netherlands

Personalised recommendations