An Automated Meeting Assistant: A Tangible Mixed Reality Interface for the AMIDA Automatic Content Linking Device

  • Jochen Ehnes
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 24)


We describe our approach to support ongoing meetings with an automated meeting assistant. The system based on the AMIDA Content Linking Device aims at providing relevant documents used in previous meetings for the ongoing meeting based on automatic speech recognition. Once the content linking device finds documents linked to a discussion about a similar subject in a previous meeting, it assumes they may be relevant for the current discussion as well. We believe that the way these documents are offered to the meeting participants is equally important as the way they are found. We developed a mixed reality, projection based user interface that lets the documents appear on the table tops in front of the meeting participants. They can hand them over to others or bring them onto the shared projection screen easily if they consider them relevant. Yet, irrelevant documents dont draw too much attention from the discussion. In this paper we describe the concept and implementation of this user interface and provide some preliminary results.


Meeting assistants Meeting processing Mixed reality(MR) Projected user interface Tangible user interface (TUI) 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ashdown, M., Robinson, P.: A personal projected display. In: MULTIMEDIA 2004: Proceedings of the 12th annual ACM international conference on Multimedia, pp. 932–933. ACM Press, New York (2004)CrossRefGoogle Scholar
  2. 2.
    Carletta, J., Ashby, S., Bourban, S., Flynn, M., Guillemot, M., Hain, T., Kadlec, J., Karaiskos, V., Kraaij, W., Kronenthal, M., Lathoud, G., Lincoln, M., Lisowska, A., McCowan, I., Post, W., Reidsma, D., Wellner, P.: The ami meeting corpus: A pre-announcement. In: Renals, S., Bengio, S. (eds.) MLMI 2005. LNCS, vol. 3869, pp. 28–39. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Ehnes, J., Knöpfle, C., Unbescheiden, M.: The pen and paper paradigm supporting multiple users on the virtual table. In: Proceedings of the Virtual Reality 2001 Conference (VR 2001), p. 157. IEEE Computer Society Press, Los Alamitos (2001)Google Scholar
  4. 4.
    Fapso, M., Schwarz, P., Szöke, I., Smrz, P., Schwarz, M., Cernocký, J., Karafiát, M., Burget, L.: Search engine for information retrieval from speech records. In: Proceedings of the Third International Seminar on Computer Treatment of Slavic and East European Languages, pp. 100–101 (2006)Google Scholar
  5. 5.
    Haller, M., Brandl, P., Leithinger, D., Leitner, J., Seifried, T., Billinghurst, M.: Shared design space: Sketching ideas using digital pens and a large augmented tabletop setup. In: Pan, Z., Cheok, D.A.D., Haller, M., Lau, R., Saito, H., Liang, R. (eds.) ICAT 2006. LNCS, vol. 4282, pp. 185–196. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    heyewall. Heyewall,
  7. 7.
    Popescu-Belis, A., Boertjes, E., Kilgour, J., Poller, P., Castronovo, S., Wilson, T., Jaimes, A., Carletta, J.: The amida automatic content linking device: Just-in-time document retrieval in meetings. In: Popescu-Belis, A., Stiefelhagen, R. (eds.) MLMI 2008. LNCS, vol. 5237, pp. 272–283. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  8. 8.
    Raskar, R., Welch, G., Fuchs, H.: Seamless projection overlaps using image warping and intensity blending. In: Proceedings of the Fourth International Conference on Virtual Systems and Multimedia, Gifu, Japan (November 1998)Google Scholar
  9. 9.
    Rekimoto, J., Saitoh, M.: Augmented surfaces: A spatially continuous workspace for hybrid computing environments. In: Proceedings of CHI 1999 (1999)Google Scholar
  10. 10.
    Underkoffler, J., Ishii, H.: Illuminating light: An optical design tool with a luminous-tangible interface. In: CHI, pp. 542–549 (1998)Google Scholar
  11. 11.
    Underkoffler, J., Ullmer, B., Ishii, H.: Emancipated pixels: real-world graphics in the luminous room. In: Rockwood, A. (ed.) Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 385–392. ACM Press/Addison-Wesley Publishing Co. (1999)Google Scholar
  12. 12.
    Wellner, P.: The digitaldesk calculator: Tangible manipulation on a desk top display. In: Proc. ACM SIGGRAPH Symposium on User Interface Software and Technology, pp. 107–115 (1991)Google Scholar
  13. 13.
    Wellner, P.: Interacting with paper on the DigitalDesk. Communications of the ACM 36(7), 86–97 (1993)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Jochen Ehnes
    • 1
  1. 1.Centre for Speech Technology ResearchUniversity of EdinburghEdinburghU.K.

Personalised recommendations