Skip to main content
SpringerLink
Log in

Augmenting and Executing SharedPlans for Multimodal Communication

  • Conference paper
  • First Online:
Book cover Cooperative Multimodal Communication (CMC 1998)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2155))

Included in the following conference series:

Abstract

The adoption of SharedPlans as a basis for multimodal dialogues is discussed. An extension to the model of plan augmentation for discourse is proposed so that it applies for multimodal interaction. The proposed process exploits SharedPlans and Adjacency Pairs in conjunction to account for global and local collaboration. Finally, multimedia coordination is taken into account. An example is followed throughout the chapter to make the consequences of the proposal more concrete.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Arens, Y. E. Hovy, and M. Vosser (1993) On the knowledge underlying multimedia presentations. In M.T. Maybury (ed.) Intelligent Multimodal Interfaces. Cambridge MA: MIT Press.

    Google Scholar 

  • Allen, J. (1983) Recognizing intentions from natural language utterances. In M. Brady and R. Berwick (eds.) Computational Models of Discourse, Cambridge, MA: MIT Press, 1982, 107–166.

    Google Scholar 

  • Andre, E. and T. Rist (1994) Supporting passive and active viewing of multimedia presentations. In P. Johnson, S. Feiner, J. Marks, M. Maybury, and J. Moore (eds.) AAAI Spring Symposium Series: Intelligent Multimedia Multimodal System, Stanford University, March 1994.

    Google Scholar 

  • Brady, M. and R. Berwick (1983) Computational Models of Discourse. Cambridge, MA: MIT Press.

    Google Scholar 

  • Bunt, H., R. Ahn, R.J. Beun, T. Borghuis and K. van Overveld (1998) Multimodal Cooperation with the DenK system. In H. Bunt, R.J. Beun and T. Borghuis (eds) Multimodal Human-Computer Communication. Berlin: Springer Verlag, 39–67.

    Google Scholar 

  • Cohen, P.R. and H.J. Levesque (1990) Rational interaction as the basis for communication. In P.R. Cohen, J. Morgan, and M. Pollack (eds.) Intentions in Communication. Cambridge, MA: MIT Press, 221–256.

    Google Scholar 

  • Cohen, P.R., J. Morgan, and M. Pollack (eds.) (1990) Intentions in Communication. Cambridge, MA: MIT Press.

    Google Scholar 

  • Cohen, P.R. (1978) On Knowing what to Say: Planning Speech Acts. PhD thesis, University of Toronto.

    Google Scholar 

  • Grosz, B. and S. Kraus (1993) Collaborative plans for group activities. In Proceedings of 13th International Joint Conference on Artificial Intelligence, Chambéry.

    Google Scholar 

  • Grosz, B. and S. Kraus (1996) Collaborative plans for complex group action. Artificial Intelligenc, 86(2).

    Google Scholar 

  • Grosz, B. and S. Kraus (1999) The evolution of sharedplans. In A. Rao and M. Wooldridge (eds.) Foundations and Theories of Rational Agencies, 227–262.

    Google Scholar 

  • Grosz, B. and C. Sidner (1986) Attention, intention and the structure of discourse. Computational Linguistics, 12(3):175–204.

    Google Scholar 

  • Grosz, B. and C. Sidner (1990) Plans for discourse. In P.R. Cohen, J. Morgan, and M. Pollack (eds.) Intentions in Communication. Cambridge, MA: MIT Press, 417–444.

    Google Scholar 

  • Han, Y. and I. Zukerman (1998) Using Cooperative Agents to Plan Multimodal Presentations. In H. Bunt, R.J. Beun, and T. Borghuis (eds.) Multimodal Human-Computer Communication; Systems, Techniques and Experiments, Berlin: Springer, 122–157.

    Chapter  Google Scholar 

  • Levinson, S. (1983) Pragmatics. Cambridge University Press.

    Google Scholar 

  • Lochbaum, K., B. Grosz, and C. Sidner (1990) Models of plans to support communication: an initial report. In Proceedings of AAAI-90, Boston.

    Google Scholar 

  • Litman, D. (1985) Plan Recognition and Discourse Analysis: an Integrated Approach for Understanding Dialogues. PhD thesis, University of Rochester, 1985.

    Google Scholar 

  • Lochbaum, K. (1991) An algorithm for plan recognition in collaborative discourse. In Proceedings of ACL-91, Berkeley.

    Google Scholar 

  • Lochbaum, K. (1994) Using Collaborative Plans to Model the Intentional Structure of Discourse. PhD thesis, Harvard University, Cambridge, MA.

    Google Scholar 

  • Maybury (1993a) Intelligent Multimedia Interfaces. Menlo Park CA/Cambridge MA: AAAI Press/MIT Press.

    Google Scholar 

  • Maybury (1993b) Planning multimedia explanation using communicative acts. In M.T. Maybury (ed.) Intelligent Multimedia Interfaces. Cambridge MA: MIT Press.

    Google Scholar 

  • Perrault, C.R. (1990) An application of default logic to speech act theory. In P.R. Cohen, J. Morgan, and M. Pollack (eds.) Intentions in Communication, Cambridge, MA: MIT Press, 161–186.

    Google Scholar 

  • Pollack, M. (1990) Plans as complex mental attitudes. In P.R. Cohen, J. Morgan, and M. Pollack (eds.) Intentions in Communication, Cambridge, MA: MIT Press, 77–104.

    Google Scholar 

  • Stock, O., C. Strapparava, and M. Zancanaro (1995) Explorations in a natural language multimodal information access environment. In M. Maybury (ed.) IJCAI-95 Workshop on Intelligent Multimedia Information Retrieval, Montréal, August 1995.

    Google Scholar 

  • Stock, O. and The AlFresco Project Team. AlFresco: Enjoying the combination of nlp and hypermedia for information exploration. In M.T. Maybury (ed.) Intelligent Multimodal Interfaces. Cambridge MA: MIT Press.

    Google Scholar 

  • Traum, D. (1994) A Computational Theory of Grounding in Natural Language Conversation. PhD thesis, University of Rochester, 1994.

    Google Scholar 

  • Wahlster, W., E. Andre, S. Bandyopadyay, W. Graf, and T. Rist (1992) WIP: The coordinated generation of multimodal presentations from a common representation. In A. Ortony, J. Slack, and O. Stock (eds.) Communication from Artificial Intelligence Perspective: Theoretical and Applied Issues. Berlin: Springer Verlag.

    Google Scholar 

  • Wahlster, W., E. André, W. Finkler, H.J. Profitlich, and T. Rist. Plan-based integration of natural language and graphics generation. Artificial Intelligence, 63:387–427.

    Google Scholar 

  • Zancanaro, M., O. Stock, and C. Strapparava (1994) To the rescue of the lost explorer: Steps toward overcoming the problems in information access dialogues. In P. Johnson, S. Feiner, J. Marks, M. Maybury, and J. Moore, (eds.) AAAI Spring Symposium Series: Intelligent Multimedia Multimodal System, Stanford University, March 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Istituto per la Ricerca Scientifica e Tecnologica, I-38050, Povo, Trento, Italy

    Oliviero Stock, Carlo Strapparava & Massimo Zancanaro

Authors
  1. Oliviero Stock
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carlo Strapparava
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Massimo Zancanaro
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computational Linguistics and AI Group, Tilburg University, P.O. Box 90153, 5000, LE Tilburg, The Netherlands

    Harry Bunt

  2. Department of Information and Computing Science, Utrecht University, P.O. Box 80.089, 3508, TB Utrecht, The Netherlands

    Robbert -Jan Beun

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Stock, O., Strapparava, C., Zancanaro, M. (2001). Augmenting and Executing SharedPlans for Multimodal Communication. In: Bunt, H., Beun, R.J. (eds) Cooperative Multimodal Communication. CMC 1998. Lecture Notes in Computer Science(), vol 2155. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45520-5_6

Download citation

  • DOI: https://doi.org/10.1007/3-540-45520-5_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42806-0

  • Online ISBN: 978-3-540-45520-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation