Skip to main content
SpringerLink
Log in

An Approach to Mixed Initiative Spoken Information Retrieval Dialogue

  • Chapter
Computational Models of Mixed-Initiative Interaction

Abstract

We present an approach to mixed initiative dialogue in acoustic user interfaces to databases. First, we discuss how we distinguish between initiative and control in mixed initiative information retrieval dialogue and how the notions of taking, keeping, and relinquishing initiative and control are reflected in our approach. Based on this discussion, we develop a dialogue planning algorithm. This algorithm distinguished between resources and routines and between the type and the content of an utterance; type and content are calculated separately by routines that reason on the resources — a dialogue model, a dialogue history, and an application description. Through this division we achieve a dialogue where the system adapts to the user’s attempts at changing the direction of a dialogue. Finally, we argue that automatic segmentation of the dialogue and automatic tracking of initiative and control is inherent to our approach.

The research described here was developed as part of their Tesadis project (see Feldes et al. 1998).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • Allen, J. and C. Perrault: 1980, Analyzing intention in utterances. Artificial Intelligence 15 (3), 143–178.

    Article  Google Scholar 

  • Austin, J.: 1962, How to Do Things with Words. London: Oxford University Press.

    Google Scholar 

  • Baekgaard, P., O. Bernsen, T. Brt ndsted, P. Dalsgaard, H. Dybkjær, L. Dybkjær, J. Kristiansen, L. Larsen, B. Lindberg, B. Maegaard, B. Music, L. Offersgaard, and C. Povlsen: 1994, The danish spoken language dialogue project — A general overview. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 89–92.

    Google Scholar 

  • Ball, J. E. and D. T. Ling: 1994, Spoken language processing in the persona conversational assistant. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 109–112.

    Google Scholar 

  • Bennacef, S., F. Néel, and H. Maynard: 1995, An oral dialogue model based on speech acts categorization. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 237–240.

    Google Scholar 

  • Bilange, E.: 1991, A task independent oral dialogue model. In: Proc. of 5th Euro. Conf of the ACL. pp. 83–87.

    Google Scholar 

  • Blomberg, M., R. Carlson, K. Elenius, B. Granström, J. Gustafson, S. Hunnicutt, R. Lindell, and L. Neovius: 1993, An experimental dialogue system: WAXHOLM. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech’93). pp. 1867–1870.

    Google Scholar 

  • Caminero-Gil, J., J. Alvarez-Cercadillo, C. Crespo-Casas, and D. Tapias-Merino: 1996, Data-driven discourse modeling for semantic interpretation. In: Proc. of 1996 Intl. Conf. on Acoustics, Speech, and Signal Processing (ICASSP’96). pp. 401–404.

    Google Scholar 

  • Carberry, S.: 1990, Plan Recognition in Natural Language Dialogue. Cambridge, MA. London, England: MIT Press.

    Google Scholar 

  • Chu-Carroll, J. and M. Brown: 1998, An evidential model for tracking initiative in collaborative dialogue interactions. User Modeling and User-Adapted Interaction. 8 (3–4) pp. 215–254.

    Article  Google Scholar 

  • Chu-Carroll, J. and S. Carberry: 1995, Response generation in collaborative negotiation. In: Proc. Of the 33th Annual Meeting of the ACL. Also available as http://xxx.lanl.gov/cmp-lg/9505001.

    Google Scholar 

  • Cohen, P.: 1998, Dialogue modeling. In: R. Cole, J. Mariani, H.Uszkoreit, G. Varile, A. Zaenen, and A. Zampolli (eds.): Survey of the State of the Art in Human Language Technology. Cambridge University Press, Cambridge, Chapt. 6.3. Also available at http://www.cse.ogi.edu/CSLU/HLTsurvey/.

    Google Scholar 

  • Cohen, R., C. Allaby, C. Cumbaa, M. Fitzgerald, K. Ho, B. Hui, C. Latulipe, F. Lu, N. Moussa, D. Pooley, A. Qian, and S. Siddiqi: 1998, What is initiative?. User Modeling and User-Adapted Interaction. 8 (3–4) pp. 171–214.

    Article  Google Scholar 

  • Cristea, D. and B. Webber: 1997, Expectations in incremental discourse. In: Proc. of the 35th Annual Meeting of the ACL and the 8th Conf of the European ACL. pp. 88–95.

    Google Scholar 

  • Dahlbäck, N. and A. Jönsson: 1992, An empirically based computationally tractable dialogue model. In: Proc. of the 14th Annual Conference of the Cognitive Science Society (COGSCI-92). Bloomington, Indiana.

    Google Scholar 

  • EAGLES: 1997, Handbook of Standards and Resources for Spoken Language Systems. http://coral.lili.uni-bielefeld.de/EAGLES/eagbook/eagbook.html.

    Google Scholar 

  • Eckert, W., G. Fink, A. Kießling, R. Kompe, T. Kuhn, F. Kummert, M. Mast, H. Niemann, E. Nöth, R. Prechtel, S. Rieck, G. Sagerer, A. Scheuer, G. Schukat-Talamazzini, and B. Seestaedt: 1992, EVAR: Ein sprachverstehendes Dialogsystem. In: KONVENS 92. pp. 49–58.

    Chapter  Google Scholar 

  • Feldes, S., G. Fries, E. Hagen, and A. Wirth: 1998, A novel service creation environment for speech-enabled database access. In: Proc. of 4th IEEE Workshop on Interactive Voice Technology for Telecommunications Applications (IVT-TA’98).

    Google Scholar 

  • Glass, J., G. Flammia, D. Goodine, M. Phillips, J. Polifroni, S. Sakai, S. Seneff, and V. Zue: 1995, Multilingual spoken-language understanding in the MIT voyager system. Speech Communication 17 (1–2), 1–18.

    Article  Google Scholar 

  • Goddeau, D., H. Meng, J. Polifroni, S. Seneff, and S. Busayapongchai: 1996, A form-based dialogue manager for spoken language applications. In: Proc. of the 1996 Intl. Conf. on Spoken Language Processing (ICSLP ‘86).

    Google Scholar 

  • Green, N. and S. Carberry: 1999, A computational mechanism for initiative in answer generation’. User Modeling and User-Adapted Interaction. This issue.

    Google Scholar 

  • Grice, H.: 1975, Logic and conversation. In: P. Cole and J. Morgan (eds.): Syntax and Semantics, Voi. 3: Speech Acts. Academic Press, pp. 41–58.

    Google Scholar 

  • Grosz, B. and C. Sidner: 1986, Attention, intentions, and the structure of discourse. Computational Linguistics 12 (3), 175–204.

    Google Scholar 

  • Hagen, E. and B. Grote: 1997, Generating efficient mixed initiative dialogue. In: Proc. ACL Workshop Interactive Spoken Dialog Systems: Bringing Speech and NLP Together in Real Applications. pp. 53–56.

    Google Scholar 

  • Hagen, E. and A. Stein: 1996, Automatic generation of a complex dialogue history. In: Proc. 11th Canadian Conference on Artificial Intelligence (AI96). pp. 84–96.

    Google Scholar 

  • Jönsson, A.: 1993, A dialogue manager using initiative-response units and distributed control. In: Proc. of 6th Euro. Conf of the ACL.

    Google Scholar 

  • Jordan, P. and B. Di Eugenio: 1997, Control and initiative in collaborative problem solving dialogues. In: Working Notes of the AAAI-97 Spring Symposium on Computational Models for Mixed Initiative Interaction. pp. 81–84.

    Google Scholar 

  • Kamp, H. and U. Reyle: 1993, From Discourse to Logic, vol. 42 of Studies in Linguistics and Philosophy. Kluwer Academic Publisher, Dordrecht.

    Google Scholar 

  • Kaspar, B., G. Fries, K. Schuhmacher, and A. Wirth: 1995, Faust — A directory assistance demonstrator. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech’93). pp. 1161–1164.

    Google Scholar 

  • Kaspar, B., K. Schuhmacher, and S. Feldes: 1997, Barge-in revised. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech’97).

    Google Scholar 

  • Lambert, L. and S. Carberry: 1991, A tripartite plan-based model of dialogue. In: Proc. of the 29th Annual Meeting of the ACL. pp. 47–54.

    Google Scholar 

  • Lester, J., B. Stone, and G. Stelling: 1999, Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments. User Modeling and User-Adapted Interaction. This issue.

    Google Scholar 

  • Litman, D. and J. Allen: 1987, A plan recognition model for subdialogues in conversations. Cognitive Science 11, 163–200.

    Article  Google Scholar 

  • Mann, W. and S. Thompson: 1988, Rhetorical structure theory: Toward a functional theory of text organization. Text 8 (3), 243–281.

    Google Scholar 

  • Naito, M., S. Kuroiwa, K. Takeda, and S. Y. F. Yato: 1994, A real-time speech dialogue system for a voice activated telephone extension service. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 129–132.

    Google Scholar 

  • O’Donnell, M.: 1990, A dynamic model of exchange. Word 41 (3), 293–327.

    Google Scholar 

  • Oerder, M. and H. Aust: 1993, A realtime prototype of an automatic inquiry system. In: Proc. of the 1994 Intl. Conf. on Spoken Language Processing (ICSLP’94). pp. 703–706.

    Google Scholar 

  • Peckham, J.: 1993, A new generation of spoken dialogue systems: Results and lessons from the SUNDIAL project. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech’93).

    Google Scholar 

  • Polanyi, R. and R. Scha: 1984, A syntactic approach to discourse semantics. In: Proc. of the 10th Intl. Conf. on Computational Linguistics (COLING’84). pp. 413–419.

    Google Scholar 

  • Reichman, R.: 1985, Getting Computers to Talk Like You and Me. Cambridge, MA: MIT Press.

    Google Scholar 

  • Sadek, M.: 1990, Logical task modelling for man-machine dialogue. In: Proc. of the Natl. Conf. on Artificial Intelligence (AAAI’90). pp. 970–975.

    Google Scholar 

  • Sadek, M., Bretier, V. Cadoret, A. Cozannet, P. Dupont, A. Ferrieux, and F. Panaget 1994, A cooperative spoken dialogue system based on a rational agent model: A first implementation on the AGS application. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 145–148.

    Google Scholar 

  • Sinclair, J. and R. Coulthard: 1975, Towards an Analysis of Discourse: The English Used by Teachers and Pupils. London: Oxford University Press.

    Google Scholar 

  • Sitter, S. and A. Stein: 1992, Modelling the illocutionary aspects of information-seeking dialogues. Information Processing and Management 8 (2), 165–180.

    Article  Google Scholar 

  • Smith, R. and D. Hipp: 1994, Spoken Natural Language Dialog Systems; A Practical Approach. New York, Oxford: Oxford University Press.

    Google Scholar 

  • Spiegel, M. and C. Kamm: 1997, Special issue on interactive voice technology for telecommunication applications (IVTTA’96). Speech Communication 23 (1–2).

    Google Scholar 

  • Stein, A., J. A. Gulla, and U. Thiel: 1999, User tailored planning of mixed inititative information seeking dialogues. User Modeling and User-Adapted Interaction. This issue.

    Google Scholar 

  • Traum, D. and E. Hinkelman: 1992, Conversation acts in task-oriented spoken dialogue. Computational Intelligence 8 (3), 575–599.

    Article  Google Scholar 

  • Walker, M., D. Litman, C. Kamm, and A. Abella: 1997, PARADISE: A framework for evaluating spoken dialogue agents. In: Proc. of the 35th Annual Meeting of the ACL and the 8th Conf of the European ACL. pp. 271–280.

    Google Scholar 

  • Walker, M. and S. Whittaker: 1990, Mixed initiative in dialogue: An investigation into discourse segmentation. In: Proc. of the 28th Annual Meeting of the ACL. pp. 70–78.

    Google Scholar 

  • Whittaker, S. and D. Attwater: 1994, Advanced speech applications — The integration of speech technology into complex services. In: Proc. ESCA Wshp. on Spoken Dialogue Systems; Theories and Applications. pp. 113–116.

    Google Scholar 

  • Whittaker, S. and P. Stenton: 1988, Cues and control in expert-client dialogues. In: Proc. of the 26th Annual Meeting of the ACL. pp. 123–130.

    Google Scholar 

  • Young, S., A. Hauptmann, W. Ward, E. Smith, and P. Werner: 1990, High level knowledge sources in usable speech recognition systems. In: A. Waibel and K. Lee (eds): Readings in Speech Recognition. San Mateo, CA: Morgan Kaufman, pp. 538–549.

    Google Scholar 

  • Burstein, M. and D. McDermott: 1986, Issues in the development of human-computer mixed-initiative planning. In: Gorayska and Mey (eds.): In Search of a Humane Interface. North Holland, pp. 285–303.

    Google Scholar 

  • Ferguson, G., J. Allen and B. Miller: 1996, TRAINS-95 Towards a mixed-initiative planning assistant. In: Proceedings of the Third International Conference on AI Planning Systems (AIPS-96). Edinburgh, Scotland, pp. 70–77.

    Google Scholar 

  • Guinn, C.: 1996, Mechanisms for mixed-initiative human-computer collaborative discourse. In: Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics. Santa Cruz, CA, pp. 278–285.

    Google Scholar 

  • Rich, C. and C. Sidner: 1996, Adding a collaborative agent to graphical user interfaces. In: Proceedings of the 9th ACM Symposium on User Interface Software and Technology. Seattle, WA, pp. 21–30.

    Google Scholar 

  • Rich, C. and C. Sidner: 1997, Segmented interaction history in collaborative interafce agent. In: Proceedings of the International Conference on Intelligent User Interfaces. Orlando, FL, pp. 23–30.

    Google Scholar 

  • Smith, R. and D. Hipp: 1994, Spoken Natural Language Dialog Systems: A Practical Approach. Oxford University Press, New York.

    Google Scholar 

  • Veloso, M.: 1996, Towards mixed-initiative rationale supported planning. In: A. Tate (ed.): Advanced Planning Technology. AAAI Press, Menlo Park, CA, pp. 277–282.

    Google Scholar 

  • Walker, M. and S. Whittaker: 1990, Mixed initiative in dialogue: An investigation into discourse segmentation. In: Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics. Pittsburgh, PA, 70–78.

    Google Scholar 

  • Whittaker, S. and P. Stenton: 1988, Cues and control in expert-client dialogues. In: Proceedings of the 26th Annual Meeting of the Association for Computational Linguistics. Buffalo, NY, pp. 123–130.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Simon Fraser University, Burnaby, BC, Canada

    Eli Hagen

  2. Deutsche Telekom Berkom, Darmstadt, Germany

    Eli Hagen

  3. School of Computer Science, Burnaby, V5A IS6, BC, Canada

    Eli Hagen

Authors
  1. Eli Hagen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Wisonsin-Parkside, Kenosha, USA

    Susan Haller

  2. German National Research Center for Information Technology, St. Augustin, Germany

    Alfred Kobsa

  3. University of Wisonsin-Milwaukee, Milwaukee, USA

    Susan McRoy

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Hagen, E. (1999). An Approach to Mixed Initiative Spoken Information Retrieval Dialogue. In: Haller, S., Kobsa, A., McRoy, S. (eds) Computational Models of Mixed-Initiative Interaction. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-1118-0_10

Download citation

  • DOI: https://doi.org/10.1007/978-94-017-1118-0_10

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-90-481-5171-4

  • Online ISBN: 978-94-017-1118-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation