Skip to main content
  • Book
  • © 2011

Reinforcement Learning for Adaptive Dialogue Systems

A Data-driven Methodology for Dialogue Management and Natural Language Generation

  • A new methodology for developing spoken dialogue systems is described in detail

  • A research guide for students and researchers

  • This work provides insights, lessons, and inspiration for future research

  • Includes supplementary material: sn.pub/extras

Buy it now

Buying options

Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Table of contents (10 chapters)

  1. Front Matter

    Pages i-xv
  2. Introduction

    • Verena Rieser, Oliver Lemon
    Pages 1-6
  3. Fundamental Concepts

    1. Front Matter

      Pages 7-7
    2. Background

      • Verena Rieser, Oliver Lemon
      Pages 9-27
    3. Reinforcement Learning

      • Verena Rieser, Oliver Lemon
      Pages 29-52
    4. Proof-of-Concept: Information Seeking Strategies

      • Verena Rieser, Oliver Lemon
      Pages 53-70
  4. Policy Learning in Simulated Environments

    1. Front Matter

      Pages 71-71
    2. Data Collection in a Wizard-of-Oz Experiment

      • Verena Rieser, Oliver Lemon
      Pages 85-99
    3. Building Simulation Environments from Wizard-of-Oz Data

      • Verena Rieser, Oliver Lemon
      Pages 101-163
  5. Evaluation and Application

    1. Front Matter

      Pages 165-165
    2. Adaptive Natural Language Generation

      • Verena Rieser, Oliver Lemon
      Pages 189-204
    3. Conclusion

      • Verena Rieser, Oliver Lemon
      Pages 205-212
  6. Back Matter

    Pages 213-253

About this book

The past decade has seen a revolution in the field of spoken dialogue systems. As in other areas of Computer Science and Artificial Intelligence, data-driven methods are now being used to drive new methodologies for system development and evaluation.

This book is a unique contribution to that ongoing change. A new  methodology for developing spoken dialogue systems is described in detail. The journey starts and ends with human behaviour in interaction, and explores methods for learning from the data, for building simulation environments for training and testing systems, and for evaluating the results. The detailed material covers: Spoken and Multimodal dialogue systems, Wizard-of-Oz data collection, User Simulation methods, Reinforcement Learning, and Evaluation methodologies.

The book is a research guide for students and researchers with a background in Computer Science, AI, or Machine Learning. It navigates through a detailed case study in data-driven methods for development and evaluation of spoken dialogue systems. Common challenges associated with this approach are discussed and example solutions are provided. This work provides insights, lessons, and inspiration for future research and development – not only for spoken dialogue systems in particular, but for data-driven approaches to human-machine interaction in general.

Authors and Affiliations

  • , School of Mathematical &, Heriot-Watt University, Edinburgh, United Kingdom

    Verena Rieser

  • , Mathematics and Computer Science, Heriot Watt University, Edinburgh, United Kingdom

    Oliver Lemon

About the authors

Professor Oliver Lemon leads the Interaction Lab in the School of Mathematical and Computer Sciences (MACS) at Heriot-Watt University, Edinburgh. He previously worked at the School of Informatics, University of Edinburgh, and at Stanford University. His main expertise is in the area of machine learning methods for intelligent and adaptive multimodal interfaces, including work on Speech Recognition, Spoken Language Understanding, Dialogue Management, and Natural Language Generation. He applies this work in new interfaces for mobile search, virtual characters, Technology Enhanced Learning, and Human-Robot Interaction, in a variety of international research projects.

 

Dr Verena Rieser is a Lecturer in Computer Science at Heriot-Watt University, Edinburgh. She previously worked at Edinburgh University in the Schools of Informatics and GeoSciences, performing research in data-driven statistical methods for multimodal interfaces, as well as for modelling impacts of environmental change for sustainable development. She received her PhD (with distinction) from Saarland University in 2008, winning the Eduard-Martin prize.

Bibliographic Information

Buy it now

Buying options

Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access