Skip to main content

Markov Decision Processes and the Belief-Desire-Intention Model

Bridging the Gap for Autonomous Agents

  • Book
  • © 2011

Overview

Part of the book series: SpringerBriefs in Computer Science (BRIEFSCOMPUTER)

This is a preview of subscription content, log in via an institution to check access.

Access this book

eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (6 chapters)

Keywords

About this book

In this work, we provide a treatment of the relationship between two models that have been widely used in the implementation of autonomous agents: the Belief DesireIntention (BDI) model and Markov Decision Processes (MDPs). We start with an informal description of the relationship, identifying the common features of the two approaches and the differences between them. Then we hone our understanding of these differences through an empirical analysis of the performance of both models on the TileWorld testbed. This allows us to show that even though the MDP model displays consistently better behavior than the BDI model for small worlds, this is not the case when the world becomes large and the MDP model cannot be solved exactly. Finally we present a theoretical analysis of the relationship between the two approaches, identifying mappings that allow us to extract a set of intentions from a policy (a solution to an MDP), and to extract a policy from a set of intentions.

Authors and Affiliations

  • , Department of Computer Science, University of Oxford, Oxford, United Kingdom

    Gerardo I. Simari

  • Brooklyn College, Dept. Computer & Information Science, City University of New York, Brooklyn, USA

    Simon D. Parsons

Bibliographic Information

  • Book Title: Markov Decision Processes and the Belief-Desire-Intention Model

  • Book Subtitle: Bridging the Gap for Autonomous Agents

  • Authors: Gerardo I. Simari, Simon D. Parsons

  • Series Title: SpringerBriefs in Computer Science

  • DOI: https://doi.org/10.1007/978-1-4614-1472-8

  • Publisher: Springer New York, NY

  • eBook Packages: Computer Science, Computer Science (R0)

  • Copyright Information: The Author(s) 2011

  • Softcover ISBN: 978-1-4614-1471-1Published: 16 September 2011

  • eBook ISBN: 978-1-4614-1472-8Published: 18 September 2011

  • Series ISSN: 2191-5768

  • Series E-ISSN: 2191-5776

  • Edition Number: 1

  • Number of Pages: VIII, 63

  • Topics: Artificial Intelligence, Simulation and Modeling

Publish with us