Skip to main content
SpringerLink
Log in

Game-Theoretic Reasoning About Actions in Nonmonotonic Causal Theories

  • Conference paper
Logic Programming and Nonmonotonic Reasoning (LPNMR 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3662))

Abstract

We present the action language \(\mathcal{GC}+\) for reasoning about actions in multi-agent systems under probabilistic uncertainty and partial observability, which is an extension of the action language \(\mathcal{C}+\) that is inspired by partially observable stochastic games (POSGs). We provide a finite-horizon value iteration for this framework and show that it characterizes finite-horizon Nash equilibria. We also describe how the framework can be implemented on top of nonmonotonic causal theories. We then present acyclic action descriptions in \(\mathcal{GC}+\) as a special case where transitions are computable in polynomial time. We also give an example that shows the usefulness of our approach in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bacchus, F., Halpern, J.Y., Levesque, H.J.: Reasoning about noisy sensors and effectors in the situation calculus. Artif. Intell. 111(1-2), 171–208 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  2. Baral, C., Tran, N., Tuan, L.-C.: Reasoning about actions in a probabilistic setting. In: Proceedings AAAI 2002, pp. 507–512 (2002)

    Google Scholar 

  3. Bernstein, D.S., Zilberstein, S., Immerman, N.: The complexity of decentralized control of Markov decision processes. In: Proceedings UAI 2000, pp. 32–37 (2000)

    Google Scholar 

  4. Boutilier, C.: Sequential optimality and coordination in multiagent systems. In: Proceedings IJCAI 1999, pp. 478–485 (1999)

    Google Scholar 

  5. Boutilier, C., Reiter, R., Price, B.: Symbolic dynamic programming for first-order MDPs. In: Proceedings IJCAI 2001, pp. 690–700 (2001)

    Google Scholar 

  6. Boutilier, C., Reiter, R., Soutchanski, M., Thrun, S.: Decision-theoretic, high-level agent programming in the situation calculus. In: Proceedings AAAI 2000, pp. 355–362 (2000)

    Google Scholar 

  7. Eiter, T., Faber, W., Leone, N., Pfeifer, G., Polleres, A.: A logic programming approach to knowledge-state planning, II: The DLV\(^\mathcal{K}\) system. Artif. Intell. 144(1-2), 157–211 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  8. Eiter, T., Lukasiewicz, T.: Probabilistic reasoning about actions in nonmonotonic causal theories. In: Proceedings UAI 2003, pp. 192–199 (2003)

    Google Scholar 

  9. Emery-Montemerlo, R., Gordon, G., Schneider, J., Thrun, S.: Game theoretic control for robot teams. In: Proceedings ICRA 2005, pp. 1175–1181 (2005)

    Google Scholar 

  10. Finzi, A., Lukasiewicz, T.: Game-theoretic reasoning about actions in nonmonotonic causal theories. Report Nr. 1843-05-04, Institut für Informationssysteme, TU Wien (2005)

    Google Scholar 

  11. Gardiol, N.H., Kaelbling, L.P.: Envelope-based planning in relational MDPs. In: Proceedings NIPS 2003 (2003)

    Google Scholar 

  12. Gelfond, M., Lifschitz, V.: Representing action and change by logic programs. J. Logic Program 17, 301–322 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  13. Giunchiglia, E., Lee, J., Lifschitz, V., McCain, N., Turner, H.: Nonmonotonic causal theories. Artif. Intell. 153(1-2), 49–104 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  14. Guestrin, C., Koller, D., Gearhart, C., Kanodia, N.: Generalizing plans to new environments in relational MDPs. In: Proceedings IJCAI 2003, pp. 1003–1010 (2003)

    Google Scholar 

  15. Hansen, E.A., Bernstein, D.S., Zilberstein, S.: Dynamic programming for partially observable stochastic games. In: Proceedings AAAI 2004, pp. 709–715 (2004)

    Google Scholar 

  16. Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101(1-2), 99–134 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  17. Littman, M.L.: Markov games as a framework for multi-agent reinforcement learning. In: Proceedings ICML 1994, pp. 157–163 (1994)

    Google Scholar 

  18. McCain, N., Turner, H.: Causal theories of action and change. In: Proceedings AAAI 1997, pp. 460–465 (1997)

    Google Scholar 

  19. McKelvey, R., McLennan, A.: Computation of equilibria in finite games. In: Handbook of Computational Economics, pp. 87–142. Elsevier, Amsterdam (1996)

    Google Scholar 

  20. Nair, R., Tambe, M., Yokoo, M., Pynadath, D.V., Marsella, S.: Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In: Proceedings IJCAI 2003, pp. 705–711 (2003)

    Google Scholar 

  21. Owen, G.: Game Theory, 2nd edn. Academic Press, London (1982)

    MATH  Google Scholar 

  22. Poole, D.: Decision theory, the situation calculus and conditional plans. Electronic Transactions on Artificial Intelligence 2(1-2), 105–158 (1998)

    MathSciNet  Google Scholar 

  23. Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, Chichester (1994)

    MATH  Google Scholar 

  24. Reiter, R.: Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems. MIT Press, Cambridge (2001)

    MATH  Google Scholar 

  25. van der Wal, J.: Stochastic Dynamic Programming. Mathematical Centre Tracts, vol. 139. Morgan Kaufmann, San Francisco (1981)

    MATH  Google Scholar 

  26. von Neumann, J., Morgenstern, O.: The Theory of Games and Economic Behavior. Princeton University Press, Princeton (1947)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut für Informationssysteme, Technische Universität Wien, Favoritenstraße 9-11, A-1040, Vienna, Austria

    Alberto Finzi & Thomas Lukasiewicz

  2. Dipartimento di Informatica e Sistemistica, Università di Roma “La Sapienza”, Via Salaria 113, I-00198, Rome, Italy

    Alberto Finzi & Thomas Lukasiewicz

Authors
  1. Alberto Finzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Lukasiewicz
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computing and Informatics, Arizona State University, 85287-8809, Tempe, AZ

    Chitta Baral

  2. Dipartimento di Matematica, Università della Calabria, I-87036, Rende, CS, Italy

    Gianluigi Greco  & Giorgio Terracina  & 

  3. Department of Mathematics, University of Calabria, 87036, Rende, CS, Italy

    Nicola Leone

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Finzi, A., Lukasiewicz, T. (2005). Game-Theoretic Reasoning About Actions in Nonmonotonic Causal Theories. In: Baral, C., Greco, G., Leone, N., Terracina, G. (eds) Logic Programming and Nonmonotonic Reasoning. LPNMR 2005. Lecture Notes in Computer Science(), vol 3662. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11546207_15

Download citation

  • DOI: https://doi.org/10.1007/11546207_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28538-0

  • Online ISBN: 978-3-540-31827-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation