Mathematical Methods of Operations Research

, Volume 78, Issue 1, pp 77–100

Conditional Markov equilibria in discounted dynamic games


    • Department of EconomicsUniversity of Turku
Original Article

DOI: 10.1007/s00186-013-0433-x

Cite this article as:
Kitti, M. Math Meth Oper Res (2013) 78: 77. doi:10.1007/s00186-013-0433-x


This paper introduces conditional Markov strategies in discrete-time discounted dynamic games with perfect monitoring. These are strategies in which players follow Markov policies after all histories. Policies induced by conditional Markov equilibria can be supported with the threat of reverting to the policy that yields the smallest expected equilibrium payoff for the deviator. This leads to a set-valued fixed-point characterization of equilibrium payoff functions. The result can be used for the computation of equilibria and for showing the existence in behavior strategies.


Dynamic gameSubgame perfect equilibriumMarkov policyDiscountingPerfect monitoring

Copyright information

© Springer-Verlag Berlin Heidelberg 2013