Abstract
The class of discounted switching controller stochastic games can be solved in one step by a linear complementarity program (LCP). Following the proof of this technical result is a discussion of a special formulation and initialization of a standard LCP pivoting algorithm which has, in numerical experiments, always terminated in a complementary solution. That the LCP algorithm as formulated always finds a complementary solution has not yet been proven, but these theoretical and experimental results have the potential to provide an alternative proof of the ordered field property for these games. Numerical experimentation with the reformulated LCP is reviewed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Raghavan, T. E. S., andFilar, J.,Algorithms for Stochastic Games—A Survey, Research Report 88-06, Department of Mathematics, University of Maryland, Baltimore County, 1988.
Filar, J.,Ordered Field Property for Stochastic Games When the Player Who Controls Transitions Changes from State to State, Journal of Optimization Theory and Applications, Vol. 34, pp. 505–517, 1981.
Vrieze, O., Tijs, S., Raghavan, T. E. S., andFilar, J.,A Finite Algorithm for the Switching Controller Stochastic Games, OR Spektrum, Vol. 5, pp. 15–24, 1983.
Filar, J. A., andSchultz, T.,Bilinear Programming and Structured Stochastic Games, Journal of Optimization Theory and Applications, Vol. 53, pp. 85–104, 1987.
Mohan, S. R., andRaghavan, T. E. S.,An Algorithm for Discounted Switching Control Games, OR Spektrum, Vol. 9, pp. 41–45, 1987.
Lemke, C.,Bimatrix Equilibrium Points and Mathematical Programming, Management Science, Vol. 11, pp. 681–689, 1965.
Cottle, R., andDantzig, G.,Complementary Pivot Theory of Mathematical Programming, Linear Algebra and Applications, Vol. 1, pp. 103–125, 1968.
Shapley, L.,Stochastic Games, Proceedings of the National Academy of Sciences, Vol. 39, pp. 1095–1100, 1953.
Rothblum, U.,Solving Stopping Stochastic Games by Maximizing a Linear Function Subject to Quadratic Constraints, Game Theory and Related Topics, Edited by O. Moeschlin and D. Pallaschke, North-Holland Publishing Company, Amsterdam, Holland, pp. 103–105, 1979.
Vrieze, O.,Stochastic Games with Finite State and Action Spaces, PhD Dissertation. Free University, Amsterdam, The Netherlands, 1984.
Raghavan, T. E. S., Tijs, S., andVrieze, O.,On Stochastic Games with Additive Reward and Transition Structure, Journal of Optimization Theory and Applications, Vol. 47, pp. 451–464, 1985.
Filar, J., Schultz, T., Thijsman, D., andVrieze, O. J.,Nonlinear Programming and Stationary Equilibria in Stochastic Games, Mathematical Programming, Vol. 50, pp. 227–237, 1991.
Mangasarian, O.,Linear Complementarity Problems Solvable by a Single Linear Program, Mathematical Programming, Vol. 10, pp. 263–270, 1976.
Author information
Authors and Affiliations
Additional information
Communicated by P. L. Yu
Rights and permissions
About this article
Cite this article
Schultz, T.A. Linear complementarity and discounted switching controller stochastic games. J Optim Theory Appl 73, 89–99 (1992). https://doi.org/10.1007/BF00940080
Issue Date:
DOI: https://doi.org/10.1007/BF00940080