Symmetric Strategy Improvement

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9135)

Abstract

Symmetry is inherent in the definition of most of the two-player zero-sum games, including parity, mean-payoff, and discounted-payoff games. It is therefore quite surprising that no symmetric analysis techniques for these games exist. We develop a novel symmetric strategy improvement algorithm where, in each iteration, the strategies of both players are improved simultaneously. We show that symmetric strategy improvement defies Friedmann’s traps, which shook the belief in the potential of classic strategy improvement to be polynomial.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Alur, R., Henzinger, T.A., Kupferman, O.: Alternating-time temporal logic. Journal of the ACM 49(5), 672–713 (2002)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Berwanger, D., Dawar, A., Hunter, P., Kreutzer, S.: DAG-width and parity games. In: Durand, B., Thomas, W. (eds.) STACS 2006. LNCS, vol. 3884, pp. 524–536. Springer, Heidelberg (2006) CrossRefGoogle Scholar
  3. 3.
    Björklund, H., Vorobyov, S.: A combinatorial strongly subexponential strategy improvement algorithm for mean payoff games. Discrete Appl. Math. 155(2), 210–229 (2007)MATHMathSciNetCrossRefGoogle Scholar
  4. 4.
    Browne, A., Clarke, E.M., Jha, S., Long, D.E., Marrero, W.: An improved algorithm for the evaluation of fixpoint expressions. TCS 178(1–2), 237–255 (1997)MATHMathSciNetCrossRefGoogle Scholar
  5. 5.
    Condon, A.: On algorithms for simple stochastic games. In: Advances in Computational Complexity Theory, pp. 51–73. American Mathematical Society (1993)Google Scholar
  6. 6.
    de Alfaro, L., Henzinger, T.A., Majumdar, R.: From verification to control: dynamic programs for omega-regular objectives. In: Proc. of LICS, pp. 279–290 (2001)Google Scholar
  7. 7.
    Emerson, E.A., Jutla, C.S.: Tree automata, \(\mu \)-calculus and determinacy. In: Proc. of FOCS, pp. 368–377. IEEE Computer Society Press, October 1991Google Scholar
  8. 8.
    Emerson, E.A., Jutla, C.S., Sistla, A.P.: On model-checking for fragments of \(\mu \)-calculus. In: Courcoubetis, C. (ed.) CAV 1993. LNCS, vol. 697, pp. 385–396. Springer, Heidelberg (1993) CrossRefGoogle Scholar
  9. 9.
    Emerson, E.A., Lei, C.: Efcient model checking in fragments of the propositional \(\mu \)-calculus. In: Proc. of LICS, pp. 267–278. IEEE Computer Society Press (1986)Google Scholar
  10. 10.
    Fearnley, J.: Exponential lower bounds for policy iteration. In: Abramsky, S., Gavoille, C., Kirchner, C., Meyer auf der Heide, F., Spirakis, P.G. (eds.) ICALP 2010. LNCS, vol. 6199, pp. 551–562. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  11. 11.
    Fearnley, J.: Non-oblivious strategy improvement. In: Clarke, E.M., Voronkov, A. (eds.) LPAR-16 2010. LNCS, vol. 6355, pp. 212–230. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  12. 12.
    Friedmann, O.: An exponential lower bound for the latest deterministic strategy iteration algorithms. LMCS 7(3) (2011)Google Scholar
  13. 13.
    Friedmann, O.: A Subexponential lower bound for Zadeh’s pivoting rule for solving linear programs and games. In: Günlük, O., Woeginger, G.J. (eds.) IPCO 2011. LNCS, vol. 6655, pp. 192–206. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  14. 14.
    Friedmann, O.: A superpolynomial lower bound for strategy iteration based on snare memorization. Discrete Applied Mathematics 161(10–11), 1317–1337 (2013)MATHMathSciNetCrossRefGoogle Scholar
  15. 15.
    Jurdziński, M.: Small progress measures for solving parity games. In: Reichel, H., Tison, S. (eds.) STACS 2000. LNCS, vol. 1770, pp. 290–301. Springer, Heidelberg (2000) CrossRefGoogle Scholar
  16. 16.
    Jurdzinski, M., Paterson, M., Zwick, U.: A deterministic subexponential algorithm for solving parity games. SIAM J. Comput. 38(4), 1519–1532 (2008)MATHMathSciNetCrossRefGoogle Scholar
  17. 17.
    Kozen, D.: Results on the propositional \(\mu \)-calculus. TCS 27, 333–354 (1983)MATHMathSciNetCrossRefGoogle Scholar
  18. 18.
    Lange, M.: Solving parity games by a reduction to SAT. In: Proc. of Int. Workshop on Games in Design and Verification (2005)Google Scholar
  19. 19.
    Lange, M., Friedmann, O.: The PGSolver collection of parity game solvers. Technical report, Institut für Informatik Ludwig-Maximilians-Universität (2010)Google Scholar
  20. 20.
    Ludwig, W.: A subexponential randomized algorithm for the simple stochastic game problem. Inf. Comput. 117(1), 151–155 (1995)MATHMathSciNetCrossRefGoogle Scholar
  21. 21.
    McNaughton, R.: Infinite games played on finite graphs. Ann. Pure Appl. Logic 65(2), 149–184 (1993)MATHMathSciNetCrossRefGoogle Scholar
  22. 22.
    Obdržálek, J.: Fast mu-calculus model checking when tree-width is bounded. In: Hunt Jr., W.A., Somenzi, F. (eds.) CAV 2003. LNCS, vol. 2725, pp. 80–92. Springer, Heidelberg (2003) CrossRefGoogle Scholar
  23. 23.
    Piterman, N.: From nondeterministic Büchi and Streett automata to deterministic parity automata. In: Proc. of LICS, pp. 255–264. IEEE Computer Society (2006)Google Scholar
  24. 24.
    Puri, A.: Theory of hybrid systems and discrete event systems. PhD thesis, Computer Science Department, University of California, Berkeley (1995)Google Scholar
  25. 25.
    Schewe, S.: Solving parity games in big steps. In: Arvind, V., Prasad, S. (eds.) FSTTCS 2007. LNCS, vol. 4855, pp. 449–460. Springer, Heidelberg (2007) CrossRefGoogle Scholar
  26. 26.
    Schewe, S.: An optimal strategy improvement algorithm for solving parity and payoff games. In: Kaminski, M., Martini, S. (eds.) CSL 2008. LNCS, vol. 5213, pp. 369–384. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  27. 27.
    Schewe, S., Finkbeiner, B.: Satisfiability and finite model property for the alternating-time \(\mu \)-calculus. In: Ésik, Z. (ed.) CSL 2006. LNCS, vol. 4207, pp. 591–605. Springer, Heidelberg (2006) CrossRefGoogle Scholar
  28. 28.
    Schewe, S., Finkbeiner, B.: Synthesis of asynchronous systems. In: Puebla, G. (ed.) LOPSTR 2006. LNCS, vol. 4407, pp. 127–142. Springer, Heidelberg (2007) CrossRefGoogle Scholar
  29. 29.
    Schewe, S., Trivedi, A., Varghese, T.: Symmetric strategy improvement (2015). CoRR, abs/1501.06484Google Scholar
  30. 30.
    Vardi, M.Y.: Reasoning about the past with two-way automata. In: Larsen, K.G., Skyum, S., Winskel, G. (eds.) ICALP 1998. LNCS, vol. 1443, pp. 628–641. Springer, Heidelberg (1998) CrossRefGoogle Scholar
  31. 31.
    Vöge, J., Jurdziński, K.: A discrete strategy improvement algorithm for solving parity games. In: Emerson, E.A., Sistla, A.P. (eds.) CAV 2000. LNCS, vol. 1855, pp. 202–215. Springer, Heidelberg (2000) CrossRefGoogle Scholar
  32. 32.
    Wilke, T.: Alternating tree automata, parity games, and modal \(\mu \)-calculus. Bull. Soc. Math. Belg. 8(2), May 2001Google Scholar
  33. 33.
    Zielonka, W.: Infinite games on finitely coloured graphs with applications to automata on infinite trees. Theor. Comput. Sci. 200(1–2), 135–183 (1998)MATHMathSciNetCrossRefGoogle Scholar
  34. 34.
    Zwick, U., Paterson, M.S.: The complexity of mean payoff games on graphs. Theoretical Computer Science 158(1–2), 343–359 (1996)MATHMathSciNetCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Sven Schewe
    • 1
  • Ashutosh Trivedi
    • 2
  • Thomas Varghese
    • 1
  1. 1.University of LiverpoolLiverpoolUK
  2. 2.Indian Institute of Technology BombayMumbaiIndia

Personalised recommendations