Abstract
Synthesis of bulletproof strategies in imperfect information scenarios is a notoriously hard problem. In this paper, we suggest that it is sometimes a viable alternative to aim at “reasonably good” strategies instead. This makes sense not only when an ideal strategy cannot be found due to the complexity of the problem, but also when no winning strategy exists at all. We propose an algorithm for synthesis of such “pretty good” strategies. The idea is to first generate a surely winning strategy with perfect information, and then iteratively improve it with respect to two criteria of dominance: one based on the amount of conflicting decisions in the strategy, and the other related to the tightness of its outcome set. We focus on reachability goals and evaluate the algorithm experimentally with very promising results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
i.e., initial states of the strategy.
- 2.
Preliminary experiments for coalitions of drones are presented in Sect. 6.
References
Alur, R., et al.: MOCHA: modularity in model checking. Technical report, University of Berkeley (2000)
Alur, R., Henzinger, T.A., Kupferman, O.: Alternating-time temporal logic. In: Proceedings of the 38th Annual Symposium on Foundations of Computer Science (FOCS), pp. 100–109. IEEE Computer Society Press (1997)
Alur, R., Henzinger, T.A., Kupferman, O.: Alternating-time temporal logic. J. ACM 49, 672–713 (2002). https://doi.org/10.1145/585265.585270
Aminof, B., Malvone, V., Murano, A., Rubin, S.: Graded modalities in strategy logic. Inf. Comput. 261, 634–649 (2018). https://doi.org/10.1016/j.ic.2018.02.022
Belardinelli, F., Condurache, R., Dima, C., Jamroga, W., Jones, A.: Bisimulations for verification of strategic abilities with application to ThreeBallot voting protocol. In: Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 1286–1295. IFAAMAS (2017)
Belardinelli, F., Lomuscio, A.: Agent-based abstractions for verifying alternating-time temporal logic with imperfect information. In: Proceedings of AAMAS, pp. 1259–1267. ACM (2017)
Berthon, R., Maubert, B., Murano, A., Rubin, S., Vardi, M.Y.: Strategy logic with imperfect information. In: Proceedings of LICS, pp. 1–12 (2017). https://doi.org/10.1109/LICS.2017.8005136
Berthon, R., Maubert, B., Murano, A., Rubin, S., Vardi, M.Y.: Strategy logic with imperfect information. ACM Trans. Comput. Log. 22(1), 5:1–5:51 (2021). https://doi.org/10.1145/3427955
Bryant, R.E.: Graph-based algorithms for Boolean function manipulation. IEEE Trans. Comput. 35(8), 677–691 (1986)
Bulling, N., Dix, J., Jamroga, W.: Model checking logics of strategic ability: complexity. In: Dastani, M., Hindriks, K., Meyer, J.J. (eds.) Specification and Verification of Multi-agent Systems, pp. 125–159. Springer, Boston (2010). https://doi.org/10.1007/978-1-4419-6984-2_5
Bulling, N., Jamroga, W.: What agents can probably enforce. Fund. Inform. 93(1–3), 81–96 (2009)
Bulling, N., Jamroga, W.: Alternating epistemic mu-calculus. In: Proceedings of IJCAI-11, pp. 109–114 (2011)
Burch, J.R., Clarke, E.M., McMillan, K.L., Dill, D.L., Hwang, L.J.: Symbolic model checking: 10-20 states and beyond. In: Proceedings of 4th Annual IEEE Symposium on Logic in Computer Science (LICS), pp. 428–439. IEEE Computer Society (1990)
Busard, S.: Symbolic model checking of multi-modal logics: uniform strategies and rich explanations. Ph.D. thesis, Universite Catholique de Louvain (2017)
Busard, S., Pecheur, C., Qu, H., Raimondi, F.: Improving the model checking of strategies under partial observability and fairness constraints. In: Merz, S., Pang, J. (eds.) ICFEM 2014. LNCS, vol. 8829, pp. 27–42. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11737-9_3
Busard, S., Pecheur, C., Qu, H., Raimondi, F.: Reasoning about memoryless strategies under partial observability and unconditional fairness constraints. Inf. Comput. 242, 128–156 (2015). https://doi.org/10.1016/j.ic.2015.03.014
Calta, J., Shkatov, D., Schlingloff, H.: Finding uniform strategies for multi-agent systems. In: Dix, J., Leite, J., Governatori, G., Jamroga, W. (eds.) CLIMA 2010. LNCS (LNAI), vol. 6245, pp. 135–152. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14977-1_12
Čermák, P., Lomuscio, A., Mogavero, F., Murano, A.: MCMAS-SLK: a model checker for the verification of strategy logic specifications. In: Biere, A., Bloem, R. (eds.) CAV 2014. LNCS, vol. 8559, pp. 525–532. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08867-9_34
Cermák, P., Lomuscio, A., Murano, A.: Verifying and synthesising multi-agent systems against one-goal strategy logic specifications. In: Proceedings of AAAI, pp. 2038–2044 (2015)
Chatterjee, K., Doyen, L., Henzinger, T., Raskin, J.F.: Algorithms for omega-regular games of incomplete information. Log. Methods Comput. Sci. 3(3), 4 (2007)
Clarke, E., Emerson, E.: Design and synthesis of synchronization skeletons using branching time temporal logic. In: Kozen, D. (ed.) Logic of Programs 1981. Lecture Notes in Computer Science, vol. 131, pp. 52–71. Springer, Cham (1981). https://doi.org/10.1007/bfb0025774
Dembiński, P., et al.: \(\surd \)erics: a tool for verifying timed automata and estelle specifications. In: Garavel, H., Hatcliff, J. (eds.) TACAS 2003. LNCS, vol. 2619, pp. 278–283. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-36577-X_20
Dima, C., Maubert, B., Pinchinat, S.: The expressive power of epistemic \(\mu \)-calculus. CoRR abs/1407.5166 (2014)
Dima, C., Maubert, B., Pinchinat, S.: Relating paths in transition systems: the fall of the modal mu-calculus. In: Italiano, G.F., Pighizzini, G., Sannella, D.T. (eds.) MFCS 2015. LNCS, vol. 9234, pp. 179–191. Springer, Heidelberg (2015). https://doi.org/10.1007/978-3-662-48057-1_14
Dima, C., Tiplea, F.: Model-checking ATL under imperfect information and perfect recall semantics is undecidable. CoRR abs/1102.4225 (2011)
Doyen, L., Raskin, J.F.: Games with imperfect information: theory and algorithms. In: Lecture Notes in Game Theory for Computer Scientists, pp. 185–212. Cambridge University Press (2011)
Gammie, P., van der Meyden, R.: MCK: model checking the logic of knowledge. In: Alur, R., Peled, D.A. (eds.) CAV 2004. LNCS, vol. 3114, pp. 479–483. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-27813-9_41
Huang, X., van der Meyden, R.: Symbolic model checking epistemic strategy logic. In: Proceedings of AAAI Conference on Artificial Intelligence, pp. 1426–1432 (2014)
Jamroga, W.: Logical Methods for Specification and Verification of Multi-agent Systems. ICS PAS Publishing House (2015)
Jamroga, W., Dix, J.: Model checking ATL\(_{ir}\) is indeed \(\Delta _2^P\)-complete. In: Proceedings of EUMAS. CEUR Workshop Proceedings, vol. 223 (2006)
Jamroga, W., Penczek, W., Dembiński, P., Mazurkiewicz, A.: Towards partial order reductions for strategic ability. In: Proceedings of the 17th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 156–165. IFAAMAS (2018)
Jamroga, W., Knapik, M.: Some things are easier for the dumb and the bright ones (beware the average!). In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI, pp. 1734–1740 (2019). https://doi.org/10.24963/ijcai.2019/240
Jamroga, W., Knapik, M., Kurpiewski, D., Mikulski, Ł.: Approximate verification of strategic abilities under imperfect information. Artif. Intell. 277 (2019). https://doi.org/10.1016/j.artint.2019.103172
Kurpiewski, D., Jamroga, W., Knapik, M.: STV: Model checking for strategies under imperfect information. In: Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems AAMAS 2019, pp. 2372–2374. IFAAMAS (2019)
Kurpiewski, D., Knapik, M., Jamroga, W.: On domination and control in strategic ability. In: Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems AAMAS 2019, pp. 197–205. IFAAMAS (2019)
Kurpiewski, D., Pazderski, W., Jamroga, W., Kim, Y.: STV+reductions: towards practical verification of strategic ability using model reductions. In: Proceedings of AAMAS, pp. 1770–1772. ACM (2021)
Lomuscio, A., Qu, H., Raimondi, F.: MCMAS: an open-source model checker for the verification of multi-agent systems. Int. J. Softw. Tools Technol. Transf. 19(1), 9–30 (2017). https://doi.org/10.1007/s10009-015-0378-x
Lomuscio, A., Raimondi, F.: Model checking knowledge, strategies, and games in multi-agent systems. In: Proceedings of International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 161–168 (2006). https://doi.org/10.1145/1160633.1160660
Mogavero, F., Murano, A., Perelli, G., Vardi, M.: Reasoning about strategies: on the model-checking problem. ACM Trans. Comput. Log. 15(4), 1–42 (2014)
Mogavero, F., Murano, A., Vardi, M.: Reasoning about strategies. In: Proceedings of FSTTCS, pp. 133–144 (2010)
Peterson, G., Reif, J.: Multiple-person alternation. In: Proceedings of the 20th Annual Symposium on Foundations of Computer Science (FOCS), pp. 348–363. IEEE Computer Society Press (1979)
Pilecki, J., Bednarczyk, M.A., Jamroga, W.: Synthesis and verification of uniform strategies for multi-agent systems. In: Bulling, N., van der Torre, L., Villata, S., Jamroga, W., Vasconcelos, W. (eds.) CLIMA 2014. LNCS (LNAI), vol. 8624, pp. 166–182. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09764-0_11
Pilecki, J., Bednarczyk, M., Jamroga, W.: SMC: synthesis of uniform strategies and verification of strategic ability for multi-agent systems. J. Log. Comput. 27(7), 1871–1895 (2017). https://doi.org/10.1093/logcom/exw032
Raimondi, F., Lomuscio, A.: Automatic verification of multi-agent systems by model checking via ordered binary decision diagrams. J. Appl. Log. 5(2), 235–251 (2007)
Schobbens, P.Y.: Alternating-time logic with imperfect recall. Electron. Notes Theor. Comput. Sci. 85(2), 82–93 (2004)
Acknowledgements
The work was supported by NCBR Poland and FNR Luxembourg under the PolLux/FNR-CORE projects STV (POLLUX-VII/1/2019 and C18/IS/12685695/IS/STV/Ryan), SpaceVote (POLLUX-XI/14/SpaceVote/2023 and C22/IS/17232062/SpaceVote) and PABLO (C21/IS/16326754/PABLO). The work of Damian Kurpiewski was also supported by the CNRS IEA project MoSART.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jamroga, W., Kurpiewski, D. (2023). Pretty Good Strategies and Where to Find Them. In: Malvone, V., Murano, A. (eds) Multi-Agent Systems. EUMAS 2023. Lecture Notes in Computer Science(), vol 14282. Springer, Cham. https://doi.org/10.1007/978-3-031-43264-4_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-43264-4_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43263-7
Online ISBN: 978-3-031-43264-4
eBook Packages: Computer ScienceComputer Science (R0)