Abstract
Many real-world applications require agents to cooperate and collaborate to accomplish shared missions; though, there are many instances where the agents should work together without communication or prior coordination. In the meantime, agents often coordinate in a decentralised manner to complete tasks that are displaced in an environment (e.g., foraging, demining, rescue or firefighting). Each agent in the team is responsible for selecting their own task and completing it autonomously. However, there is a possibility of an adversary in the team, who tries to prevent other agents from achieving their goals. In this study, we assume there is an agent who estimates the model of other agents in the team to boost the team’s performance regardless of the enemy’s attacks. Hence, we present On-line Estimators for Ad-hoc Task Allocation with Adversary (OEATA-A), a novel algorithm to have better estimations of the teammates’ future behaviour, which includes identifying enemies among friends.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Albrecht, S., Stone, P.: Reasoning about hypothetical agent behaviours and their parameters. In: Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS’17 (2017)
Albrecht, S.V., Ramamoorthy, S.: A game-theoretic model and best-response learning method for ad hoc coordination in multiagent systems. The University of Edinburgh, Technical report (2013)
Barrett, S., Rosenfeld, A., Kraus, S., Stone, P.: Making friends on the fly: cooperating with new teammates. Artif. Intell. 242, 132–171 (2017)
Berman, S., Halasz, A., Hsieh, M.A., Kumar, V.: Optimized stochastic policies for task allocation in swarms of robots. IEEE Trans. Robot. 25(4), 927–937 (2009)
Celli, A., Ciccone, M., Bongo, R., Gatti, N.: Coordination in adversarial sequential team games via multi-agent deep reinforcement learning. arXiv preprint arXiv:1912.07712 (2019)
Hart, P.E., Nilsson, N.J., Raphael, B.: A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybern. 4(2), 100–107 (1968)
Lin, J., Dzeparoska, K., Zhang, S.Q., Leon-Garcia, A., Papernot, N.: On the robustness of cooperative multi-agent reinforcement learning. arXiv preprint arXiv:2003.03722 (2020)
Mirchevska, V., Luštrek, M., Bežek, A., Gams, M.: Discovering strategic behaviour of multi-agent systems in adversary settings. Comput. Inform. 33(1), 79–108 (2014)
Phan, T., et al.: Learning and testing resilience in cooperative multi-agent systems. In: Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1055–1063 (2020)
Shafipour Yourdshahi, E., Do Carmo Alves, M., Soriano Marcolino, L., Angelov, P.: Decentralised task allocation in the fog: estimators for effective ad-hoc teamwork. In: 11th International Workshop on Optimization and Learning in Multiagent Systems (2020)
Uesato, J., et al.: Rigorous agent evaluation: an adversarial approach to uncover catastrophic failures. arXiv preprint arXiv:1812.01647 (2018)
Yourdshahi, E.S., Pinder, T., Dhawan, G., Marcolino, L.S., Angelov, P.: Towards large scale ad-hoc teamwork. In: 2018 IEEE International Conference on Agents (ICA), pp. 44–49. IEEE (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Shafipour, E., Fallah, S. (2021). Task-Based Ad-hoc Teamwork with Adversary. In: Fox, C., Gao, J., Ghalamzan Esfahani, A., Saaj, M., Hanheide, M., Parsons, S. (eds) Towards Autonomous Robotic Systems. TAROS 2021. Lecture Notes in Computer Science(), vol 13054. Springer, Cham. https://doi.org/10.1007/978-3-030-89177-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-89177-0_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89176-3
Online ISBN: 978-3-030-89177-0
eBook Packages: Computer ScienceComputer Science (R0)