Abstract
Nowadays Decentralized Partial Observable Markov Decision Process framework represents the actual state of art in Multi-Agent System. Dec-POMDP incorporates the concepts of independent view and message exchange to the original POMDP model, opening new possibilities about the independent views for each agent in the system. Nevertheless there are some limitations about the communication.
About communication on MAS, Dec-POMDP is still focused in the message structure and content instead of the communication relationship between agents, which is our focus. On the other hand, the convergence on MAS is about the group of agents convergence as a whole, to achieve it the collaboration between the agents is necessary.
The collaboration and/or communication cost in MAS is high, in computational cost terms, to improve this is important to limit the communication between agents to the only necessary cases.
The present approach is focused in the impact of the communication limitation on MAS, and how it may improve the use of system resources, by reducing computational, without harming the global convergence. In this sense \(\delta \)-radius is a unified algorithm, based on Influence Value Reinforcement Learning and Independent Learning models, that allows restriction of the communication by the variation of \(\delta \).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Amato, C., Chowdhary, G., Geramifard, A., Ure, N., Kochenderfer, M.: Decentralized control of partially observable markov decision processes. In: 2013 IEEE 52nd Annual Conference on Decision and Control (CDC), pp. 2398–2405, December 2013
Barrios-Aranibar, D., Gonçalves, L.M.G.: Learning from delayed rewards using influence values applied to coordination in multi-agent systems. In: VIII SBAI-Simpósio Brasileiro de Automaç ao Inteligente (2007)
Barrios Aranibar, D., Gonçalves, L.M.G., de Carvalho, F.V.: Aprendizado por Reforço com Valores de Influência em Sistemas Multi-Agente (2009)
Goldman, C.V., Zilberstein, S.: Optimizing information exchange in cooperative multi-agent systems. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2003, pp. 137–144. ACM, New York (2003)
Guestrin, C., Venkataraman, S., Koller, D.: Context-specific multiagent coordination and planning with factored mdps. In: Proceedings of the Eighteenth National Conference on Artificial Intelligence and Fourteenth Conference on Innovative Applications of Artificial Intelligence, July 28 - August 1, 2002, Edmonton, Alberta, Canada, pp. 253–259 (2002)
Pini, G., Gagliolo, M., Brutschy, A., Dorigo, M., Birattari, M.: Task partitioning in a robot swarm: a study on the effect of communication. Swarm Intelligence 7(2), 173–199 (2013)
Tan, M.: Multi-agent reinforcement learning: independent versus cooperative agents. In: Proceedings of the Tenth International Conference on Machine Learning (ICML 1993), pp. 330–337. Morgan Kauffman, San Francisco (1993)
Whitehead, S.D.: A complexity analysis of cooperative mechanisms in reinforcement learning. In: Proceedings of AAAI 1991, Anaheim, CA, pp. 607–613 (1991)
Zhang, C., Lesser, V.: Coordinating multi-agent reinforcement learning with limited communication. In: Ito, J., Gini, S. (eds.) Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems, IFAAMAS, St. Paul, MN, pp. 1101–1108 (2013)
Zhang, K., Maeda, Y., Takahashi, Y.: Group behavior learning in multi-agent systems based on social interaction among agents. SCIS & ISIS 12010, 193–198 (2010)
Åström, K.: Optimal control of markov processes with incomplete state information. Journal of Mathematical Analysis and Applications 10(1), 174–205 (1965)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Camargo, J.A., Barrios-Aranibar, D. (2016). \(\delta \)-Radius Unified Influence Value Reinforcement Learning. In: Omatu, S., et al. Distributed Computing and Artificial Intelligence, 13th International Conference. Advances in Intelligent Systems and Computing, vol 474. Springer, Cham. https://doi.org/10.1007/978-3-319-40162-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-40162-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40161-4
Online ISBN: 978-3-319-40162-1
eBook Packages: EngineeringEngineering (R0)