Abstract
Communication embodied the social characteristic of multi-agent systems. Agents could benefit from exchanging information. When communication incurs a cost, whether to communicate or not also becomes a decision to make. In this paper, we study communication decision problems with an extension framework of interactive dynamic influence diagrams (I-DIDs), we assume a communication sub-stage where all communication complete before deciding the regular action. In our framework, agent at higher level has a choice of performing a communication action just after the previous action finishes and before the next action is chosen. The purpose of communication is for higher level agent to send its current observation (real or deceptive) to other agent at lower level. Agent initiates communication so as to optimize the benefit it obtains as the result of the interaction. An example problem is studied under this framework. From this example we can see the impact communication policies have on the overall rewards of agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Huber, M., Durfee, E.: Deciding when to commit to action during observation-based coordination. In: Proceedings of the First International Conference on Multi-Agent Systems, pp. 163–170 (1995)
Gmytrasiewicz, P.J., Durfee, E.H.: Rational communication in multi-agent environments. Autonomous Agents and Multi-Agent Systems 4, 233–272 (2001)
Pynadath, D., Tambe, M.: Multi-agent teamwork: Analyzing the optimality and complexity of key theories and models. In: Proceedings of the First Autonomous Agents and Multi-Agent Systems Conference, pp. 873–880 (2002)
Xuan, P., Lesser, V., Zilberstein, S.: Communication decisions in multi-agent cooperation: model and experiments. In: Proceeding of the Fifth International Conference on Autonomous Agents, pp. 616–623. ACM Press (2001)
Goldman, C., Ziberstein, S.: Optimizing information exchange in cooperative multi-agent systems. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 137–144 (2003)
Seuken, S., Zilberstein, S.: Formal models and algorithms for decentralized decision making under uncertainty. Journal of Autonomous Agents and Multi-Agent Systems 17(2), 190–250 (2008)
Machennan, B.: Synthetic ethology: An approach to the study of communication. In: Langton, C.G., Taylor, C., Farmer, J.D., Rasmussen, S. (eds.) Artificial Life II. SFI Studies in the Sciences of Complexity, pp. 631–658. Addison-Wesley (1991)
Dunbar, R.: Theory of mind and the evolution of language. In: Hurford, J.R., Studdert-Kennedy, M., Knight, C. (eds.) Approaches to the Evolution of Language, pp. 92–100. Cambridge University Press (1998)
Pynadath, D.V., Tambe, M.: The communicative multiagent team decision problem: Analyzing teamwork theories and models. Journal of Artificial Intelligence Research 16, 389–423 (2002)
Goldman, C.V., Zilberstein, S.: Decentralized control of cooperative systems: Categorization and complexity analysis. Journal of Artificial Intelligence Research 22, 143–174 (2004)
Becker, R., Carlin, A., Lesser, V., Zilberstein, S.: Analyzing myopic approaches for multi-agent communication. Computational Intelligence 25(1), 31–50 (2009)
Carlin, A., Zilberstein, S.: Value of communication in decentralized POMDPs. In: AAMAS 2009 Workshop on Multi-Agent Sequential Decision-Making in Uncertain Domains (2009)
Doshi, P., Zeng, Y.F., Chen, Q.: Graphical models for interactive POMDPs: representations and solutions. Journal of Autonomous Agents and Multi-agent Systems 18(3), 376–416 (2009)
Polich, K., Gmytrasiewicz, P.: Interactive dynamic influence diagrams. In: 6th International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 147–149. ACM Press (2007)
Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101(2), 99–134 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, B., Luo, J. (2012). Interactive Dynamic Influence Diagrams Modeling Communication. In: Zhao, M., Sha, J. (eds) Communications and Information Processing. Communications in Computer and Information Science, vol 288. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31965-5_73
Download citation
DOI: https://doi.org/10.1007/978-3-642-31965-5_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31964-8
Online ISBN: 978-3-642-31965-5
eBook Packages: Computer ScienceComputer Science (R0)