Abstract
In a Network Multiagent System (NMAS), agent learning is one of the most investigated attribute and vital issues in terms of enhancing the global productivity of the system. The work in this paper implements a new approach that uses neighboring agent characteristics to improve the learning performance of an agent in NMAS considering social networks. The main contributions of this work are: First, it presents the basic principles of multi-agent learning while considering various learning issues. Second, it reviews the main research developments in the field of multi-agent learning. Third, it introduces a network multi-agent learning framework by considering the neighboring agent characteristics, i.e., the relative degree of neighboring nodes and past interaction histories of neighboring agents in a social network. Furthermore, the proposed framework is experimentally assessed by implementing various social networks (scale-free and small-world) in the form of a NMAS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Claus, C., Boutilier, C.: The Dynamics of reinforcement learning in cooperative multiagent systems. In: Proceedings of the Fifteenth National Conference on Artificial Intelligence, pp. 746–752 (1998)
Franchi, E.: A multi-agent implementation of social networks. In: Proceedings of the 11th {WOA} 2010 Workshop, Dagli Oggetti Agli Agenti, Rimini, Italy (2010)
Franchi, E., Poggi, A.: Multi-Agent systems and social networks. Handbook of Research on Business Social Networking: Organizational, Managerial, and Technological Dimensions. IGI Global, Hershey, Pennsylvania, pp. 84–97 (2011)
Hao, J., Leung, H.: The dynamics of reinforcement social learning in cooperative multiagent systems. In: Proceedings of IJCAI 2013, Beijing, pp. 184–190 (2013)
Hao, J., Leung, H.: Achieving socially optimal outcomes in multiagent systems with reinforcement social learning. ACM Trans. Auton. Adapt. Syst. 8(3), 1–23 (2013)
Hao, J., Huang, D., Cai, Y., Leung, H.: Networked reinforcement social learning towards coordination in cooperative multiagent systems. In: 26th IEEE International Conference on Tools with Artificial Intelligence (2014)
Hao, J., Leung, H.: Reinforcement social learning of coordination in cooperative multiagent systems (extended abstract). In: Proceedings of AAMAS 2013, Saint Paul, pp. 1321–1322 (2013)
Hao, J., Huang, D., Cai, Y., Leung, H.: The dynamics of reinforcement social learning in networked cooperative multiagent systems. In: Proceedings of AAAI 1958, pp. 111–122 (2017)
Hao, J.Y., Leung, H. F.: Learning to achieve social rationality using tag mechanism in repeated interactions. In: Proceedings of ICTAI 2011, pp. 148–155 (2011)
Jiang, Y., Zhou, Y., Wang, W.: Task allocation for undependable multiagent systems in social networks. IEEE Trans. Parallel Distrib. Syst. 24(8), 1671–1681 (2013)
Jiang, Y., Jiang, J.C.: Understanding social networks from a multiagent perspective. IEEE Trans. Parallel Distrib. Syst. 25(10), 2743–2759 (2013)
Kapetanakis, S., Kudenko, D.: Reinforcement learning of coordination in cooperative multiagent systems. In: Proceedings of the AAAI 2002, pp. 326–331 (2002)
Lauer, M., Riedmiller, M.: An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: Proceedings of ICML 2000, pp. 535–542 (2012)
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., Mordatch, I.: Multi-Agent actor-critic for mixed cooperative-competitive environments. In: Proceedings of 2017 Conference on Neural Information Processing Systems (2017)
Matignon, L., Laurent, G.J., Le For-Piat, N.: Independent reinforcement learners in cooperative Markov games: a survey regarding coordination problems. Knowl. Eng. Rev. 27, 1–31 (2012)
Matlock, M., Sen, S.: Effective tag mechanisms for evolving coordination. In: Proceedings of AAMAS 2007, pp. 1340–1347 (2007)
Matthew, E.G., Marie des, J.: Social network structures and their impact on multi-agent system dynamics. In: Proceedings of FLAIRS 2005, pp. 32–37 (2005)
Multi-Agent system. Wikipedia, Wikipedia Foundation. https://en.wikipedia.org/wiki/Multi-agent_system. Accessed 5 Jan 2018
Glavic, M.: Agents and Multi-Agent Systems: A Short Introduction for Power Engineers. http://www.montefiore.ulg.ac.be/~glavic/MAS-Intro_Tech_report.pdf
Silva, F., Glatt, R., Costa, A.H.R.: Simultaneously learning and advising in multi-agent reinforcement learning. In: Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems (AAMAS 2017). International Foundation for Autonomous Agents and Multiagent Systems, Richland, pp. 1100–1108 (2017)
Tuyls, K., Weiss, G.: Multiagent learning: basics, challenges, and prospects. AI Mag. 33(3), 41–50 (2012)
Wooldridge, M.: An Introduction to Multiagent Systems. John Wiley, Hoboken (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kaur, H., Devi, G. (2019). Impact of Neighboring Agent’s Characteristics with Q-Learning in Network Multi-agent System. In: Luhach, A., Singh, D., Hsiung, PA., Hawari, K., Lingras, P., Singh, P. (eds) Advanced Informatics for Computing Research. ICAICR 2018. Communications in Computer and Information Science, vol 955. Springer, Singapore. https://doi.org/10.1007/978-981-13-3140-4_67
Download citation
DOI: https://doi.org/10.1007/978-981-13-3140-4_67
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3139-8
Online ISBN: 978-981-13-3140-4
eBook Packages: Computer ScienceComputer Science (R0)