Abstract
Learning automata act in a stochastic environment and are able to update their action probabilities considering the inputs from their environment, so optimizing their functionality as a result. In this paper, the goal is to investigate and evaluate the application of learning automata to cooperation in multi-agent systems, using soccer simulation server as a test bed. We have also evaluated our learning method in hard situations such as malfunctioning of some of the agents in the team and in situations that agents’ sense/act abilities have a lot of noise involved. Our experiment results show that learning automata adapt well with these situations.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Stone, P.: Layered Learning in Multi_Agent Systems, PhD thesis, School of Computer Science. Carnegie Mellon University (December 1998)
Kitano, H. (ed.): RoboCup-97: Robot Soccer World Cup I. Springer, Heidelberg (1998)
Andre, D., Corten, E., Dorer, K., Gugenberger, P., Joldos, M., Kummenje, J., Navaratil, P.A., Noda, I., Riley, P., Stone, P., Takahashi, R., Yeap, T.: Soccer server manual, version 4.0, Technical Report RoboCup –1998-2001, RoboCup (1998)
Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Prentice Hall, Inc., Englewood Cliffs (1989)
Khojasteh, M.R., Meybodi, M.R.: The Technique “Best Corner in State Square” for Generalization of Environmental States in a Cooperative Multi-agent Domain. In: CSICC 2003. Proceedings of the 8th annual CSI computer conference, pp. 446–455, Mashhad, Iran (February 25–27, 2003)
Khojasteh, M.R.: Cooperation in Multi-agent Systems using Learning Automata, M.Sc. thesis, Computer Engineering Faculty, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran (May 2002)
Khojasteh, M.R., Meybodi, M.R.: Using Learning Automata in Cooperation among Agents in a Team. In: Proceedings of the 12th Portuguese Conference on Artificial Intelligence, IEEE Conference Publication Program with ISBN 0-7803-9365-1 and IEEE Catalog Number 05EX1157, University of Beira Interior, pp. 306–312, Covilhã, Portugal (December 5-8, 2005)
Thathachar, M.A.L., Sastry, P.S.: A New Approach to the Design of Reinforcement Schemes for Learning Automata. IEEE Transactions on Systems, Man, and Cybernetics, SMC-15(1) (Janaury/February 1985)
Oomen, B.J., Lanctot, J.K.: Discretized Pursuit Learning Automata. IEEE Transactions on Systems, Man, and Cybernetics SMC-20(4) (July/August 1990)
Noda, I.: Team Description: Saloo, AIST & PREST, Japan (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khojasteh, M.R., Meybodi, M.R. (2007). Evaluating Learning Automata as a Model for Cooperation in Complex Multi-agent Domains. In: Lakemeyer, G., Sklar, E., Sorrenti, D.G., Takahashi, T. (eds) RoboCup 2006: Robot Soccer World Cup X. RoboCup 2006. Lecture Notes in Computer Science(), vol 4434. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74024-7_40
Download citation
DOI: https://doi.org/10.1007/978-3-540-74024-7_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74023-0
Online ISBN: 978-3-540-74024-7
eBook Packages: Computer ScienceComputer Science (R0)