Abstract
Grouping motion, such as bird flocking, land animal herding, and fish schooling, is well-known in nature. Many observations have shown that there are no leading agents to control the behavior of the group. Several models have been proposed for describing the flocking behavior, which we regard as a distinctive example of the aggregate motions. In these models, some fixed rule is given to each of the individuals a priori for their interactions in reductive and rigid manner. Instead of this, we have proposed a new framework for self-organized flocking of agents by reinforcement learning. It will become important to introduce a learning scheme for making collective behavior in artificial autonomous distributed systems. In this paper, anti-predator behaviors of agents are examined by our scheme through computer simulations. We demonstrate the feature of behavior under two learning modes against agents of the same kind and predators.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Shaw, E.: Schooling Fishes. American Scientist 66, 166–175 (1978)
Partridge, B.L.: The structure and function of fish schools. Scientific American 246, 90–99 (1982)
Pitcher, T.J., Wyche, C.J.: Predator avoidance behaviour of sand-eel schools: why schools seldom split. In: Noakes, D.L.G., Lindquist, B.G., Helfman, G.S., Ward, J.A. (eds.) Predators and Prey in Fishes, pp. 193–204. Junk, The Hague (1983)
Aoki, I.: A Simulation Study on the Schooling Mechanism in Fish. Bulletin of the Japanese Society of Scientific Fisheries 48(8), 1081–1088 (1982)
Reynolds, C.W.: Flocks, Herds, and Schools: A Distributed Behavioral Model. Computer Graphics 21(4), 25–34 (1987)
Huth, A., Wissel, C.: The Simulation of the Movement of Fish Schools. Journal of Theoretical Biology 156, 365–385 (1992)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement Learning: A Survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)
Sutton, R.S., Barto, A.G.: Reinforcement Learning. MIT Press, Cambridge (1982)
Tomimasu, M., Morihiro, K., Nishimura, H., Isokawa, T., Matsui, N.: A Reinforcement Learning Scheme of Adaptive Flocking Behavior. In: Proceedings of the 10th International Conference on Artificial Life and Robotics (AROB), GS1-4, Oita, Japan, February 4-6 (2005)
Watkins, C.J.C.H., Dayan, P.: Q-learning. Machine Learning 8, 279–292 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Morihiro, K., Isokawa, T., Nishimura, H., Matsui, N. (2006). Emergence of Flocking Behavior Based on Reinforcement Learning. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893011_89
Download citation
DOI: https://doi.org/10.1007/11893011_89
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46542-3
Online ISBN: 978-3-540-46544-7
eBook Packages: Computer ScienceComputer Science (R0)