Skip to main content

Emergence of Flocking Behavior Based on Reinforcement Learning

  • Conference paper
Knowledge-Based Intelligent Information and Engineering Systems (KES 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4253))

Abstract

Grouping motion, such as bird flocking, land animal herding, and fish schooling, is well-known in nature. Many observations have shown that there are no leading agents to control the behavior of the group. Several models have been proposed for describing the flocking behavior, which we regard as a distinctive example of the aggregate motions. In these models, some fixed rule is given to each of the individuals a priori for their interactions in reductive and rigid manner. Instead of this, we have proposed a new framework for self-organized flocking of agents by reinforcement learning. It will become important to introduce a learning scheme for making collective behavior in artificial autonomous distributed systems. In this paper, anti-predator behaviors of agents are examined by our scheme through computer simulations. We demonstrate the feature of behavior under two learning modes against agents of the same kind and predators.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Shaw, E.: Schooling Fishes. American Scientist 66, 166–175 (1978)

    Google Scholar 

  2. Partridge, B.L.: The structure and function of fish schools. Scientific American 246, 90–99 (1982)

    Article  Google Scholar 

  3. Pitcher, T.J., Wyche, C.J.: Predator avoidance behaviour of sand-eel schools: why schools seldom split. In: Noakes, D.L.G., Lindquist, B.G., Helfman, G.S., Ward, J.A. (eds.) Predators and Prey in Fishes, pp. 193–204. Junk, The Hague (1983)

    Google Scholar 

  4. Aoki, I.: A Simulation Study on the Schooling Mechanism in Fish. Bulletin of the Japanese Society of Scientific Fisheries 48(8), 1081–1088 (1982)

    MathSciNet  Google Scholar 

  5. Reynolds, C.W.: Flocks, Herds, and Schools: A Distributed Behavioral Model. Computer Graphics 21(4), 25–34 (1987)

    Article  MathSciNet  Google Scholar 

  6. Huth, A., Wissel, C.: The Simulation of the Movement of Fish Schools. Journal of Theoretical Biology 156, 365–385 (1992)

    Article  Google Scholar 

  7. Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement Learning: A Survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)

    Google Scholar 

  8. Sutton, R.S., Barto, A.G.: Reinforcement Learning. MIT Press, Cambridge (1982)

    Google Scholar 

  9. Tomimasu, M., Morihiro, K., Nishimura, H., Isokawa, T., Matsui, N.: A Reinforcement Learning Scheme of Adaptive Flocking Behavior. In: Proceedings of the 10th International Conference on Artificial Life and Robotics (AROB), GS1-4, Oita, Japan, February 4-6 (2005)

    Google Scholar 

  10. Watkins, C.J.C.H., Dayan, P.: Q-learning. Machine Learning 8, 279–292 (1992)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Morihiro, K., Isokawa, T., Nishimura, H., Matsui, N. (2006). Emergence of Flocking Behavior Based on Reinforcement Learning. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893011_89

Download citation

  • DOI: https://doi.org/10.1007/11893011_89

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-46542-3

  • Online ISBN: 978-3-540-46544-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics