Evolving coordinated group behaviours through maximisation of mean mutual information
- 249 Downloads
A well known problem in the design of the control system for a swarm of robots concerns the definition of suitable individual rules that result in the desired coordinated behaviour. A possible solution to this problem is given by the automatic synthesis of the individual controllers through evolutionary or learning processes. These processes offer the possibility to freely search the space of the possible solutions for a given task, under the guidance of a user-defined utility function. Nonetheless, there exist no general principles to follow in the definition of such a utility function in order to reward coordinated group behaviours. As a consequence, task dependent functions must be devised each time a new coordination problem is under study. In this paper, we propose the use of measures developed in Information Theory as task-independent, implicit utility functions. We present two experiments in which three robots are trained to produce generic coordinated behaviours. Each robot is provided with rich sensory and motor apparatus, which can be exploited to explore the environment and to communicate with other robots. We show how coordinated behaviours can be synthesised through a simple evolutionary process. The only criteria used to evaluate the performance of the robotic group is the estimate of mutual information between the motor states of the robots.
KeywordsEvolutionary robotics Information theory Mutual information
Unable to display preview. Download preview PDF.
- Cianci, C. M., Raemy, C., Pugh, J., & Martinoli, A. (2007). Communication in a swarm of miniature robots: the e-puck as an educational tool for swarm robotics. In E. Şahin, W. M. Spears, & A. F. T. Winfield (Eds.), Lecture notes in computer science: Vol. 4433. Swarm robotics—second SAB 2006 international workshop, revised selected papers (pp. 103–115), Rome, Italy, September 30–October 1, 2006. Berlin: Springer. Google Scholar
- Feldman, D. (2002). A brief introduction to: information theory, excess entropy and computational mechanics. (Technical report). College of the Atlantic, Bar Harbor, ME. Google Scholar
- Funes, P., Orme, B., & Bonabeau, E. (2003). Evolving emergent group behaviors for simple humans agents. In W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim, & J. Ziegler (Eds.), Lecture notes in artificial intelligence: Vol. 2801. Advances in artificial life. Proceedings of the 7th European conference on artificial life (ECAL 2003) (pp. 76–89). Berlin: Springer. Google Scholar
- Klyubin, A., Polani, D., & Nehaniv, C. (2005a). All else being equal being empowered. In M. Capcarrere, A. A. Freitas, P. J. Bentley, C. G. Johnson, & J. Timmis (Eds.), Lecture notes in artificial intelligence: Vol. 3630. Advances in artificial life. Proceedings of the 8th European conference on artificial life (ECAL 2005) (pp. 744–753). Berlin: Springer. Google Scholar
- Lungarella, M., & Pfeifer, R. (2001). Robots as cognitive tools: Information theoretic analysis of sensory-motor data. In Proceedings of the 2nd international IEEE/RSJ conference on humanoid robotics (pp. 245–252). Piscataway: IEEE Press. Google Scholar
- Mondada, F., & Bonani, M. (2007). The e-puck education robot. http://www.e-puck.org/.
- Nolfi, S., & Floreano, D. (2000). Evolutionary robotics: the biology, intelligence, and technology of self-organizing machines. Cambridge: MIT Press/Bradford Books. Google Scholar
- Olsson, L., Nehaniv, C., & Polani, D. (2005). Sensor adaptation and development in robots by entropy maximization of sensory data. In Proceedings of the 6th IEEE international symposium on computational intelligence in robotics and automation (CIRA-2005) (pp. 587–592). Piscataway: IEEE Computer Society. CrossRefGoogle Scholar
- Prokopenko, M., & Wang, P. (2003). Evaluating team performance at the edge of chaos. In D. Polani, B. Browning, A. Bonarini, & K. Yoshida (Eds.), Lecture notes in computer science: Vol. 3020. RoboCup 2003: robot soccer world cup VII (pp. 89–101). Berlin: Springer. Google Scholar
- Prokopenko, M., Gerasimov, V., & Tanev, I. (2006a). Evolving spatiotemporal coordination in a modular robotic system. In S. Nolfi, G. Baldassarre, R. Calabretta, J. C. T. Hallam, D. Marocco, J. A. Meyer, O. Miglino, & D. Parisi (Eds.), From animals to animats 9: 9th international conference on the simulation of adaptive behavior (SAB 2006) (pp. 558–569). Berlin: Springer. Google Scholar
- Prokopenko, M., Gerasimov, V., & Tanev, I. (2006b). Measuring spatiotemporal coordination in a modular robotic system. In L. M. Rocha, L. S. Yaeger, M. A. Bedau, D. Floreano, R. L. Goldstone, & A. Vespignani (Eds.), Artificial life X: proceedings of the tenth international conference on the simulation and synthesis of living systems (pp. 185–191). Cambridge: MIT Press. Google Scholar
- Quinn, M., Smith, L., Mayley, G., & Husbands, P. (2003). Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors. Philosophical Transactions of the Royal Society of London, Series A: Mathematical, Physical and Engineering Sciences, 361, 2321–2344. CrossRefMathSciNetGoogle Scholar
- Shannon, C. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379–423 and 623–656. Google Scholar
- Sporns, O., & Lungarella, M. (2006). Evolving coordinated behavior by maximizing information structure. In L. M. Rocha, L. S. Yaeger, M. A. Bedau, D. Floreano, R. L. Goldstone, & A. Vespignani (Eds.), Artificial life X: proceedings of the tenth international conference on the simulation and synthesis of living systems (pp. 323–329). Cambridge: MIT Press. Google Scholar
- Tarapore, D., Lungarella, M., & Gomez, G. (2004). Fingerprinting agent-environment interaction via information theory. In F. Groen, N. Amato, A. Bonarini, E. Yoshida, & B. Kröse (Eds.), Intelligent autonomous systems 8 (pp. 512–520). Amsterdam: IOS. Google Scholar
- Trianni, V., Nolfi, S., & Dorigo, M. (2008). Evolution, self-organisation and swarm robotics. In C. Blum & D. Merkle (Eds.), Natural computing series. Swarm intelligence. Introduction and applications. Berlin: Springer. Google Scholar