Information Dynamics of Evolved Agents

  • Paul L. Williams
  • Randall D. Beer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6226)


Information-theoretic techniques have received much recent attention as tools for the analysis of embodied agents. However, while techniques for quantifying static information structure are well-established, the application of information theory to the analysis of temporal behavior is still in its infancy. Here we formulate a novel information-theoretic approach for analyzing the dynamics of information flow in embodied systems. To demonstrate our approach, we apply it to analyze a previously evolved model of relational categorization. The results of this analysis demonstrate the unique strengths of our approach for exploring the detailed structure of information dynamics, and point towards a natural synergy between temporally-extended information theory and dynamical systems theory.


Information Gain Information Dynamics Object Size Stimulus Feature Size Information 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ay, N., Polani, D.: Information flows in causal networks. Advances in Complex Systems 11(1), 17 (2008)zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Beer, R.D.: The dynamics of active categorical perception in an evolved model agent. Adaptive Behavior 11(4), 209–243 (2003)CrossRefGoogle Scholar
  3. 3.
    Butts, D.A.: How much information is associated with a particular stimulus? Network 14, 177–187 (2003)CrossRefGoogle Scholar
  4. 4.
    Cover, T.M., Thomas, J.A.: Elements of Information Theory, 2nd edn. Wiley-Interscience, New York (2006)zbMATHGoogle Scholar
  5. 5.
    DeWeese, M.R., Meister, M.: How to measure the information gained from one symbol. Network 10, 325–340 (1999)zbMATHCrossRefGoogle Scholar
  6. 6.
    Keinan, A.: Controlled analysis of neurocontrollers with informational lesioning. Philosophical Transactions of the Royal Society A 361(1811), 2123–2144 (2003)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Liang, X.S., Kleeman, R.: A rigorous formalism of information transfer between dynamical system components. II. Continuous flow. Physica D 227(2), 173–182 (2007)zbMATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Lizer, J.T., Prokopenko, M., Zomaya, A.: Local information transfer as a spatiotemporal filter for complex systems. Physical Review E 77, 26110 (2008)CrossRefGoogle Scholar
  9. 9.
    Lizier, J.T., Prokopenko, M., Tanev, I., Zomaya, A.Y.: Emergence of glider-like structures in a modular robotic system. Proceedings of ALife XI, 366–373 (2008)Google Scholar
  10. 10.
    Lungarella, M., Pegors, T., Bulwinkle, D., Sporns, O.: Methods for quantifying the informational structure of sensory and motor data. Neuroinformatics 3(3), 243–262 (2005)CrossRefGoogle Scholar
  11. 11.
    Lungarella, M., Sporns, O.: Mapping information flow in sensorimotor networks. PLoS Computational Biology 2(10), 1301–1312 (2006)CrossRefGoogle Scholar
  12. 12.
    Nehaniv, C.L., Mirza, N.A., Olsson, L.: Development via information self-structuring of sensorimotor experience. In: Lungarella, M., Iida, F., Bongard, J.C., Pfeifer, R. (eds.) 50 Years of Aritficial Intelligence. LNCS (LNAI), vol. 4850, pp. 87–98. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  13. 13.
    Pearl, J.: Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge (2000)zbMATHGoogle Scholar
  14. 14.
    Polani, D., Sporns, O., Lungarella, M.: How information and embodiment shape intelligent information processing. In: Lungarella, M., Iida, F., Bongard, J.C., Pfeifer, R. (eds.) 50 Years of Aritficial Intelligence. LNCS (LNAI), vol. 4850, pp. 99–111. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  15. 15.
    Prokopenko, M., Gerasimov, V., Tanev, I.: Evolving spatiotemporal coordination in a modular robotic system. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J.C.T., Marocco, D., Meyer, J.-A., Miglino, O., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 548–559. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  16. 16.
    Schreiber, T.: Measuring information transfer. Physical Review Letters 85(2), 461–464 (2000)CrossRefGoogle Scholar
  17. 17.
    Scott, D.W.: Multivariate Density Estimation: Theory, Practice, and Visualization. Wiley-Interscience, Hoboken (1992)zbMATHCrossRefGoogle Scholar
  18. 18.
    Seth, A.: Causal networks in simulated neural systems. Cognitive Neurodynamics 2(1), 49–64 (2008)CrossRefGoogle Scholar
  19. 19.
    Seth, A., Edelman, G.: Environment and behavior influence the complexity of evolved neural networks. Adaptive Behavior 12, 5–20 (2004)CrossRefGoogle Scholar
  20. 20.
    Sporns, O., Lungarella, M.: Evolving coordinated behavior by maximizing information structure. ALifeX, 323–329 (2006)Google Scholar
  21. 21.
    Strogatz, S.H.: Nonlinear Dynamics and Chaos. Addison-Wesley, Reading (1994)Google Scholar
  22. 22.
    Tarapore, D., Lungarella, M., Gómez, G.: Quantifying patterns of agent–environment interaction. Robotics and Autonomous Systems 54(2), 150–158 (2006)CrossRefGoogle Scholar
  23. 23.
    Williams, P.L., Beer, R.D., Gasser, M.: An embodied dynamical approach to relational categorization. In: CogSci 2008, pp. 223–228 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Paul L. Williams
    • 1
  • Randall D. Beer
    • 1
    • 2
  1. 1.Cognitive Science Program 
  2. 2.School of Informatics and ComputingIndiana UniversityBloomingtonUSA

Personalised recommendations