Emergent behaviours based on episodic encoding and familiarity driven retrieval

  • Emilia I. Barakova
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3192)


In analogy to animal research, where behavioural and internal neu-ral dynamics are simultaneously analysed, this paper suggests a method for emergent behaviours arising in interaction with the underlying neural mech-anism. This way an attempt to go beyond the indeterministic nature of the emergent behaviours of robots is made. The neural dynamics is represented as an interaction of memories of experienced episodes, the current environ-mental input and the feedback of previous motor actions. The emergent prop-erties can be observed in a two staged process: exploratory (latent) learning and goal oriented learning. Correspondingly, the learning is dominated to a different extent by two factors: novelty and reward. While the reward learn-ing is used to show the relevance of the method, the novelty/familiarity is a basis for forming the emergent properties. The method is strongly inspired by the state of the art understanding of the hippocampal functioning and espe-cially its role in novelty detection and episodic memory formation in relation to spatial context.


Episodic Memory Place Cell Emergent Behaviour Hebbian Learning Novelty Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bunsey, M., Eichenbaum, H.B.: Conservation of hippocampal memory function in rats and humans. Nature (London) 379, 255–257 (1996)CrossRefGoogle Scholar
  2. 2.
    Eichenbaum, H., Dudchenko, P., Wood, E., Shapiro, M., Tanila, H.: The Hippocampus, Memory, and Place Cells: Is It Spatial Memory or a Memory Space? Neuron. Cell Press 23, 209–226 (1999)Google Scholar
  3. 3.
    Stark, C.E., Squire, L.R.: Simple and associative recognition memory in the hippocampal region. Learn. Mem. 8, 190–197 (1998)CrossRefGoogle Scholar
  4. 4.
    Franz, M.O., Mallot, H.A.: Biomimetic robot navigation. Robotics and Autonomous Systems 30, 133–153 (2000)CrossRefGoogle Scholar
  5. 5.
    Arleo, A., Gerstner, W.: Spatial cognition and neuro-mimetic navigation: A model of hippocampal place cell activity. Biological Cybernetics 83, 287–299 (2000)CrossRefGoogle Scholar
  6. 6.
    Burgess, N., Recce, M., O’Keefe, J.: A model of hippocampal function. Neural Networks 7, 1065–1081 (1994)zbMATHCrossRefGoogle Scholar
  7. 7.
    Touretzky, D.S., Redish, A.D.: Theory of rodent navigation based on interacting representations of space. Hippocampus 6, 247–270 (1996)CrossRefGoogle Scholar
  8. 8.
    Conway, M.A.: Sensory-perceptual episodic memory and its context: autobiographical memory. Phil. Trans. R. Soc. Lond. B 356, 1375–1384 (2001)CrossRefGoogle Scholar
  9. 9.
    Tulving, E., Donaldson, W.: Organization of memory. Acad. Press, New York (1972)Google Scholar
  10. 10.
    Barakova, E., Lourens, T.: Prediction of rapidly changing environmental dynamics for real time behaviour adaptation. In: Dynamic Perception, pp. 147–152. IOS press, Amsterdam (2002)Google Scholar
  11. 11.
    Pfeifer, R., Scheier, C.: Understanding Intelligence. MIT Press, Cambridge (1999)Google Scholar
  12. 12.
    O’Keefe, J., Nadel, L.: The Hippocampus as a Cognitive Map. Oxford Press (1971)Google Scholar
  13. 13.
    Schweighofer, N., Doya, K., Lay, F.: Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control. Neuro science 103, 35–50 (2002)Google Scholar
  14. 14.
    Zhang, L., Tao, H., Holt, C., Harris, W., Poo, M.: A critical window for cooperation and competition among developing retinotectal synapses. Nature 395 (1998)Google Scholar
  15. 15.
    Markram, H., Lubke, H., Frotscher, M., Sakmann, B.: Regulation of synaptic efficacy by coincidence of postsynaptic aps and epsps. Science 275, 213–215 (1997)CrossRefGoogle Scholar
  16. 16.
    Dayan, P., Abbott, L.F.: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. MIT Press, Cambridge MA (2001)zbMATHGoogle Scholar
  17. 17.
    Foster, D.J., Morris, R.G.M., Dayan, P.: A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10, 1–16 (2000)CrossRefGoogle Scholar
  18. 18.
    Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)Google Scholar
  19. 19.
    Fritzke, B.: Growing cell structures- a self organizing network for unsupervised and supervised learning. Neural Networks 7, 1441–1460 (1995)CrossRefGoogle Scholar
  20. 20.
    Martinetz, T., Schulten, K.: Topology representing networks. Neural Networks 7(3), 507–522 (1994)CrossRefGoogle Scholar
  21. 21.
    Barakova, E., Zimmer, U.: Dynamic Situation and Trajectory Discrimination by Means of Clustering and Summation of Raw Range Data, AISTA, Australia (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Emilia I. Barakova
    • 1
  1. 1.RIKEN BSISaitamaJapan

Personalised recommendations