Skip to main content

Spontaneous Dynamics and Associative Learning in an Assymetric Recurrent Random Neural Network

  • Chapter
Mathematics of Neural Networks

Part of the book series: Operations Research/Computer Science Interfaces Series ((ORCS,volume 8))

Abstract

Freeman’s investigations on the olfactory bulb of the rabbit showed that its dynamics was chaotic, and that recognition of a learned pattern is linked to a dimension reduction of the dynamics on a much simpler attractor (near limit cycle). We adress here the question wether this behaviour is specific of this particular architecture or if this kind of behaviour observed is an important property of chaotic neural network using a Hebb- like learning rule. In this paper, we use a mean-field theoretical statement to determine the spontaneous dynamics of an assymetric recurrent neural network. In particular we determine the range of random weight matrix for which the network is chaotic. We are able to explain the various changes observed in the dynamical regime when sending static random patterns. We propose a Hebb-like learning rule to store a pattern as a limit cycle or strange attractor. We numerically show the dynamics reduction of a finite-size chaotic network during learning and recognition of a pattern. Though associative learning is actually performed the low storage capacity of the system leads to the consideration of more realistic architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amari S.I., Characteristics of random nets of analog neuron-like elements, IEEE Trans.Syst.Man.Cyb, Vol. 2.5 (1972), pp643–657.

    Google Scholar 

  2. Babloyantz A., Nicolis C., Salazar J.M., Evidence of chaotic dynamics of brain activity during the sleep cycle, Phys. Lett. Vol. 111A (1985), pp152–156.

    Google Scholar 

  3. Cessac B., Increase in complexity in random neural networks, J.PhysI, Vol. 5 (1995), pp409–432.

    Google Scholar 

  4. Cessac B., Doyon B., Quoy M., Samuelides M., Mean-field equations, bifurcation map and route to chaos in: discrete time neural networks, Physica D, Vol. 74 (1994), pp 24–30

    Google Scholar 

  5. Doyon B., Cessac B., Quoy M., Samuelides M., Chaos in Neural Networks With Random Connectivity, International Journal Of Bifurcation and Chaos, Vol. 3 (1993), No. 2, pp279–291.

    Article  MATH  Google Scholar 

  6. Eckhorn R., Bauer R., Jordan W., Brosch M., Kruse W., Munk M., Reitboeck H.J., Coherent oscillations: A mechanism of feature linking in the visual cortex? Multiple electrode and correlation analysis in the cat, Biol. Cybernet. Vol. 60 (1988), pp121–130.

    Article  Google Scholar 

  7. Gray C.M., Koenig P., Engel A.K., Singer W. Oscillatory responses in cat visual cortex exhibit intercolumnar synchronisation which reflects global stimulus properties, Nature Vol. 338 (1989), pp334–337.

    Article  Google Scholar 

  8. Hirsch M.W., Convergent Activation Dynamics in Continuous Time Networks, Neural NetworksVol. 2 (1989), pp331–349.

    Article  Google Scholar 

  9. Skarda C.A., Freeman W.J., How brains make chaos in order to make sense of the world, Behav. Brain Sci. Vol. 10 (1987), pp161–195.

    Article  Google Scholar 

  10. Sompolinsky H., Crisanti A., Sommers H.J., Chaos in random neural networks, Phys. Rev. Lett. Vol. 61 (1988), pp259–262.

    Article  MathSciNet  Google Scholar 

  11. Yao Y., Freeman W.J., Model of biological pattern recognition with spatially chaotic dynamics, Neural Networks Vol. 3 (1990), pp153–170.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer Science+Business Media New York

About this chapter

Cite this chapter

Samuelides, M., Doyon, B., Cessac, B., Quoy, M. (1997). Spontaneous Dynamics and Associative Learning in an Assymetric Recurrent Random Neural Network. In: Ellacott, S.W., Mason, J.C., Anderson, I.J. (eds) Mathematics of Neural Networks. Operations Research/Computer Science Interfaces Series, vol 8. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-6099-9_54

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-6099-9_54

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-7794-8

  • Online ISBN: 978-1-4615-6099-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics