Skip to main content

Pair-Associate Learning with Modulated Spike-Time Dependent Plasticity

  • Conference paper
Artificial Neural Networks and Machine Learning – ICANN 2012 (ICANN 2012)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7552))

Included in the following conference series:

  • 4088 Accesses

Abstract

We propose an associative learning model using reward modulated spike-time dependent plasticity in reinforcement learning paradigm. The task of learning is to associate a stimulus pair, known as the predictor − choice pair, to a target response. In our model, a generic architecture of neural network has been used, with minimal assumption about the network dynamics. We demonstrate that stimulus-stimulus-response association can be implemented in a stochastic way within a noisy setting. The network has rich dynamics resulting from its recurrent connectivity and background activity. The algorithm can learn temporal sequence detection and solve temporal XOR problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bi, G.Q., Poo, M.M.: Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength and postsynaptic cell type. J. Neurosci. 18, 10464–10472 (1998)

    Google Scholar 

  2. Gu, Q.: Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity. Neuroscience 111, 815–835 (2002)

    Article  Google Scholar 

  3. Smith, W.B., Starck, S.R., Roberts, R.W., Schuman, E.M.: Dopaminergic Stimulation of Local Protein Synthesis Enhances Surface Expression of GluR1 and Synaptic Transmission in Hippocampal Neurons. Neuron 45, 765–779 (2005)

    Article  Google Scholar 

  4. Wise, R.A.: Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483–494 (2004)

    Article  Google Scholar 

  5. Florian, R.V.: Reinforcement learning through modulation of spike-timing dependent synaptic plasticity. Neural Comput. 6, 1468–1502 (2007)

    Article  MathSciNet  Google Scholar 

  6. Izhikevich, E.M.: Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17, 2443–2452 (2007)

    Article  Google Scholar 

  7. Izhikevich, E.M.: Simple Model of Spiking Neurons. IEEE Trans. Neural Networks 14(6), 1569–1572 (2003)

    Article  MathSciNet  Google Scholar 

  8. Izhikevich, E.M.: Polychronization: Computation with Spikes. Neural Computation 18, 245–282 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  9. Gerstner, W., Kistler, W.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. University Press, Cambridge (2002)

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yusoff, N., Grüning, A., Notley, S. (2012). Pair-Associate Learning with Modulated Spike-Time Dependent Plasticity. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds) Artificial Neural Networks and Machine Learning – ICANN 2012. ICANN 2012. Lecture Notes in Computer Science, vol 7552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33269-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33269-2_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33268-5

  • Online ISBN: 978-3-642-33269-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics