Advertisement

Learning a Markov process with a synchronous Boltzmann machine

  • Ursula Iturrarán
  • Antonia J. Jones
Plasticity Phenomena (Maturing, Learning and Memory)
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1240)

Abstract

In this paper we present the simulations of a synchronous Boltzmann machine which learns to model a Markov process. The advantage in using synchronous updating is lies in the parallelism that the model offers. Learning with synchronous Boltzmann machines provides an attractive alternative to asynchronous learning provided that one can establish a suitable theoretical framework. The dynamics of synchronous Boltzmann machines were first studied by W.A. Little [Little 1974], [Little 1978] and [Perreto 1984]. The aim of the present study is to present the results generated by a new local learning algorithm for synchronous Boltzmann machines. The algorithm uses Gradient-Descent to update weights and thresholds. Three different Markov processes were set to be modelled with a three unit network.

Keywords

Boltzmann machine Synchronous Learning Markov process Gradient-descent 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [Hinton et. al,]
    1986 Hinton G.E, and T.J Sejnowski. Learning and relearning in Boltzmann machines. In Parallel Distributed Processing: Explorations in Microstucture of Cognition (D.E. Rumelhart and J.L. McClelland eds.) Cambridge MA: MIT Press.Google Scholar
  2. [Iturrarán]
    1996 Ursula Iturrarán and Antonia J. Jones. Learning a Markov process with a synchronous Boltzmann machine. Research Report. Available from: Department of Computer Science, University of Wales, Cardiff, PO Box 916, CF2 3XF, UK.Google Scholar
  3. [Kullback]
    Kullback 1959 Information theory and statistics, Wiley, N.Y, 1959.Google Scholar
  4. [Little 1974]
    W. A. Little. The existence of persistent states in the brain. Math. Biosci. 19:101, 1974.Google Scholar
  5. [Little 1978]
    W. A. Little. and G. L. Shaw. Analytic study of the memory storage capability of a neural network. Mathematical Biosciences 39: 281–290, 1978.Google Scholar
  6. [Perreto]
    1984 P. Perreto. Collective properties of neural networks: A statistical physics approach. Biological Cybernetics. 50, 51–62.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Ursula Iturrarán
    • 1
  • Antonia J. Jones
    • 2
  1. 1.Department of Computing, Imperial College of Science Technology and MedicineUniversity of LondonLondonEngland UK
  2. 2.Department of Computer ScienceUniversity of WalesCardiffUK

Personalised recommendations