Movement Prediction from Real-World Images Using a Liquid State Machine

  • Harald Burgsteiner
  • Mark Kröll
  • Alexander Leopold
  • Gerald Steinbauer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3533)


Prediction is an important task in robot motor control where it is used to gain feedback for a controller. With such a self-generated feedback, which is available before sensor readings from an environment can be processed, a controller can be stabilized and thus the performance of a moving robot in a real-world environment is improved. So far, only experiments with artificially generated data have shown good results. In a sequence of experiments we evaluate whether a liquid state machine in combination with a supervised learning algorithm can be used to predict ball trajectories with input data coming from a video camera mounted on a robot participating in the RoboCup. This pre-processed video data is fed into a recurrent spiking neural network. Connections to some output neurons are trained by linear regression to predict the position of a ball in various time steps ahead. Our results support the idea that learning with a liquid state machine can be applied not only to designed data but also to real, noisy data.


Output Neuron Recurrent Neural Network Movement Prediction Liquid Pool Supervise Learning Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jordan, M.I., Wolpert, D.M.: Computational motor control. In: Gazzaniga, M. (ed.) The Cognitive Neurosciences. MIT Press, Cambridge (1999)Google Scholar
  2. 2.
    Jaeger, H.: The echo state approach to analysing and training recurrent neural networks. Technical Report 148, GMD (2001)Google Scholar
  3. 3.
    Maass, W., Natschlaeger, T., Markram, T.: Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation 14(11), 2531–2560 (2002)zbMATHCrossRefGoogle Scholar
  4. 4.
    Maass, W., Legenstein, R.A., Markram, H.: A new approach towards vision suggested by biologically realistic neural microcircuit models. In: Bülthoff, H.H., Lee, S.-W., Poggio, T.A., Wallraven, C. (eds.) BMCV 2002. LNCS, vol. 2525, pp. 282–293. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Bear, M.F.: Neuroscience: Exploring the brain. Williams and Wilkins, Baltimore (2000)Google Scholar
  6. 6.
    Gupta, A., Wang, Y., Markram, H.: Organizing principles for a diversity of gabaergic interneurons and synapses in the neocortex. Science 287, 273–278 (2000)CrossRefGoogle Scholar
  7. 7.
    Thomson, A.M., West, D.C., Wang, Y., Bannister, A.P.: Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: Triple intracellular recordings and biocytin labelling in vitro. Cerebral Cortex 12(9), 936–953 (2002)CrossRefGoogle Scholar
  8. 8.
    Markram, H., Wang, Y., Tsodyks, M.: Differential signaling via the same axon of neocortical pyramidal neurons. PNAS 95(9), 5323–5328 (1998)CrossRefGoogle Scholar
  9. 9.
    Fraser, G., Steinbauer, G., Wotawa, F.: A modular architecture for a multi-purpose mobile robot. In: Orchard, B., Yang, C., Ali, M. (eds.) IEA/AIE 2004. LNCS (LNAI), vol. 3029, pp. 1007–1015. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Harald Burgsteiner
    • 1
  • Mark Kröll
    • 2
  • Alexander Leopold
    • 2
  • Gerald Steinbauer
    • 3
  1. 1.InfoMed/Health Care EngineeringGraz University of Applied SciencesGrazAustria
  2. 2.Institute for Theoretical Computer ScienceGraz University of TechnologyGrazAustria
  3. 3.Institute for Software TechnologyGraz University of TechnologyGrazAustria

Personalised recommendations