Recurrence Enhances the Spatial Encoding of Static Inputs in Reservoir Networks

  • Christian Emmerich
  • René Felix Reinhart
  • Jochen Jakob Steil
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6353)

Abstract

We shed light on the key ingredients of reservoir computing and analyze the contribution of the network dynamics to the spatial encoding of inputs. Therefore, we introduce attractor-based reservoir networks for processing of static patterns and compare their performance and encoding capabilities with a related feedforward approach. We show that the network dynamics improve the nonlinear encoding of inputs in the reservoir state which can increase the task-specific performance.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Verstraeten, D., Schrauwen, B.: On the Quantification of Dynamics in Reservoir Computing. In: Alippi, C., Polycarpou, M., Panayiotou, C., Ellinas, G. (eds.) ICANN 2009. LNCS, vol. 5768, pp. 985–994. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Jaeger, H.: The echo state approach to analysing and training recurrent neural networks. Technical Report 148, German National Research Center for Information Technology (2001)Google Scholar
  3. 3.
    Verstraeten, D., Schrauwen, B., Stroobandt, D.: Reservoir-based techniques for speech recognition. In: Proc. IEEE IJCNN, pp. 1050–1053 (2006)Google Scholar
  4. 4.
    Ozturk, M., Principe, J.: An associative memory readout for ESNs with applications to dynamical pattern recognition. Neural Networks 20(3), 377–390 (2007)MATHCrossRefGoogle Scholar
  5. 5.
    Huang, G., Zhu, Q., Siew, C.: Extreme learning machine: Theory and applications. Neurocomputing 70(1-3), 489–501 (2006)CrossRefGoogle Scholar
  6. 6.
    Frank, A., Asuncion, A.: UCI machine learning repository (2010), http://archive.ics.uci.edu/ml
  7. 7.
    Forina, M., Armanino, C.: Eigenvector projection and simplified nonlinear mapping of fatty acid content of italian olive oils. Ann. Chem. (72), 125–127 (1982)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Christian Emmerich
    • 1
  • René Felix Reinhart
    • 1
  • Jochen Jakob Steil
    • 1
  1. 1.Research Institute for Cognition and Robotics (CoR-Lab)Bielefeld UniversityBielefeldGermany

Personalised recommendations