Abstract
Aims and Objectives
• To provide a brief historical background to neural networks.
• To investigate simple neural network architectures.
• To consider applications in the real world.
• To present working MATLAB program files for some neural networks.
• To introduce neurodynamics.
On completion of this chapter the reader should be able to
• use the generalized delta learning rule with backpropagation of errors to train a network;
• determine the stability of Hopfield networks using a suitable Lyapunov function;
• use the Hopfield network as an associative memory; •
study the dynamics of a neuromodule in terms of bistability, chaos, periodicity, quasiperiodicity, and chaos control.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Z.G. Bandar, D.A. McLean, J.D. O’Shea, J.A. Rothwell, Analysis of the behaviour of a subject. International Publication Number WO 02/087443 A1 (2002)
P. Dayan, L.F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (MIT Press, Cambridge, 2001)
M. Di Marco, M. Forti, A. Tesi, Existence and characterization of limit cycles in nearly symmetric neural networks. IEEE Trans. Circ. Syst. Fund. Theor. Appl. 49, 979–992 (2002)
W.J. Freeman, Neurodynamics: An Exploration in Mesoscopic Brain Dynamics (Perspectives in Neural Computing) (Springer, New York, 2000)
M.T. Hagan, H.B. Demuth, M.H. Beale, Neural Network Design (Brooks-Cole, Pacific Grove, 1995)
H. Haken, Brain Dynamics: An Introduction to Models and Simulations (Springer, New York, 2008)
D. Harrison, D.L. Rubinfeld, Hedonic prices and the demand for clean air. J. Environ. Econ. Manag. 5, 81–102 (1978)
S.O. Haykin, Neural Networks and Learning Machines, 3rd edn. (Prentice-Hall, Upper Saddle River, 2008)
J. Heaton, Introduction to the Math of Neural Networks (Kindle Edition) (Heaton Research Inc., Chesterfield, Missouri, 2012)
D.O. Hebb, The Organization of Behaviour (Wiley, New York, 1949)
J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)
J.J. Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Nat. Acad. Sci. 81, 3088–3092 (1984)
J.J. Hopfield, D.W. Tank, Neural computation of decisions in optimization problems. Biol. Cybern. 52, 141–154 (1985)
E.M. Izhikevich, Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting (Computational Neuroscience) (MIT Press, Cambridge, 2006)
T. Kohonen, Self-organized formation of topologically correct feature maps. Biol. Cybern. 43, 59–69 (1982)
B. Kosko, Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence (Prentice-Hall, Upper Saddle River, 1999)
W. McCulloch, W. Pitts, A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133 (1943)
M. Minsky, S. Papert, Perceptrons (MIT Press, Cambridge, 1969)
F. Pasemann, A simple chaotic neuron. Physica D 104, 205–211 (1997)
F. Pasemann, Driving neuromodules into synchronous chaos. Lect. Notes. Comput. Sci. 1606, 377–384 (1999)
F. Rosenblatt, The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65, 386–408 (1958)
J.A. Rothwell, Z. Bandar, J. O’Shea J., D. McLean, Silent talker: a new computer-based system for the analysis of facial cues to deception, Applied Cognitive Psychology 20, 757–777 (2006)
D.E. Rumelhart, J.L. McClelland (eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1 (MIT Press, Cambridge, 1986)
S. Samarasinghe, Neural Networks for Applied Sciences and Engineering (Auerbach, Boca Raton, 2006)
I.W. Sandberg (ed.), J.T. Lo, C.L. Fancourt, J. Principe, S. Haykin, S. Katargi, Nonlinear Dynamical Systems: Feedforward Neural Network Perspectives (Adaptive Learning Systems to Signal Processing, Communications and Control) (Wiley-Interscience, New York, 2001)
S.J. Schiff, K. Jerger, D.H. Doung, T. Chang, M.L. Spano, W.L. Ditto, Controlling chaos in the brain. Nature 370, 615 (1994)
M. Tahir, Java Implementation Of Neural Networks (BookSurge LLC, an Amazon.com Company, 2007)
B. Widrow, M.E. Hoff, Adaptive switching circuits, 1960 IRE WESCON Convention Record, New York, IRE Part 4 (1960), pp. 96–104
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Lynch, S. (2014). Neural Networks. In: Dynamical Systems with Applications using MATLAB®. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-06820-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-06820-6_18
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-319-06819-0
Online ISBN: 978-3-319-06820-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)