Dynamics of Learning In Hierarchical Models – Singularity and Milnor Attractor
We study the dynamics of learning in a hierarchical model such as multilayer perceptron. Such a model includes singularities, which affects its dynamics seriously. The Milnor type attractors appear, because of the singularity. We will show its trajectories explicitly, and present the topological nature of the singularities.
KeywordsDynamics of learning On-line learning Multilayer-perceptron Singularity Milnor attractor