Multilayer Perceptron Learning Utilizing Reducibility Mapping
In the search space of MLP(J), multilayer perceptron having J hidden units, there exist flat areas called singular regions created by applying reducibility mapping to the optimal solution of MLP(J −1). Since such singular regions cause serious slowdown for learning, a learning method for avoiding singular regions has been aspired. However, such avoiding does not guarantee the quality of the final solutions. This paper proposes a new learning method which does not avoid but makes good use of singular regions to stably and successively find solutions excellent enough for MLP(J). The potential of the method is shown by our experiments using artificial and real data sets.
KeywordsMultilayer perceptron Learning method Reducibility mapping Singular region Polynomial network
Unable to display preview. Download preview PDF.
- 3.Duda, R.O., Hart, P.E., Stork, D.G.: Pattern classification, 2nd edn. John Wiley & Sons, Inc. (2001)Google Scholar
- 7.Luenberger, D.G.: Linear and nonlinear programming. Addison-Wesley (1984)Google Scholar
- 9.Nakano, R., Satoh, S., Ohwaki, T.: Learning method utilizing singular region of multilayer perceptron. In: Proc. 3rd Int. Conf. on Neural Computation Theory and Applications, pp. 106–111 (2011)Google Scholar
- 10.Watanabe, S.: Algebraic geometry and statistical learning theory. Cambridge Univ. Press (2009)Google Scholar