The influence of the sigmoid function parameters on the speed of backpropagation learning

  • Jun Han
  • Claudio Moraga
Computational Models of Neurons and Neural Nets
Part of the Lecture Notes in Computer Science book series (LNCS, volume 930)

Abstract

Sigmoid function is the most commonly known function used in feed forward neural networks because of its nonlinearity and the computational simplicity of its derivative. In this paper we discuss a variant sigmoid function with three parameters that denote the dynamic range, symmetry and slope of the function respectively. We illustrate how these parameters influence the speed of backpropagation learning and introduce a hybrid sigmoidal network with different parameter configuration in different layers. By regulating and modifying the sigmoid function parameter configuration in different layers the error signal problem, oscillation problem and asymmetrical input problem can be reduced. To compare the learning capabilities and the learning rate of the hybrid sigmoidal networks with the conventional networks we have tested the two-spirals benchmark that is known to be a very difficult task for backpropagation and their relatives.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag 1995

Authors and Affiliations

  • Jun Han
    • 1
  • Claudio Moraga
    • 1
  1. 1.Research Group Computational Intelligence Dept. of Computer ScienceUniversity of DortmundDortmundGermany

Personalised recommendations