Boundedness of Weight Elimination for BP Neural Networks
- Cite this paper as:
- Wang J., Zurada J.M., Wang Y., Wang J., Xie G. (2014) Boundedness of Weight Elimination for BP Neural Networks. In: Rutkowski L., Korytkowski M., Scherer R., Tadeusiewicz R., Zadeh L.A., Zurada J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2014. Lecture Notes in Computer Science, vol 8467. Springer, Cham
Weight elimination can be usefully interpreted as an assumption about the prior distribution of the weights trained in the backpropagation neural networks (BPNN). Weight elimination based on different scaling of weight parameters is of a general form, with the weight decay and subset selection methods as special cases. The applications of this method have been well developed, however, only few references provides more comprehensive theoretical analysis. To address this issue, we investigate the uniform boundedness of the trained weights based on a descriptive proof.
Keywordsbackpropagation neural networks weight decay weight elimination boundedness
Unable to display preview. Download preview PDF.