Abstract
In this paper, we present a new learning method using prior information for three-layer neural networks. Usually when neural networks are used for identification of systems, all of their weights are trained independently, without considering interrelated weights values. Thus, the training results are usually not good. The reason for this in that each parameter has its influence on others during learning. To overcome this problem, we first give an exact mathematical equation that describes the relation between weight values given a set of data conveying prior information. The we present a new learning method that trains part of the weights and calculates the others using these exact mathematical equations. This method often a priori keeps the given mathematical structure exactly the same during learning; in other words, training is done so that the network follows a predetermined trajectory. Numerical computer simulation results are provided to support this approach.
Similar content being viewed by others
References
Daniel T, Hwang J-N (1997) Solving inverse problems by Bayesian neural network iterative inversion with ground truth incorporation. IEEE Trans Signal Process 45 (11):553–567
Myung H, Kim J-H, (1997) Time-varying two-phase optimization and its application to neural networks learning, IEEE Trans Neural Networks 8(6):1293–1300
Chen T, Chen H (1995) Approximation capability to functions of several variables. Nonlinear functional and operators by radial basis function neural networks. IEEE Trans Neural Networks 6(4):904–917
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Lu, B., Hirasawa, K. & Murata, J. A new learning method using prior information of neural networks. Artif Life Robotics 4, 78–83 (2000). https://doi.org/10.1007/BF02480860
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02480860