ISNN 2005: Advances in Neural Networks – ISNN 2005 pp 1028-1033 | Cite as
A Modified MCA EXIN Algorithm and Its Convergence Analysis
Abstract
The minor component is the eigenvector associated with the smallest eigenvalue of the covariance matrix of the input data. The minor component analysis (MCA) is a statistical method for extracting the minor component. Many neural networks have been proposed to solve MCA. However, there exists the problem of the divergence of the norm of the weight vector in these neural networks. In this paper, a modification to the well known MCA EXIN algorithm is presented by adjusting the learning rate. The modified MCA EXIN algorithm can guarantee that the norm of the weight vector of the neural network converges to a constant. Mathematical proofs and simulation results are given to show the convergence of the algorithm.
Keywords
Neural Network Weight Vector Learning Rate Convergence Analysis Mathematical ProofPreview
Unable to display preview. Download preview PDF.
References
- 1.Gao, K., Ahmad, M.O., Swamy, M.N.: Learning Algorithm for Total Least Squares Adaptive Signal Processing. Electron. Lett. 28, 430–432 (1992)CrossRefGoogle Scholar
- 2.Xu, L., Oja, E., Suen, C.: Modified Hebbian Learning for Curve and Surface Fitting. Neural Networks 5, 441–457 (1992)CrossRefGoogle Scholar
- 3.Fiori, S., Piazza, F.: Neural MCA for Robust Beamforming. In: Proc of International Symposium on circuits and Systems (ISCAS 2000), vol. III, pp. 614–617 (2000)Google Scholar
- 4.Cirrincione, M., Cirrincione, G., Herault, J., Huffel, S.V.: The MCA EXIN Neuron for the Minor Component Analysis. IEEE Trans. Neural Networks 13, 160–187 (2002)CrossRefGoogle Scholar
- 5.Taleb, A., Cirrincione, G.: Against the Convergence of the Minor Component Analysis Neurons. IEEE Trans. Neural Networks 10, 207–210 (1999)CrossRefGoogle Scholar
- 6.Zufiria, P., On, J.: the Discrete-time Dynamics of the Basic Hebbian Neural-network Nodes. IEEE Trans. Neural Networks 13, 1342–1352 (2002)CrossRefGoogle Scholar