An Efficient Algorithm for Complex-Valued Neural Networks Through Training Input Weights
- 2.6k Downloads
Complex-valued neural network is a type of neural networks, which is extended from real number domain to complex number domain. Fully complex extreme learning machine (CELM) is an efficient algorithm, which owes faster convergence than the common complex backpropagation (CBP) neural networks. However, it needs more hidden neurons to reach competitive performance. Recently, an efficient learning algorithm is proposed for the single-hidden layer feed-forward neural network which is called the upper-layer-solution-aware algorithm (USA). Motivated by USA, an efficient algorithm for complex-valued neural networks through training input weights (GGICNN) has been proposed to train the split complex-valued neural networks in this paper. Compared with CELM and CBP, an illustrated experiment has been done in detail which observes the better generalization ability and more compact architecture for the proposed algorithm.
KeywordsComplex-valued Neural networks Extreme learning machine Complex backpropagation Gradient
This work was supported in part by the National Natural Science Foundation of China (No. 61305075), the China Postdoctoral Science Foundation (No. 2012M520624), the Natural Science Foundation of Shandong Province (No. ZR2013FQ004, ZR2013DM015, ZR2015AL014), the Specialized Research Fund for the Doctoral Program of Higher Education of China (No. 20130133120014) and the Fundamental Research Funds for the Central Universities (Nos. 14CX05042A, 15CX05053A, 15CX02079A, 15CX08011A, 15CX02064A).
- 10.Zhang, H., Liu, X., Xu, D., Zhang, Y.: Convergence analysis of fully complex backpropagation algorithm based on Wirtinger calculus. Cogn. Neurodyn. 46, 5789–5796 (2014)Google Scholar
- 12.Xu, D., Dong, J., Zhang, H.: Deterministic convergence of Wirtinger-gradient methods for complex-valued neural networks. Neural Process. Lett. 1–12 (2016)Google Scholar
- 17.Shukla, S., Yadav, R.N.: Regularized weighted circular complex-valued extreme learning machine for imbalanced learning. IEEE Access 3048–3057 (2016)Google Scholar