Abstract
A novel modeling based on deep learning framework which can exactly manifest the characteristics of nonlinear system is proposed in this paper. Specifically, a Deep Reconstruction Model (DRM) is defined integrating with the advantages of the deep learning and Elman neural network (ENN). The parameters of the model are initialized by performing unsupervised pre-training in a layer-wise fashion using restricted Boltzmann machines (RBMs) to provide a faster convergence rate for modeling. ENN can be used to manifest the memory effect of system. To validate the proposed approach, two different nonlinear systems are used for experiments. The first one corresponds to the class-D power amplifier which operates in the ohmic and cutoff regions. According to error of time domain and spectrum, back propagation neural network model improved by RBMs (BP-RBMs) and ENN are compared with different input signals which are the simulated two-tone signal and actual square wave signal. The second system is a permanent magnet synchronous motor servo control system based on fuzzy PID control strategy. In terms of simulated and actual speed curves, BP-RBMs, DRM and ENN models are adopted on comparison, respectively. It is shown by experimental results that the proposed model with fewer parameters and iteration number can reconstruct the nonlinear system accurately and depict the memory effect, the nonlinear distortion and the dynamic performance of system precisely.
Similar content being viewed by others
References
Zhu, Q., Wang, Y., Zhao, D.: Review of rational (total) nonlinear dynamic system modelling, identification, and control. Int. J. Syst. Sci. (2013)
Liu, T., Ye, Y., Zeng, X., Ghannouchi, F.M.: Memory effect modeling of wideband wireless transmitters using neural networks. In: IEEE International Conference on Circuits and Systems for Communications, pp. 703–707. IEEE (2008)
Amin, S., Landin, P.N., Handel, P., Ronnow, D.: Behavioral modeling and linearization of crosstalk and memory effects in RF MIMO transmitters. IEEE Trans. Microw. Theory Tech. 62(4), 810–823 (2014)
Jie, S., Peng, T., Yuan, X.: An improved synchronous control strategy based on fuzzy controller for PMSM. Elektronika Ir Elektrotechnika. 20(6), 17–23 (2014)
Xia, Z., Qiao, G., Zheng, T., Zhang, W.: Nonlinear modeling and dynamic analysis of the rotor-bearing system. Nonlinear Dyn. 57(4), 559–577 (2009)
Guo, Y., Guo, L.Z., Billings, S.A., Coca, D., Lang, Z.Q.: Volterra series approximation of a class of nonlinear dynamical systems using the Adomian decomposition method. Nonlinear Dyn. 74(1–2), 359–371 (2013)
Fehri, B., Boumaiza, S.: Baseband equivalent Volterra series for digital predistortion of dual-band power amplifiers. IEEE Trans. Microw. Theory Tech. 62(3), 700–714 (2014)
Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)
Langkvist, M., Karlsson, L., Loutfi, A.: A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recogn. Lett. 42(6), 11–24 (2014)
Xu, J., Li, H., Zhou, S.: Improving mixing rate with tempered transition for learning restricted Boltzmann machines. Neurocomputing 139, 328–335 (2014)
Huang, W., Song, G., Hong, H., Xie, K.: Deep architecture for traffic flow prediction: deep belief networks with multitask learning. IEEE Trans. Intell. Transp. Syst. 15(5), 2191–2201 (2014)
Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. (2009)
Erhan, D., Courville, A., Bengio, Y., Vincent, P.: Why does unsupervised pre-training help deep learning. J. Mach. Learn. Res. 11(3), 625–660 (2010)
Salakhutdinov, R., Hinton, G.: An efficient learning procedure for deep Boltzmann machines. Neural Comput. 24(8), 1967–2006 (2012)
Song, Qing: On the weight convergence of Elman networks. IEEE Trans. Neural Netw. 21(3), 463–480 (2010)
Mkadem, F., Boumaiza, S.: Physically inspired neural network model for RF power amplifier behavioral modeling and digital predistortion. IEEE Trans. Microw. Theory Tech. 59(4), 913–923 (2011)
Wisell, D.H., Rudlund, B., Ronnow, D.: Characterization of memory effects in power amplifiers using digital two-tone measurements. IEEE Trans. Instrum. Meas. 56(6), 2757–2766 (2007)
Acknowledgments
This work was supported in part by the Foundation of Key Laboratory of China’s Education Ministry and A Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jin, X., Shao, J., Zhang, X. et al. Modeling of nonlinear system based on deep learning framework. Nonlinear Dyn 84, 1327–1340 (2016). https://doi.org/10.1007/s11071-015-2571-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-015-2571-6