Abstract
This paper reviews application of modern optimization methods for functionals describing digital predistortion (DPD) of signals with orthogonal frequency division multiplexing (OFDM) modulation. The considered family of model functionals is determined by the class of cascade Wiener–Hammerstein models, which can be represented as a computational graph consisting of various nonlinear blocks. To assess optimization methods with the best convergence depth and rate as a properties of this models family we multilaterally consider modern techniques used in optimizing neural networks and numerous numerical methods used to optimize non-convex multimodal functions.
The research emphasizes the most effective of the considered techniques and describes several useful observations about the model properties and optimization methods behavior.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Netw. 5(2), 157–166 (1994)
Briffa, M.A.: Linearization of RF power amplifiers. Ph.D. thesis, Victoria University (1996)
Chen, P., Alsahali, S., Alt, A., Lees, J., Tasker, P.J.: Behavioral modeling of GAN power amplifiers using long short-term memory networks. In: 2018 International Workshop on Integrated Nonlinear Microwave and Millimetre-Wave Circuits (INMMIC), pp. 1–3. IEEE (2018)
Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)
Ding, L., et al.: A robust digital baseband predistorter constructed using memory polynomials. IEEE Trans. Commun. 52(1), 159–165 (2004)
Ghannouchi, F.M., Hammi, O., Helaoui, M.: Behavioral Modeling and Predistortion of Wideband Wireless Transmitters. Wiley, Hoboken (2015)
Guan, L., Zhu, A.: Green communications: digital predistortion for wideband RF power amplifiers. IEEE Microwave Mag. 15(7), 84–99 (2014)
Hadi, M.U., Awais, M., Raza, M.: Multiband 5G NR-over-fiber system using analog front haul. In: 2020 International Topical Meeting on Microwave Photonics (MWP), pp. 136–139. IEEE (2020)
Hochreiter, S.: The vanishing gradient problem during learning recurrent neural nets and problem solutions. Internat. J. Uncertain. Fuzziness Know.-Based Syst. 6(02), 107–116 (1998)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Hornik, K.: Approximation capabilities of multilayer feedforward networks. Neural Netw. 4(2), 251–257 (1991)
Kang, S., Sung, E.T., Hong, S.: Dynamic feedback linearizer of RF CMOS power amplifier. IEEE Microwave Wirel. Compon. Lett. 28(10), 915–917 (2018)
Katz, A., Wood, J., Chokola, D.: The evolution of PA linearization: from classic feedforward and feedback through analog and digital predistortion. IEEE Microw. Mag. 17(2), 32–40 (2016)
Li, G., Zhang, Y., Li, H., Qiao, W., Liu, F.: Instant gated recurrent neural network behavioral model for digital predistortion of RF power amplifiers. IEEE Access 8, 67474–67483 (2020)
Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015)
Luongvinh, D., Kwon, Y.: Behavioral modeling of power amplifiers using fully recurrent neural networks. In: 2005 IEEE MTT-S International Microwave Symposium Digest, pp. 1979–1982. IEEE (2005)
Morgan, D.R., Ma, Z., Kim, J., Zierdt, M.G., Pastalan, J.: A generalized memory polynomial model for digital predistortion of RF power amplifiers. IEEE Trans. Signal Process. 54(10), 3852–3860 (2006)
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., Cottrell, G.: A dual-stage attention-based recurrent neural network for time series prediction. arXiv preprint arXiv:1704.02971 (2017)
Shih, S.-Y., Sun, F.-K., Lee, H.: Temporal pattern attention for multivariate time series forecasting. https://doi.org/10.48550/arxiv.1809.04206. https://arxiv.org/abs/1809.04206
Wang, D., Aziz, M., Helaoui, M., Ghannouchi, F.M.: Augmented real-valued time-delay neural network for compensation of distortions and impairments in wireless transmitters. IEEE Trans. Neural Netw. Learn. Syst. 30(1), 242–254 (2018)
Yu, H., Xu, G., Liu, T., Huang, J., Zhang, X.: A memory term reduction approach for digital pre-distortion using the attention mechanism. IEEE Access 7, 38185–38194 (2019)
Zhang, J.S., Xiao, X.C.: Predicting chaotic time series using recurrent neural network. Chin. Phys. Lett. 17(2), 88–90 (2000). https://doi.org/10.1088/0256-307x/17/2/004
Zhu, A.: Decomposed vector rotation-based behavioral modeling for digital predistortion of RF power amplifiers. IEEE Trans. Microw. Theory Tech. 63(2), 737–744 (2015)
Zhu, A., Pedro, J.C., Brazil, T.J.: Dynamic deviation reduction-based Volterra behavioral modeling of RF power amplifiers. IEEE Trans. Microw. Theory Tech. 54(12), 4323–4332 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Maslovskiy, A., Kunitsyn, A., Gasnikov, A. (2022). Application of Attention Technique for Digital Pre-distortion. In: Olenev, N., Evtushenko, Y., Jaćimović, M., Khachay, M., Malkova, V., Pospelov, I. (eds) Advances in Optimization and Applications. OPTIMA 2022. Communications in Computer and Information Science, vol 1739. Springer, Cham. https://doi.org/10.1007/978-3-031-22990-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-22990-9_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22989-3
Online ISBN: 978-3-031-22990-9
eBook Packages: Computer ScienceComputer Science (R0)