Intelligent Transmission Scheduling Based on Deep Reinforcement Learning
- 110 Downloads
With the increasing diversification of ship users’ communication services, the QoS of data transmission has become the limitation of the development of maritime communication. The software-defined maritime communication networks are proposed to solve the problem of communication mode obstacles in heterogeneous networks. Based on this framework, we propose a transmission scheduling scheme based on improved deep Q learning algorithm which combines the deep Q network with softmax classifier (also known as S-DQN algorithm) to improve throughput, balance delay and energy consumption. First of all, the Markov decision process (MDP) is used to realize the optimal scheduling strategy. In addition, the mapping relationship between the optimal policy and the obtained information is established by using the deep Q network in the system. When the input data arrives, after the amounts of data self-learning, the optimal strategy is made as quickly and accurately as possible. The simulation results show that the scheme is better than other traditional schemes under the different quality of service, which verifies the effectiveness of the scheme.
- 7.Qin, M., et al.: Learning-aided multiple time-scale SON function coordination in ultra-dense small-cell networks. IEEE Trans. Wireless Commun. 18(4), 2080–2092 (2019)Google Scholar
- 8.Mnih, V,Kavukcuoglu, K,Silver, D., et al.: Playing Atari with deep reinforcement learning. Computer Science (2013). arXiv:1312.5602
- 10.Van Hasselt, H., Guez, A., Silver, D.: Deep reinforcement learning with double q-learning. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp. 2094–2100 (2016)Google Scholar