Abstract
5G Networks and Multi-access Edge Computing (MEC) will serve various use cases of emerging technologies with a wide range of requirements of multiple resources. Network slicing being the promising technology of providing virtual infrastructure, which can be customized according to the different use case requirements. Network slicing at the edge becomes new paradigm to providing cloud capabilities at the edge of Radio Access Network (RAN). In this chapter, we propose a Reinforcement Learning-based Deep Q-Network (DQN) approach to learn an optimal policy by constantly interacting with the task off-loader (environment) where the problem is modelled as a Markov decision process (MDP) while using a deep neural network to estimate the reward and transition functions. The simulation results show that the learned policy based on the proposed schema provides optimal compute performance while maintaining lower networking costs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Afolabi, Ibrahim, et al. “Network slicing and softwarization: A survey on principles, enabling technologies, and solutions.” IEEE Communications Surveys & Tutorials 20.3 (2018): 2429–2453.
Gupta, R. K., & Sahoo, B. (2018). Security Issues in Software-Defined Networks. IUP Journal of Information Technology, 14(2).
Gupta, R. K., Choubey, A., Jain, S., Greeshma, R. R., & Misra, R. (2020, July). Machine learning based network slicing and resource allocation for electric vehicles (EVs). In International Conference on Internet of Things and Connected Technologies (pp. 333–347). Springer, Cham.
Hu, Yun Chao, et al. “Mobile edge computing—A key technology towards 5G.” ETSI white paper 11.11 (2015): 1–16.
Hassan, Najmul, Kok-Lim Alvin Yau, and Celimuge Wu. “Edge computing in 5G: A review.” IEEE Access 7 (2019): 127276–127289.
Gupta, R. K., & Misra, R. (2019, December). Machine learning-based slice allocation algorithms in 5G networks. In 2019 International Conference on Advances in Computing, Communication and Control (ICAC3) (pp. 1–4). IEEE.
A. Filali, A. Abouaomar, S. Cherkaoui, A. Kobbane and M. Guizani, “Multi-Access Edge Computing: A Survey,” in IEEE Access, vol. 8, pp. 197017–197046, 2020, https://doi.org/10.1109/ACCESS.2020.3034136.
Li, J., Gao, H., Lv, T., & Lu, Y. (2018, April). Deep reinforcement learning based computation offloading and resource allocation for MEC. In 2018 IEEE Wireless Communications and Networking Conference (WCNC) (pp. 1–6). IEEE.
Gupta, R. K., Ranjan, A., Moid, M. A., & Misra, R. (2020, July). Deep-Learning based mobile-traffic forecasting for resource utilization in 5G network slicing. In International Conference on Internet of Things and Connected Technologies (pp. 410–424). Springer, Cham.
Y. Chen, Z. Liu, Y. Zhang, Y. Wu, X. Chen and L. Zhao, “Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things,” in IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4925–4934, July 2021, https://doi.org/10.1109/TII.2020.3028963.
L. Huang, S. Bi and Y. -J. A. Zhang, “Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks,” in IEEE Transactions on Mobile Computing, vol. 19, no. 11, pp. 2581–2593, 1 Nov. 2020, https://doi.org/10.1109/TMC.2019.2928811.
I. AlQerm and J. Pan, “Enhanced Online Q-Learning Scheme for Resource Allocation with Maximum Utility and Fairness in Edge-IoT Networks,” in IEEE Transactions on Network Science and Engineering, vol. 7, no. 4, pp. 3074–3086, 1 Oct.–Dec. 2020, https://doi.org/10.1109/TNSE.2020.3015689.
W. Zhang et al., “Deep Reinforcement Learning Based Resource Management for DNN Inference in IIoT,” GLOBECOM 2020 - 2020 IEEE Global Communications Conference, 2020, pp. 1–6, https://doi.org/10.1109/GLOBECOM42002.2020.9322223.
X. Xiong, K. Zheng, L. Lei and L. Hou, “Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing,” in IEEE Journal on Selected Areas in Communications, vol. 38, no. 6, pp. 1133–1146, June 2020, https://doi.org/10.1109/JSAC.2020.2986615.
X. Liu, Z. Qin and Y. Gao, “Resource Allocation for Edge Computing in IoT Networks via Reinforcement Learning,” ICC 2019 - 2019 IEEE International Conference on Communications (ICC), Shanghai, China, 2019, pp. 1–6, https://doi.org/10.1109/ICC.2019.8761385.
N. Mohan and J. Kangasharju, “Edge-Fog cloud: A distributed cloud for Internet of Things computations,” 2016 Cloudification of the Internet of Things (CIoT), Paris, France, 2016, pp. 1–6, https://doi.org/10.1109/CIOT.2016.7872914.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gupta, R.K., Pannu, P., Misra, R. (2023). Resource Allocation in 5G and Beyond Edge-Slice Networking Using Deep Reinforcement Learning. In: Misra, R., Omer, R., Rajarajan, M., Veeravalli, B., Kesswani, N., Mishra, P. (eds) Machine Learning and Big Data Analytics. ICMLBDA 2022. Springer Proceedings in Mathematics & Statistics, vol 401. Springer, Cham. https://doi.org/10.1007/978-3-031-15175-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-15175-0_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15174-3
Online ISBN: 978-3-031-15175-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)