Skip to main content
SpringerLink
Log in

Cellular Licensed Band Sharing Technology Among Mobile Operators: A Reinforcement Learning Perspective

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Next-generation wireless networks will need to support of very high data rates and low–latency communications, which will require a new wireless radio technology paradigm. The growing number of mobile users is causing spectrum scarcity; and hence, an efficient spectrum utilization method is required. Conventional scheduling-based resource allocation scheme in wireless networks under limited resources is a challenging due to the complex network situations, dynamic network environment, and diverse needs for future networks. To overcome resource scarcity in mobile networks, spectrum sharing among multiple operators may be an efficient solution. Traditional methods of dynamic spectrum sharing are model-dependent, and they are not robust to the changing wireless environments. To enable low-latency communications for complex future wireless networks, efficient machine learning algorithms can be used across the wireless network infrastructure. Integrating machine learning for resource allocation can leverage intelligent and efficient mechanisms for dynamic wireless networks. To efficiently and intelligently utilize the scarce resources of dynamic networks, this paper proposes an efficient machine learning-based spectrum sharing method among multiple mobile network operators (MNOs). A mobile network operator uses the idle slots of the another operator and transmits the information efficiently. Using the neural network model, each MNO learns the spectrum utilization of other MNOs and selects the idle slots of other MNOs. Simulation results have been computed and compared with the conventional scheme where resources are not shared. These simulation results show that the proposed neural network model can efficiently learn the network quickly, and spectrum sharing can lead to improved network performance in terms of the delay, user-perceived throughput, resource usage, packet drop, and sum throughput of the network.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Calvanese Strinati, E., Barbarossa, S., Gonzalez-Jimenez, J. L., & Ktenas, D. (2019). 6G: The Next Frontier: From Holographic Messaging to Artificial Intelligence Using Subterahertz and Visible Light Communication. IEEE Vehicular Technology Magazine, 14(3), 42–50.

    Article  Google Scholar 

  2. Zhang, L., Xiao, M., Wu, G., Alam, M., Liang, Y.-C., & Li, S. (2017). A survey of advanced techniques for spectrum sharing in 5G networks. IEEE Wireless Communications, 24(5), 44–51.

    Article  Google Scholar 

  3. Lin, Y. T., Tembine, H., & Chen, K. C. (2012). Inter-operator spectrum sharing in future cellular systems. IEEE Global Communications Conference (GLOBECOM), 2597–2602.

  4. Luo, J., Eichinger, J., Zhao, Z., & Schulz, E. (2014). Multi-carrier waveform based flexible inter-operator spectrum sharing for 5G systems. IEEE DySPAN, 449–457.

  5. Moon, B. (2017). Dynamic spectrum access for internet of things service in cognitive radio-enabled LPWANs. Sensors (Switzerland), 17.

  6. Bkassiny, M., Li, Y., & Jayaweera, S. K. (2013). A survey on machine learning techniques in cognitive radios. IEEE Communications Surveys and Tutorials, 15(3), 1136–1159.

    Article  Google Scholar 

  7. Wang, W., Kwasinski, A., Niyato, D., & Han, Z. (2016). A survey on applications of model-free strategy learning in cognitive wireless networks. IEEE Communications Surveys and Tutorials, 18(3), 1717–1757.

    Article  Google Scholar 

  8. Thilina, K. M., Choi, K. W., Saquib, N., & Hossain, E. (2013). Machine learning techniques for cooperative spectrum sensing in cognitive radio networks. IEEE Journal on Selected Areas in Communications, 31(11), 2209–2221.

    Article  Google Scholar 

  9. Zhang, J., Kountanis, D. I., & Al-Fuqaha, A. (2012). Two novel learning algorithms to solve the spectrum sharing problem in cognitive radio networks, In 2012 International Conference on Systems and Informatics (ICSAI2012), Yantai, 1472–1476.

  10. Azmat, F., Chen, Y., & Stocks, N. (2016). Analysis of spectrum occupancy using machine learning algorithms. IEEE Transactions on Vehicular Technology, 65(9), 6853–6860.

    Article  Google Scholar 

  11. Shrestha, A. P., & Yoo, S.-J. (2018). Optimal resource allocation using support vector machine for wireless power transfer in cognitive radio networks. IEEE Transactions on Vehicular Technology, 67(9), 8525–8535.

    Article  Google Scholar 

  12. Popoola, J.J., & Van Olst, R. (2011). Application of neural network for sensing primary radio signals in a cognitive radio environment. IEEE Africon’11, Livingstone, Zambia, 1–6.

  13. Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019). Artificial neural networks-based machine learning for wireless networks: A tutorial. IEEE Communications Surveys and Tutorials, 21(4), 3039–3071.

    Article  Google Scholar 

  14. Zappone, A., Renzo, M. D., & Debbah, M. (2019). Wireless networks design in the era of deep learning: Model-based, AI-based, or both? ArXiv preprint.arXiv:1902.02647.

  15. Tan, J., Xiao, S., Han, S. , & Liang, Y. C. (2018). A learning based coexistence mechanism for LAA-LTE based HetNets. In Proc. 2018 IEEE International Conference on Communications, 1–6.

  16. Park, T., Abuzainab, N., & Saad, W. (2016). Learning how to communicate in the internet of things: Finite resources and heterogeneity. IEEE Access, 4, 7063–7073.

    Article  Google Scholar 

  17. Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019). Application of machine learning in wireless networks: Key techniques and open issues. IEEE Communications Surveys and Tutorials, 21(4), 3072–3108.

    Article  Google Scholar 

  18. Sun, Y., Peng, M., & Poor, H. V. (2018). A distributed approach to improving spectral efficiency in uplink device-to-device-enabled cloud radio access networks. IEEE Transactions on Wireless Communications, 66(12), 6511–6526.

    Article  Google Scholar 

  19. Chen, M., Saad, W., & Yin, C. (2017). Echo state networks for self-organizing resource allocation in LTE-U with uplink-downlink decoupling. IEEE Transactions on Wireless Communications, 16(1), 3–16.

    Article  Google Scholar 

  20. Fan, C., Li, B., Zhao, C., Guo, W., & Liang, Y.-C. (2018). Learning-based spectrum sharing and spatial reuse in mm-Wave ultradense networks. IEEE Transactions on Vehicular Technology, 67(6), 4954–4968.

    Article  Google Scholar 

  21. Alnwaimi, G., Vahid, S., & Moessner, K. (2015). Dynamic heterogeneous learning games for opportunistic access in LTE-based macro/femtocell deployments. IEEE Transactions on Wireless Communications, 14(4), 2294–2308.

    Article  Google Scholar 

  22. Puspita, R. H., Shah, S. D. A., Lee, G., Roh, B., Oh, J., Kang, S., & (2019). Reinforcement learning based 5g enabled cognitive radio networks. In Proc. . (2019). International Conference on Information and Communication Technology Convergence (ICTC) (pp. 555–558). Korea (South): Jeju Island.

  23. Liang, L., Ye, H., Li, G. Y., & (2019). Multi-agent reinforcement learning for spectrum sharing in vehicular networks. In: Proc. . (2019). IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) (pp. 1–5). France: Cannes.

  24. Liang, L., Ye, H., & Li, G. Y. (2019). Spectrum sharing in vehicular networks based on multi-agent reinforcement learning. IEEE Journal on Selected Areas in Communications, 37(10), 2282–2292.

    Article  Google Scholar 

  25. Sallent, O., Perez-Romero, J., Ferrus, R., & Agusti, R. (2015). Learning-based coexistence for LTE operation in unlicensed bands. Proc. IEEE ICCW, 2307–2313.

  26. Wang, T., Wen, C. K., Wang, H., Gao, F., Jiang, T., & Jin, S. (2017). Deep learning for wireless physical layer: Opportunities and challenges. China Communications, 14(11), 92–111.

    Article  Google Scholar 

  27. Mao, Q., Hu, F., & Hao, Q. (2018). Deep learning for intelligent wireless networks: A comprehensive survey. IEEE Communications Surveys and Tutorials, 20(4), 2595–2621.

    Article  Google Scholar 

  28. Ruan, L., & Wong, E. (2018). Machine intelligence in allocating bandwidth to achieve low-latency performance. ONDM, 226–229.

  29. Riedmiller, M. (2005). Neural fitted Q iteration-first experiences with a data efficient neural reinforcement learning method. European Conference on Machine Learning (pp. 317–328). Berlin, Heidelberg: Springer.

  30. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., & Petersen, S. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529–533.

    Article  Google Scholar 

  31. Series, M. (2009). Guidelines for evaluation of radio interface technologies for IMT-advanced. Technical report, ITU.

  32. Silva, V., Abrao, T., & Jeszensky, P. J. (2004). Statistically correct simulation models for the generation of multiple uncorrelated Rayleigh fading waveforms. In Eighth IEEE International Symposium on Spread Spectrum Techniques and Applications - Programme and Book of Abstracts (IEEE Cat. No.04TH8738) Sydney, NSW, Australia, 472–476.

Download references

Acknowledgements

This work was supported in part by Samsung Research in Samsung Electronics.

Author information

Authors and Affiliations

  1. College of Information and Communication Engineering, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do, 16419, Republic of Korea

    Minsu Shin, Danish Mehmood Mughal, Sang-Hyo Kim & Min Young Chung

  2. Samsung Research, Samsung Seoul R&D Campus, 56, Seongchon–gil, Seocho–gu, Seoul, Republic of Korea

    Seungil Park

Authors
  1. Minsu Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Danish Mehmood Mughal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seungil Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sang-Hyo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Min Young Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Min Young Chung.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shin, M., Mughal, D.M., Park, S. et al. Cellular Licensed Band Sharing Technology Among Mobile Operators: A Reinforcement Learning Perspective. Wireless Pers Commun 120, 27–47 (2021). https://doi.org/10.1007/s11277-021-08432-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-021-08432-0

Keywords

Search

Navigation