Skip to main content

Reinforcement Learning Based Preamble Resource Allocation Scheme for Access Control in Machine-to-Machine Communication

  • Conference paper
  • First Online:
Communications and Networking (ChinaCom 2022)

Abstract

With the rapid development of Internet of Things (IoT) technology, the number of large numbers of Machine Type Communication (MTC) devices involved in M2M has increased dramatically. When large scale MTC devices access the base station at the same time in a short period of time, this can cause traffic overload and lead to a sharp drop in the success rate of access of MTC devices. 3GPP has proposed the access class barring (ACB) scheme to defer access requests from certain activated MTC devices to avoid congestion at the base station (BS). In this paper, we propose a dynamic ACB scheme for grouping MTC devices and a resource allocation scheme for preamble. First, MTC devices are classified into two categories according to their characteristics: delay-sensitive and energy-constrained. The two categories use separate preamble resources, and a temporary ACB factor is calculated for each time slot based on the current preamble resources and the number of devices. The preamble resources are reallocated based on this temporary ACB factor using reinforcement learning methods, and then the ACB factor is dynamically adjusted according to the new preamble resources. Simulation results show that the solution improves the access success rate of M2M devices, reducing the total service time of delay-sensitive devices by 40\(\%\) compared to the traditional solution, while reducing the access collision rate of energy-constrained devices by 30\(\%\).

Supported by the National Key R &D Program of China under Grant 2020YFB1806702.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Nguyen, D.C., Ding, M., Pathirana, P.N., Seneviratne, A., Li, J., Niyato, D., Dobre, O., Poor, H.V.: 6g internet of things: A comprehensive survey. IEEE Internet Things J. 9(1), 359–383 (2022). https://doi.org/10.1109/JIOT.2021.3103320

    Article  Google Scholar 

  2. Wu, H., Zhu, C., La, R.J., Liu, X., Zhang, Y.: Fasa: Accelerated s-aloha using access history for event-driven m2m communications. IEEE/ACM Trans. Netw. 21(6), 1904–1917 (2013). https://doi.org/10.1109/TNET.2013.2241076

    Article  Google Scholar 

  3. Laya, A., Alonso, L., Alonso-Zarate, J.: Is the random access channel of lte and lte-a suitable for m2m communications? a survey of alternatives. IEEE Commun. Surv. Tutor. 16(1), 4–16 (2014). https://doi.org/10.1109/SURV.2013.111313.00244

    Article  Google Scholar 

  4. Zhang, D., Liu, J., Zhou, W.: Acb scheme based on reinforcement learning in m2m communication. In: GLOBECOM 2020–2020 IEEE Global Communications Conference, pp. 1–6 (2020). https://doi.org/10.1109/GLOBECOM42002.2020.9322144

  5. Pacheco-Paramo, D., Tello-Oquendo, L.: Adjustable access control mechanism in cellular mtc networks: A double q-learning approach. In: 2019 IEEE Fourth Ecuador Technical Chapters Meeting (ETCM), pp. 1–6 (2019). https://doi.org/10.1109/ETCM48019.2019.9014871

  6. Haider Shah, S.W., Riaz, A.T., Iqbal, K.: Congestion control through dynamic access class barring for bursty mtc traffic in future cellular networks. In: 2018 International Conference on Frontiers of Information Technology (FIT), pp. 176–181 (2018). https://doi.org/10.1109/FIT.2018.00038

  7. Bui, A.T.H., Pham, A.T.: Deep reinforcement learning-based access class barring for energy-efficient mmtc random access in lte networks. IEEE Access 8, 227657–227666 (2020). https://doi.org/10.1109/ACCESS.2020.3045811

    Article  Google Scholar 

  8. Chen, Z., Smith, D.B.: Heterogeneous machine-type communications in cellular networks: Random access optimization by deep reinforcement learning. In: 2018 IEEE International Conference on Communications (ICC), pp. 1–6 (2018). https://doi.org/10.1109/ICC.2018.8422775

  9. Toor, W.T., Jin, H.: Combined access barring for energy and delay constrained machine type communications. In: 2018 International Conference on Information and Communication Technology Convergence (ICTC), pp. 130–132 (2018). https://doi.org/10.1109/ICTC.2018.8539640

  10. Duan, S., Shah-Mansouri, V., Wang, Z., Wong, V.W.S.: D-acb: Adaptive congestion control algorithm for bursty m2m traffic in lte networks. IEEE Trans. Veh. Technol. 65(12), 9847–9861 (2016). https://doi.org/10.1109/TVT.2016.2527601

    Article  Google Scholar 

  11. Zhao, X., Wang, C., Wang, W.: Dynamic preamble grouping and access control scheme in machine-to-machine communication. In: 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP), pp. 1–6 (2019). https://doi.org/10.1109/WCSP.2019.8928049

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongyu Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, H., Liu, B., Gao, H., Xu, X., Su, X. (2023). Reinforcement Learning Based Preamble Resource Allocation Scheme for Access Control in Machine-to-Machine Communication. In: Gao, F., Wu, J., Li, Y., Gao, H. (eds) Communications and Networking. ChinaCom 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 500. Springer, Cham. https://doi.org/10.1007/978-3-031-34790-0_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34790-0_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34789-4

  • Online ISBN: 978-3-031-34790-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics