Skip to main content
SpringerLink
Log in

Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Blockchain and deep reinforcement learning (DRL) are two separate transaction systems committed to the credibility and usefulness of system functionality. There is rapid growth importance in integrating both technologies into effective and stable information exchange and research solutions. Blockchain is a revolutionary platform for future generational telecommunications networking that will set up the secured and distributed information exchange framework. In combination with DRL, blockchain could significantly improve the efficiency of mobile communications. The rapid growth of networks for the Internet of Things (IoT) necessitates the development of suitable and reliable infrastructure as well as a significant proportion of the information. Blockchain, a distributed and reliable ledger, is often considered a considerably beneficial means of providing scientific confidentiality and security to IoT devices. When interacting with massive IoT records, the Blockchain’s decrease becomes a significant issue. Thus, it is necessary to improve transaction performance and deal with massive data transmission situations. As a result, the work presented here explores the DRL fundamental operation of the blockchain-enabled IoT system, where transactions are simultaneously strengthened, and community-based divisibility is ensured. Throughout this paper, the authors first present the decentralised and efficient structure for communication by incorporating DRL and blockchain across wireless services that allow for the scalable and reliable allocation of information. The results show that the proposed method has shorter delays and requires less transmission power.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Aftab A, Ashraf N, Qureshi HK, Hassan SA, Jangsher S (2020) BLOCK-ML: blockchain and machine learning for UAV-BSs deployment. In: IEEE 92nd vehicular technology conference

  • Alam T (2019) IoT-Fog: A communication framework using Blockchain in the internet of things. In: Int J Recent Technol Eng (IJRTE) 7(6)

  • Alam T (2020) Design a blockchain-based middleware layer in the Internet of Things Architecture. JOIV: Int J Inf vis 4(1):28–31

    Article  Google Scholar 

  • Alam T, Benaida M (2018) CICS: cloud–internet communication security framework for the internet of smart devices. Int J Interact Mobile Technol (iJIM) 12(6):74

    Article  Google Scholar 

  • Bhatia J, Modi Y, Tanwar S, Bhavsar M (2019) Software defined vehicular networks: a comprehensive review. Int J Commun Syst 32(12):e4005

    Article  Google Scholar 

  • Dai Y, Xu D, Maharjan S, Chen Z, He Q, Zhang Y (2019) Blockchain and deep reinforcement learning empowered intelligent 5G beyond. IEEE Network 33(3):10–17

    Article  Google Scholar 

  • Dai Y, Xu D, Zhang K, Maharjan S, Zhang Y (2020) Deep reinforcement learning and permissioned Blockchain for content caching in vehicular edge computing and networks. IEEE Trans Veh Technol 69(4):4312–4324

    Article  Google Scholar 

  • François-Lavet V, Henderson P, Islam R, Bellemare MG, Pineau J (2018) An introduction to deep reinforcement learning. arXiv preprint http://arxiv.org/abs/1811.12560

  • Gao Y, Wu W, Nan H, Sun Y, Si P (2020) Deep reinforcement learning based task scheduling in mobile blockchain for IoT applications. In: ICC 2020–2020 IEEE international conference on communications (ICC). IEEE, pp 1–7

  • Gong Y, Sun S, Wei Y, Song M (2021) Deep reinforcement learning for edge computing resource allocation in blockchain network slicing broker framework. In: 2021 IEEE 93rd vehicular technology conference (VTC2021-Spring). IEEE, pp 1–6

  • Jameel F, Javaid U, Khan WU, Aman MN, Pervaiz H, Jäntti R (2020) Reinforcement learning in blockchain-enabled IIoT networks: a survey of recent advances and open challenges. Sustainability 12(12):5161

    Article  Google Scholar 

  • Lan D, Taherkordi A, Eliassen F, Liu L (2020) Deep reinforcement learning for computation offloading and caching in fog-based vehicular networks. In: 2020 IEEE 17th international conference on mobile ad hoc and sensor systems (MASS), IEEE, pp 622–630

  • Liang W, Huang W, Long J, Zhang K, Li KC, Zhang D (2020) Deep reinforcement learning for resource protection and real-time detection in IoT environment. IEEE Internet Things J 7(7):6392–6401

    Article  Google Scholar 

  • Liu CH, Lin Q, Wen S (2018) Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Trans Industr Inf 15(6):3516–3526

    Article  Google Scholar 

  • Liu M, Teng Y, Yu FR, Leung VC, Song M (2019a) Deep reinforcement learning based performance optimization in blockchain-enabled Internet of vehicle. In: ICC 2019–2019 IEEE International Conference on Communications (ICC). IEEE, pp 1–6.

  • Liu M, Yu FR, Teng Y, Leung VC, Song M (2019b) Performance optimization for blockchain-enabled industrial Internet of Things (IIoT) systems: a deep reinforcement learning approach. IEEE Trans Industr Inf 15(6):3559–3570

    Article  Google Scholar 

  • Nguyen DC, Pathirana PN, Ding M, Seneviratne A (2019) Blockchain as a Service for Multi-Access Edge Computing: A Deep Reinforcement Learning Approach. arXiv preprint http://arxiv.org/abs/2001.08165

  • Nguyen D, Pathirana P, Ding M, Seneviratne A (2021) Secure computation offloading in Blockchain based IoT networks with deep reinforcement learning. In: IEEE Transactions on Network Science and Engineering

  • Otto F (2021) Model-free deep reinforcement learning—algorithms and applications. In: Reinforcement learning algorithms: analysis and applications. Springer, Cham, pp 109–121

  • Qiu X, Liu L, Chen W, Hong Z, Zheng Z (2019) Online deep reinforcement learning for computation offloading in blockchain-empowered mobile edge computing. IEEE Trans Veh Technol 68(8):8050–8062

    Article  Google Scholar 

  • Qiu C, Ren X, Cao Y, Mai T (2020) Deep reinforcement learning empowered adaptivity for future blockchain networks. IEEE Open J Comput Soc 2:99–105

    Article  Google Scholar 

  • Rathore S, Park JH, Chang H (2021) Deep learning and blockchain-empowered security framework for intelligent 5G-enabled IoT. IEEE Access 9:90075–90083

    Article  Google Scholar 

  • Tsai CW (2021) Toward blockchain for intelligent systems. IEEE Consumer Electronics Magazine

  • Wang T, Liew SC, Zhang S (2021) When Blockchain meets AI: optimal mining strategy achieved by machine learning. Int J Intell Syst 36(5):2183–2207

    Article  Google Scholar 

  • Weng J, Weng J, Zhang J, Li M, Zhang Y, Luo W (2019) Deepchain: auditable and privacy-preserving deep learning with blockchain-based incentive. IEEE Transactions on Dependable and Secure Computing

  • Wu Y, Wang Z, Ma Y, Leung VC (2021) Deep reinforcement learning for Blockchain in industrial IoT: a survey. Comput Networks 191:108004

    Article  Google Scholar 

  • Yue Y, Li S, Legg P, Li F (2021) Deep learning-based security behaviour analysis in IoT environments: a survey. Security and Communication Networks

  • Zhang R, Yu FR, Liu J, Huang T, Liu Y (2020) Deep reinforcement learning (DRL)-based device-to-device (D2D) caching with Blockchain and mobile edge computing. IEEE Trans Wireless Commun 19(10):6469–6485

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Systems, Islamic University of Madinah, Madinah, Saudi Arabia

    Tanweer Alam & Mohamed Benaida

  2. Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn, Batu Pahat, Malaysia

    Arif Ullah

Authors
  1. Tanweer Alam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arif Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohamed Benaida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tanweer Alam.

Ethics declarations

Conflict of interest

The author declares no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alam, T., Ullah, A. & Benaida, M. Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems. J Ambient Intell Human Comput 14, 9959–9972 (2023). https://doi.org/10.1007/s12652-021-03663-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-021-03663-2

Keywords

Search

Navigation