Skip to main content
SpringerLink
Log in

Incorporating quantum key distribution and reinforcement learning for secure and efficient smart grid advanced metering infrastructure

  • Published:
Optical and Quantum Electronics Aims and scope Submit manuscript

Abstract

The Smart Grid AMI is at the forefront of modernizing energy management for efficient energy distribution and maintaining grid reliability. However, the seamless flow of data within AMI introduces critical security challenges, necessitating innovative approaches to ensure secure data transmission. This paper addresses these challenges by proposing a Quantum Key Distribution (QKD) based on Multi-Objective Optimization (MOO) and Reinforcement Learning (RL) framework for secure data transmission within the Smart Grid AMI. Primarily, we formulate the routing problem as a MOO challenge with four primary objectives namely, energy efficiency, latency minimization, reliability, and security to capture the essence of efficient and secure data transmission. Further, we introduce an RL agent based on the Proximal Policy Optimization (PPO) algorithm for robust policy learning. The RL agent by exploring diverse routing actions and receiving rewards optimizes the routing decisions within the network environment based on the objectives specified in the multi-objective function (MOF). A novel MOF quantifies trade-offs between security and performance metrics, integrating QKD-based security metrics with traditional optimization objectives. This function guides the RL agent in making informed routing decisions. Through extensive simulations using the NS-2 simulator in a realistic Smart Grid AMI environment, the proposed approach obtained energy consumption of 750 J, latency of 55 ms, and security level of 96% and also revealed significant improvements compared to conventional techniques widely employed for secured communication in AMI networks. Overall, the simulation results exhibited that the proposed method showed outstanding performance by achieving energy efficiency of 0.95, latency reduction of 0.92, reliability improvement of 0.94, and security enhancement of 0.96. Overall, this integration offers a pioneering solution to address the evolving security challenges in the Smart Grid landscape and contributes to the advancement of secure data transmission in Smart Grid AMI networks, fostering a resilient and secure energy ecosystem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  • Abdulaal, M.J., Mahmoud, M., Bello, S.A., Khalid, J., Aljohani, A.J., Milyani, A.H., Abusorrah, A.M., Ibrahem, M.I.: Privacy-preserving detection of power theft in smart grid change and transmit (CAT) advanced metering infrastructure. IEEE Access (2023)

  • Abdullah, A.A., El-den, B.M., Abo-Al-Ez, K.M., Hassan, T.M.: Security management for an advanced metering infrastructure (AMI) system of smart electrical grids. Appl. Sci. 13(15), 8990 (2023)

    Article  Google Scholar 

  • Akgün, M., Soykan, E.U., Soykan, G.: A privacy-preserving scheme for smart grid using trusted execution environment. IEEE Access 11, 9182–9196 (2023)

    Article  Google Scholar 

  • Gallardo, J.L., Ahmed, M.A., Jara, N.: Clustering algorithm-based network planning for advanced metering infrastructure in smart grid. IEEE Access 9, 48992–49006 (2021)

    Article  Google Scholar 

  • Halle, P.D., Shiyamala, S.: Secure advance metering infrastructure protocol for smart grid power system enabled by the Internet of Things. Microprocess. Microsyst. 95, 104708 (2022)

    Article  Google Scholar 

  • Hasan, M.M., Mohd Ariffin, N.A., Mohd Sani, N.F.: LIKA: lightweight identity based key agreement protocol for secure data transmission in advanced metering infrastructure of smart grid. Energies 15(21), 8106 (2022)

    Article  Google Scholar 

  • Hassan, M., Tariq, N., Alsirhani, A., Alomari, A., Khan, F.A., Alshahrani, M.M., Ashraf, M., Humayun, M.: GITM: a gini index-based trust mechanism to mitigate and isolate sybil attack in RPL-enabled smart grid advanced metering infrastructures. IEEE Access, (2023)

  • Hu, S., Chen, Y., Zheng, Y., Xing, B., Li, Y., Zhang, L., Chen, L.: Provably secure ECC-based authentication and key agreement scheme for advanced metering infrastructure in the smart grid. IEEE Trans. Industr. Inf. 19(4), 5985–5994 (2022)

    Article  Google Scholar 

  • Huang, C., Sun, C.C., Duan, N., Jiang, Y., Applegate, C., Barnes, P.D., Stewart, E.: Smart meter pinging and reading through AMI two-way communication networks to monitor grid edge devices and DERs. IEEE Trans. Smart Grid 13(5), 4144–4153 (2021)

    Article  Google Scholar 

  • Kalidass, J., Purusothaman, T., Suresh, P.: Enhancement of end-to-end security in advanced metering infrastructure. J. Amb. Intell. Human. Comput. 22, 1–10 (2021)

    Google Scholar 

  • Kebotogetse, O., Samikannu, R., Yahya, A.: A concealed based approach for secure transmission in advanced metering infrastructure. IEEE Access 10, 84809–84817 (2022)

    Article  Google Scholar 

  • Khan, A.A., Kumar, V., Ahmad, M., Rana, S.: LAKAF: lightweight authentication and key agreement framework for smart grid network. J. Syst. Architect. 116, 102053 (2021)

    Article  Google Scholar 

  • Li, Q., He, D., Liu, H., Jia, X., Yang, Z.: MCPAP: a MSIS-based conditional privacy-preserving authentication protocol for smart grids. J. Syst. Architect. 143, 102960 (2023)

    Article  Google Scholar 

  • Liu, K., Wang, C., Zhou, X.: Decentralizing access control system for data sharing in smart grid. High-Confidence Comput. 3(2), 100113 (2023)

    Article  Google Scholar 

  • Mohammadali, A., Haghighi, M.S.: A privacy-preserving homomorphic scheme with multiple dimensions and fault tolerance for metering data aggregation in smart grid. IEEE Trans. Grid 12(6), 5212–5220 (2021)

    Article  Google Scholar 

  • Mohapatra, H., Rath, A.K.: A fault tolerant routing scheme for advanced metering infrastructure: an approach towards smart grid. Clust. Comput. 24(3), 2193–2211 (2021)

    Article  Google Scholar 

  • Naeem, A., Javaid, N., Aslam, Z., Nadeem, M.I., Ahmed, K., Ghadi, Y.Y., Alahmadi, T.J., Ghamry, N.A., Eldin, S.: A novel data balancing approach and a deep fractal network with light gradient boosting approach for theft detection in smart grids. Heliyon 9(9), 10 (2023)

    Article  Google Scholar 

  • Nyangaresi, V.O., Abd-Elnaby, M., Eid, M.M., Nabih Zaki, R.A.: Trusted authority based session key agreement and authentication algorithm for smart grid networks. Trans. Emerg. Telecommun. Technolog. 33(9), 4528 (2022)

    Article  Google Scholar 

  • Olakanmi, O.O.: PASS: a privacy-aware approach for secure smart metering in advanced metering infrastructure networks. J. Appl. Secur. Res. 16(1), 37–62 (2021)

    Article  Google Scholar 

  • Prateek, K., Maity, S., Amin, R.: An unconditionally secured privacy-preserving authentication scheme for smart metering infrastructure in smart grid. IEEE Trans. Netw. Sci. Eng. 10(2), 1085–1095 (2022)

    Article  MathSciNet  Google Scholar 

  • Ramyasri, G., Murthy, G.R., Itapu, S., Krishna, S.M.: Data transmission using secure hybrid techniques for smart energy metering devices e-Prime-advances in electrical engineering. Electron. Energy 4, 100134 (2023)

    Google Scholar 

  • Rehman, A., Haseeb, K., Jeon, G., Bahaj, S.A.: Secure edge-based energy management protocol in smart grid environments with correlation analysis. Sensors 22(23), 9236 (2022)

    Article  ADS  Google Scholar 

  • Repuri, R.K., Darsy, J.P.: Energy-efficient lora routing for smart grids. Sensors 23(6), 3072 (2023)

    Article  ADS  Google Scholar 

  • Sharma, H., Kumar, N., Panigrahi, B.K., Alotaibi, A.: Deep learning-based authentication framework for secure terrestrial communications in next generation heterogeneous networks. IEEE Int. Things Magaz. 5(4), 174–179 (2022)

    Article  Google Scholar 

  • Singh, N.K., Mahajan, V.: End-user privacy protection scheme from cyber intrusion in smart grid advanced metering infrastructure. Int. J. Crit. Infrastruct. Prot. 34, 100410 (2021)

    Article  Google Scholar 

  • Swain, A., Salkuti, S.R., Swain, K.: An optimized and decentralized energy provision system for smart cities. Energies 14(5), 1451 (2021)

    Article  Google Scholar 

  • Tang, C.Y., Liu, C.H., Chen, W.K., You, S.D.: Implementing action mask in proximal policy optimization (PPO) algorithm. ICT Express 6(3), 200–203 (2020)

    Article  Google Scholar 

  • Xiang, X., Cao, J.: An efficient authenticated key agreement scheme supporting privacy-preservation for smart grid communication. Electric Power Syst. Res. 203, 107630 (2022)

    Article  Google Scholar 

  • Yu, S., Park, K.: ISG-SLAS: Secure and lightweight authentication and key agreement scheme for industrial smart grid using fuzzy extractor. J. Syst. Architect. 131, 102698 (2022)

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Electronics and Communication Engineering, Arunachala College of Engineering for Women, Nagercoil, Tamil Nadu, India

    G. Starlin Beula

  2. Electronics and Communication Engineering, C.S.I Institute of Technology, Thovalai, Kanyakumari, Tamil Nadu, India

    S. Wilfred Franklin

Authors
  1. G. Starlin Beula
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Wilfred Franklin
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All agreed on the content of the study. GSB and SWF collected all the data for analysis. GSB agreed on the methodology. GSB and SWF completed the analysis based on agreed steps. Results and conclusions are discussed and written together. The author read and approved the final manuscript.

Corresponding author

Correspondence to G. Starlin Beula.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human or animal subjects performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Beula, G.S., Franklin, S.W. Incorporating quantum key distribution and reinforcement learning for secure and efficient smart grid advanced metering infrastructure. Opt Quant Electron 56, 932 (2024). https://doi.org/10.1007/s11082-024-06600-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11082-024-06600-7

Keywords

Search

Navigation