Skip to main content
Log in

SEKad: a scalable protocol for blockchain networks with enhanced broadcast efficiency

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Blockchain technology has been increasingly integrated into various fields of economic and social development. However, scalability issues such as low broadcast efficiency, high communication overhead, and high redundant transmission rate have greatly limited the large-scale application of blockchain. This paper proposes a new scalability-enhanced Kademlia network protocol (SEKad), which optimizes blockchain network transmission in terms of both network topology and communication broadcast mechanism, provides a new approach to solving the scalability problem from the network layer. In SEKad protocol, firstly, SEKad employs a method that aligns the physical topology with the network topology for node clustering. This strategy groups neighboring nodes into clusters, streamlining network complexity and reducing network diameter. Secondly, SEKad presents a cluster-adaptable network topology based on Kademlia (Kad-CA). Kad-CA improves the rationality and efficiency of per-hop routing, optimizing the construction of K buckets and thus enhancing overall network efficiency. Finally, within the network transmission model, SEKad devise the smallest sub-tree broadcasting mechanism and the minimum redundant transmission mechanism for Kad-CA. These mechanisms work to reduce the redundant transmission rate, and enhance broadcasting efficiency. In order to evaluate the performance of SEKad, we built an experimental platform and conducted evaluations. The experimental results show that SEKad has better network scalability and stability, the network diameter size can be reduced by 27% and the redundant transmission rate can be reduced by 30%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

Available upon request.

References

  1. Zarrin, J., Wen Phang, H., Babu Saheer, L., Zarrin, B.: Blockchain for decentralization of internet: prospects, trends, and challenges. Clust. Comput. 24(4), 2841–2866 (2021). https://doi.org/10.1007/s10586-021-03301-8

    Article  Google Scholar 

  2. Dotan, M., Pignolet, Y.-A., Schmid, S., Tochner, S., Zohar, A.: Survey on blockchain networking: context, state-of-the-art, challenges. ACM Comput. Surv. (CSUR) 54(5), 1–34 (2021)

    Article  Google Scholar 

  3. Makani, S., Pittala, R., Alsayed, E., Aloqaily, M., Jararweh, Y.: A survey of blockchain applications in sustainable and smart cities. Clust. Comput. 8, 1–22 (2022). https://doi.org/10.1007/s10586-022-03625-z

    Article  Google Scholar 

  4. Zaghloul, E., Li, T., Mutka, M.W., Ren, J.: Bitcoin and blockchain: security and privacy. IEEE Internet Things J. 7(10), 10288–10313 (2020). https://doi.org/10.1109/JIOT.2020.3004273

    Article  Google Scholar 

  5. Li, W., He, M.: Comparative analysis of bitcoin, ethereum, and libra. In: 2020 IEEE 11th International Conference on Software Engineering and Service Science (ICSESS), pp. 545–550 (2020). https://doi.org/10.1109/ICSESS49938.2020.9237710. IEEE

  6. Sanka, A.I., Cheung, R.C.: A systematic review of blockchain scalability: issues, solutions, analysis and future research. J. Netw. Comput. Appl. 195, 103232 (2021). https://doi.org/10.1016/j.jnca.2021.103232

    Article  Google Scholar 

  7. Antwi, R., Gadze, J.D., Tchao, E.T., Sikora, A., Nunoo-Mensah, H., Agbemenu, A.S., Obour Agyekum, K.O.B., Agyemang, J.O., Welte, D., Keelson, E.: A survey on network optimization techniques for blockchain systems. Algorithms 15(6), 193 (2022). https://doi.org/10.3390/a15060193

    Article  Google Scholar 

  8. Zhang, L., Xu, H., Onireti, O., Imran, M.A., Cao, B.: How much communication resource is needed to run a wireless blockchain network? IEEE Netw. 36(1), 128–135 (2021). https://doi.org/10.1109/MNET.101.2100208

    Article  Google Scholar 

  9. Xiao, Y., Zhang, N., Lou, W., Hou, Y.T.: A survey of distributed consensus protocols for blockchain networks. IEEE Commun. Surv. Tutor. 22(2), 1432–1465 (2020)

    Article  Google Scholar 

  10. Kaur, G., Gandhi, C.: Scalability in blockchain: challenges and solutions. In: Handbook of Research on Blockchain Technology, pp. 373–406. Elsevier (2020)

  11. Misic, J., Misic, V.B., Chang, X., Motlagh, S.G., Ali, M.Z.: Block delivery time in bitcoin distribution network. In: ICC 2019–2019 IEEE International Conference on Communications (ICC), pp. 1–7 (2019). https://doi.org/10.1109/ICC.2019.8761420. IEEE

  12. Aoki, Y., Shudo, K.: Proximity neighbor selection in blockchain networks. In: 2019 IEEE International Conference on Blockchain (Blockchain), pp. 52–58 (2019). https://doi.org/10.1109/Blockchain.2019.00016. IEEE

  13. Kiffer, L., Salman, A., Levin, D., Mislove, A., Nita-Rotaru, C.: Under the hood of the ethereum gossip protocol. In: International Conference on Financial Cryptography and Data Security, pp. 437–456 (2021). https://doi.org/10.1007/978-3-662-64331-0_23. Springer

  14. Xu, X., Sun, G., Luo, L., Cao, H., Yu, H., Vasilakos, A.V.: Latency performance modeling and analysis for hyperledger fabric blockchain network. Inform. Process. Manag. 58(1), 102436 (2021). https://doi.org/10.1016/j.ipm.2020.102436

    Article  Google Scholar 

  15. Neudecker, T., Hartenstein, H.: Network layer aspects of permissionless blockchains. IEEE Commun. Surv. Tutor. 21(1), 838–857 (2018)

    Article  Google Scholar 

  16. Ripeanu, M., Foster, I., Iamnitchi, A.: Mapping the gnutella network: properties of large-scale peer-to-peer systems and implications for system design. arXiv preprint cs/0209028 (2002). https://doi.org/10.48550/arXiv.cs/0209028

  17. Schollmeier, R.: A definition of peer-to-peer networking for the classification of peer-to-peer architectures and applications. In: Proceedings First International Conference on Peer-to-Peer Computing, pp. 101–102 (2001). https://doi.org/10.1109/P2P.2001.990434. IEEE

  18. Maymounkov, P., Mazieres, D.: Kademlia: A peer-to-peer information system based on the xor metric. In: International Workshop on Peer-to-Peer Systems, pp. 53–65 (2002). https://doi.org/10.1007/3-540-45748-8_5. Springer

  19. Czirkos, Z., Hosszú, G.: Enhancing the kademlia p2p network. Period. Polytech. Electr. Eng. (Archives) 54(3–4), 87–92 (2010). https://doi.org/10.3311/pp.ee.2010-3-4.01

    Article  Google Scholar 

  20. Loizou, N., Richtárik, P.: Revisiting randomized gossip algorithms: general framework, convergence rates and novel block and accelerated protocols. IEEE Trans. Inform.Theory 67(12), 8300–8324 (2021). https://doi.org/10.1109/TIT.2021.3113285

    Article  MathSciNet  MATH  Google Scholar 

  21. Androulaki, E., Barger, A., Bortnikov, V., Cachin, C., Christidis, K., De Caro, A., Enyeart, D., Ferris, C., Laventman, G., Manevich, Y., et al.: Hyperledger fabric: a distributed operating system for permissioned blockchains. In: Proceedings of the Thirteenth EuroSys Conference, pp. 1–15 (2018). https://doi.org/10.1145/3190508.3190538

  22. Boyd, S., Ghosh, A., Prabhakar, B., Shah, D.: Randomized gossip algorithms. IEEE Trans. Inform. Theory 52(6), 2508–2530 (2006). https://doi.org/10.1109/TIT.2006.874516

    Article  MathSciNet  MATH  Google Scholar 

  23. Jiang, S., Wu, J.: Taming propagation delay and fork rate in bitcoin mining network. In: 2021 IEEE International Conference on Blockchain (Blockchain), pp. 314–320 (2021). https://doi.org/10.1109/Blockchain53845.2021.00050. IEEE

  24. Hao, W., Zeng, J., Dai, X., Xiao, J., Hua, Q.-S., Chen, H., Li, K.-C., Jin, H.: Towards a trust-enhanced blockchain p2p topology for enabling fast and reliable broadcast. IEEE Trans. Netwo. Serv. Manag. 17(2), 904–917 (2020). https://doi.org/10.1109/TNSM.2020.2980303

    Article  Google Scholar 

  25. Yang, X., Shi, L.: Ari: a p2p optimization for blockchain systems. In: 2019 17th International Conference on Privacy, Security and Trust (PST), pp. 1–6 (2019). https://doi.org/10.1109/PST47121.2019.8949064. IEEE

  26. Kaddoura, M., Bahr, N., Gambucci, E.: Sh-p2p: Self-healing peer-to-peer network with optimal multicast routing. In: 2022 IEEE International Conference on Electro Information Technology (eIT), pp. 027–031 (2022). https://doi.org/10.1109/eIT53891.2022.9813897. IEEE

  27. Wang, H., Li, H., Wang, Z., Han, B., Zhang, M., Chong, P.H.J., Chu, X., Liu, Y., Liew, S.-Y., Wuttisittikulkij, L.: A p2p network topology for optimizing partition tolerance to reach the cap guarantee bound in consortium blockchains. arXiv preprint arXiv:2109.02907 (2021). https://doi.org/10.48550/arXiv.2109.02907

  28. Kaneko, Y., Asaka, T.: Dht clustering for load balancing considering blockchain data size. In: 2018 Sixth International Symposium on Computing and Networking Workshops (CANDARW), pp. 71–74 (2018). https://doi.org/10.1109/CANDARW.2018.00022. IEEE

  29. Huang, J., Tan, L., Mao, S., Yu, K.: Blockchain network propagation mechanism based on p4p architecture. Secur. Commun. Netw. 2021, 1–12 (2021)

    Google Scholar 

  30. Yu, B., Li, X., Zhao, H., Zhou, T.: A scalable blockchain network model with transmission paths and neighbor node subareas. Computing 104(10), 2253–2277 (2022). https://doi.org/10.1007/s00607-021-00913-1

    Article  Google Scholar 

  31. Santiago, C., Lee, C.: Accelerating message propagation in blockchain networks. In: 2020 International Conference on Information and Communication Technology Convergence (ICTC), pp. 157–160 (2020). IEEE

  32. Saldamli, G., Upadhyay, C., Jadhav, D., Shrishrimal, R., Patil, B., Tawalbeh, L.: Improved gossip protocol for blockchain applications. Clust. Comput. 25(3), 1915–1926 (2022). https://doi.org/10.1007/s10586-021-03504-z

    Article  Google Scholar 

  33. Berendea, N., Mercier, H., Onica, E., Riviere, E.: Fair and efficient gossip in hyperledger fabric. In: 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS), pp. 190–200 (2020). https://doi.org/10.1109/ICDCS47774.2020.00027. IEEE

  34. Chen, J., Qin, Y.: Reducing block propagation delay in blockchain networks via guarantee verification. In: 2021 IEEE 29th International Conference on Network Protocols (ICNP), pp. 1–6 (2021). https://doi.org/10.1109/ICNP52444.2021.9651926. IEEE

  35. Ayinala, K., Choi, B.-Y., Song, S.: Pichu: Accelerating block broadcasting in blockchain networks with pipelining and chunking. In: 2020 IEEE International Conference on Blockchain (Blockchain), pp. 221–228 (2020). https://doi.org/10.1109/Blockchain50366.2020.00035. IEEE

  36. He, X., Cui, Y., Jiang, Y.: An improved gossip algorithm based on semi-distributed blockchain network. In: 2019 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), pp. 24–27 (2019). https://doi.org/10.1109/CyberC.2019.00014. IEEE

  37. Zhao, C., Wang, T., Zhang, S.: Lightblock: Reducing bandwidth required to synchronize blocks in ethereum network. In: 2021 International Conference on Communications, Information System and Computer Engineering (CISCE), pp. 868–874 (2021). https://doi.org/10.1109/CISCE52179.2021.9445911. IEEE

  38. Wang, R., Njilla, L., Yu, S.: Ac: An ndn-based blockchain network with erasure coding. In: 2023 International Conference on Computing, Networking and Communications (ICNC), pp. 591–595 (2023). https://doi.org/10.1109/ICNC57223.2023.10074192. IEEE

  39. Chen, P., Bai, F., Shen, T., Gong, B., Zhang, L., Huang, L., An, Z., Mir, T., Tu, S., Waqas, M.: Scca: a slicing-and coding-based consensus algorithm for optimizing storage in blockchain-based iot data sharing. Peer-to-Peer Netw. Appl. 15(4), 1964–1978 (2022)

    Article  Google Scholar 

  40. Zhang, L., Wang, T., Liew, S.C.: Speeding up block propagation in bitcoin network: uncoded and coded designs. Comput. Netw. 206, 108791 (2022)

    Article  Google Scholar 

  41. maxmind: GeoLite City Database. http://dev.maxmind.com/geoip/legacy/geolite/. Accessed 4 Oct, 2022

  42. Montresor, A., Jelasity, M.: Peersim: A scalable p2p simulator. In: 2009 IEEE Ninth International Conference on Peer-to-Peer Computing, pp. 99–100 (2009). https://doi.org/10.1109/P2P.2009.5284506. IEEE

  43. BitcoinNodes: Bitcoin network snapshot. https://bitnodes.io/nodes/. Accessed Otc 4, 2022

Download references

Funding

This work was supported in part by the Major Scientific and Technological Projects in Yunnan Province under Grant 202002AB080001-8; in part by the Yunnan Key Laboratory of Blockchain Application Technology under Grant 202105AG070005 and Project YNB202109 and YNB202115; in part by the National Natural Science Foundation of China under Grant 61971208; in part by the Yunnan Reserve Talents of Young and Middle-Aged Academic and Technical Leaders (Shen Tao) under Grant 2019HB005; in part by the Yunnan Young Top Talents of Ten thousand Plan (Shen Tao, Zhu Yan, Yunren Social Development) under Grant 2018 73; and in part by the Scientific Research Fund Project of Yunnan Provincial Department of Education under Grant 2022Y160.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study conception and design. TS and QS did the ideal development and most of the implementation and evaluation. The first draft of the manuscript was written by QS. CZ contributed to the technical discussion as well as contributed to the manuscript writing and proofreading. As the corresponding author, FB supervised the entire process from idea development to implementation, experimentation and evaluation, and paper writing.

Corresponding author

Correspondence to Fenhua Bai.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Ethical approval

This material has not being published in whole or in part elsewhere.

Research invovling human and/or animal participants

This study does not involve human participants and/or animal research, which is used for non-life science journals.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shen, T., Sun, Q., Zhang, C. et al. SEKad: a scalable protocol for blockchain networks with enhanced broadcast efficiency. Cluster Comput (2023). https://doi.org/10.1007/s10586-023-04158-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10586-023-04158-9

Keywords

Navigation