Skip to main content
SpringerLink
Log in

Cross-organizational data exchange based on consortium blockchain with consistency guarantee

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Effective data exchange holds the potential to bridge information gaps between organizations, creating essential prerequisites for enhanced collaboration. However, in cross-organizational database systems, ensuring strong consistency is often challenging. Inconsistent query results may be returned from different databases if data records are not timely synchronized, degrading mutual trust and collaboration efficiency among organizations. To address this issue, a novel cross-organizational data exchange approach is proposed. Specifically, consortium blockchain is leveraged as a Write-Ahead Log, enabling different organizations to trace relevant requests failed to be executed in real-time, thereby promptly providing consistent query results for users. Detailed settings on protocol level are designed for the blockchain platform to facilitate data exchange regulation, including data structures, consensus algorithms and an access control mechanism. Extensive simulation experiments are conducted to evaluate the performance of the proposed approach and investigate the impact of different parameters on data consistency and system availability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Algorithm 1
Fig. 6
Algorithm 2
Fig. 7
Algorithm 3
Fig. 8
Algorithm 4
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Li T, Ren W, Xiang Y, Zheng X, Zhu T, Choo K-KR, Srivastava G (2021) FAPS: a fair, autonomous and privacy-preserving scheme for big data exchange based on oblivious transfer, ether cheque and smart contracts. Inf Sci 544:469–484

    Article  MathSciNet  Google Scholar 

  2. Gasco-Hernandez M, Gil-Garcia JR, Luna-Reyes LF (2022) Unpacking the role of technology, leadership, governance and collaborative capacities in inter-agency collaborations. Gov Inf Q 39(3):101710

    Article  Google Scholar 

  3. Fu D, Hu S, Zhang L, He S, Qiu J (2021) An intelligent cloud computing of trunk logistics alliance based on blockchain and big data. J Supercomput 77(12):13863–13878

    Article  Google Scholar 

  4. Susha I, Rukanova B, Zuiderwijk A, Gil-Garcia JR, Gasco Hernandez M (2023) Achieving voluntary data sharing in cross sector partnerships: three partnership models. Inf Organ 33(1):100448

    Article  Google Scholar 

  5. Awad Abdellatif A, Samara L, Mohamed A, Erbad A, Chiasserini CF, Guizani M, O’Connor MD, Laughton J (2021) MEdge-chain: leveraging edge computing and blockchain for efficient medical data exchange. IEEE Internet Things J 8(21):15762–15775

    Article  Google Scholar 

  6. Kokociński M, Kobus T, Wojciechowski PT (2022) On mixing eventual and strong consistency: acute cloud types. IEEE Trans Parallel Distrib Syst 33(6):1338–1356

    Article  Google Scholar 

  7. Tian J, Pang Y (2022) A causal consistency model based on grouping strategy. J Supercomput 78(16):17736–17757

    Article  Google Scholar 

  8. He S, He P, Chen Z, Yang T, Su Y, Lyu MR (2021) A survey on automated log analysis for reliability engineering. ACM Comput Surv 54(6):966

    Google Scholar 

  9. Lockerman J, Faleiro JM, Kim J, Sankaran S, Abadi DJ, Aspnes J, Sen S, Balakrishnan M (2018) The fuzzylog: a partially ordered shared log. In: Proceedings of the 13th USENIX Conference on Operating Systems Design and Implementation. OSDI’18, pp 357–372, Carlsbad, CA, USA

  10. Ren K, Li D, Abadi DJ (2019) Slog: serializable, low-latency, geo-replicated transactions. In: Proceedings of the VLDB Endowment, vol 12, pp 1747–1761

  11. Zhu L, Xie Y, Zhou Y, Fan Q, Zhang C, Liu X (2023) Enabling efficient and secure health data sharing for healthcare IoT systems. Futur Gener Comput Syst 149:304–316

    Article  Google Scholar 

  12. Wen B, Wang Y, Ding Y, Zheng H, Qin B, Yang C (2023) Security and privacy protection technologies in securing blockchain applications. Inf Sci 645:119322

    Article  Google Scholar 

  13. Chen X (2020) Security-preserving social data sharing methods in modern social big knowledge systems. Inf Sci 515:404–416

    Article  Google Scholar 

  14. Georgiou MA, Paphitis A, Sirivianos M, Herodotou H (2019) Towards auto-scaling existing transactional databases with strong consistency. In: 2019 IEEE 35th International Conference on Data Engineering Workshops (ICDEW). ICDEW’2019, pp 107–112

  15. Li C, Wang C, Luo Y (2020) An efficient scheduling optimization strategy for improving consistency maintenance in edge cloud environment. J Supercomput 76(9):6941–6968

    Article  Google Scholar 

  16. Ali O, Shrestha A, Chatfield A, Murray P (2020) Assessing information security risks in the cloud: a case study of Australian local government authorities. Gov Inf Q 37(1):101419

    Article  Google Scholar 

  17. Guo J, Li C, Luo Y (2022) Blockchain-assisted caching optimization and data storage methods in edge environment. J Supercomput 78(16):18225–18257

    Article  Google Scholar 

  18. Shoukohyar S, Seddigh MR (2020) Uncovering the dark and bright sides of implementing collaborative forecasting throughout sustainable supply chains: an exploratory approach. Technol Forecast Soc Chang 158:120059

    Article  Google Scholar 

  19. Tong W, Dong X, Shen Y, Jiang X, Zhang Z (2022) A blockchain-driven data exchange model in multi-domain IoT with controllability and parallelity. Futur Gener Comput Syst 135:85–94

    Article  Google Scholar 

  20. Gil-Garcia JR, Guler A, Pardo TA, Burke GB (2019) Characterizing the importance of clarity of roles and responsibilities in government inter-organizational collaboration and information sharing initiatives. Gov Inf Q 36(4):101393

    Article  Google Scholar 

  21. Huang C, Liu D, Ni J, Lu R, Shen X (2021) Achieving accountable and efficient data sharing in industrial internet of things. IEEE Trans Industr Inf 17(2):1416–1427

    Article  Google Scholar 

  22. Spanaki K, Karafili E, Despoudi S (2021) AI applications of data sharing in agriculture 4.0: a framework for role-based data access control. Int J Inf Manag 59:5102350

    Article  Google Scholar 

  23. Mahmud M, Sohan MSH, Reno S, Sikder MAB, Hossain FS (2023) Advancements in scalability of blockchain infrastructure through IPFS and dual blockchain methodology. J Supercomput 5:96

    Google Scholar 

  24. Engin Z, Treleaven P (2019) Algorithmic Government: automating public services and supporting civil servants in using data science technologies. Comput J 62(3):448–460

    Article  Google Scholar 

  25. De Porre K, Myter F, Scholliers C, Gonzalez Boix E (2020) CScript: a distributed programming language for building mixed-consistency applications. J Parallel Distribut Comput 144:109–123

    Article  Google Scholar 

  26. Zhao Y, Fan B (2021) Effect of an agency’s resources on the implementation of open government data. Inf Manag 58(4):103465

    Article  Google Scholar 

  27. Sanka AI, Irfan M, Huang I, Cheung RCC (2021) A survey of breakthrough in blockchain technology: adoptions, applications, challenges and future research. Comput Commun 169:179–201

    Article  Google Scholar 

  28. Liu T, Yuan Y, Yu Z (2021) The service architecture of Internet of Things terminal connection based on blockchain technology. J Supercomput 77(11):12690–12710

    Article  Google Scholar 

  29. Miyachi K, Mackey TK (2021) hOCBS: a privacy-preserving blockchain framework for healthcare data leveraging an on-chain and off-chain system design. Inf Process Manag 58(3):102535

    Article  Google Scholar 

  30. Rukanova B, Tan Y-H, Huiden R, Ravulakollu A, Grainger A, Heijmann F (2020) A framework for voluntary business-government information sharing. Gov Inf Q 37(4):101501

    Article  Google Scholar 

  31. Rukanova B, Tan Y-H, Slegt M, Molenhuis M, van Rijnsoever B, Migeotte J, Labare MLM, Plecko K, Caglayan B, Shorten G, van der Meij O, Post S (2021) Identifying the value of data analytics in the context of government supervision: insights from the customs domain. Gov Inf Q 38(1):101496

    Article  Google Scholar 

  32. Susha I, Grönlund Å, Van Tulder R (2019) Data driven social partnerships: exploring an emergent trend in search of research challenges and questions. Gov Inf Q 36(1):112–128

    Article  Google Scholar 

  33. Roth T, Stohr A, Amend J, Fridgen G, Rieger A (2023) Blockchain as a driving force for federalism: a theory of cross-organizational task-technology fit. Int J Inf Manage 68:102476

    Article  Google Scholar 

  34. Ruijer E (2021) Designing and implementing data collaboratives: a governance perspective. Gov Inf Q 38(4):101612

    Article  Google Scholar 

  35. Lin Y, Kemme B, Patiño-Martínez M, Jiménez-Peris R (2005) Middleware based data replication providing snapshot isolation. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data. SIGMOD ’05, pp 419–430, Baltimore, Maryland

  36. Ouyang L, Huang Y, Wei H, Lu J (2021) Achieving probabilistic atomicity with well-bounded staleness and low read latency in distributed datastores. IEEE Trans Parallel Distrib Syst 32(4):815–829

    Article  Google Scholar 

  37. Gomes CO, Junior MN, Nogueira B, Maciel P, Tavares E (2023) NoSQL-based storage systems: influence of consistency on performance, availability and energy consumption. J Supercomput 79(18):21424–21448

    Article  Google Scholar 

  38. Spirovska K, Didona D, Zwaenepoel W (2021) Optimistic causal consistency for geo-replicated key-value stores. IEEE Trans Parallel Distrib Syst 32(3):527–542

    Article  Google Scholar 

  39. Kraska T, Hentschel M, Alonso G, Kossmann D (2009) Consistency rationing in the cloud: pay only when it matters. Proc VLDB Endow 2(1):253–264

    Article  Google Scholar 

  40. Mahmood T, Narayanan SP, Rao S, Vijaykumar TN, Thottethodi M (2021) Karma: cost-effective geo-replicated cloud storage with dynamic enforcement of causal consistency. IEEE Trans Cloud Comput 9(1):197–211

    Article  Google Scholar 

  41. Junfeng T, Wenqing B, Haoyi J (2022) PGCE: a distributed storage causal consistency model based on partial geo-replication and cloud-edge collaboration architecture. Comput Netw 212:109065

    Article  Google Scholar 

  42. Zhao X, Lam K-Y, Zhu C, Chow C-Y, Kuo T-W (2022) MVLevelDB: using log-structured tree to support temporal queries in IoT. IEEE Internet Things J 9(10):7815–7825

    Article  Google Scholar 

  43. Li P, Pan L, Yang X, Song W, Xiao Z, Birman K (2022) Stabilizer: Geo-replication with user-defined consistency. In: 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS), pp 359–369

  44. Khelaifa A, Benharzallah S, Kahloul L, Euler R, Laouid A, Bounceur A (2019) A comparative analysis of adaptive consistency approaches in cloud storage. J Parallel Distrib Comput 129:36–49

    Article  Google Scholar 

  45. Du Y, Xu Z, Zhang K, Liu J, Stewart C, Huang J (2023) Cost-effective strong consistency on scalable geo-diverse data replicas. IEEE Trans Cloud Comput 11(2):1764–1776

    Article  Google Scholar 

  46. Castiglia T, Goldberg C, Patterson S (2020) A hierarchical model for fast distributed consensus in dynamic networks. In: 2020 IEEE 40th International Conference on Distributed Computing Systems. ICDCS’2020, pp 1189–1190

  47. Huang R, Wang J, Song S, Lin X, Zhu X, Pei J (2023) Efficiently cleaning structured event logs: a graph repair approach. ACM Trans Database Syst 48(1):6389

    Article  MathSciNet  Google Scholar 

  48. Bessani A, Correia M, Quaresma B, André F, Sousa P (2013) Depsky: dependable and secure storage in a cloud-of-clouds. ACM Trans Storage 9(4):1–33

    Article  Google Scholar 

  49. Muzammal M, Qu Q, Nasrulin B (2019) Renovating blockchain with distributed databases: an open source system. Futur Gener Comput Syst 90:105–117

    Article  Google Scholar 

  50. Di Francesco Maesa D, Lisi A, Mori P, Ricci L, Boschi G (2023) Self sovereign and blockchain based access control: supporting attributes privacy with zero knowledge. J Netw Comput Appl 212:103577

    Article  Google Scholar 

  51. Wang T, Shen H, Chen J, Chen F, Wu Q, Xie D (2023) A hybrid blockchain-based identity authentication scheme for Mobile Crowd Sensing. Futur Gener Comput Syst 143:40–50

    Article  Google Scholar 

  52. Ji S, Zhang J, Zhang Y, Han Z, Ma C (2023) LAFED: a lightweight authentication mechanism for blockchain-enabled federated learning system. Futur Gener Comput Syst 145:56–67

    Article  Google Scholar 

  53. Yu H, Cai L, Min H, Su X (2023) Advancing medical data classification through federated learning and blockchain incentive mechanism: implications for modern software systems and applications. J Supercomput 5:69

    Google Scholar 

  54. Al Shahrani AM, Rizwan A, Sánchez-Chero M, Cornejo LLC, Shabaz M (2023) Blockchain-enabled federated learning for prevention of power terminals threats in IoT environment using edge zero-trust model. J Supercomput 2:958

    Google Scholar 

  55. Mao Q, Wang L, Long Y, Han L, Wang Z, Chen K (2024) A blockchain-based framework for federated learning with privacy preservation in power load forecasting. Knowl-Based Syst 284:111338

    Article  Google Scholar 

  56. Pinder JP (2017) Chapter 7-theoretical probability distributions. In: Pinder JP (ed) Introduction to Business Analytics Using Simulation. Academic Press, New York, pp 151–195

    Chapter  Google Scholar 

  57. Sadeghi M, Barati M (2012) Performance analysis of poisson and exponential distribution queuing model in local area network. In: 2012 International Conference on Computer and Communication Engineering. ICCCE’2012, pp 499–503

  58. Ihler A, Hutchins J, Smyth P (2006) Adaptive event detection with time-varying Poisson processes. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’2006, pp 207–216, Philadelphia, PA, USA

  59. Ihler A, Hutchins J, Smyth P (2007) Learning to detect events with Markov-modulated Poisson processes. ACM Trans Knowl Discov Data 1(3):13

    Article  Google Scholar 

  60. Ibe OC (2014) Chapter 4-special probability distributions. Fundamentals of Applied Probability and Random Processes, 2nd edn. Academic Press, Boston, pp 103–158

    Chapter  Google Scholar 

Download references

Acknowledgements

This work was supported by National Social Science Fund of China (No.19ATQ005) and National Natural Science Foundation of China (No.72374030).

Author information

Authors and Affiliations

  1. Center for Governance Studies, Beijing Normal University at Zhuhai, Zhuhai, 519087, China

    Qian Geng

  2. Department of Information Management, School of Government, Beijing Normal University, Beijing, 100875, China

    Qian Geng, Ziang Chuai & Jian Jin

Authors
  1. Qian Geng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ziang Chuai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jian Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jian Jin.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Geng, Q., Chuai, Z. & Jin, J. Cross-organizational data exchange based on consortium blockchain with consistency guarantee. J Supercomput (2024). https://doi.org/10.1007/s11227-024-06164-z

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-024-06164-z

Keywords

Search

Navigation