Skip to main content
SpringerLink
Log in

A quorum-based data consistency approach for non-relational database

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Quorum algorithm has become one of the most widely adopted approaches for storing data in the failure-prone distributed storage systems. In this paper, a new approach is proposed which is able to set different levels of data consistency in key-value NoSQL databases. The proposed approach is based on the parameters set in the NoSQL-dependent structure and is applied to distributed systems, using the quorum algorithm to adjust the consistency and to determine the different grades of data. In this paper, different data writing and reading and mix reading/writing operations are implemented test-bed to study the performance of the proposed approach. In addition to its main goal for improving data consistency, the proposed approach also satisfies the accepted compromise between the pillars of the CAP and PACELC theorems. Evaluation of the results shows that the objectives for consistency and efficiency of the proposed approach have been met.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Kausar, M.A., Nasar, M.: SQL versus NoSQL databases to assess their appropriateness for big data application. Recent Adv. Comput. Sci. Commun. 14(4), 1098–1108 (2021). https://doi.org/10.2174/2213275912666191028111632

    Article  Google Scholar 

  2. Bagga, S., Sharma, A.: A Comparative Study of NoSQL Databases. Recent Innovations in Computing, Lecture Notes in Electrical Engineering. Springer, New York (2021)

    Google Scholar 

  3. Stonebraker, M., Madden, S., Abadi, D.J., Harizopoulos, S., Hachem, N., Helland, P.: The end of an architectural era: it's time for a complete rewrite. In: Proceedings of the 33rd international conference on very large data bases Endowment (VLDB), 2007, pp. 1150–1160. https://doi.org/10.1145/3226595.3226637.

  4. Gorbenko, A., Romanovsky, A., Tarasyuk, O.: Interplaying Cassandra NoSQL Consistency and performance: A benchmarking approach. Dependable Computing - EDCC Workshops, Communications in Computer and Information Science, Vol. 1279, Springer, 2020, pp. 168–184. https://doi.org/10.1007/978-3-030-58462-7_14.

  5. Dipietro, S.: Performance modelling and optimisation of NoSQL database systems. ACM SIGMETRICS Perform. Eval. Rev. 47(3), 10–13 (2020). https://doi.org/10.1145/3380908.3380912

    Article  Google Scholar 

  6. Aatish, C., Avinash, M.: Data Management in Erasure-Coded Distributed Storage Systems. In: 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID), pp. 902–907. (2020). https://doi.org/10.1109/CCGrid49817.2020.00018.

  7. Rani, A., Goyal, N., Gadia, S.K.: Twitter Data Modelling and Provenance Support for Key-Value Pair Databases. Databases Theory and Applications, Lecture Notes in Computer Science. Springer, New York (2021)

    Google Scholar 

  8. Moniruzzaman, A.B.M., Hossain, S.A.: Nosql database: New era of databases for big data analytics classification, characteristics and comparison. (2013). http://arxiv.org/abs/1307.0191.

  9. Gavrielatos, V., Katsarakis, A., Nagarajan, V., Grot, B., Joshi, A.: Kite: Efficient and available release consistency for the datacenter. In: Proceedings of the 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 1–16. (2020). https://doi.org/10.1145/3332466.3374516.

  10. Ramy, E.A.: Consistency analysis of replication-based probabilistic key-value stores. IEEE International Conference on Communications (ICC), pp. 1–6. (2021) https://doi.org/10.1109/ICC42927.2021.9500811.

  11. Nwe, T., Yee, T.T., Chaw H.E.: Performance analysis of key-value stores with consistent replica selection approach. In: Asian Conference on Intelligent Information and Database Systems, Intelligent Information and Database Systems, pp. 377–387. (2020) https://doi.org/10.1007/978-981-15-3380-8_33.

  12. Tabet, K., Mokadem, R., Laouar, M.R.: A data replication strategy for document-oriented NoSQL systems. Int. J. Grid Utility Comput. 10(1), 53–62 (2019). https://doi.org/10.1504/IJGUC.2019.097224

    Article  Google Scholar 

  13. Bharati, R.D., Attar, V.Z.: Workload-Driven Transactional Partitioning for Distributed Databases. Data Intelligence and Cognitive Informatics, pp. 389–396. Springer, Berlin (2021)

    Book  Google Scholar 

  14. Mokadem, R., Hameurlain, A.: A data replication strategy with Tenant Performance and Provider Economic Profit Guarantees in Cloud Data Centers. J. Syst. Softw. (2019). https://doi.org/10.1016/j.jss.2019.110447

    Article  Google Scholar 

  15. Gomes, C., Tavares, E., Junior, M.N.D.O., et al.: Cloud storage availability and performance assessment: a study based on NoSQL DBMS. J. Supercomput. (2021). https://doi.org/10.1007/s11227-021-03976-1

    Article  Google Scholar 

  16. Pandey, A.K., Pandey, R.: Influence of CAP theorem on big data analysis. Int. J. Inform. Technol. (IJIT) 6, 6 (2020)

    Google Scholar 

  17. Tauro, C.J., Ganesan, N., Easo, A.A., Mathew, S.: Convergent replicated data structures that tolerate eventual consistency in NoSQL databases. Advances in Computing and Communications (ICACC), Third International Conference, IEEE, 2013, pp. 70–75. https://doi.org/10.1109/ICACC.2013.109.

  18. Lewis-Pye, A., Roughgarden, T.: Resource Pools and the CAP Theorem. (2020). http://arxiv.org/abs/2006.10698.

  19. Asaad, C., Baïna, K., Ghogho, M. NOSQL Databases: Yearning for Disambiguation. (2020). http://arxiv.org/abs/2003.04074.

  20. Gifford, D.K.: Weighted Voting for Replicated Data. ACM SIGOPS 7th Sym. on Op. Systems Principles, SOSP, 1979, pp. 150–162. https://doi.org/10.1145/800215.806583.

  21. Mahfoud, Z., Nouali-Taboudjemat, N.: Consistency in cloud-based database systems. Int. J. Comput. Inform. (2019). https://doi.org/10.31449/inf.v43i3.2650

    Article  Google Scholar 

  22. Abadi, D.J.: DBMS Musings: Problems with CAP, and Yahoo's little known NoSQL system. (2010) Accessed 09 Nov 2016.

  23. Chatterjee, S., Golab, W.: Brief announcement: A probabilistic performance model and tuning framework for eventually consistent distributed storage systems. Proceedings of the ACM Symposium on Principles of Distributed Computing, 2017, pp. 259–261. https://doi.org/10.1145/3087801.3087850.

  24. Li, C., Porto, D., Clement, A., Gehrke, J., Preguiça, N., Rodrigues, R.: Making geo-replicated systems fast as possible, consistent when necessary. Presented as part of the 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI 12), 2012, pp. 265–278.

  25. Krechowicz, A., Deniziak, S., Łukawski, G.: Highly scalable distributed architecture for NoSQL datastore supporting strong consistency. IEEE (2021). https://doi.org/10.1109/ACCESS.2021.3077680

    Article  Google Scholar 

  26. Kokocinski, M., Kobus, T., Wojciechowski, P.T.: On mixing eventual and strong consistency: Acute cloud types. IEEE Trans. Parallel Distrib. Syst. (2021). https://doi.org/10.1109/TPDS.2021.3090318

    Article  MATH  Google Scholar 

  27. Sidhanta, S., Golab, W., Mukhopadhyay, S., Basu, S.: Optcon: An adaptable sla-aware consistency tuning framework for quorum-based stores. 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 388–397. (2016). https://doi.org/10.1109/CCGrid.2016.9.

  28. Diogo, M., Cabral, B., Bernardino, J.: Consistency models of NoSQL databases. Future Internet (2019). https://doi.org/10.3390/fi11020043

    Article  Google Scholar 

  29. Haifeng, Y., Amin, V.: Design and evaluation of a CONIT-based continuous consistency model for replicated services. ACM Trans. Comput. Syst. 20(3), 239–282 (2002). https://doi.org/10.1145/566340.566342

    Article  Google Scholar 

  30. Ghalem, B., Yahya, S.A.: Hybrid approach for consistency management in large scale systems. Proceedings of the International conference on Networking and Services. IEEE Computer Society (2006).

  31. Mansouri, Y., Toosi, A.N., Buyya, R.: Data storage management in cloud environments: Taxonomy, survey, and future directions. ACM Comput. Surveys 50, 6 (2017). https://doi.org/10.1145/3136623

    Article  Google Scholar 

  32. Viotti, P., Vukolić, M.: Consistency in non-transactional distributed storage systems. ACM Comput. Surveys 49, 1 (2016). https://doi.org/10.1145/2926965

    Article  Google Scholar 

  33. Kallman, R.: H-store: a high-performance, distributed main memory transaction processing system. Proc. Very Large Data Bases Endow. (VLDB) 1(2), 1496–1499 (2008)

    Google Scholar 

  34. Kraska, T., Hentschel, M., et al.: Consistency rationing in the cloud: Pay only when it matters. Proc Very Large Data Bases Endow (VLDB) 2(1), 253–264 (2009). https://doi.org/10.14778/1687627.1687657

    Article  Google Scholar 

  35. Ruay-Shiung, C., Jih-Sheng, C.: Adaptable replica consistency service for data grid. In: Third International Conference on Information Technology: New Generations (ITNG’06) (2006). https://doi.org/10.1109/ITNG.2006.23.

  36. Wada, H., Fekete, A., Zhao, L., Lee, K., Liu, A.: Data consistency properties and the trade-offs in commercial cloud storage: the consumers’ perspective. 5th Biennial Conference on Innovative Data Systems Research, Online Proceedings, (2011) pp. 134–143.

  37. Pankowski, T.: Consistency and availability of Data in replicated NoSQL databases. In: Proceedings of the International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE), 2015, pp. 102–109.

  38. Shapiro, M., Ardekani, M.S., Petri, G.: Consistency in 3D. National Institute for Research in Computer Science and Automation (Inria), hal.archives-ouvertes.fr, 2016. hal-01343592.

  39. Crooks, N., Pu, Y., Alvisi, L., Clement, A.: Seeing is believing: a client-centric specification of database isolation. Proceedings of the ACM Symposium on Principles of Distributed Computing, 2017, pp. 73–82. https://doi.org/10.1145/3087801.3087802.

  40. Jiménez-Peris, R., Patiño-Martínez, M., Kemme, B., Alonso, G.: Improving the Scalability of Fault-Tolerant Database Clusters. In: Proceedings 22nd International Conference on Distributed Computing Systems (2002). https://doi.org/10.1109/ICDCS.2002.1022297.

  41. Chihoub, H., Ibrahim, S., Antoniu, G., Perez, M.S.: Harmony: Towards automated self-adaptive consistency in cloud storage. IEEE Int. Conf. Clust. Comput. (2012). https://doi.org/10.1109/CLUSTER.2012.56

    Article  Google Scholar 

  42. Armbrust, M., Curtis, K., Kraska, T., Fox, A., Franklin, M.J., Patterson, D.A.: PIQL: Success-tolerant query processing in the cloud. Proc. Very Large Data Bases Endow. (VLDB) 5(3), 181–192 (2012)

    Google Scholar 

  43. Gotsman, A., Yang, H., Ferreira, C., Najafzadeh, M., Shapiro, M.: Cause I’m strong enough: reasoning about consistency choices in distributed systems. In: Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, pp. 371–384. (2016) https://doi.org/10.1145/2837614.2837625.

  44. Tomsic, A.Z., Bravo, M., Shapiro, M.: Distributed transactional reads: the strong, the quick, the fresh & the impossible. Proceedings of the 19th International Middleware Conference, pp. 120–133. (2018) https://doi.org/10.1145/3274808.3274818.

  45. Abawajy, J.H., Deris, M.M.: Data replication approach with consistency guarantee for data grid. IEEE Trans. Comput. 63(12), 2975–2987 (2014). https://doi.org/10.1109/TC.2013.183

    Article  MathSciNet  MATH  Google Scholar 

  46. Sarra, S., Amar, K., Hafida, B.: A load balancing strategy for replica consistency maintenance in data grid systems. Informatica 37(3), 345–353 (2013)

    Google Scholar 

  47. McKenzie, M., Fan, H., Golab, W.: Continuous partial quorums for consistency-latency tuning in distributed NoSQL storage systems. (2015). http://arxiv.org/abs/1507.03162.

  48. Ceresnak, R., Matiasko, K., Dudas, A.: Influencing migration processes by real-time data. In: 28th Conference of Open Innovations Association (FRUCT), pp. 1–7. (2021). https://doi.org/10.23919/FRUCT50888.2021.9347581.

  49. Gilbert, S., Lynch, N.A.: Perspectives on the CAP theorem. Institute of Electrical and Electronics Engineers. pp. 30–36 (2012). https://doi.org/10.1109/MC.2011.389.

  50. Terry, D.B., Prabhakaran, V., Kotla, R., Balakrishnan, M., Aguilera, M.K., Abu-Libdeh, H.: Consistency-based service level agreements for cloud storage. In: Proceedings of the 24th ACM Symposium on Operating Systems Principles, pp. 309–324. (2013). https://doi.org/10.1145/2517349.2522731.

  51. Khan, A.W., et al.: Analyzing and evaluating critical challenges and practices for software vendor organizations to secure big data on cloud computing: An AHP-based systematic approach. IEEE (2021). https://doi.org/10.1109/ACCESS.2021.3100287

    Article  Google Scholar 

  52. Fadelelmoula, A.A.: Exploiting cloud computing and web services to achieve data consistency, availability, and partition tolerance in the large-scale pervasive systems. Int. J. Interact. Mobile Technol. 15, 74–102 (2021)

    Article  Google Scholar 

  53. Golab, W., Rahman, M.R., Auyoung, A., Keeton, K., Gupta, I.: Client-centric benchmarking of eventual consistency for cloud storage systems. In: IEEE 34th International Conference on Distributed Computing Systems (ICDCS), pp. 493–502. (2014) https://doi.org/10.1109/ICDCS.2014.57.

  54. Dizdarevic, J., Avdagic, Z., Orucevic, F., et al.: Advanced consistency management of highly-distributed transactional database in a hybrid cloud environment using novel R-TBC/RTA approach. J. Cloud Comput. (2021). https://doi.org/10.1186/s13677-021-00230-0

    Article  Google Scholar 

  55. http://eforexcel.com/wp/downloads-18-sample-csv-files-data-sets-for-testing-sales/, Accessed 23 June 2021.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Nasim Naseri Seyedi Noudoust & Ali Rezaee

  2. Department of Computer Engineering, North Tehran Branch, Islamic Azad University, Tehran, Iran

    Sahar Adabi

Authors
  1. Nasim Naseri Seyedi Noudoust
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sahar Adabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ali Rezaee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sahar Adabi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naseri Seyedi Noudoust, N., Adabi, S. & Rezaee, A. A quorum-based data consistency approach for non-relational database. Cluster Comput 25, 1515–1540 (2022). https://doi.org/10.1007/s10586-021-03531-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-021-03531-w

Keywords

Search

Navigation