Skip to main content

CBench-Dynamo: A Consistency Benchmark for NoSQL Database Systems

  • Conference paper
  • First Online:
Performance Evaluation and Benchmarking for the Era of Cloud(s) (TPCTC 2019)

Abstract

Nowadays software architects face new challenges because Internet has grown to a point where popular websites are accessed by hundreds of millions of people on a daily basis. One powerful machine is no longer economically viable and resilient in order to handle such outstanding traffic and architectures have since been migrated to horizontal scaling. However, traditional databases, usually associated with a relational design, were not ready for horizontal scaling. Therefore, NoSQL databases have proposed to fill the gap left by their predecessors. This new paradigm is proposed to better serve currently massive scaled-up Internet usage when consistency is no longer a top priority and a high available service is preferable. Cassandra is a NoSQL database based on the Amazon Dynamo design. Dynamo-based databases are designed to run in a cluster while offering high availability and eventual consistency to clients when subject to network partition events. Therefore, the main goal of this work is to propose CBench-Dynamo, the first consistency benchmark for NoSQL databases. Our proposed benchmark correlates properties, such as performance, consistency, and availability, in different consistency configurations while subjecting the System Under Test to network partition events.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brewer, E.: Towards robust distributed systems. Pod. Principles Distrib. Comput. Conf. 1, 1–12 (2000)

    Google Scholar 

  2. Gilbert, S., Lynch, N.: Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. SIGACT News 33, 51–59 (2002)

    Article  Google Scholar 

  3. Pritchett, D.: BASE: an acid alternative. Queue 6, 48–55 (2008)

    Article  Google Scholar 

  4. Yahoo! GitHub Repository: YCSB (Yahoo! Cloud Serving Benchmark). https://github.com/brianfrankcooper/YCSB

  5. Henning, J.L., Arnold, J.A., Lange, K.-D., et al.: How to Build a Benchmark, pp. 333–336 (2015)

    Google Scholar 

  6. Cooper, B.F., Silberstein, A., Tam, E., et al.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing, pp 143–154. ACM, New York (2010)

    Google Scholar 

  7. Bailis, P., Venkataraman, S., Franklin, M.J., et al.: Quantifying eventual consistency with PBS. Commun. ACM 57, 93–102 (2014)

    Article  Google Scholar 

  8. Bermbach, D., Tai, S.: Benchmarking eventual consistency: lessons learned from long-term experimental studies. In: Proceedings- 2014 IEEE International Conference Cloud Engineering, IC2E 2014, pp. 47–56 (2014)

    Google Scholar 

  9. Patil, S., Polte, M., Ren, K., et al.: YCSB ++: benchmarking and performance debugging advanced features in scalable table stores. In: Proceedings of the 2nd ACM Symposium on Cloud Computing, pp. 9:1–9:14. ACM, New York (2011)

    Google Scholar 

  10. DeCandia, G., Hastorun, D., Jampani, M., et al.: Dynamo: Amazon’s highly available key-value store. In: Proceedings Symposium Operations System Princ, pp. 205–220 (2007)

    Google Scholar 

  11. Bailis, P., Venkataraman, S., Franklin, M.J., et al.: Probabilistically bounded staleness for practical partial quorums. Proc VLDB Endow 5, 776–787 (2012)

    Article  Google Scholar 

  12. Diogo, M., Cabral, B., Bernardino, J.: Consistency models of NoSQL databases. Fut. Internet 11, 43 (2019)

    Article  Google Scholar 

  13. Diogo, M.: GitHub Repository: YCSB-Consistency (2019)

    Google Scholar 

  14. Diogo, M.: GitHub Repository: CBench-Analyser (2019). https://github.com/migueldiogo/cbench-analyser

  15. Diogo, M.: GitHub Repository: ansible-dynamo-clusters (2019). https://github.com/migueldiogo/ansible-dynamo-clusters

  16. Marcus, E.: The myth of the nines. In: Blueprints High Available (2003). https://searchstorage.techtarget.com/tip/The-myth-of-the-nines

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Miguel Diogo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Diogo, M., Cabral, B., Bernardino, J. (2020). CBench-Dynamo: A Consistency Benchmark for NoSQL Database Systems. In: Nambiar, R., Poess, M. (eds) Performance Evaluation and Benchmarking for the Era of Cloud(s). TPCTC 2019. Lecture Notes in Computer Science(), vol 12257. Springer, Cham. https://doi.org/10.1007/978-3-030-55024-0_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-55024-0_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-55023-3

  • Online ISBN: 978-3-030-55024-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics