Towards Comprehensive Measurement of Consistency Guarantees for Cloud-Hosted Data Storage Services

  • David Bermbach
  • Liang Zhao
  • Sherif Sakr
Conference paper

DOI: 10.1007/978-3-319-04936-6_3

Volume 8391 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Bermbach D., Zhao L., Sakr S. (2014) Towards Comprehensive Measurement of Consistency Guarantees for Cloud-Hosted Data Storage Services. In: Nambiar R., Poess M. (eds) Performance Characterization and Benchmarking. TPCTC 2013. Lecture Notes in Computer Science, vol 8391. Springer, Cham

Abstract

The CAP theorem and the PACELC model have described the existence of direct trade-offs between consistency and availability as well as consistency and latency in distributed systems. Cloud storage services and NoSQL systems, both optimized for the web with high availability and low latency requirements, hence, typically opt to relax consistency guarantees. In particular, these systems usually offer eventual consistency which guarantees that all replicas will, in the absence of failures and further updates, eventually converge towards a consistent state where all replicas are identical. This, obviously, is a very imprecise description of actual guarantees.

Motivated by the popularity of eventually consistent storage systems, we take the position that a standard consistency benchmark is of great practical value. This paper is intended as a call for action; its goal is to motivate further research on building a standard comprehensive benchmark for quantifying the consistency guarantees of eventually consistent storage systems. We discuss the main challenges and requirements of such a benchmark, and present first steps towards a comprehensive consistency benchmark for cloud-hosted data storage systems. We evaluate our approach using experiments on both Cassandra and MongoDB.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • David Bermbach
    • 1
  • Liang Zhao
    • 2
  • Sherif Sakr
    • 2
  1. 1.Karlsruhe Institute of TechnologyKarlsruheGermany
  2. 2.NICTAUniversity of New South WalesSydneyAustralia