Consistency Benchmarking: Evaluating the Consistency Behavior of Middleware Services in the Cloud
Cloud service providers such as Amazon Web Services offer a set of next-generation storage and messaging middleware services that can be utilized on-demand over the Internet. Outsourcing software into the cloud, however, confronts application developers with the challenge of understanding the behavior of distributed systems, which are out of their control. This work proposes an approach to benchmark the consistency behavior of services by example of Amazon Simple Queue Service (SQS), a hosted, Web-scale, distributed message queue that is exposed as a Web service. The data of our consistency benchmarking tests are evaluated with the metric harvest as described by Fox and Brewer (1999). Our tests with SQS indicate that the client-service interaction intensity has an influence on harvest.
Keywordscloud computing distributed systems service-oriented computing
- 1.Bernstein, P.A.: Middleware: A model for distributed system services. ACM Commun 39(2) (1996)Google Scholar
- 2.Fox, A., Brewer, E.A.: Harvest, yield, and scalable tolerant systems. In: Proceedings of the 7th Workshop on Hot Topics in Operating Systems (1999)Google Scholar
- 6.Amazon Web Services LLC: Amazon Simple Queue Service developer guide - API version 2009-02-01 (2010)Google Scholar
- 7.Garfinkel, S.: An evaluation of Amazon’s grid computing services: EC2, S3 and SQS. Tech. Rep. TR-08-07, Harvard University (2007)Google Scholar
- 8.Binnig, C., Kossmann, D., Kraska, T., Loesing, S.: How is the Weather tomorrow? Towards a Benchmark for the Cloud. In: DBTest Workshop (ACM SIGMOD), Providence, USA (2009)Google Scholar