Chapter

Performance Characterization and Benchmarking. Traditional to Big Data

Volume 8904 of the series Lecture Notes in Computer Science pp 173-187

Date:

A Query, a Minute: Evaluating Performance Isolation in Cloud Databases

  • Tim KieferAffiliated withDatabase Technology Group, Technische Universität Dresden Email author 
  • , Hendrik SchönAffiliated withDatabase Technology Group, Technische Universität Dresden
  • , Dirk HabichAffiliated withDatabase Technology Group, Technische Universität Dresden
  • , Wolfgang LehnerAffiliated withDatabase Technology Group, Technische Universität Dresden

* Final gross prices may vary according to local VAT.

Get Access

Abstract

Several cloud providers offer reltional databases as part of their portfolio. It is however not obvious how resource virtualization and sharing, which is inherent to cloud computing, influence performance and predictability of these cloud databases.

Cloud providers give little to no guarantees for consistent execution or isolation from other users. To evaluate the performance isolation capabilities of two commercial cloud databases, we ran a series of experiments over the course of a week (a query, a minute) and report variations in query response times. As a baseline, we ran the same experiments on a dedicated server in our data center. The results show that in the cloud single outliers are up to 31 times slower than the average. Additionally, one can see a point in time after which the average performance of all executed queries improves by 38 %.