A Query, a Minute: Evaluating Performance Isolation in Cloud Databases

  • Tim Kiefer
  • Hendrik Schön
  • Dirk Habich
  • Wolfgang Lehner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8904)


Several cloud providers offer reltional databases as part of their portfolio. It is however not obvious how resource virtualization and sharing, which is inherent to cloud computing, influence performance and predictability of these cloud databases.

Cloud providers give little to no guarantees for consistent execution or isolation from other users. To evaluate the performance isolation capabilities of two commercial cloud databases, we ran a series of experiments over the course of a week (a query, a minute) and report variations in query response times. As a baseline, we ran the same experiments on a dedicated server in our data center. The results show that in the cloud single outliers are up to 31 times slower than the average. Additionally, one can see a point in time after which the average performance of all executed queries improves by 38 %.


  1. 1.
    Amazon: Amazon Relational Database Service (2014). http://aws.amazon.com/rds/
  2. 2.
    Curino, C., Jones, E.P.C., Popa, R.A., Malviya, N., Wu, E., Madden, S., Balakrishnan, H., Zeldovich, N.: Relational cloud: a Database-as-a-Service for the cloud. In: CIDR 2011, Asilomar, California, USA (2011). http://dspace.mit.edu/handle/1721.1/62241
  3. 3.
    Das, S., Narasayya, V., Li, F., Syamala, M.: CPU sharing techniques for performance isolation in multi-tenant relational Database-as-a-Service. In: VLDB 2014, Hangzhou, China, vol. 7 (2014). http://www.vldb.org/pvldb/vol7/p37-das.pdf
  4. 4.
    Gupta, D., Cherkasova, L., Gardner, R., Vahdat, A.: Enforcing performance isolation across virtual machines in Xen. In: van Steen, M., Henning, M. (eds.) Middleware 2006. LNCS, vol. 4290, pp. 342–362. Springer, Heidelberg (2006). http://link.springer.com/chapter/10.1007/11925071_18 CrossRefGoogle Scholar
  5. 5.
    Jacobs, D., Aulbach, S.: Ruminations on multi-tenant databases. In: BTW 2007, Aachen, Germany, pp. 5–9 (2007). http://citeseerx.ist.psu.edu/viewdoc/download?doi=
  6. 6.
    Kaldewey, T., Wong, T.M., Golding, R., Povzner, A., Brandt, S., Maltzahn, C.: Virtualizing disk performance. In: 2008 IEEE Real-Time and Embedded Technology and Applications Symposium, pp. 319–330. IEEE, April 2008. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4550803
  7. 7.
    Kiefer, T., Lehner, W.: Private table database virtualization for DBaaS. In: UCC 2011, Melbourne, Australia, vol. 1, pp. 328–329. IEEE, December 2011. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6123516
  8. 8.
    Kiefer, T., Schlegel, B., Lehner, W.: MulTe: a multi-tenancy database benchmark framework. In: Nambiar, R., Poess, M. (eds.) TPCTC 2012. LNCS, vol. 7755, pp. 92–107. Springer, Heidelberg (2013). http://link.springer.com/chapter/10.1007%2F978-3-642-36727-4_7 CrossRefGoogle Scholar
  9. 9.
    Kossmann, D., Kraska, T., Loesing, S.: An evaluation of alternative architectures for transaction processing in the cloud. In: SIGMOD 2010 - Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, p. 579 (2010). http://portal.acm.org/citation.cfm?doid=1807167.1807231
  10. 10.
    Krebs, R., Momm, C., Kounev, S.: Metrics and techniques for quantifying performance isolation in cloud environments. Sci. Comput. Program. 90, 116–134 (2014). http://linkinghub.elsevier.com/retrieve/pii/S0167642313001962 CrossRefGoogle Scholar
  11. 11.
    Microsoft: Microsoft Windows Azure (2014). http://www.windowsazure.com/en-us/
  12. 12.
    Narasayya, V., Das, S., Syamala, M., Chandramouli, B., Chaudhuri, S.: SQLVM: performance isolation in multi-tenant relational Database-as-a-Service. In: CIDR 2013 (2013)Google Scholar
  13. 13.
    Oracle: Oracle Database Cloud Service (2014). https://cloud.oracle.com/database?tabID=1383678914614
  14. 14.
    Shue, D., Freedman, M.J., Shaikh, A.: Performance isolation and fairness for multi-tenant cloud storage. In: OSDI 2012 (2012). https://www.usenix.org/system/files/conference/osdi12/osdi12-final-215.pdf
  15. 15.
    Somani, G., Chaudhary, S.: Application performance isolation in virtualization. In: CLOUD 2009, pp. 41–48. IEEE (2009). http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5284105
  16. 16.
    TPC: Transaction Processing Performance Council, TPC-H (2014). http://www.tpc.org/tpch/

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Tim Kiefer
    • 1
  • Hendrik Schön
    • 1
  • Dirk Habich
    • 1
  • Wolfgang Lehner
    • 1
  1. 1.Database Technology GroupTechnische Universität DresdenDresdenGermany

Personalised recommendations