Selected Topics in Performance Evaluation and Benchmarking

Volume 7755 of the series Lecture Notes in Computer Science pp 34-50

Two Firsts for the TPC: A Benchmark to Characterize Databases Virtualized in the Cloud, and a Publicly-Available, Complete End-to-End Reference Kit

  • Andrew BondAffiliated withRed Hat, Inc.
  • , Greg KopczynskiAffiliated withVMware, Inc.
  • , H. Reza TaheriAffiliated withVMware, Inc.

* Final gross prices may vary according to local VAT.

Get Access


The TPC formed a subcommittee in 2010 to develop TPC V, a benchmark for virtualized databases. We soon discovered two major issues. First, a database benchmark running in a VM, or even a consolidation scenario of a few database VMs, is no longer adequate. There is demand for a benchmark that emulates cloud computing, e.g., a mix of heterogeneous VMs, and dynamic load elasticity for each VM. Secondly, waiting for system or database vendors to develop benchmarking kits to run such a benchmark is problematic. Hence, we are developing a publicly-available, end-to-end reference kit that will run against the open source PostgreSQL DBMS. This paper describes TPC V and the proposed architecture of its reference kit; provides a progress report; and presents results from prototyping experiments with the reference kit.


Database performance virtualization PostgreSQL cloud computing