Two Firsts for the TPC: A Benchmark to Characterize Databases Virtualized in the Cloud, and a Publicly-Available, Complete End-to-End Reference Kit

  • Andrew Bond
  • Greg Kopczynski
  • H. Reza Taheri
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7755)


The TPC formed a subcommittee in 2010 to develop TPC V, a benchmark for virtualized databases. We soon discovered two major issues. First, a database benchmark running in a VM, or even a consolidation scenario of a few database VMs, is no longer adequate. There is demand for a benchmark that emulates cloud computing, e.g., a mix of heterogeneous VMs, and dynamic load elasticity for each VM. Secondly, waiting for system or database vendors to develop benchmarking kits to run such a benchmark is problematic. Hence, we are developing a publicly-available, end-to-end reference kit that will run against the open source PostgreSQL DBMS. This paper describes TPC V and the proposed architecture of its reference kit; provides a progress report; and presents results from prototyping experiments with the reference kit.


Database performance virtualization PostgreSQL cloud computing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bose, S., Mishra, P., Sethuraman, P., Taheri, R.: Benchmarking Database Performance in a Virtual Environment. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 167–182. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Creasy, R.J.: The Origin of the VM/370 Time-Sharing System. IBM Journal of Research and Development 25(5), 483Google Scholar
  3. 3.
  4. 4.
    Figueiredo, R., Dinda, P.A., Fortes, J.A.B.: Guest Editors’ Introduction: Resource Virtualization Renaissance. Computer 38(5), 28–31 (2005), CrossRefGoogle Scholar
  5. 5.
    Gartner Identifies the Top 10 Strategic Technologies for (2012),
  6. 6.
    Nanda, S., Chiueh, T.-C.: A Survey on Virtualization Technologies. Technical Report ECSL-TR-179, SUNY at Stony Brook (2005),
  7. 7.
    Nelson, M., Lim, B.-H., Hutchins, G.: Fast Transparent Migration for Virtual Machines. In: USENIX 2005, pp. 391–394 (April 2005)Google Scholar
  8. 8.
    Rosenblum, M., Garfinkel, T.: Virtual Machine Monitors: Current Technology and Future Trends. Computer 38(5), 39–47 (2005)CrossRefGoogle Scholar
  9. 9.
    Sethuraman, P., Taheri, R.: TPC-V: A Benchmark for Evaluating the Performance of Database Applications in Virtual Environments. In: Nambiar, R., Poess, M. (eds.) TPCTC 2010. LNCS, vol. 6417, pp. 121–135. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    SPEC Virtualization Committee,
  11. 11.
    TPC: Detailed TPC-C description,
  12. 12.
    TPC: Detailed TPC-E Description,
  13. 13.
  14. 14.
    TPC: TPC Benchmark H Specification,
  15. 15.
    TPC: DBGen and Reference Data Set,
  16. 16.
    TPC: TPC Benchmark DS Specification,
  17. 17.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Andrew Bond
    • 1
  • Greg Kopczynski
    • 2
  • H. Reza Taheri
    • 2
  1. 1.Red Hat, Inc.USA
  2. 2.VMware, Inc.USA

Personalised recommendations