Two Firsts for the TPC: A Benchmark to Characterize Databases Virtualized in the Cloud, and a Publicly-Available, Complete End-to-End Reference Kit

  • Andrew Bond
  • Greg Kopczynski
  • H. Reza Taheri
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7755)

Abstract

The TPC formed a subcommittee in 2010 to develop TPC V, a benchmark for virtualized databases. We soon discovered two major issues. First, a database benchmark running in a VM, or even a consolidation scenario of a few database VMs, is no longer adequate. There is demand for a benchmark that emulates cloud computing, e.g., a mix of heterogeneous VMs, and dynamic load elasticity for each VM. Secondly, waiting for system or database vendors to develop benchmarking kits to run such a benchmark is problematic. Hence, we are developing a publicly-available, end-to-end reference kit that will run against the open source PostgreSQL DBMS. This paper describes TPC V and the proposed architecture of its reference kit; provides a progress report; and presents results from prototyping experiments with the reference kit.

Keywords

Database performance virtualization PostgreSQL cloud computing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bose, S., Mishra, P., Sethuraman, P., Taheri, R.: Benchmarking Database Performance in a Virtual Environment. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 167–182. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Creasy, R.J.: The Origin of the VM/370 Time-Sharing System. IBM Journal of Research and Development 25(5), 483Google Scholar
  3. 3.
  4. 4.
    Figueiredo, R., Dinda, P.A., Fortes, J.A.B.: Guest Editors’ Introduction: Resource Virtualization Renaissance. Computer 38(5), 28–31 (2005), http://www2.computer.org/portal/web/csdl/doi/10.1109/MC.2005.159 CrossRefGoogle Scholar
  5. 5.
    Gartner Identifies the Top 10 Strategic Technologies for (2012), http://www.gartner.com/it/page.jsp?id=1826214
  6. 6.
    Nanda, S., Chiueh, T.-C.: A Survey on Virtualization Technologies. Technical Report ECSL-TR-179, SUNY at Stony Brook (2005), http://www.ecsl.cs.sunysb.edu/tr/TR179.pdf
  7. 7.
    Nelson, M., Lim, B.-H., Hutchins, G.: Fast Transparent Migration for Virtual Machines. In: USENIX 2005, pp. 391–394 (April 2005)Google Scholar
  8. 8.
    Rosenblum, M., Garfinkel, T.: Virtual Machine Monitors: Current Technology and Future Trends. Computer 38(5), 39–47 (2005)CrossRefGoogle Scholar
  9. 9.
    Sethuraman, P., Taheri, R.: TPC-V: A Benchmark for Evaluating the Performance of Database Applications in Virtual Environments. In: Nambiar, R., Poess, M. (eds.) TPCTC 2010. LNCS, vol. 6417, pp. 121–135. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    SPEC Virtualization Committee, http://www.spec.org/virt_sc2010/
  11. 11.
    TPC: Detailed TPC-C description, http://www.tpc.org/tpcc/detail.asp
  12. 12.
    TPC: Detailed TPC-E Description, http://www.tpc.org/tpce/spec/TPCEDetailed.doc
  13. 13.
  14. 14.
    TPC: TPC Benchmark H Specification, http://www.tpc.org/tpch/spec/tpch2.14.4.pdf
  15. 15.
    TPC: DBGen and Reference Data Set, http://www.tpc.org/tpch/spec/tpch_2_14_3.zip
  16. 16.
    TPC: TPC Benchmark DS Specification, http://www.tpc.org/tpcds/spec/tpcds_1.1.0.pdf
  17. 17.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Andrew Bond
    • 1
  • Greg Kopczynski
    • 2
  • H. Reza Taheri
    • 2
  1. 1.Red Hat, Inc.USA
  2. 2.VMware, Inc.USA

Personalised recommendations