Performance Analysis of Database Virtualization with the TPC-VMS Benchmark
TPC-VMS is a benchmark designed to measure the performance of virtualized databases using existing, time-tested TPC workloads. In this paper, we will present our experience in using the TPC-E workload under the TPC-VMS rules to measure the performance of 3 OLTP databases consolidated onto a single server. We will describe the tuning steps employed to more than double the performance and reach 98.6 % of the performance of a non-virtualized server – if we aggregate the throughputs of the 3 VMs for quantifying the tuning process. The paper will detail lessons learned in optimizing performance by tuning the application, the database manager, the guest operating system, the hypervisor, and the hardware on both AMD and Intel processors.
Since TPC-E results have been disclosed with non-virtualized databases on both platforms, we can analyze the performance overheads of virtualization for database workloads. With a native-virtual performance gap of just a few percentage points, we will show that virtualized servers make excellent platforms for the most demanding database workloads.
KeywordsDatabase performance Virtualization SQL server Workload consolidation Performance tuning Cloud computing
We would like to thank the TPC for making the TPC-VMS benchmark available, and the following individuals for their contribution to the benchmark results: Bao Chun-Jie, Seongbeom Kim, Paul Cao, Juan Garcia-Rovetta, Bruce Herndon, and Chethan Kumar.
- 1.Bhargava, R., Serebrin, B., Spanini, F., Manne, S.: Accelerating two-dimensional page walks for virtualized systems. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2008Google Scholar
- 2.Bhatia, N.: Performance evaluation of intel EPT hardware assist. http://www.vmware.com/pdf/Perf_ESX_Intel-EPT-eval.pdf
- 3.Bond, A., Johnson, D., Kopczynski, G., Taheri, H.: Architecture and performance characteristics of a PostgreSQL implementation of the TPC-E and TPC-V workloads. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 77–92. Springer, Heidelberg (2014). ISBN 978-3-319-04935-9Google Scholar
- 4.Buell, J., et al.: Methodology for performance analysis of VMware vSphere under Tier-1 applications. VMware Tech. J. Summer 2013Google Scholar
- 5.IDC: Worldwide Virtual Machine 2013–2017 Forecast: Virtualization Buildout Continues Strong. http://www.idc.com/getdoc.jsp?containerId=242762
- 6.Intel 64 and IA-32 Architectures Developer’s ManualGoogle Scholar
- 7.Smith, W.D., Sebastian, S.: Virtualization Performance Insights from TPC-VMS. http://www.tpc.org/tpcvms/tpc-vms-2013-1.0.pdf
- 8.SPECvirt_sc2013 benchmark info, SPEC Virtualization Committee. http://www.spec.org/virt_sc2013/
- 9.TPC: Detailed TPC-C description. http://www.tpc.org/tpcc/detail.asp
- 10.TPC: Detailed TPC-E Description. http://www.tpc.org/tpce/spec/TPCEDetailed.doc
- 11.TPC: TPC Benchmark H Specification. http://www.tpc.org/tpch/spec/tpch2.14.4.pdf
- 12.TPC: TPC Benchmark DS Specification. http://www.tpc.org/tpcds/spec/tpcds_1.1.0.pdf
- 13.TPC: TPC-VMS benchmark. http://www.tpc.org/tpcvms/default.asp
- 14.VMware, Inc.: VMmark 2.x. http://www.vmware.com/products/vmmark/overview.html
- 15.VMware, Inc.: Performance Characteristics of VMFS and RDM. http://www.vmware.com/files/pdf/vmfs_rdm_perf.pdf
- 16.VMware, Inc.: The Architecture of VMware ESXi. http://www.vmware.com/files/pdf/ESXi_architecture.pdf