Towards an Enhanced Benchmark Advocating Energy-Efficient Systems
The growing energy consumption of data centers has become an area of research interest lately. For this reason, the research focus has broadened from a solely performance-oriented system evaluation to an exploration where energy efficiency is considered as well. The Transaction Processing Performance Council (TPC) has also reflected this shift by introducing the TPC-Energy benchmark. In this paper, we recommend extensions, refinements, and variations for such benchmarks. For this purpose, we present performance measurements of real-world DB servers and show that their mean utilization is far from peak and, thus, benchmarking results, even in conjunction with TPC-Energy, lead to inadequate assessment decisions, e.g., when a database server has to be purchased. Therefore, we propose a new kind of benchmarking paradigm that includes more realistic power measures. Our proposal will enable appraisals of database servers based on broader requirement profiles instead of focusing on sole performance. Furthermore, our energy-centric benchmarks will encourage the design and development of energy-proportional hardware and the evolution of energy-aware DBMSs.
KeywordsPower Consumption Load Level Database Server Business Intelligence System Under Test
Unable to display preview. Download preview PDF.
- 3.Poess, M., Nambiar, R.O.: Energy Cost, The Key Challenge of Today’s Data Centers: A Power Consumption Analysis of TPC-C Results. PVLDB 1(2), 1229–1240 (2008)Google Scholar
- 5.Rivoire, S., Shah, M.A., Ranganathan, P., Kozyrakis, C.: JouleSort: A Balanced Energy-Efficiency Benchmark. In: SIGMOD Conference, pp. 365–376 (2007)Google Scholar
- 6.Spector, A.Z.: Distributed Computing at Multi-dimensional Scale (Keynote). In: Proceedings of Int. Middleware Conference (2008)Google Scholar