Towards an Enhanced Benchmark Advocating Energy-Efficient Systems

  • Daniel Schall
  • Volker Hoefner
  • Manuel Kern
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7144)


The growing energy consumption of data centers has become an area of research interest lately. For this reason, the research focus has broadened from a solely performance-oriented system evaluation to an exploration where energy efficiency is considered as well. The Transaction Processing Performance Council (TPC) has also reflected this shift by introducing the TPC-Energy benchmark. In this paper, we recommend extensions, refinements, and variations for such benchmarks. For this purpose, we present performance measurements of real-world DB servers and show that their mean utilization is far from peak and, thus, benchmarking results, even in conjunction with TPC-Energy, lead to inadequate assessment decisions, e.g., when a database server has to be purchased. Therefore, we propose a new kind of benchmarking paradigm that includes more realistic power measures. Our proposal will enable appraisals of database servers based on broader requirement profiles instead of focusing on sole performance. Furthermore, our energy-centric benchmarks will encourage the design and development of energy-proportional hardware and the evolution of energy-aware DBMSs.


Power Consumption Load Level Database Server Business Intelligence System Under Test 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barroso, L.A., Hölzle, U.: The Case for Energy-Proportional Computing. Computer 40, 33–37 (2007)CrossRefGoogle Scholar
  2. 2.
    Härder, T., Hudlet, V., Ou, Y., Schall, D.: Energy Efficiency Is Not Enough, Energy Proportionality Is Needed! In: Xu, J., Yu, G., Zhou, S., Unland, R. (eds.) DASFAA Workshops 2011. LNCS, vol. 6637, pp. 226–239. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  3. 3.
    Poess, M., Nambiar, R.O.: Energy Cost, The Key Challenge of Today’s Data Centers: A Power Consumption Analysis of TPC-C Results. PVLDB 1(2), 1229–1240 (2008)Google Scholar
  4. 4.
    Poess, M., Nambiar, R.O., Vaid, K., Stephens Jr., J.M., Huppler, K., Haines, E.: Energy Benchmarks: A Detailed Analysis. In: Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking, E-Energy 2010, pp. 131–140. ACM, New York (2010)CrossRefGoogle Scholar
  5. 5.
    Rivoire, S., Shah, M.A., Ranganathan, P., Kozyrakis, C.: JouleSort: A Balanced Energy-Efficiency Benchmark. In: SIGMOD Conference, pp. 365–376 (2007)Google Scholar
  6. 6.
    Spector, A.Z.: Distributed Computing at Multi-dimensional Scale (Keynote). In: Proceedings of Int. Middleware Conference (2008)Google Scholar
  7. 7.
    Weiss, A.: Computing in the Clouds. Networker 11, 16–25 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Daniel Schall
    • 1
  • Volker Hoefner
    • 1
  • Manuel Kern
    • 2
  1. 1.Database and Information Systems GroupUniversity of KaiserslauternGermany
  2. 2.SPH AGStuttgartGermany

Personalised recommendations