Abstract
The growing energy consumption of data centers has become an area of research interest lately. For this reason, the research focus has broadened from a solely performance-oriented system evaluation to an exploration where energy efficiency is considered as well. The Transaction Processing Performance Council (TPC) has also reflected this shift by introducing the TPC-Energy benchmark. In this paper, we recommend extensions, refinements, and variations for such benchmarks. For this purpose, we present performance measurements of real-world DB servers and show that their mean utilization is far from peak and, thus, benchmarking results, even in conjunction with TPC-Energy, lead to inadequate assessment decisions, e.g., when a database server has to be purchased. Therefore, we propose a new kind of benchmarking paradigm that includes more realistic power measures. Our proposal will enable appraisals of database servers based on broader requirement profiles instead of focusing on sole performance. Furthermore, our energy-centric benchmarks will encourage the design and development of energy-proportional hardware and the evolution of energy-aware DBMSs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barroso, L.A., Hölzle, U.: The Case for Energy-Proportional Computing. Computer 40, 33–37 (2007)
Härder, T., Hudlet, V., Ou, Y., Schall, D.: Energy Efficiency Is Not Enough, Energy Proportionality Is Needed! In: Xu, J., Yu, G., Zhou, S., Unland, R. (eds.) DASFAA Workshops 2011. LNCS, vol. 6637, pp. 226–239. Springer, Heidelberg (2011)
Poess, M., Nambiar, R.O.: Energy Cost, The Key Challenge of Today’s Data Centers: A Power Consumption Analysis of TPC-C Results. PVLDB 1(2), 1229–1240 (2008)
Poess, M., Nambiar, R.O., Vaid, K., Stephens Jr., J.M., Huppler, K., Haines, E.: Energy Benchmarks: A Detailed Analysis. In: Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking, E-Energy 2010, pp. 131–140. ACM, New York (2010)
Rivoire, S., Shah, M.A., Ranganathan, P., Kozyrakis, C.: JouleSort: A Balanced Energy-Efficiency Benchmark. In: SIGMOD Conference, pp. 365–376 (2007)
Spector, A.Z.: Distributed Computing at Multi-dimensional Scale (Keynote). In: Proceedings of Int. Middleware Conference (2008)
Weiss, A.: Computing in the Clouds. Networker 11, 16–25 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schall, D., Hoefner, V., Kern, M. (2012). Towards an Enhanced Benchmark Advocating Energy-Efficient Systems. In: Nambiar, R., Poess, M. (eds) Topics in Performance Evaluation, Measurement and Characterization. TPCTC 2011. Lecture Notes in Computer Science, vol 7144. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32627-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-32627-1_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32626-4
Online ISBN: 978-3-642-32627-1
eBook Packages: Computer ScienceComputer Science (R0)