Towards an Extensible Middleware for Database Benchmarking

  • David Bermbach
  • Jörn Kuhlenkamp
  • Akon Dey
  • Sherif Sakr
  • Raghunath Nambiar
Conference paper

DOI: 10.1007/978-3-319-15350-6_6

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8904)
Cite this paper as:
Bermbach D., Kuhlenkamp J., Dey A., Sakr S., Nambiar R. (2015) Towards an Extensible Middleware for Database Benchmarking. In: Nambiar R., Poess M. (eds) Performance Characterization and Benchmarking. Traditional to Big Data. TPCTC 2014. Lecture Notes in Computer Science, vol 8904. Springer, Cham

Abstract

Today’s database benchmarks are designed to evaluate a particular type of database. Furthermore, popular benchmarks, like those from TPC, come without a ready-to-use implementation requiring database benchmark users to implement the benchmarking tool from scratch. The result of this is that there is no single framework that can be used to compare arbitrary database systems. The primary reason for this, among others, being the complexity of designing and implementing distributed benchmarking tools.

In this paper, we describe our vision of a middleware for database benchmarking which eliminates the complexity and difficulty of designing and running arbitrary benchmarks: workload specification and interface mappers for the system under test should be nothing but configuration properties of the middleware. We also sketch out an architecture for this benchmarking middleware and describe the main components and their requirements.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • David Bermbach
    • 1
  • Jörn Kuhlenkamp
    • 1
  • Akon Dey
    • 2
  • Sherif Sakr
    • 3
  • Raghunath Nambiar
    • 4
  1. 1.Information Systems Engineering GroupTU BerlinBerlinGermany
  2. 2.School of Information TechnologiesUniversity of SydneySydneyAustralia
  3. 3.King Saud Bin Abdulaziz University for Health SciencesRiyadhSaudi Arabia
  4. 4.Cisco Systems, Inc.San JoseUSA

Personalised recommendations