Chapter

Performance Characterization and Benchmarking. Traditional to Big Data

Volume 8904 of the series Lecture Notes in Computer Science pp 1-12

Date:

Introducing TPCx-HS: The First Industry Standard for Benchmarking Big Data Systems

  • Raghunath NambiarAffiliated withCisco Systems, Inc.
  • , Meikel PoessAffiliated withOracle Corporation
  • , Akon DeyAffiliated withSchool of Information Technologies, University of Sydney
  • , Paul CaoAffiliated withHewlett-Packard
  • , Tariq Magdon-IsmailAffiliated withVMware, Inc. Email author 
  • , Da Qi RenAffiliated withFuturewei Technologies
  • , Andrew BondAffiliated withRed Hat

* Final gross prices may vary according to local VAT.

Get Access

Abstract

The designation Big Data has become a mainstream buzz phrase across many industries as well as research circles. Today many companies are making performance claims that are not easily verifiable and comparable in the absence of a neutral industry benchmark. Instead one of the test suites used to compare performance of Hadoop based Big Data systems is the TeraSort. While it nicely defines the data set and tasks to measure Big Data Hadoop systems it lacks a formal specification and enforcement rules that enable the comparison of results across systems. In this paper we introduce TPCx-HS, the industry’s first industry standard benchmark, designed to stress both hardware and software that is based on Apache HDFS API compatible distributions. TPCx-HS extends the workload defined in TeraSort with formal rules for implementation, execution, metric, result verification, publication and pricing. It can be used to asses a broad range of system topologies and implementation methodologies of Big Data Hadoop systems in a technically rigorous and directly comparable and vendor-neutral manner.

Keywords

TPC Big Data Industry standard Benchmark